Jun 02 21:39:04.122856 ip-10-0-139-67 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 02 21:39:04.122866 ip-10-0-139-67 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 02 21:39:04.122874 ip-10-0-139-67 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 02 21:39:04.123085 ip-10-0-139-67 systemd[1]: Failed to start Kubernetes Kubelet. Jun 02 21:39:14.239295 ip-10-0-139-67 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 02 21:39:14.239313 ip-10-0-139-67 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot eddfd0bf5f7c4163ac6e5a68011352d9 -- Jun 02 21:41:47.724914 ip-10-0-139-67 systemd[1]: Starting Kubernetes Kubelet... Jun 02 21:41:48.139203 ip-10-0-139-67 kubenswrapper[2553]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 21:41:48.139203 ip-10-0-139-67 kubenswrapper[2553]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 21:41:48.139203 ip-10-0-139-67 kubenswrapper[2553]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 21:41:48.139203 ip-10-0-139-67 kubenswrapper[2553]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 21:41:48.139203 ip-10-0-139-67 kubenswrapper[2553]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 21:41:48.140563 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.140485 2553 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 21:41:48.143171 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143157 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 21:41:48.143171 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143172 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 21:41:48.143234 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143176 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 21:41:48.143234 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143182 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 21:41:48.143234 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143186 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 21:41:48.143234 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143189 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 21:41:48.143234 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143192 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 21:41:48.143234 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143196 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 21:41:48.143234 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143199 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 21:41:48.143234 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143202 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 21:41:48.143234 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143204 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 21:41:48.143234 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143207 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 21:41:48.143234 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143215 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 21:41:48.143234 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143218 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 21:41:48.143234 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143221 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 21:41:48.143234 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143224 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 21:41:48.143234 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143228 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 21:41:48.143234 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143231 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 21:41:48.143234 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143233 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 21:41:48.143234 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143236 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 21:41:48.143234 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143239 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 21:41:48.143793 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143242 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 21:41:48.143793 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143245 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 21:41:48.143793 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143248 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 21:41:48.143793 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143250 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 21:41:48.143793 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143253 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 21:41:48.143793 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143255 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 21:41:48.143793 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143258 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 21:41:48.143793 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143261 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 21:41:48.143793 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143263 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 21:41:48.143793 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143266 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 21:41:48.143793 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143268 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 21:41:48.143793 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143271 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 21:41:48.143793 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143273 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 21:41:48.143793 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143276 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 21:41:48.143793 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143279 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 21:41:48.143793 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143281 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 21:41:48.143793 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143284 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 21:41:48.143793 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143286 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 21:41:48.143793 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143289 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 21:41:48.143793 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143292 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 21:41:48.144537 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143294 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 21:41:48.144537 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143297 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 21:41:48.144537 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143301 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 21:41:48.144537 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143303 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 21:41:48.144537 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143306 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 21:41:48.144537 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143308 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 21:41:48.144537 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143311 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 21:41:48.144537 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143313 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 21:41:48.144537 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143316 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 21:41:48.144537 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143318 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 21:41:48.144537 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143321 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 21:41:48.144537 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143323 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 21:41:48.144537 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143325 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 21:41:48.144537 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143329 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 21:41:48.144537 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143331 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 21:41:48.144537 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143334 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 21:41:48.144537 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143337 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 21:41:48.144537 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143339 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 21:41:48.144537 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143342 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 21:41:48.144537 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143344 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 21:41:48.145113 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143347 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 21:41:48.145113 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143349 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 21:41:48.145113 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143352 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 21:41:48.145113 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143354 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 21:41:48.145113 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143357 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 21:41:48.145113 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143359 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 21:41:48.145113 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143361 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 21:41:48.145113 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143364 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 21:41:48.145113 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143367 2553 feature_gate.go:328] unrecognized feature gate: Example Jun 02 21:41:48.145113 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143369 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 21:41:48.145113 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143372 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 21:41:48.145113 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143375 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 21:41:48.145113 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143377 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 21:41:48.145113 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143380 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 21:41:48.145113 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143384 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 21:41:48.145113 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143388 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 21:41:48.145113 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143391 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 21:41:48.145113 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143393 2553 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 21:41:48.145113 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143396 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 21:41:48.145571 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143398 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 21:41:48.145571 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143401 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 21:41:48.145571 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143403 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 21:41:48.145571 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143406 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 21:41:48.145571 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143408 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 21:41:48.145571 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.143411 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 21:41:48.145571 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145078 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 21:41:48.145571 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145089 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 21:41:48.145571 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145093 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 21:41:48.145571 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145096 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 21:41:48.145571 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145099 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 21:41:48.145571 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145102 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 21:41:48.145571 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145105 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 21:41:48.145571 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145108 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 21:41:48.145571 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145111 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 21:41:48.145571 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145114 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 21:41:48.145571 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145116 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 21:41:48.145571 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145119 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 21:41:48.145571 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145122 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 21:41:48.145571 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145125 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 21:41:48.146074 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145127 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 21:41:48.146074 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145130 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 21:41:48.146074 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145132 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 21:41:48.146074 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145135 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 21:41:48.146074 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145137 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 21:41:48.146074 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145140 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 21:41:48.146074 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145142 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 21:41:48.146074 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145145 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 21:41:48.146074 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145148 2553 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 21:41:48.146074 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145150 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 21:41:48.146074 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145153 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 21:41:48.146074 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145156 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 21:41:48.146074 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145159 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 21:41:48.146074 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145162 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 21:41:48.146074 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145164 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 21:41:48.146074 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145167 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 21:41:48.146074 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145169 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 21:41:48.146074 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145172 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 21:41:48.146074 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145175 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 21:41:48.146074 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145178 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 21:41:48.146593 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145180 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 21:41:48.146593 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145183 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 21:41:48.146593 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145185 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 21:41:48.146593 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145188 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 21:41:48.146593 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145190 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 21:41:48.146593 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145193 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 21:41:48.146593 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145195 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 21:41:48.146593 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145198 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 21:41:48.146593 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145200 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 21:41:48.146593 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145203 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 21:41:48.146593 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145205 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 21:41:48.146593 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145208 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 21:41:48.146593 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145210 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 21:41:48.146593 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145212 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 21:41:48.146593 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145215 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 21:41:48.146593 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145218 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 21:41:48.146593 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145220 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 21:41:48.146593 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145223 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 21:41:48.146593 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145225 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 21:41:48.146593 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145228 2553 feature_gate.go:328] unrecognized feature gate: Example Jun 02 21:41:48.147100 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145231 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 21:41:48.147100 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145233 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 21:41:48.147100 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145236 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 21:41:48.147100 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145238 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 21:41:48.147100 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145241 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 21:41:48.147100 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145243 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 21:41:48.147100 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145245 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 21:41:48.147100 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145248 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 21:41:48.147100 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145252 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 21:41:48.147100 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145257 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 21:41:48.147100 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145260 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 21:41:48.147100 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145264 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 21:41:48.147100 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145267 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 21:41:48.147100 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145270 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 21:41:48.147100 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145273 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 21:41:48.147100 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145276 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 21:41:48.147100 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145279 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 21:41:48.147100 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145281 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 21:41:48.147100 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145284 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 21:41:48.147562 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145286 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 21:41:48.147562 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145289 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 21:41:48.147562 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145292 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 21:41:48.147562 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145295 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 21:41:48.147562 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145297 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 21:41:48.147562 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145301 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 21:41:48.147562 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145303 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 21:41:48.147562 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145306 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 21:41:48.147562 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145308 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 21:41:48.147562 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145311 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 21:41:48.147562 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145313 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 21:41:48.147562 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145317 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 21:41:48.147562 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.145321 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 21:41:48.147562 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145396 2553 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 21:41:48.147562 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145403 2553 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 21:41:48.147562 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145409 2553 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 21:41:48.147562 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145414 2553 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 21:41:48.147562 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145418 2553 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 21:41:48.147562 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145422 2553 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 21:41:48.147562 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145426 2553 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 21:41:48.147562 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145430 2553 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 21:41:48.148095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145433 2553 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 21:41:48.148095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145436 2553 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 21:41:48.148095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145440 2553 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 21:41:48.148095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145444 2553 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 21:41:48.148095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145447 2553 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 21:41:48.148095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145450 2553 flags.go:64] FLAG: --cgroup-root="" Jun 02 21:41:48.148095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145453 2553 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 21:41:48.148095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145456 2553 flags.go:64] FLAG: --client-ca-file="" Jun 02 21:41:48.148095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145459 2553 flags.go:64] FLAG: --cloud-config="" Jun 02 21:41:48.148095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145462 2553 flags.go:64] FLAG: --cloud-provider="external" Jun 02 21:41:48.148095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145465 2553 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 21:41:48.148095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145470 2553 flags.go:64] FLAG: --cluster-domain="" Jun 02 21:41:48.148095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145472 2553 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 21:41:48.148095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145475 2553 flags.go:64] FLAG: --config-dir="" Jun 02 21:41:48.148095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145478 2553 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 21:41:48.148095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145481 2553 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 21:41:48.148095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145485 2553 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 21:41:48.148095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145489 2553 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 21:41:48.148095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145492 2553 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 21:41:48.148095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145496 2553 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 21:41:48.148095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145499 2553 flags.go:64] FLAG: --contention-profiling="false" Jun 02 21:41:48.148095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145502 2553 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 21:41:48.148095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145505 2553 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 21:41:48.148095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145508 2553 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 21:41:48.148095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145511 2553 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 21:41:48.148740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145515 2553 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 21:41:48.148740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145518 2553 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 21:41:48.148740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145521 2553 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 21:41:48.148740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145524 2553 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 21:41:48.148740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145527 2553 flags.go:64] FLAG: --enable-server="true" Jun 02 21:41:48.148740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145529 2553 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 21:41:48.148740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145534 2553 flags.go:64] FLAG: --event-burst="100" Jun 02 21:41:48.148740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145537 2553 flags.go:64] FLAG: --event-qps="50" Jun 02 21:41:48.148740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145540 2553 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 21:41:48.148740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145544 2553 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 21:41:48.148740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145547 2553 flags.go:64] FLAG: --eviction-hard="" Jun 02 21:41:48.148740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145551 2553 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 21:41:48.148740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145554 2553 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 21:41:48.148740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145557 2553 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 21:41:48.148740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145560 2553 flags.go:64] FLAG: --eviction-soft="" Jun 02 21:41:48.148740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145562 2553 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 21:41:48.148740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145565 2553 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 21:41:48.148740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145568 2553 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 21:41:48.148740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145571 2553 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 21:41:48.148740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145574 2553 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 21:41:48.148740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145577 2553 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 21:41:48.148740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145580 2553 flags.go:64] FLAG: --feature-gates="" Jun 02 21:41:48.148740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145584 2553 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 21:41:48.148740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145587 2553 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 21:41:48.148740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145590 2553 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 21:41:48.149425 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145594 2553 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 21:41:48.149425 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145597 2553 flags.go:64] FLAG: --healthz-port="10248" Jun 02 21:41:48.149425 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145600 2553 flags.go:64] FLAG: --help="false" Jun 02 21:41:48.149425 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145603 2553 flags.go:64] FLAG: --hostname-override="ip-10-0-139-67.ec2.internal" Jun 02 21:41:48.149425 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145606 2553 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 21:41:48.149425 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145609 2553 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 21:41:48.149425 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145612 2553 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 21:41:48.149425 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145615 2553 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 21:41:48.149425 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145631 2553 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 21:41:48.149425 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145634 2553 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 21:41:48.149425 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145637 2553 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 21:41:48.149425 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145640 2553 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 21:41:48.149425 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145643 2553 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 21:41:48.149425 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145646 2553 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 21:41:48.149425 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145650 2553 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 21:41:48.149425 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145653 2553 flags.go:64] FLAG: --kube-reserved="" Jun 02 21:41:48.149425 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145656 2553 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 21:41:48.149425 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145659 2553 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 21:41:48.149425 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145662 2553 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 21:41:48.149425 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145665 2553 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 21:41:48.149425 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145667 2553 flags.go:64] FLAG: --lock-file="" Jun 02 21:41:48.149425 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145670 2553 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 21:41:48.149425 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145673 2553 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 21:41:48.149425 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145676 2553 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 21:41:48.150016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145681 2553 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 21:41:48.150016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145684 2553 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 21:41:48.150016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145688 2553 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 21:41:48.150016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145691 2553 flags.go:64] FLAG: --logging-format="text" Jun 02 21:41:48.150016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145693 2553 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 21:41:48.150016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145697 2553 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 21:41:48.150016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145700 2553 flags.go:64] FLAG: --manifest-url="" Jun 02 21:41:48.150016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145703 2553 flags.go:64] FLAG: --manifest-url-header="" Jun 02 21:41:48.150016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145707 2553 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 21:41:48.150016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145711 2553 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 21:41:48.150016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145716 2553 flags.go:64] FLAG: --max-pods="110" Jun 02 21:41:48.150016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145719 2553 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 21:41:48.150016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145722 2553 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 21:41:48.150016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145725 2553 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 21:41:48.150016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145728 2553 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 21:41:48.150016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145730 2553 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 21:41:48.150016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145734 2553 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 21:41:48.150016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145736 2553 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 21:41:48.150016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145743 2553 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 21:41:48.150016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145746 2553 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 21:41:48.150016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145749 2553 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 21:41:48.150016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145752 2553 flags.go:64] FLAG: --pod-cidr="" Jun 02 21:41:48.150016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145755 2553 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145760 2553 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145764 2553 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145767 2553 flags.go:64] FLAG: --pods-per-core="0" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145770 2553 flags.go:64] FLAG: --port="10250" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145773 2553 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145776 2553 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0172c242fea0d2e26" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145779 2553 flags.go:64] FLAG: --qos-reserved="" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145782 2553 flags.go:64] FLAG: --read-only-port="10255" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145785 2553 flags.go:64] FLAG: --register-node="true" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145788 2553 flags.go:64] FLAG: --register-schedulable="true" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145791 2553 flags.go:64] FLAG: --register-with-taints="" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145795 2553 flags.go:64] FLAG: --registry-burst="10" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145797 2553 flags.go:64] FLAG: --registry-qps="5" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145800 2553 flags.go:64] FLAG: --reserved-cpus="" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145803 2553 flags.go:64] FLAG: --reserved-memory="" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145807 2553 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145810 2553 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145813 2553 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145816 2553 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145822 2553 flags.go:64] FLAG: --runonce="false" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145825 2553 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145828 2553 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145831 2553 flags.go:64] FLAG: --seccomp-default="false" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145834 2553 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145837 2553 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 21:41:48.150571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145839 2553 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 21:41:48.151216 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145842 2553 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 21:41:48.151216 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145845 2553 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 21:41:48.151216 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145848 2553 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 21:41:48.151216 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145851 2553 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 21:41:48.151216 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145854 2553 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 21:41:48.151216 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145857 2553 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 21:41:48.151216 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145861 2553 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 21:41:48.151216 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145863 2553 flags.go:64] FLAG: --system-cgroups="" Jun 02 21:41:48.151216 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145869 2553 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 21:41:48.151216 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145875 2553 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 21:41:48.151216 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145878 2553 flags.go:64] FLAG: --tls-cert-file="" Jun 02 21:41:48.151216 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.145881 2553 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 21:41:48.151216 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.146420 2553 flags.go:64] FLAG: --tls-min-version="" Jun 02 21:41:48.151216 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.146424 2553 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 21:41:48.151216 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.146428 2553 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 21:41:48.151216 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.146431 2553 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 21:41:48.151216 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.146434 2553 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 21:41:48.151216 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.146437 2553 flags.go:64] FLAG: --v="2" Jun 02 21:41:48.151216 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.146441 2553 flags.go:64] FLAG: --version="false" Jun 02 21:41:48.151216 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.146445 2553 flags.go:64] FLAG: --vmodule="" Jun 02 21:41:48.151216 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.146449 2553 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 21:41:48.151216 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.146453 2553 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 21:41:48.151216 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146541 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 21:41:48.151216 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146544 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 21:41:48.151216 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146547 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 21:41:48.151863 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146550 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 21:41:48.151863 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146554 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 21:41:48.151863 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146557 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 21:41:48.151863 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146560 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 21:41:48.151863 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146563 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 21:41:48.151863 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146565 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 21:41:48.151863 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146568 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 21:41:48.151863 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146571 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 21:41:48.151863 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146573 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 21:41:48.151863 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146576 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 21:41:48.151863 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146579 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 21:41:48.151863 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146582 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 21:41:48.151863 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146584 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 21:41:48.151863 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146587 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 21:41:48.151863 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146589 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 21:41:48.151863 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146594 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 21:41:48.151863 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146597 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 21:41:48.151863 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146599 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 21:41:48.151863 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146603 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 21:41:48.151863 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146605 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 21:41:48.152364 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146608 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 21:41:48.152364 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146611 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 21:41:48.152364 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146613 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 21:41:48.152364 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146616 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 21:41:48.152364 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146631 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 21:41:48.152364 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146633 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 21:41:48.152364 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146636 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 21:41:48.152364 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146639 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 21:41:48.152364 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146641 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 21:41:48.152364 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146644 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 21:41:48.152364 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146647 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 21:41:48.152364 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146650 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 21:41:48.152364 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146652 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 21:41:48.152364 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146655 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 21:41:48.152364 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146658 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 21:41:48.152364 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146661 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 21:41:48.152364 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146664 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 21:41:48.152364 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146666 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 21:41:48.152364 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146669 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 21:41:48.152364 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146671 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 21:41:48.152893 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146674 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 21:41:48.152893 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146676 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 21:41:48.152893 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146679 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 21:41:48.152893 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146684 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 21:41:48.152893 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146687 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 21:41:48.152893 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146691 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 21:41:48.152893 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146695 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 21:41:48.152893 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146699 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 21:41:48.152893 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146703 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 21:41:48.152893 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146707 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 21:41:48.152893 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146710 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 21:41:48.152893 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146713 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 21:41:48.152893 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146716 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 21:41:48.152893 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146719 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 21:41:48.152893 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146722 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 21:41:48.152893 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146724 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 21:41:48.152893 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146727 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 21:41:48.152893 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146730 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 21:41:48.152893 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146732 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 21:41:48.153365 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146735 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 21:41:48.153365 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146737 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 21:41:48.153365 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146740 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 21:41:48.153365 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146743 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 21:41:48.153365 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146745 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 21:41:48.153365 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146748 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 21:41:48.153365 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146750 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 21:41:48.153365 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146752 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 21:41:48.153365 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146757 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 21:41:48.153365 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146760 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 21:41:48.153365 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146762 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 21:41:48.153365 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146764 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 21:41:48.153365 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146767 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 21:41:48.153365 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146770 2553 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 21:41:48.153365 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146772 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 21:41:48.153365 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146775 2553 feature_gate.go:328] unrecognized feature gate: Example Jun 02 21:41:48.153365 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146778 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 21:41:48.153365 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146781 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 21:41:48.153365 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146783 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 21:41:48.153365 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146786 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 21:41:48.153907 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146790 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 21:41:48.153907 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146793 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 21:41:48.153907 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146796 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 21:41:48.153907 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.146798 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 21:41:48.153907 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.147313 2553 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 21:41:48.154035 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.153931 2553 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 21:41:48.154065 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.154036 2553 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 21:41:48.154096 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154082 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 21:41:48.154096 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154087 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 21:41:48.154096 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154091 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 21:41:48.154096 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154094 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 21:41:48.154096 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154097 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 21:41:48.154217 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154101 2553 feature_gate.go:328] unrecognized feature gate: Example Jun 02 21:41:48.154217 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154104 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 21:41:48.154217 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154107 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 21:41:48.154217 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154110 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 21:41:48.154217 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154115 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 21:41:48.154217 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154118 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 21:41:48.154217 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154121 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 21:41:48.154217 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154123 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 21:41:48.154217 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154126 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 21:41:48.154217 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154129 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 21:41:48.154217 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154132 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 21:41:48.154217 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154134 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 21:41:48.154217 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154137 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 21:41:48.154217 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154140 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 21:41:48.154217 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154142 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 21:41:48.154217 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154145 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 21:41:48.154217 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154147 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 21:41:48.154217 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154150 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 21:41:48.154217 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154153 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 21:41:48.154217 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154156 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 21:41:48.154732 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154158 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 21:41:48.154732 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154161 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 21:41:48.154732 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154164 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 21:41:48.154732 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154166 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 21:41:48.154732 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154169 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 21:41:48.154732 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154172 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 21:41:48.154732 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154175 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 21:41:48.154732 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154178 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 21:41:48.154732 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154180 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 21:41:48.154732 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154183 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 21:41:48.154732 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154186 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 21:41:48.154732 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154188 2553 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 21:41:48.154732 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154191 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 21:41:48.154732 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154194 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 21:41:48.154732 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154197 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 21:41:48.154732 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154199 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 21:41:48.154732 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154202 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 21:41:48.154732 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154204 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 21:41:48.154732 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154207 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 21:41:48.154732 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154210 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 21:41:48.155214 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154212 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 21:41:48.155214 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154214 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 21:41:48.155214 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154217 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 21:41:48.155214 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154219 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 21:41:48.155214 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154222 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 21:41:48.155214 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154225 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 21:41:48.155214 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154227 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 21:41:48.155214 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154230 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 21:41:48.155214 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154232 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 21:41:48.155214 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154235 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 21:41:48.155214 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154237 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 21:41:48.155214 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154240 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 21:41:48.155214 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154243 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 21:41:48.155214 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154246 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 21:41:48.155214 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154249 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 21:41:48.155214 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154251 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 21:41:48.155214 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154254 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 21:41:48.155214 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154256 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 21:41:48.155214 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154259 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 21:41:48.155689 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154262 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 21:41:48.155689 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154264 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 21:41:48.155689 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154267 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 21:41:48.155689 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154269 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 21:41:48.155689 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154272 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 21:41:48.155689 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154274 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 21:41:48.155689 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154277 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 21:41:48.155689 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154280 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 21:41:48.155689 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154282 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 21:41:48.155689 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154284 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 21:41:48.155689 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154287 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 21:41:48.155689 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154289 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 21:41:48.155689 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154292 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 21:41:48.155689 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154294 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 21:41:48.155689 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154297 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 21:41:48.155689 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154300 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 21:41:48.155689 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154303 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 21:41:48.155689 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154306 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 21:41:48.155689 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154309 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 21:41:48.155689 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154312 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 21:41:48.156172 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154314 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 21:41:48.156172 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154317 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 21:41:48.156172 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.154321 2553 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 21:41:48.156172 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154415 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 21:41:48.156172 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154419 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 21:41:48.156172 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154422 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 21:41:48.156172 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154425 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 21:41:48.156172 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154428 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 21:41:48.156172 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154431 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 21:41:48.156172 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154434 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 21:41:48.156172 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154436 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 21:41:48.156172 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154439 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 21:41:48.156172 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154441 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 21:41:48.156172 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154445 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 21:41:48.156172 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154448 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 21:41:48.156172 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154450 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 21:41:48.156560 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154453 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 21:41:48.156560 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154455 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 21:41:48.156560 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154458 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 21:41:48.156560 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154461 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 21:41:48.156560 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154463 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 21:41:48.156560 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154466 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 21:41:48.156560 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154470 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 21:41:48.156560 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154473 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 21:41:48.156560 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154476 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 21:41:48.156560 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154479 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 21:41:48.156560 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154481 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 21:41:48.156560 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154484 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 21:41:48.156560 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154486 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 21:41:48.156560 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154489 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 21:41:48.156560 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154491 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 21:41:48.156560 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154494 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 21:41:48.156560 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154496 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 21:41:48.156560 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154499 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 21:41:48.156560 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154502 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 21:41:48.157044 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154504 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 21:41:48.157044 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154507 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 21:41:48.157044 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154509 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 21:41:48.157044 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154512 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 21:41:48.157044 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154515 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 21:41:48.157044 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154517 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 21:41:48.157044 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154520 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 21:41:48.157044 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154523 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 21:41:48.157044 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154525 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 21:41:48.157044 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154528 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 21:41:48.157044 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154530 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 21:41:48.157044 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154533 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 21:41:48.157044 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154536 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 21:41:48.157044 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154539 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 21:41:48.157044 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154541 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 21:41:48.157044 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154543 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 21:41:48.157044 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154546 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 21:41:48.157044 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154549 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 21:41:48.157044 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154551 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 21:41:48.157044 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154554 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 21:41:48.157532 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154556 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 21:41:48.157532 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154559 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 21:41:48.157532 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154561 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 21:41:48.157532 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154564 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 21:41:48.157532 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154566 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 21:41:48.157532 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154569 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 21:41:48.157532 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154571 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 21:41:48.157532 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154574 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 21:41:48.157532 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154578 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 21:41:48.157532 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154581 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 21:41:48.157532 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154584 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 21:41:48.157532 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154586 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 21:41:48.157532 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154588 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 21:41:48.157532 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154591 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 21:41:48.157532 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154593 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 21:41:48.157532 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154596 2553 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 21:41:48.157532 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154599 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 21:41:48.157532 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154601 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 21:41:48.157532 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154604 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 21:41:48.157532 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154606 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 21:41:48.158031 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154609 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 21:41:48.158031 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154611 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 21:41:48.158031 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154614 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 21:41:48.158031 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154631 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 21:41:48.158031 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154636 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 21:41:48.158031 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154640 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 21:41:48.158031 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154642 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 21:41:48.158031 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154645 2553 feature_gate.go:328] unrecognized feature gate: Example Jun 02 21:41:48.158031 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154648 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 21:41:48.158031 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154651 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 21:41:48.158031 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154654 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 21:41:48.158031 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154656 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 21:41:48.158031 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154659 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 21:41:48.158031 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:48.154661 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 21:41:48.158031 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.154666 2553 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 21:41:48.158031 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.155326 2553 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 21:41:48.159630 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.159607 2553 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 21:41:48.160495 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.160484 2553 server.go:1019] "Starting client certificate rotation" Jun 02 21:41:48.160598 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.160581 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 21:41:48.160644 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.160632 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 21:41:48.185044 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.185024 2553 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 21:41:48.186195 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.186175 2553 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 21:41:48.197443 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.197427 2553 log.go:25] "Validated CRI v1 runtime API" Jun 02 21:41:48.202799 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.202784 2553 log.go:25] "Validated CRI v1 image API" Jun 02 21:41:48.205095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.205080 2553 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 21:41:48.208229 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.208206 2553 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 af1fb445-20e5-4ee2-9cbc-c2ea63493403:/dev/nvme0n1p3 b056d2bf-0153-41ec-9f3d-d524213d488c:/dev/nvme0n1p4] Jun 02 21:41:48.208302 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.208227 2553 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 21:41:48.212953 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.212840 2553 manager.go:217] Machine: {Timestamp:2026-06-02 21:41:48.212348858 +0000 UTC m=+0.381302561 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101204 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bb2e597e59060a87c2b686cd1d1d2 SystemUUID:ec2bb2e5-97e5-9060-a87c-2b686cd1d1d2 BootID:eddfd0bf-5f7c-4163-ac6e-5a68011352d9 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6a:a6:d3:5d:db Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6a:a6:d3:5d:db Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:81:4d:7c:46:6f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 21:41:48.215558 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.215543 2553 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 21:41:48.215715 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.215698 2553 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 21:41:48.217954 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.217928 2553 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 21:41:48.218090 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.217958 2553 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-67.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 21:41:48.218137 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.218099 2553 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 21:41:48.218137 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.218108 2553 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 21:41:48.218137 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.218115 2553 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 21:41:48.218848 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.218838 2553 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 21:41:48.219983 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.219973 2553 state_mem.go:36] "Initialized new in-memory state store" Jun 02 21:41:48.220086 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.220077 2553 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 21:41:48.222653 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.222642 2553 kubelet.go:491] "Attempting to sync node with API server" Jun 02 21:41:48.222696 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.222663 2553 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 21:41:48.222696 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.222675 2553 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 21:41:48.222696 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.222684 2553 kubelet.go:397] "Adding apiserver pod source" Jun 02 21:41:48.222696 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.222692 2553 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 21:41:48.223698 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.223686 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 21:41:48.223738 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.223705 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 21:41:48.226791 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.226774 2553 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 21:41:48.227207 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.227186 2553 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 21:41:48.228744 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.228730 2553 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 21:41:48.231001 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.230905 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 21:41:48.231001 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.230926 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 21:41:48.231001 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.230933 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 21:41:48.231001 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.230938 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 21:41:48.231001 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.230948 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 21:41:48.231001 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.230953 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 21:41:48.231001 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.230959 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 21:41:48.231001 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.230964 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 21:41:48.231001 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.230971 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 21:41:48.231001 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.230977 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 21:41:48.231001 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.230989 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 21:41:48.231001 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.230999 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 21:41:48.231697 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.231686 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 21:41:48.231697 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.231698 2553 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 21:41:48.234665 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.234651 2553 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 21:41:48.234733 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.234686 2553 server.go:1295] "Started kubelet" Jun 02 21:41:48.234778 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.234738 2553 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 21:41:48.234821 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.234782 2553 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 21:41:48.234876 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.234830 2553 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 21:41:48.237069 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.237044 2553 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 21:41:48.237349 ip-10-0-139-67 systemd[1]: Started Kubernetes Kubelet. Jun 02 21:41:48.238717 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:48.238362 2553 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-67.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 21:41:48.238717 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:48.238551 2553 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 21:41:48.239222 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.239200 2553 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-67.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 21:41:48.240174 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.240151 2553 server.go:317] "Adding debug handlers to kubelet server" Jun 02 21:41:48.243982 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:48.243195 2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-67.ec2.internal.18b561923276c3e5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-67.ec2.internal,UID:ip-10-0-139-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-67.ec2.internal,},FirstTimestamp:2026-06-02 21:41:48.234662885 +0000 UTC m=+0.403616588,LastTimestamp:2026-06-02 21:41:48.234662885 +0000 UTC m=+0.403616588,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-67.ec2.internal,}" Jun 02 21:41:48.244271 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.244251 2553 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 21:41:48.244367 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.244278 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 21:41:48.244423 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.244402 2553 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 21:41:48.244423 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.244418 2553 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 21:41:48.244535 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.244522 2553 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 21:41:48.244747 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.244728 2553 reconstruct.go:97] "Volume reconstruction finished" Jun 02 21:41:48.244747 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.244745 2553 reconciler.go:26] "Reconciler: start to sync state" Jun 02 21:41:48.244964 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:48.244938 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-67.ec2.internal\" not found" Jun 02 21:41:48.245173 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.245154 2553 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 21:41:48.245173 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.245174 2553 factory.go:55] Registering systemd factory Jun 02 21:41:48.245173 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:48.245159 2553 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 21:41:48.245173 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.245186 2553 factory.go:223] Registration of the systemd container factory successfully Jun 02 21:41:48.245379 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.245369 2553 factory.go:153] Registering CRI-O factory Jun 02 21:41:48.245429 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.245383 2553 factory.go:223] Registration of the crio container factory successfully Jun 02 21:41:48.245429 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.245399 2553 factory.go:103] Registering Raw factory Jun 02 21:41:48.245429 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.245413 2553 manager.go:1196] Started watching for new ooms in manager Jun 02 21:41:48.245856 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.245842 2553 manager.go:319] Starting recovery of all containers Jun 02 21:41:48.248154 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.248131 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z672k" Jun 02 21:41:48.254105 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.254089 2553 manager.go:324] Recovery completed Jun 02 21:41:48.254354 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:48.254329 2553 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 21:41:48.255417 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.255396 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z672k" Jun 02 21:41:48.259569 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.259556 2553 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 21:41:48.261463 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.261447 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientMemory" Jun 02 21:41:48.261551 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.261480 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 21:41:48.261551 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.261497 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientPID" Jun 02 21:41:48.262016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.262005 2553 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 21:41:48.262016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.262015 2553 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 21:41:48.262098 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.262032 2553 state_mem.go:36] "Initialized new in-memory state store" Jun 02 21:41:48.264251 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.264239 2553 policy_none.go:49] "None policy: Start" Jun 02 21:41:48.264294 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.264255 2553 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 21:41:48.264294 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.264270 2553 state_mem.go:35] "Initializing new in-memory state store" Jun 02 21:41:48.268204 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:48.268188 2553 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-67.ec2.internal\" not found" node="ip-10-0-139-67.ec2.internal" Jun 02 21:41:48.318199 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.318182 2553 manager.go:341] "Starting Device Plugin manager" Jun 02 21:41:48.318313 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:48.318252 2553 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 21:41:48.318313 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.318267 2553 server.go:85] "Starting device plugin registration server" Jun 02 21:41:48.318526 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.318512 2553 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 21:41:48.318586 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.318527 2553 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 21:41:48.318701 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.318682 2553 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 21:41:48.318772 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.318764 2553 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 21:41:48.318772 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.318772 2553 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 21:41:48.319525 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:48.319507 2553 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 21:41:48.319588 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:48.319542 2553 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-67.ec2.internal\" not found" Jun 02 21:41:48.335068 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.335038 2553 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 21:41:48.336182 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.336166 2553 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 21:41:48.336256 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.336191 2553 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 21:41:48.336256 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.336211 2553 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 21:41:48.336256 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.336219 2553 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 21:41:48.336410 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:48.336301 2553 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 21:41:48.338879 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.338863 2553 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 21:41:48.419556 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.419495 2553 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 21:41:48.420352 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.420333 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientMemory" Jun 02 21:41:48.420429 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.420365 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 21:41:48.420429 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.420375 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientPID" Jun 02 21:41:48.420429 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.420398 2553 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-67.ec2.internal" Jun 02 21:41:48.427530 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.427514 2553 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-67.ec2.internal" Jun 02 21:41:48.427602 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:48.427538 2553 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-67.ec2.internal\": node \"ip-10-0-139-67.ec2.internal\" not found" Jun 02 21:41:48.437196 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.437177 2553 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-67.ec2.internal"] Jun 02 21:41:48.437268 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.437236 2553 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 21:41:48.438652 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.438634 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientMemory" Jun 02 21:41:48.438719 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.438664 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 21:41:48.438719 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.438675 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientPID" Jun 02 21:41:48.439718 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.439706 2553 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 21:41:48.439875 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.439860 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" Jun 02 21:41:48.439932 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.439896 2553 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 21:41:48.440366 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.440351 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientMemory" Jun 02 21:41:48.440435 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.440375 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 21:41:48.440435 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.440386 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientPID" Jun 02 21:41:48.440435 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.440407 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientMemory" Jun 02 21:41:48.440435 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.440434 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 21:41:48.440563 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.440449 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientPID" Jun 02 21:41:48.441668 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.441655 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-67.ec2.internal" Jun 02 21:41:48.441726 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.441678 2553 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 21:41:48.442377 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.442362 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientMemory" Jun 02 21:41:48.442448 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.442392 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 21:41:48.442448 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.442405 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientPID" Jun 02 21:41:48.444116 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:48.444100 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-67.ec2.internal\" not found" Jun 02 21:41:48.445565 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.445549 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4f54130458f2eedc16600e107a401f1c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal\" (UID: \"4f54130458f2eedc16600e107a401f1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" Jun 02 21:41:48.445665 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.445573 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f54130458f2eedc16600e107a401f1c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal\" (UID: \"4f54130458f2eedc16600e107a401f1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" Jun 02 21:41:48.445665 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.445590 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4885e4402645ea72c822907b9a1090f4-config\") pod \"kube-apiserver-proxy-ip-10-0-139-67.ec2.internal\" (UID: \"4885e4402645ea72c822907b9a1090f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-67.ec2.internal" Jun 02 21:41:48.461201 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:48.461181 2553 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-67.ec2.internal\" not found" node="ip-10-0-139-67.ec2.internal" Jun 02 21:41:48.465414 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:48.465398 2553 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-67.ec2.internal\" not found" node="ip-10-0-139-67.ec2.internal" Jun 02 21:41:48.544886 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:48.544859 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-67.ec2.internal\" not found" Jun 02 21:41:48.546027 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.546012 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f54130458f2eedc16600e107a401f1c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal\" (UID: \"4f54130458f2eedc16600e107a401f1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" Jun 02 21:41:48.546074 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.546035 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4885e4402645ea72c822907b9a1090f4-config\") pod \"kube-apiserver-proxy-ip-10-0-139-67.ec2.internal\" (UID: \"4885e4402645ea72c822907b9a1090f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-67.ec2.internal" Jun 02 21:41:48.546074 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.546051 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4f54130458f2eedc16600e107a401f1c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal\" (UID: \"4f54130458f2eedc16600e107a401f1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" Jun 02 21:41:48.546141 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.546089 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4f54130458f2eedc16600e107a401f1c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal\" (UID: \"4f54130458f2eedc16600e107a401f1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" Jun 02 21:41:48.546141 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.546114 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f54130458f2eedc16600e107a401f1c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal\" (UID: \"4f54130458f2eedc16600e107a401f1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" Jun 02 21:41:48.546141 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.546118 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4885e4402645ea72c822907b9a1090f4-config\") pod \"kube-apiserver-proxy-ip-10-0-139-67.ec2.internal\" (UID: \"4885e4402645ea72c822907b9a1090f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-67.ec2.internal" Jun 02 21:41:48.645068 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:48.645043 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-67.ec2.internal\" not found" Jun 02 21:41:48.745697 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:48.745639 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-67.ec2.internal\" not found" Jun 02 21:41:48.763861 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.763847 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" Jun 02 21:41:48.768295 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:48.768277 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-67.ec2.internal" Jun 02 21:41:48.846023 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:48.845991 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-67.ec2.internal\" not found" Jun 02 21:41:48.946344 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:48.946320 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-67.ec2.internal\" not found" Jun 02 21:41:49.046784 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:49.046734 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-67.ec2.internal\" not found" Jun 02 21:41:49.147180 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:49.147152 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-67.ec2.internal\" not found" Jun 02 21:41:49.160373 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:49.160358 2553 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 21:41:49.160508 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:49.160486 2553 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 21:41:49.244716 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:49.244685 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 21:41:49.247591 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:49.247573 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-67.ec2.internal\" not found" Jun 02 21:41:49.256975 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:49.256952 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 21:36:48 +0000 UTC" deadline="2027-12-21 04:17:42.436549515 +0000 UTC" Jun 02 21:41:49.256975 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:49.256974 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13590h35m53.179577611s" Jun 02 21:41:49.259942 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:49.259923 2553 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 21:41:49.276781 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:49.276750 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tfcgw" Jun 02 21:41:49.284199 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:49.284058 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tfcgw" Jun 02 21:41:49.285301 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:49.285250 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4885e4402645ea72c822907b9a1090f4.slice/crio-9db8cc0449854363a99132d2ffeb4154b75bef574b79ab56ca01bb6508c85139 WatchSource:0}: Error finding container 9db8cc0449854363a99132d2ffeb4154b75bef574b79ab56ca01bb6508c85139: Status 404 returned error can't find the container with id 9db8cc0449854363a99132d2ffeb4154b75bef574b79ab56ca01bb6508c85139 Jun 02 21:41:49.285490 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:49.285467 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f54130458f2eedc16600e107a401f1c.slice/crio-c19561429579cd7d7f06ecd31f5728a24cb02107cb2581e13575abc9dc456091 WatchSource:0}: Error finding container c19561429579cd7d7f06ecd31f5728a24cb02107cb2581e13575abc9dc456091: Status 404 returned error can't find the container with id c19561429579cd7d7f06ecd31f5728a24cb02107cb2581e13575abc9dc456091 Jun 02 21:41:49.289270 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:49.289257 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 21:41:49.338591 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:49.338509 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" event={"ID":"4f54130458f2eedc16600e107a401f1c","Type":"ContainerStarted","Data":"c19561429579cd7d7f06ecd31f5728a24cb02107cb2581e13575abc9dc456091"} Jun 02 21:41:49.339415 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:49.339395 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-67.ec2.internal" event={"ID":"4885e4402645ea72c822907b9a1090f4","Type":"ContainerStarted","Data":"9db8cc0449854363a99132d2ffeb4154b75bef574b79ab56ca01bb6508c85139"} Jun 02 21:41:49.347689 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:49.347668 2553 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-67.ec2.internal\" not found" Jun 02 21:41:49.430389 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:49.430367 2553 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 21:41:49.446392 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:49.446373 2553 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 21:41:49.544254 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:49.544234 2553 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 21:41:49.544383 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:49.544355 2553 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-67.ec2.internal" Jun 02 21:41:49.553562 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:49.553536 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 21:41:49.554897 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:49.554885 2553 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" Jun 02 21:41:49.563825 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:49.563811 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 21:41:50.224666 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.224634 2553 apiserver.go:52] "Watching apiserver" Jun 02 21:41:50.232857 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.232831 2553 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 21:41:50.234720 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.234685 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-67.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal","openshift-network-diagnostics/network-check-target-db2qf","openshift-network-operator/iptables-alerter-s48gg","kube-system/konnectivity-agent-4jt68","openshift-cluster-node-tuning-operator/tuned-xzspb","openshift-dns/node-resolver-824lv","openshift-image-registry/node-ca-7wp2q","openshift-multus/multus-additional-cni-plugins-q52sb","openshift-multus/multus-jz744","openshift-multus/network-metrics-daemon-4jr88","openshift-ovn-kubernetes/ovnkube-node-s67gg"] Jun 02 21:41:50.236210 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.236165 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.238300 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.238276 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" Jun 02 21:41:50.238535 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.238511 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 21:41:50.238744 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.238724 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ppv42\"" Jun 02 21:41:50.238824 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.238757 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 21:41:50.239488 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.239352 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:41:50.239488 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:50.239426 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db2qf" podUID="fd65e214-8d99-48d4-a62a-e86376de6a80" Jun 02 21:41:50.240405 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.240382 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 21:41:50.241048 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.240724 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 21:41:50.241048 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.240824 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t85c4\"" Jun 02 21:41:50.241048 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.240834 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 21:41:50.241245 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.241051 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s48gg" Jun 02 21:41:50.242303 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.242282 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4jt68" Jun 02 21:41:50.243119 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.243050 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 21:41:50.243614 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.243344 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-824lv" Jun 02 21:41:50.243614 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.243411 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 21:41:50.243614 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.243517 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-txjx4\"" Jun 02 21:41:50.243614 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.243520 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 21:41:50.244995 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.244504 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 21:41:50.244995 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.244645 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.244995 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.244804 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 21:41:50.246135 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.245729 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 21:41:50.246135 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.245878 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sqp44\"" Jun 02 21:41:50.246135 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.245918 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nl5jm\"" Jun 02 21:41:50.246135 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.245965 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 21:41:50.246371 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.246222 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7wp2q" Jun 02 21:41:50.246682 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.246663 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 21:41:50.247206 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.247187 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 21:41:50.247837 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.247476 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 21:41:50.247927 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.247894 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 21:41:50.247927 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.247915 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4z2np\"" Jun 02 21:41:50.248030 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.247952 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:41:50.248030 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:50.248012 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jr88" podUID="b9038487-6455-44d7-8c00-1323fb060fd9" Jun 02 21:41:50.248130 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.248046 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 21:41:50.248746 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.248597 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 21:41:50.248746 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.248645 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qzhx8\"" Jun 02 21:41:50.248746 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.248698 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 21:41:50.248948 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.248872 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jz744" Jun 02 21:41:50.248948 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.248927 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.249288 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.249201 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 21:41:50.251678 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.251659 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 21:41:50.252337 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.252315 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 21:41:50.252450 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.252433 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 21:41:50.253882 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.252758 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 21:41:50.253882 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.252981 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 21:41:50.254661 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.254100 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hw8tx\"" Jun 02 21:41:50.254661 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.254378 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpntm\" (UniqueName: \"kubernetes.io/projected/94556912-e14c-4114-9af1-b0c7be76b545-kube-api-access-kpntm\") pod \"aws-ebs-csi-driver-node-67qj5\" (UID: \"94556912-e14c-4114-9af1-b0c7be76b545\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" Jun 02 21:41:50.254661 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.254417 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lshbh\" (UniqueName: \"kubernetes.io/projected/f5f436e1-413c-4e03-8555-fd576d4a697d-kube-api-access-lshbh\") pod \"multus-additional-cni-plugins-q52sb\" (UID: \"f5f436e1-413c-4e03-8555-fd576d4a697d\") " pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.254661 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.254458 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-system-cni-dir\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.255005 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.254895 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qmpcz\"" Jun 02 21:41:50.255005 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.254943 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 21:41:50.255101 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.254898 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 21:41:50.255257 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.255236 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-host-run-k8s-cni-cncf-io\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.255377 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.255361 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-etc-sysctl-conf\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.255442 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.255402 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f5f436e1-413c-4e03-8555-fd576d4a697d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q52sb\" (UID: \"f5f436e1-413c-4e03-8555-fd576d4a697d\") " pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.255634 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.255602 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1111ee31-ecfc-4c23-9f47-f29df074bb53-tmp\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.255709 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.255661 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/94556912-e14c-4114-9af1-b0c7be76b545-kubelet-dir\") pod \"aws-ebs-csi-driver-node-67qj5\" (UID: \"94556912-e14c-4114-9af1-b0c7be76b545\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" Jun 02 21:41:50.255709 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.255689 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/94556912-e14c-4114-9af1-b0c7be76b545-device-dir\") pod \"aws-ebs-csi-driver-node-67qj5\" (UID: \"94556912-e14c-4114-9af1-b0c7be76b545\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" Jun 02 21:41:50.255806 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.255723 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ab949e00-2922-4650-bb9e-71830cb21bf8-agent-certs\") pod \"konnectivity-agent-4jt68\" (UID: \"ab949e00-2922-4650-bb9e-71830cb21bf8\") " pod="kube-system/konnectivity-agent-4jt68" Jun 02 21:41:50.255806 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.255754 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ab949e00-2922-4650-bb9e-71830cb21bf8-konnectivity-ca\") pod \"konnectivity-agent-4jt68\" (UID: \"ab949e00-2922-4650-bb9e-71830cb21bf8\") " pod="kube-system/konnectivity-agent-4jt68" Jun 02 21:41:50.255902 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.255832 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-etc-kubernetes\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.255902 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.255881 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5f436e1-413c-4e03-8555-fd576d4a697d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q52sb\" (UID: \"f5f436e1-413c-4e03-8555-fd576d4a697d\") " pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.256024 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.255928 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-etc-modprobe-d\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.256075 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.256051 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-etc-sysconfig\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.256127 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.256086 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-sys\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.256127 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.256117 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-lib-modules\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.256216 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.256142 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-host\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.256216 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.256189 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tq4t\" (UniqueName: \"kubernetes.io/projected/1bb1fdcd-7ba6-48e4-8421-d364035b2c78-kube-api-access-8tq4t\") pod \"iptables-alerter-s48gg\" (UID: \"1bb1fdcd-7ba6-48e4-8421-d364035b2c78\") " pod="openshift-network-operator/iptables-alerter-s48gg" Jun 02 21:41:50.256307 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.256224 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/83f2febb-89fb-452c-833e-facb9d8bb557-hosts-file\") pod \"node-resolver-824lv\" (UID: \"83f2febb-89fb-452c-833e-facb9d8bb557\") " pod="openshift-dns/node-resolver-824lv" Jun 02 21:41:50.256307 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.256254 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-etc-kubernetes\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.256307 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.256284 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/94556912-e14c-4114-9af1-b0c7be76b545-registration-dir\") pod \"aws-ebs-csi-driver-node-67qj5\" (UID: \"94556912-e14c-4114-9af1-b0c7be76b545\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" Jun 02 21:41:50.256494 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.256352 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1bb1fdcd-7ba6-48e4-8421-d364035b2c78-iptables-alerter-script\") pod \"iptables-alerter-s48gg\" (UID: \"1bb1fdcd-7ba6-48e4-8421-d364035b2c78\") " pod="openshift-network-operator/iptables-alerter-s48gg" Jun 02 21:41:50.256494 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.256382 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvwpx\" (UniqueName: \"kubernetes.io/projected/c23fe6dd-65fe-43e4-b687-5ddc4cef6c1a-kube-api-access-hvwpx\") pod \"node-ca-7wp2q\" (UID: \"c23fe6dd-65fe-43e4-b687-5ddc4cef6c1a\") " pod="openshift-image-registry/node-ca-7wp2q" Jun 02 21:41:50.256494 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.256417 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5f436e1-413c-4e03-8555-fd576d4a697d-os-release\") pod \"multus-additional-cni-plugins-q52sb\" (UID: \"f5f436e1-413c-4e03-8555-fd576d4a697d\") " pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.256494 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.256448 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-host-run-multus-certs\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.256494 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.256477 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-etc-systemd\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.256754 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.256505 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/94556912-e14c-4114-9af1-b0c7be76b545-sys-fs\") pod \"aws-ebs-csi-driver-node-67qj5\" (UID: \"94556912-e14c-4114-9af1-b0c7be76b545\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" Jun 02 21:41:50.256754 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.256532 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/896e8971-2598-4454-9661-2b3329ccc4f1-multus-daemon-config\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.256754 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.256564 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-run\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.256754 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.256596 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h558h\" (UniqueName: \"kubernetes.io/projected/1111ee31-ecfc-4c23-9f47-f29df074bb53-kube-api-access-h558h\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.256754 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.256656 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c23fe6dd-65fe-43e4-b687-5ddc4cef6c1a-serviceca\") pod \"node-ca-7wp2q\" (UID: \"c23fe6dd-65fe-43e4-b687-5ddc4cef6c1a\") " pod="openshift-image-registry/node-ca-7wp2q" Jun 02 21:41:50.256754 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.256688 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-hostroot\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.257027 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.256790 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-host-var-lib-cni-bin\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.257027 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.256824 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-host-var-lib-kubelet\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.257027 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.256855 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5f436e1-413c-4e03-8555-fd576d4a697d-cni-binary-copy\") pod \"multus-additional-cni-plugins-q52sb\" (UID: \"f5f436e1-413c-4e03-8555-fd576d4a697d\") " pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.257027 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.256922 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-multus-socket-dir-parent\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.257027 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.256955 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1111ee31-ecfc-4c23-9f47-f29df074bb53-etc-tuned\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.257384 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.256999 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f5f436e1-413c-4e03-8555-fd576d4a697d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q52sb\" (UID: \"f5f436e1-413c-4e03-8555-fd576d4a697d\") " pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.257478 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.257412 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-os-release\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.257478 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.257451 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/94556912-e14c-4114-9af1-b0c7be76b545-etc-selinux\") pod \"aws-ebs-csi-driver-node-67qj5\" (UID: \"94556912-e14c-4114-9af1-b0c7be76b545\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" Jun 02 21:41:50.257584 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.257480 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83f2febb-89fb-452c-833e-facb9d8bb557-tmp-dir\") pod \"node-resolver-824lv\" (UID: \"83f2febb-89fb-452c-833e-facb9d8bb557\") " pod="openshift-dns/node-resolver-824lv" Jun 02 21:41:50.257584 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.257501 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-host-run-netns\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.257584 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.257528 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/94556912-e14c-4114-9af1-b0c7be76b545-socket-dir\") pod \"aws-ebs-csi-driver-node-67qj5\" (UID: \"94556912-e14c-4114-9af1-b0c7be76b545\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" Jun 02 21:41:50.257584 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.257550 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c23fe6dd-65fe-43e4-b687-5ddc4cef6c1a-host\") pod \"node-ca-7wp2q\" (UID: \"c23fe6dd-65fe-43e4-b687-5ddc4cef6c1a\") " pod="openshift-image-registry/node-ca-7wp2q" Jun 02 21:41:50.257584 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.257572 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5f436e1-413c-4e03-8555-fd576d4a697d-system-cni-dir\") pod \"multus-additional-cni-plugins-q52sb\" (UID: \"f5f436e1-413c-4e03-8555-fd576d4a697d\") " pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.257845 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.257595 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-host-var-lib-cni-multus\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.257845 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.257657 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frsd9\" (UniqueName: \"kubernetes.io/projected/896e8971-2598-4454-9661-2b3329ccc4f1-kube-api-access-frsd9\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.257845 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.257679 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/896e8971-2598-4454-9661-2b3329ccc4f1-cni-binary-copy\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.257845 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.257701 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-var-lib-kubelet\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.257845 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.257739 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5f436e1-413c-4e03-8555-fd576d4a697d-cnibin\") pod \"multus-additional-cni-plugins-q52sb\" (UID: \"f5f436e1-413c-4e03-8555-fd576d4a697d\") " pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.257845 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.257785 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-multus-cni-dir\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.257845 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.257812 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-cnibin\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.257845 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.257841 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1bb1fdcd-7ba6-48e4-8421-d364035b2c78-host-slash\") pod \"iptables-alerter-s48gg\" (UID: \"1bb1fdcd-7ba6-48e4-8421-d364035b2c78\") " pod="openshift-network-operator/iptables-alerter-s48gg" Jun 02 21:41:50.258208 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.257863 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ss55\" (UniqueName: \"kubernetes.io/projected/83f2febb-89fb-452c-833e-facb9d8bb557-kube-api-access-7ss55\") pod \"node-resolver-824lv\" (UID: \"83f2febb-89fb-452c-833e-facb9d8bb557\") " pod="openshift-dns/node-resolver-824lv" Jun 02 21:41:50.258208 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.257889 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-multus-conf-dir\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.258208 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.257912 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-etc-sysctl-d\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.258208 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.257936 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc6zn\" (UniqueName: \"kubernetes.io/projected/fd65e214-8d99-48d4-a62a-e86376de6a80-kube-api-access-fc6zn\") pod \"network-check-target-db2qf\" (UID: \"fd65e214-8d99-48d4-a62a-e86376de6a80\") " pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:41:50.285793 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.285763 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 21:36:49 +0000 UTC" deadline="2028-01-30 00:54:26.954436363 +0000 UTC" Jun 02 21:41:50.285943 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.285927 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14547h12m36.668515034s" Jun 02 21:41:50.308585 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.308562 2553 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 21:41:50.345851 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.345822 2553 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 21:41:50.358106 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358079 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-host-var-lib-cni-bin\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.358233 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358121 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-host-var-lib-kubelet\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.358233 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358150 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5f436e1-413c-4e03-8555-fd576d4a697d-cni-binary-copy\") pod \"multus-additional-cni-plugins-q52sb\" (UID: \"f5f436e1-413c-4e03-8555-fd576d4a697d\") " pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.358233 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358177 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-multus-socket-dir-parent\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.358233 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358184 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-host-var-lib-kubelet\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.358233 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358150 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-host-var-lib-cni-bin\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.358233 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358202 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1111ee31-ecfc-4c23-9f47-f29df074bb53-etc-tuned\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.358526 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358251 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-multus-socket-dir-parent\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.358526 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358259 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-host-run-ovn-kubernetes\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.358526 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358286 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f861eb36-c26d-4d0e-9b5e-64543a169fb2-ovn-node-metrics-cert\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.358526 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358316 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f5f436e1-413c-4e03-8555-fd576d4a697d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q52sb\" (UID: \"f5f436e1-413c-4e03-8555-fd576d4a697d\") " pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.358526 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358362 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-os-release\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.358526 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358387 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/94556912-e14c-4114-9af1-b0c7be76b545-etc-selinux\") pod \"aws-ebs-csi-driver-node-67qj5\" (UID: \"94556912-e14c-4114-9af1-b0c7be76b545\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" Jun 02 21:41:50.358526 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358414 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83f2febb-89fb-452c-833e-facb9d8bb557-tmp-dir\") pod \"node-resolver-824lv\" (UID: \"83f2febb-89fb-452c-833e-facb9d8bb557\") " pod="openshift-dns/node-resolver-824lv" Jun 02 21:41:50.358526 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358436 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-host-run-netns\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.358526 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358461 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/94556912-e14c-4114-9af1-b0c7be76b545-socket-dir\") pod \"aws-ebs-csi-driver-node-67qj5\" (UID: \"94556912-e14c-4114-9af1-b0c7be76b545\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" Jun 02 21:41:50.358526 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358485 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-host-run-netns\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.358526 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358512 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-var-lib-openvswitch\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.358526 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358519 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-os-release\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.359090 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358533 2553 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 21:41:50.359090 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358570 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f861eb36-c26d-4d0e-9b5e-64543a169fb2-ovnkube-config\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.359090 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358607 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7q26\" (UniqueName: \"kubernetes.io/projected/f861eb36-c26d-4d0e-9b5e-64543a169fb2-kube-api-access-f7q26\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.359090 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358633 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/94556912-e14c-4114-9af1-b0c7be76b545-etc-selinux\") pod \"aws-ebs-csi-driver-node-67qj5\" (UID: \"94556912-e14c-4114-9af1-b0c7be76b545\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" Jun 02 21:41:50.359090 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358667 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxg4m\" (UniqueName: \"kubernetes.io/projected/b9038487-6455-44d7-8c00-1323fb060fd9-kube-api-access-gxg4m\") pod \"network-metrics-daemon-4jr88\" (UID: \"b9038487-6455-44d7-8c00-1323fb060fd9\") " pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:41:50.359090 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358715 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c23fe6dd-65fe-43e4-b687-5ddc4cef6c1a-host\") pod \"node-ca-7wp2q\" (UID: \"c23fe6dd-65fe-43e4-b687-5ddc4cef6c1a\") " pod="openshift-image-registry/node-ca-7wp2q" Jun 02 21:41:50.359090 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358739 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5f436e1-413c-4e03-8555-fd576d4a697d-system-cni-dir\") pod \"multus-additional-cni-plugins-q52sb\" (UID: \"f5f436e1-413c-4e03-8555-fd576d4a697d\") " pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.359090 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358762 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-host-var-lib-cni-multus\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.359090 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358788 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-frsd9\" (UniqueName: \"kubernetes.io/projected/896e8971-2598-4454-9661-2b3329ccc4f1-kube-api-access-frsd9\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.359090 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358813 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f861eb36-c26d-4d0e-9b5e-64543a169fb2-ovnkube-script-lib\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.359090 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358839 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/896e8971-2598-4454-9661-2b3329ccc4f1-cni-binary-copy\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.359090 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358852 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/94556912-e14c-4114-9af1-b0c7be76b545-socket-dir\") pod \"aws-ebs-csi-driver-node-67qj5\" (UID: \"94556912-e14c-4114-9af1-b0c7be76b545\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" Jun 02 21:41:50.359090 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358859 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5f436e1-413c-4e03-8555-fd576d4a697d-cni-binary-copy\") pod \"multus-additional-cni-plugins-q52sb\" (UID: \"f5f436e1-413c-4e03-8555-fd576d4a697d\") " pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.359090 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358883 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-var-lib-kubelet\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.359090 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358852 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-host-run-netns\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.359090 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358900 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-host-var-lib-cni-multus\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.359090 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358906 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5f436e1-413c-4e03-8555-fd576d4a697d-system-cni-dir\") pod \"multus-additional-cni-plugins-q52sb\" (UID: \"f5f436e1-413c-4e03-8555-fd576d4a697d\") " pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.359874 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358910 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5f436e1-413c-4e03-8555-fd576d4a697d-cnibin\") pod \"multus-additional-cni-plugins-q52sb\" (UID: \"f5f436e1-413c-4e03-8555-fd576d4a697d\") " pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.359874 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358955 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-var-lib-kubelet\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.359874 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358933 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83f2febb-89fb-452c-833e-facb9d8bb557-tmp-dir\") pod \"node-resolver-824lv\" (UID: \"83f2febb-89fb-452c-833e-facb9d8bb557\") " pod="openshift-dns/node-resolver-824lv" Jun 02 21:41:50.359874 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358965 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-multus-cni-dir\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.359874 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.358995 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5f436e1-413c-4e03-8555-fd576d4a697d-cnibin\") pod \"multus-additional-cni-plugins-q52sb\" (UID: \"f5f436e1-413c-4e03-8555-fd576d4a697d\") " pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.359874 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359027 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-cnibin\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.359874 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359030 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-multus-cni-dir\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.359874 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359040 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c23fe6dd-65fe-43e4-b687-5ddc4cef6c1a-host\") pod \"node-ca-7wp2q\" (UID: \"c23fe6dd-65fe-43e4-b687-5ddc4cef6c1a\") " pod="openshift-image-registry/node-ca-7wp2q" Jun 02 21:41:50.359874 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359079 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1bb1fdcd-7ba6-48e4-8421-d364035b2c78-host-slash\") pod \"iptables-alerter-s48gg\" (UID: \"1bb1fdcd-7ba6-48e4-8421-d364035b2c78\") " pod="openshift-network-operator/iptables-alerter-s48gg" Jun 02 21:41:50.359874 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359135 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f5f436e1-413c-4e03-8555-fd576d4a697d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q52sb\" (UID: \"f5f436e1-413c-4e03-8555-fd576d4a697d\") " pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.359874 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359150 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-cnibin\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.359874 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359189 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ss55\" (UniqueName: \"kubernetes.io/projected/83f2febb-89fb-452c-833e-facb9d8bb557-kube-api-access-7ss55\") pod \"node-resolver-824lv\" (UID: \"83f2febb-89fb-452c-833e-facb9d8bb557\") " pod="openshift-dns/node-resolver-824lv" Jun 02 21:41:50.359874 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359194 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1bb1fdcd-7ba6-48e4-8421-d364035b2c78-host-slash\") pod \"iptables-alerter-s48gg\" (UID: \"1bb1fdcd-7ba6-48e4-8421-d364035b2c78\") " pod="openshift-network-operator/iptables-alerter-s48gg" Jun 02 21:41:50.359874 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359228 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-systemd-units\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.359874 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359257 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-etc-openvswitch\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.359874 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359281 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-log-socket\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.359874 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359307 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-multus-conf-dir\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.359874 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359334 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-etc-sysctl-d\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.360644 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359345 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-multus-conf-dir\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.360644 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359359 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fc6zn\" (UniqueName: \"kubernetes.io/projected/fd65e214-8d99-48d4-a62a-e86376de6a80-kube-api-access-fc6zn\") pod \"network-check-target-db2qf\" (UID: \"fd65e214-8d99-48d4-a62a-e86376de6a80\") " pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:41:50.360644 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359387 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-host-cni-bin\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.360644 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359413 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kpntm\" (UniqueName: \"kubernetes.io/projected/94556912-e14c-4114-9af1-b0c7be76b545-kube-api-access-kpntm\") pod \"aws-ebs-csi-driver-node-67qj5\" (UID: \"94556912-e14c-4114-9af1-b0c7be76b545\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" Jun 02 21:41:50.360644 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359422 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/896e8971-2598-4454-9661-2b3329ccc4f1-cni-binary-copy\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.360644 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359440 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lshbh\" (UniqueName: \"kubernetes.io/projected/f5f436e1-413c-4e03-8555-fd576d4a697d-kube-api-access-lshbh\") pod \"multus-additional-cni-plugins-q52sb\" (UID: \"f5f436e1-413c-4e03-8555-fd576d4a697d\") " pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.360644 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359469 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-system-cni-dir\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.360644 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359473 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-etc-sysctl-d\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.360644 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359500 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-host-run-k8s-cni-cncf-io\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.360644 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359520 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-system-cni-dir\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.360644 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359524 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-etc-sysctl-conf\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.360644 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359551 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-run-systemd\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.360644 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359564 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-host-run-k8s-cni-cncf-io\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.360644 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359577 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.360644 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359650 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-etc-sysctl-conf\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.360644 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359649 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f5f436e1-413c-4e03-8555-fd576d4a697d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q52sb\" (UID: \"f5f436e1-413c-4e03-8555-fd576d4a697d\") " pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.360644 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359695 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1111ee31-ecfc-4c23-9f47-f29df074bb53-tmp\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.361450 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359722 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/94556912-e14c-4114-9af1-b0c7be76b545-kubelet-dir\") pod \"aws-ebs-csi-driver-node-67qj5\" (UID: \"94556912-e14c-4114-9af1-b0c7be76b545\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" Jun 02 21:41:50.361450 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359746 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/94556912-e14c-4114-9af1-b0c7be76b545-device-dir\") pod \"aws-ebs-csi-driver-node-67qj5\" (UID: \"94556912-e14c-4114-9af1-b0c7be76b545\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" Jun 02 21:41:50.361450 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359770 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ab949e00-2922-4650-bb9e-71830cb21bf8-agent-certs\") pod \"konnectivity-agent-4jt68\" (UID: \"ab949e00-2922-4650-bb9e-71830cb21bf8\") " pod="kube-system/konnectivity-agent-4jt68" Jun 02 21:41:50.361450 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359795 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ab949e00-2922-4650-bb9e-71830cb21bf8-konnectivity-ca\") pod \"konnectivity-agent-4jt68\" (UID: \"ab949e00-2922-4650-bb9e-71830cb21bf8\") " pod="kube-system/konnectivity-agent-4jt68" Jun 02 21:41:50.361450 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359824 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-host-cni-netd\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.361450 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359847 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-etc-kubernetes\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.361450 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359873 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-host-slash\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.361450 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359886 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/94556912-e14c-4114-9af1-b0c7be76b545-kubelet-dir\") pod \"aws-ebs-csi-driver-node-67qj5\" (UID: \"94556912-e14c-4114-9af1-b0c7be76b545\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" Jun 02 21:41:50.361450 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359897 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5f436e1-413c-4e03-8555-fd576d4a697d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q52sb\" (UID: \"f5f436e1-413c-4e03-8555-fd576d4a697d\") " pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.361450 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359953 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-etc-modprobe-d\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.361450 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359981 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-etc-sysconfig\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.361450 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360004 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5f436e1-413c-4e03-8555-fd576d4a697d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q52sb\" (UID: \"f5f436e1-413c-4e03-8555-fd576d4a697d\") " pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.361450 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360008 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-sys\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.361450 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360037 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-lib-modules\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.361450 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360056 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-sys\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.361450 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360060 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-host\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.361450 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360096 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-host\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.362253 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360104 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8tq4t\" (UniqueName: \"kubernetes.io/projected/1bb1fdcd-7ba6-48e4-8421-d364035b2c78-kube-api-access-8tq4t\") pod \"iptables-alerter-s48gg\" (UID: \"1bb1fdcd-7ba6-48e4-8421-d364035b2c78\") " pod="openshift-network-operator/iptables-alerter-s48gg" Jun 02 21:41:50.362253 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360130 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-etc-kubernetes\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.362253 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360133 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/83f2febb-89fb-452c-833e-facb9d8bb557-hosts-file\") pod \"node-resolver-824lv\" (UID: \"83f2febb-89fb-452c-833e-facb9d8bb557\") " pod="openshift-dns/node-resolver-824lv" Jun 02 21:41:50.362253 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.359842 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/94556912-e14c-4114-9af1-b0c7be76b545-device-dir\") pod \"aws-ebs-csi-driver-node-67qj5\" (UID: \"94556912-e14c-4114-9af1-b0c7be76b545\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" Jun 02 21:41:50.362253 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360103 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f5f436e1-413c-4e03-8555-fd576d4a697d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q52sb\" (UID: \"f5f436e1-413c-4e03-8555-fd576d4a697d\") " pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.362253 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360161 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-etc-kubernetes\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.362253 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360167 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-etc-sysconfig\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.362253 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360268 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-etc-modprobe-d\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.362253 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360313 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/83f2febb-89fb-452c-833e-facb9d8bb557-hosts-file\") pod \"node-resolver-824lv\" (UID: \"83f2febb-89fb-452c-833e-facb9d8bb557\") " pod="openshift-dns/node-resolver-824lv" Jun 02 21:41:50.362253 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360344 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/94556912-e14c-4114-9af1-b0c7be76b545-registration-dir\") pod \"aws-ebs-csi-driver-node-67qj5\" (UID: \"94556912-e14c-4114-9af1-b0c7be76b545\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" Jun 02 21:41:50.362253 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360396 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1bb1fdcd-7ba6-48e4-8421-d364035b2c78-iptables-alerter-script\") pod \"iptables-alerter-s48gg\" (UID: \"1bb1fdcd-7ba6-48e4-8421-d364035b2c78\") " pod="openshift-network-operator/iptables-alerter-s48gg" Jun 02 21:41:50.362253 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360412 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-etc-kubernetes\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.362253 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360434 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-run-ovn\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.362253 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360478 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hvwpx\" (UniqueName: \"kubernetes.io/projected/c23fe6dd-65fe-43e4-b687-5ddc4cef6c1a-kube-api-access-hvwpx\") pod \"node-ca-7wp2q\" (UID: \"c23fe6dd-65fe-43e4-b687-5ddc4cef6c1a\") " pod="openshift-image-registry/node-ca-7wp2q" Jun 02 21:41:50.362253 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360492 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-lib-modules\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.362253 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360505 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5f436e1-413c-4e03-8555-fd576d4a697d-os-release\") pod \"multus-additional-cni-plugins-q52sb\" (UID: \"f5f436e1-413c-4e03-8555-fd576d4a697d\") " pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.362253 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360530 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-host-run-multus-certs\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.363045 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360541 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/94556912-e14c-4114-9af1-b0c7be76b545-registration-dir\") pod \"aws-ebs-csi-driver-node-67qj5\" (UID: \"94556912-e14c-4114-9af1-b0c7be76b545\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" Jun 02 21:41:50.363045 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360664 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ab949e00-2922-4650-bb9e-71830cb21bf8-konnectivity-ca\") pod \"konnectivity-agent-4jt68\" (UID: \"ab949e00-2922-4650-bb9e-71830cb21bf8\") " pod="kube-system/konnectivity-agent-4jt68" Jun 02 21:41:50.363045 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360670 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5f436e1-413c-4e03-8555-fd576d4a697d-os-release\") pod \"multus-additional-cni-plugins-q52sb\" (UID: \"f5f436e1-413c-4e03-8555-fd576d4a697d\") " pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.363045 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360719 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-etc-systemd\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.363045 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360735 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-host-run-multus-certs\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.363045 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360775 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/94556912-e14c-4114-9af1-b0c7be76b545-sys-fs\") pod \"aws-ebs-csi-driver-node-67qj5\" (UID: \"94556912-e14c-4114-9af1-b0c7be76b545\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" Jun 02 21:41:50.363045 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360805 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-host-kubelet\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.363045 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360859 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/94556912-e14c-4114-9af1-b0c7be76b545-sys-fs\") pod \"aws-ebs-csi-driver-node-67qj5\" (UID: \"94556912-e14c-4114-9af1-b0c7be76b545\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" Jun 02 21:41:50.363045 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360888 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/896e8971-2598-4454-9661-2b3329ccc4f1-multus-daemon-config\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.363045 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360891 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-etc-systemd\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.363045 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360927 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-run\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.363045 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360964 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h558h\" (UniqueName: \"kubernetes.io/projected/1111ee31-ecfc-4c23-9f47-f29df074bb53-kube-api-access-h558h\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.363045 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.360991 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-run-openvswitch\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.363045 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.361030 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs\") pod \"network-metrics-daemon-4jr88\" (UID: \"b9038487-6455-44d7-8c00-1323fb060fd9\") " pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:41:50.363045 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.361040 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1bb1fdcd-7ba6-48e4-8421-d364035b2c78-iptables-alerter-script\") pod \"iptables-alerter-s48gg\" (UID: \"1bb1fdcd-7ba6-48e4-8421-d364035b2c78\") " pod="openshift-network-operator/iptables-alerter-s48gg" Jun 02 21:41:50.363045 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.361057 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c23fe6dd-65fe-43e4-b687-5ddc4cef6c1a-serviceca\") pod \"node-ca-7wp2q\" (UID: \"c23fe6dd-65fe-43e4-b687-5ddc4cef6c1a\") " pod="openshift-image-registry/node-ca-7wp2q" Jun 02 21:41:50.363045 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.361108 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1111ee31-ecfc-4c23-9f47-f29df074bb53-run\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.363566 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.361297 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/896e8971-2598-4454-9661-2b3329ccc4f1-multus-daemon-config\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.363566 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.361303 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-hostroot\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.363566 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.361438 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-node-log\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.363566 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.361466 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f861eb36-c26d-4d0e-9b5e-64543a169fb2-env-overrides\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.363566 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.361554 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/896e8971-2598-4454-9661-2b3329ccc4f1-hostroot\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.363566 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.361580 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c23fe6dd-65fe-43e4-b687-5ddc4cef6c1a-serviceca\") pod \"node-ca-7wp2q\" (UID: \"c23fe6dd-65fe-43e4-b687-5ddc4cef6c1a\") " pod="openshift-image-registry/node-ca-7wp2q" Jun 02 21:41:50.363566 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.362066 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1111ee31-ecfc-4c23-9f47-f29df074bb53-tmp\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.363566 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.362108 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1111ee31-ecfc-4c23-9f47-f29df074bb53-etc-tuned\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.363566 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.362954 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ab949e00-2922-4650-bb9e-71830cb21bf8-agent-certs\") pod \"konnectivity-agent-4jt68\" (UID: \"ab949e00-2922-4650-bb9e-71830cb21bf8\") " pod="kube-system/konnectivity-agent-4jt68" Jun 02 21:41:50.373689 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.373665 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvwpx\" (UniqueName: \"kubernetes.io/projected/c23fe6dd-65fe-43e4-b687-5ddc4cef6c1a-kube-api-access-hvwpx\") pod \"node-ca-7wp2q\" (UID: \"c23fe6dd-65fe-43e4-b687-5ddc4cef6c1a\") " pod="openshift-image-registry/node-ca-7wp2q" Jun 02 21:41:50.373822 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:50.373806 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:41:50.373888 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:50.373835 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:41:50.373888 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:50.373849 2553 projected.go:194] Error preparing data for projected volume kube-api-access-fc6zn for pod openshift-network-diagnostics/network-check-target-db2qf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:41:50.373987 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:50.373948 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd65e214-8d99-48d4-a62a-e86376de6a80-kube-api-access-fc6zn podName:fd65e214-8d99-48d4-a62a-e86376de6a80 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:50.873926024 +0000 UTC m=+3.042879729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fc6zn" (UniqueName: "kubernetes.io/projected/fd65e214-8d99-48d4-a62a-e86376de6a80-kube-api-access-fc6zn") pod "network-check-target-db2qf" (UID: "fd65e214-8d99-48d4-a62a-e86376de6a80") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:41:50.374692 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.374672 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frsd9\" (UniqueName: \"kubernetes.io/projected/896e8971-2598-4454-9661-2b3329ccc4f1-kube-api-access-frsd9\") pod \"multus-jz744\" (UID: \"896e8971-2598-4454-9661-2b3329ccc4f1\") " pod="openshift-multus/multus-jz744" Jun 02 21:41:50.375205 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.375187 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tq4t\" (UniqueName: \"kubernetes.io/projected/1bb1fdcd-7ba6-48e4-8421-d364035b2c78-kube-api-access-8tq4t\") pod \"iptables-alerter-s48gg\" (UID: \"1bb1fdcd-7ba6-48e4-8421-d364035b2c78\") " pod="openshift-network-operator/iptables-alerter-s48gg" Jun 02 21:41:50.377175 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.377156 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpntm\" (UniqueName: \"kubernetes.io/projected/94556912-e14c-4114-9af1-b0c7be76b545-kube-api-access-kpntm\") pod \"aws-ebs-csi-driver-node-67qj5\" (UID: \"94556912-e14c-4114-9af1-b0c7be76b545\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" Jun 02 21:41:50.377266 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.377186 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h558h\" (UniqueName: \"kubernetes.io/projected/1111ee31-ecfc-4c23-9f47-f29df074bb53-kube-api-access-h558h\") pod \"tuned-xzspb\" (UID: \"1111ee31-ecfc-4c23-9f47-f29df074bb53\") " pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.378802 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.378779 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ss55\" (UniqueName: \"kubernetes.io/projected/83f2febb-89fb-452c-833e-facb9d8bb557-kube-api-access-7ss55\") pod \"node-resolver-824lv\" (UID: \"83f2febb-89fb-452c-833e-facb9d8bb557\") " pod="openshift-dns/node-resolver-824lv" Jun 02 21:41:50.382011 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.381987 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lshbh\" (UniqueName: \"kubernetes.io/projected/f5f436e1-413c-4e03-8555-fd576d4a697d-kube-api-access-lshbh\") pod \"multus-additional-cni-plugins-q52sb\" (UID: \"f5f436e1-413c-4e03-8555-fd576d4a697d\") " pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.461924 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.461897 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-host-run-netns\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.462103 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.461951 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-var-lib-openvswitch\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.462103 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.461978 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f861eb36-c26d-4d0e-9b5e-64543a169fb2-ovnkube-config\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.462103 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.461996 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-host-run-netns\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.462103 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462015 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-var-lib-openvswitch\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.462103 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462003 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f7q26\" (UniqueName: \"kubernetes.io/projected/f861eb36-c26d-4d0e-9b5e-64543a169fb2-kube-api-access-f7q26\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.462103 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462068 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gxg4m\" (UniqueName: \"kubernetes.io/projected/b9038487-6455-44d7-8c00-1323fb060fd9-kube-api-access-gxg4m\") pod \"network-metrics-daemon-4jr88\" (UID: \"b9038487-6455-44d7-8c00-1323fb060fd9\") " pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:41:50.462103 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462100 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f861eb36-c26d-4d0e-9b5e-64543a169fb2-ovnkube-script-lib\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.462478 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462167 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-systemd-units\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.462478 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462208 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-etc-openvswitch\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.462478 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462237 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-log-socket\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.462478 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462265 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-systemd-units\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.462478 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462281 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-host-cni-bin\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.462478 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462312 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-etc-openvswitch\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.462478 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462314 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-run-systemd\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.462478 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462325 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-log-socket\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.462478 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462347 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.462478 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462354 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-run-systemd\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.462478 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462371 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-host-cni-bin\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.462478 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462380 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-host-cni-netd\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.462478 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462407 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.462478 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462410 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-host-slash\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.462478 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462446 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-host-slash\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.462478 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462452 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-host-cni-netd\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.462478 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462462 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-run-ovn\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.463266 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462494 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-run-ovn\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.463266 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462501 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-host-kubelet\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.463266 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462518 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f861eb36-c26d-4d0e-9b5e-64543a169fb2-ovnkube-config\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.463266 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462531 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-run-openvswitch\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.463266 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462555 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-host-kubelet\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.463266 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462558 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs\") pod \"network-metrics-daemon-4jr88\" (UID: \"b9038487-6455-44d7-8c00-1323fb060fd9\") " pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:41:50.463266 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462588 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-node-log\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.463266 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462635 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-run-openvswitch\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.463266 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462613 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f861eb36-c26d-4d0e-9b5e-64543a169fb2-env-overrides\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.463266 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:50.462670 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:41:50.463266 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462683 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-node-log\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.463266 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462689 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-host-run-ovn-kubernetes\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.463266 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462715 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f861eb36-c26d-4d0e-9b5e-64543a169fb2-ovn-node-metrics-cert\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.463266 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462714 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f861eb36-c26d-4d0e-9b5e-64543a169fb2-ovnkube-script-lib\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.463266 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:50.462729 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs podName:b9038487-6455-44d7-8c00-1323fb060fd9 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:50.96271642 +0000 UTC m=+3.131670129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs") pod "network-metrics-daemon-4jr88" (UID: "b9038487-6455-44d7-8c00-1323fb060fd9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:41:50.463266 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.462757 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f861eb36-c26d-4d0e-9b5e-64543a169fb2-host-run-ovn-kubernetes\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.463266 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.463087 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f861eb36-c26d-4d0e-9b5e-64543a169fb2-env-overrides\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.465217 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.465197 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f861eb36-c26d-4d0e-9b5e-64543a169fb2-ovn-node-metrics-cert\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.470923 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.470898 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxg4m\" (UniqueName: \"kubernetes.io/projected/b9038487-6455-44d7-8c00-1323fb060fd9-kube-api-access-gxg4m\") pod \"network-metrics-daemon-4jr88\" (UID: \"b9038487-6455-44d7-8c00-1323fb060fd9\") " pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:41:50.471891 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.471874 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7q26\" (UniqueName: \"kubernetes.io/projected/f861eb36-c26d-4d0e-9b5e-64543a169fb2-kube-api-access-f7q26\") pod \"ovnkube-node-s67gg\" (UID: \"f861eb36-c26d-4d0e-9b5e-64543a169fb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.549045 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.548951 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xzspb" Jun 02 21:41:50.559734 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.559707 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s48gg" Jun 02 21:41:50.568233 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.568212 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" Jun 02 21:41:50.573890 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.573867 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4jt68" Jun 02 21:41:50.580424 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.580406 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-824lv" Jun 02 21:41:50.587954 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.587933 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q52sb" Jun 02 21:41:50.595471 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.595447 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7wp2q" Jun 02 21:41:50.602013 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.601994 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jz744" Jun 02 21:41:50.607647 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.607630 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:41:50.960655 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:50.960609 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab949e00_2922_4650_bb9e_71830cb21bf8.slice/crio-9c0c21486a8343a70c3c64b97c7cafe8c129b31d316e096314f71c293390369f WatchSource:0}: Error finding container 9c0c21486a8343a70c3c64b97c7cafe8c129b31d316e096314f71c293390369f: Status 404 returned error can't find the container with id 9c0c21486a8343a70c3c64b97c7cafe8c129b31d316e096314f71c293390369f Jun 02 21:41:50.962024 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:50.962000 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83f2febb_89fb_452c_833e_facb9d8bb557.slice/crio-1971ff1c516ab0726f6fa0129d124a5c4caa6b951ae69a1b4b8509e4af053cd3 WatchSource:0}: Error finding container 1971ff1c516ab0726f6fa0129d124a5c4caa6b951ae69a1b4b8509e4af053cd3: Status 404 returned error can't find the container with id 1971ff1c516ab0726f6fa0129d124a5c4caa6b951ae69a1b4b8509e4af053cd3 Jun 02 21:41:50.965524 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:50.965498 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc23fe6dd_65fe_43e4_b687_5ddc4cef6c1a.slice/crio-2975d16199b0a03c302c112b673cab9284f8b5ba7583cea5190a67a7282cea0b WatchSource:0}: Error finding container 2975d16199b0a03c302c112b673cab9284f8b5ba7583cea5190a67a7282cea0b: Status 404 returned error can't find the container with id 2975d16199b0a03c302c112b673cab9284f8b5ba7583cea5190a67a7282cea0b Jun 02 21:41:50.965660 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.965542 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs\") pod \"network-metrics-daemon-4jr88\" (UID: \"b9038487-6455-44d7-8c00-1323fb060fd9\") " pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:41:50.965660 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:50.965605 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fc6zn\" (UniqueName: \"kubernetes.io/projected/fd65e214-8d99-48d4-a62a-e86376de6a80-kube-api-access-fc6zn\") pod \"network-check-target-db2qf\" (UID: \"fd65e214-8d99-48d4-a62a-e86376de6a80\") " pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:41:50.965836 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:50.965693 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:41:50.965836 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:50.965752 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs podName:b9038487-6455-44d7-8c00-1323fb060fd9 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:51.965732091 +0000 UTC m=+4.134685791 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs") pod "network-metrics-daemon-4jr88" (UID: "b9038487-6455-44d7-8c00-1323fb060fd9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:41:50.965836 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:50.965772 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:41:50.965836 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:50.965793 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:41:50.965836 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:50.965807 2553 projected.go:194] Error preparing data for projected volume kube-api-access-fc6zn for pod openshift-network-diagnostics/network-check-target-db2qf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:41:50.966060 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:50.965861 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd65e214-8d99-48d4-a62a-e86376de6a80-kube-api-access-fc6zn podName:fd65e214-8d99-48d4-a62a-e86376de6a80 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:51.965844777 +0000 UTC m=+4.134798467 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fc6zn" (UniqueName: "kubernetes.io/projected/fd65e214-8d99-48d4-a62a-e86376de6a80-kube-api-access-fc6zn") pod "network-check-target-db2qf" (UID: "fd65e214-8d99-48d4-a62a-e86376de6a80") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:41:50.966220 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:50.966204 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1111ee31_ecfc_4c23_9f47_f29df074bb53.slice/crio-6750ab0955a575fd01c0008fd3fde0e646e205a0dae96079556a32de257ac3c0 WatchSource:0}: Error finding container 6750ab0955a575fd01c0008fd3fde0e646e205a0dae96079556a32de257ac3c0: Status 404 returned error can't find the container with id 6750ab0955a575fd01c0008fd3fde0e646e205a0dae96079556a32de257ac3c0 Jun 02 21:41:50.967056 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:50.967037 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94556912_e14c_4114_9af1_b0c7be76b545.slice/crio-59ef5c4afed6fc002e3b6d8055e6ab22e78d248bf4d993c406edf4e70cc14d35 WatchSource:0}: Error finding container 59ef5c4afed6fc002e3b6d8055e6ab22e78d248bf4d993c406edf4e70cc14d35: Status 404 returned error can't find the container with id 59ef5c4afed6fc002e3b6d8055e6ab22e78d248bf4d993c406edf4e70cc14d35 Jun 02 21:41:50.968380 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:50.968354 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb1fdcd_7ba6_48e4_8421_d364035b2c78.slice/crio-70cf18c3cbdd2358944660e30e1ace0ea2cba97407f0021b79f3385fd59bc93e WatchSource:0}: Error finding container 70cf18c3cbdd2358944660e30e1ace0ea2cba97407f0021b79f3385fd59bc93e: Status 404 returned error can't find the container with id 70cf18c3cbdd2358944660e30e1ace0ea2cba97407f0021b79f3385fd59bc93e Jun 02 21:41:50.968976 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:50.968614 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod896e8971_2598_4454_9661_2b3329ccc4f1.slice/crio-58ea8d5aa00b357f5a80bf6e918a687bf6754cc18dd95cb7834f6db9a91ac219 WatchSource:0}: Error finding container 58ea8d5aa00b357f5a80bf6e918a687bf6754cc18dd95cb7834f6db9a91ac219: Status 404 returned error can't find the container with id 58ea8d5aa00b357f5a80bf6e918a687bf6754cc18dd95cb7834f6db9a91ac219 Jun 02 21:41:50.970555 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:50.970526 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5f436e1_413c_4e03_8555_fd576d4a697d.slice/crio-2be641f970b4fb0a35a5816c8d65036b2543d8f1ee889cf58df60d47cc29b125 WatchSource:0}: Error finding container 2be641f970b4fb0a35a5816c8d65036b2543d8f1ee889cf58df60d47cc29b125: Status 404 returned error can't find the container with id 2be641f970b4fb0a35a5816c8d65036b2543d8f1ee889cf58df60d47cc29b125 Jun 02 21:41:50.972718 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:41:50.972691 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf861eb36_c26d_4d0e_9b5e_64543a169fb2.slice/crio-4298bfa8e25f10bfc5df5bb09e8428a908d9f593420ea2cccbc89da5a026d34e WatchSource:0}: Error finding container 4298bfa8e25f10bfc5df5bb09e8428a908d9f593420ea2cccbc89da5a026d34e: Status 404 returned error can't find the container with id 4298bfa8e25f10bfc5df5bb09e8428a908d9f593420ea2cccbc89da5a026d34e Jun 02 21:41:51.286442 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:51.286402 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 21:36:49 +0000 UTC" deadline="2028-01-27 05:10:13.886178956 +0000 UTC" Jun 02 21:41:51.286442 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:51.286442 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14479h28m22.599741462s" Jun 02 21:41:51.336778 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:51.336750 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:41:51.336889 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:51.336851 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db2qf" podUID="fd65e214-8d99-48d4-a62a-e86376de6a80" Jun 02 21:41:51.344203 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:51.344177 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" event={"ID":"94556912-e14c-4114-9af1-b0c7be76b545","Type":"ContainerStarted","Data":"59ef5c4afed6fc002e3b6d8055e6ab22e78d248bf4d993c406edf4e70cc14d35"} Jun 02 21:41:51.345176 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:51.345145 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-824lv" event={"ID":"83f2febb-89fb-452c-833e-facb9d8bb557","Type":"ContainerStarted","Data":"1971ff1c516ab0726f6fa0129d124a5c4caa6b951ae69a1b4b8509e4af053cd3"} Jun 02 21:41:51.346058 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:51.346034 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4jt68" event={"ID":"ab949e00-2922-4650-bb9e-71830cb21bf8","Type":"ContainerStarted","Data":"9c0c21486a8343a70c3c64b97c7cafe8c129b31d316e096314f71c293390369f"} Jun 02 21:41:51.347445 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:51.347421 2553 generic.go:358] "Generic (PLEG): container finished" podID="4f54130458f2eedc16600e107a401f1c" containerID="8ab9831a02ad60f176437be81f1ee86b7e90a5935039fa1dc606e977f91d80f0" exitCode=0 Jun 02 21:41:51.347525 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:51.347495 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" event={"ID":"4f54130458f2eedc16600e107a401f1c","Type":"ContainerDied","Data":"8ab9831a02ad60f176437be81f1ee86b7e90a5935039fa1dc606e977f91d80f0"} Jun 02 21:41:51.348647 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:51.348604 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-67.ec2.internal" event={"ID":"4885e4402645ea72c822907b9a1090f4","Type":"ContainerStarted","Data":"4320a72e4b421494e26ec9b9d9ef0ec79fb7ffa3c93f8fd8d8167efc5f1a9657"} Jun 02 21:41:51.349568 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:51.349548 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" event={"ID":"f861eb36-c26d-4d0e-9b5e-64543a169fb2","Type":"ContainerStarted","Data":"4298bfa8e25f10bfc5df5bb09e8428a908d9f593420ea2cccbc89da5a026d34e"} Jun 02 21:41:51.350414 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:51.350389 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q52sb" event={"ID":"f5f436e1-413c-4e03-8555-fd576d4a697d","Type":"ContainerStarted","Data":"2be641f970b4fb0a35a5816c8d65036b2543d8f1ee889cf58df60d47cc29b125"} Jun 02 21:41:51.351306 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:51.351286 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jz744" event={"ID":"896e8971-2598-4454-9661-2b3329ccc4f1","Type":"ContainerStarted","Data":"58ea8d5aa00b357f5a80bf6e918a687bf6754cc18dd95cb7834f6db9a91ac219"} Jun 02 21:41:51.352313 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:51.352295 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s48gg" event={"ID":"1bb1fdcd-7ba6-48e4-8421-d364035b2c78","Type":"ContainerStarted","Data":"70cf18c3cbdd2358944660e30e1ace0ea2cba97407f0021b79f3385fd59bc93e"} Jun 02 21:41:51.353174 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:51.353156 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xzspb" event={"ID":"1111ee31-ecfc-4c23-9f47-f29df074bb53","Type":"ContainerStarted","Data":"6750ab0955a575fd01c0008fd3fde0e646e205a0dae96079556a32de257ac3c0"} Jun 02 21:41:51.354000 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:51.353983 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7wp2q" event={"ID":"c23fe6dd-65fe-43e4-b687-5ddc4cef6c1a","Type":"ContainerStarted","Data":"2975d16199b0a03c302c112b673cab9284f8b5ba7583cea5190a67a7282cea0b"} Jun 02 21:41:51.973184 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:51.973146 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fc6zn\" (UniqueName: \"kubernetes.io/projected/fd65e214-8d99-48d4-a62a-e86376de6a80-kube-api-access-fc6zn\") pod \"network-check-target-db2qf\" (UID: \"fd65e214-8d99-48d4-a62a-e86376de6a80\") " pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:41:51.973355 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:51.973219 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs\") pod \"network-metrics-daemon-4jr88\" (UID: \"b9038487-6455-44d7-8c00-1323fb060fd9\") " pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:41:51.973355 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:51.973341 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:41:51.973485 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:51.973402 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs podName:b9038487-6455-44d7-8c00-1323fb060fd9 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:53.973381966 +0000 UTC m=+6.142335657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs") pod "network-metrics-daemon-4jr88" (UID: "b9038487-6455-44d7-8c00-1323fb060fd9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:41:51.973848 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:51.973827 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:41:51.973848 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:51.973852 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:41:51.974065 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:51.973866 2553 projected.go:194] Error preparing data for projected volume kube-api-access-fc6zn for pod openshift-network-diagnostics/network-check-target-db2qf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:41:51.974065 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:51.973910 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd65e214-8d99-48d4-a62a-e86376de6a80-kube-api-access-fc6zn podName:fd65e214-8d99-48d4-a62a-e86376de6a80 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:53.973895612 +0000 UTC m=+6.142849316 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fc6zn" (UniqueName: "kubernetes.io/projected/fd65e214-8d99-48d4-a62a-e86376de6a80-kube-api-access-fc6zn") pod "network-check-target-db2qf" (UID: "fd65e214-8d99-48d4-a62a-e86376de6a80") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:41:52.339534 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:52.338982 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:41:52.339534 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:52.339117 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jr88" podUID="b9038487-6455-44d7-8c00-1323fb060fd9" Jun 02 21:41:52.375715 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:52.375682 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" event={"ID":"4f54130458f2eedc16600e107a401f1c","Type":"ContainerStarted","Data":"24e4a41d0efa95733c4cd8d48c720659063e03e41e81ff587133ae7297cefd80"} Jun 02 21:41:52.393280 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:52.393225 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-67.ec2.internal" podStartSLOduration=3.393207198 podStartE2EDuration="3.393207198s" podCreationTimestamp="2026-06-02 21:41:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:41:51.399889281 +0000 UTC m=+3.568842993" watchObservedRunningTime="2026-06-02 21:41:52.393207198 +0000 UTC m=+4.562160911" Jun 02 21:41:53.337790 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:53.337280 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:41:53.337790 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:53.337407 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db2qf" podUID="fd65e214-8d99-48d4-a62a-e86376de6a80" Jun 02 21:41:53.988856 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:53.988020 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fc6zn\" (UniqueName: \"kubernetes.io/projected/fd65e214-8d99-48d4-a62a-e86376de6a80-kube-api-access-fc6zn\") pod \"network-check-target-db2qf\" (UID: \"fd65e214-8d99-48d4-a62a-e86376de6a80\") " pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:41:53.988856 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:53.988096 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs\") pod \"network-metrics-daemon-4jr88\" (UID: \"b9038487-6455-44d7-8c00-1323fb060fd9\") " pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:41:53.988856 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:53.988232 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:41:53.988856 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:53.988292 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs podName:b9038487-6455-44d7-8c00-1323fb060fd9 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:57.988273161 +0000 UTC m=+10.157226858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs") pod "network-metrics-daemon-4jr88" (UID: "b9038487-6455-44d7-8c00-1323fb060fd9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:41:53.988856 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:53.988741 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:41:53.988856 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:53.988760 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:41:53.988856 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:53.988773 2553 projected.go:194] Error preparing data for projected volume kube-api-access-fc6zn for pod openshift-network-diagnostics/network-check-target-db2qf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:41:53.988856 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:53.988818 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd65e214-8d99-48d4-a62a-e86376de6a80-kube-api-access-fc6zn podName:fd65e214-8d99-48d4-a62a-e86376de6a80 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:57.988802594 +0000 UTC m=+10.157756286 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fc6zn" (UniqueName: "kubernetes.io/projected/fd65e214-8d99-48d4-a62a-e86376de6a80-kube-api-access-fc6zn") pod "network-check-target-db2qf" (UID: "fd65e214-8d99-48d4-a62a-e86376de6a80") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:41:54.337564 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:54.337496 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:41:54.337719 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:54.337652 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jr88" podUID="b9038487-6455-44d7-8c00-1323fb060fd9" Jun 02 21:41:55.337672 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:55.337182 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:41:55.337672 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:55.337310 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db2qf" podUID="fd65e214-8d99-48d4-a62a-e86376de6a80" Jun 02 21:41:56.224370 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:56.223730 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" podStartSLOduration=7.223709499 podStartE2EDuration="7.223709499s" podCreationTimestamp="2026-06-02 21:41:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:41:52.393466165 +0000 UTC m=+4.562419878" watchObservedRunningTime="2026-06-02 21:41:56.223709499 +0000 UTC m=+8.392663221" Jun 02 21:41:56.224370 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:56.223972 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-nk9h6"] Jun 02 21:41:56.226316 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:56.226292 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:41:56.226458 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:56.226377 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk9h6" podUID="e1d6b94e-7add-49da-bd1a-cc6b4f302261" Jun 02 21:41:56.306962 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:56.306925 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e1d6b94e-7add-49da-bd1a-cc6b4f302261-dbus\") pod \"global-pull-secret-syncer-nk9h6\" (UID: \"e1d6b94e-7add-49da-bd1a-cc6b4f302261\") " pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:41:56.307124 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:56.306982 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1d6b94e-7add-49da-bd1a-cc6b4f302261-original-pull-secret\") pod \"global-pull-secret-syncer-nk9h6\" (UID: \"e1d6b94e-7add-49da-bd1a-cc6b4f302261\") " pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:41:56.307124 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:56.307052 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e1d6b94e-7add-49da-bd1a-cc6b4f302261-kubelet-config\") pod \"global-pull-secret-syncer-nk9h6\" (UID: \"e1d6b94e-7add-49da-bd1a-cc6b4f302261\") " pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:41:56.337755 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:56.337551 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:41:56.337755 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:56.337711 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jr88" podUID="b9038487-6455-44d7-8c00-1323fb060fd9" Jun 02 21:41:56.407683 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:56.407460 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e1d6b94e-7add-49da-bd1a-cc6b4f302261-dbus\") pod \"global-pull-secret-syncer-nk9h6\" (UID: \"e1d6b94e-7add-49da-bd1a-cc6b4f302261\") " pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:41:56.407683 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:56.407531 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1d6b94e-7add-49da-bd1a-cc6b4f302261-original-pull-secret\") pod \"global-pull-secret-syncer-nk9h6\" (UID: \"e1d6b94e-7add-49da-bd1a-cc6b4f302261\") " pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:41:56.407683 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:56.407564 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e1d6b94e-7add-49da-bd1a-cc6b4f302261-kubelet-config\") pod \"global-pull-secret-syncer-nk9h6\" (UID: \"e1d6b94e-7add-49da-bd1a-cc6b4f302261\") " pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:41:56.407683 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:56.407636 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e1d6b94e-7add-49da-bd1a-cc6b4f302261-dbus\") pod \"global-pull-secret-syncer-nk9h6\" (UID: \"e1d6b94e-7add-49da-bd1a-cc6b4f302261\") " pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:41:56.408019 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:56.407770 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 21:41:56.408019 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:56.407846 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d6b94e-7add-49da-bd1a-cc6b4f302261-original-pull-secret podName:e1d6b94e-7add-49da-bd1a-cc6b4f302261 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:56.90782575 +0000 UTC m=+9.076779452 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1d6b94e-7add-49da-bd1a-cc6b4f302261-original-pull-secret") pod "global-pull-secret-syncer-nk9h6" (UID: "e1d6b94e-7add-49da-bd1a-cc6b4f302261") : object "kube-system"/"original-pull-secret" not registered Jun 02 21:41:56.408019 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:56.407886 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e1d6b94e-7add-49da-bd1a-cc6b4f302261-kubelet-config\") pod \"global-pull-secret-syncer-nk9h6\" (UID: \"e1d6b94e-7add-49da-bd1a-cc6b4f302261\") " pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:41:56.911102 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:56.911063 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1d6b94e-7add-49da-bd1a-cc6b4f302261-original-pull-secret\") pod \"global-pull-secret-syncer-nk9h6\" (UID: \"e1d6b94e-7add-49da-bd1a-cc6b4f302261\") " pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:41:56.911294 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:56.911220 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 21:41:56.911294 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:56.911278 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d6b94e-7add-49da-bd1a-cc6b4f302261-original-pull-secret podName:e1d6b94e-7add-49da-bd1a-cc6b4f302261 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:57.911264438 +0000 UTC m=+10.080218137 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1d6b94e-7add-49da-bd1a-cc6b4f302261-original-pull-secret") pod "global-pull-secret-syncer-nk9h6" (UID: "e1d6b94e-7add-49da-bd1a-cc6b4f302261") : object "kube-system"/"original-pull-secret" not registered Jun 02 21:41:57.337032 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:57.336959 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:41:57.337175 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:57.337097 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk9h6" podUID="e1d6b94e-7add-49da-bd1a-cc6b4f302261" Jun 02 21:41:57.337480 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:57.337458 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:41:57.337614 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:57.337554 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db2qf" podUID="fd65e214-8d99-48d4-a62a-e86376de6a80" Jun 02 21:41:57.918540 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:57.918444 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1d6b94e-7add-49da-bd1a-cc6b4f302261-original-pull-secret\") pod \"global-pull-secret-syncer-nk9h6\" (UID: \"e1d6b94e-7add-49da-bd1a-cc6b4f302261\") " pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:41:57.919007 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:57.918600 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 21:41:57.919007 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:57.918680 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d6b94e-7add-49da-bd1a-cc6b4f302261-original-pull-secret podName:e1d6b94e-7add-49da-bd1a-cc6b4f302261 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:59.918661406 +0000 UTC m=+12.087615101 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1d6b94e-7add-49da-bd1a-cc6b4f302261-original-pull-secret") pod "global-pull-secret-syncer-nk9h6" (UID: "e1d6b94e-7add-49da-bd1a-cc6b4f302261") : object "kube-system"/"original-pull-secret" not registered Jun 02 21:41:58.020224 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:58.019392 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs\") pod \"network-metrics-daemon-4jr88\" (UID: \"b9038487-6455-44d7-8c00-1323fb060fd9\") " pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:41:58.020224 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:58.019477 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fc6zn\" (UniqueName: \"kubernetes.io/projected/fd65e214-8d99-48d4-a62a-e86376de6a80-kube-api-access-fc6zn\") pod \"network-check-target-db2qf\" (UID: \"fd65e214-8d99-48d4-a62a-e86376de6a80\") " pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:41:58.020224 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:58.019655 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:41:58.020224 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:58.019675 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:41:58.020224 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:58.019688 2553 projected.go:194] Error preparing data for projected volume kube-api-access-fc6zn for pod openshift-network-diagnostics/network-check-target-db2qf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:41:58.020224 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:58.019744 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd65e214-8d99-48d4-a62a-e86376de6a80-kube-api-access-fc6zn podName:fd65e214-8d99-48d4-a62a-e86376de6a80 nodeName:}" failed. No retries permitted until 2026-06-02 21:42:06.019725287 +0000 UTC m=+18.188678989 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fc6zn" (UniqueName: "kubernetes.io/projected/fd65e214-8d99-48d4-a62a-e86376de6a80-kube-api-access-fc6zn") pod "network-check-target-db2qf" (UID: "fd65e214-8d99-48d4-a62a-e86376de6a80") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:41:58.020224 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:58.020146 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:41:58.020224 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:58.020192 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs podName:b9038487-6455-44d7-8c00-1323fb060fd9 nodeName:}" failed. No retries permitted until 2026-06-02 21:42:06.020176629 +0000 UTC m=+18.189130328 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs") pod "network-metrics-daemon-4jr88" (UID: "b9038487-6455-44d7-8c00-1323fb060fd9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:41:58.337967 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:58.337413 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:41:58.337967 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:58.337546 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jr88" podUID="b9038487-6455-44d7-8c00-1323fb060fd9" Jun 02 21:41:59.336549 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:59.336514 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:41:59.337019 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:59.336550 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:41:59.337019 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:59.336646 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db2qf" podUID="fd65e214-8d99-48d4-a62a-e86376de6a80" Jun 02 21:41:59.337019 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:59.336771 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk9h6" podUID="e1d6b94e-7add-49da-bd1a-cc6b4f302261" Jun 02 21:41:59.934284 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:41:59.934247 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1d6b94e-7add-49da-bd1a-cc6b4f302261-original-pull-secret\") pod \"global-pull-secret-syncer-nk9h6\" (UID: \"e1d6b94e-7add-49da-bd1a-cc6b4f302261\") " pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:41:59.934463 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:59.934413 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 21:41:59.934531 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:41:59.934494 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d6b94e-7add-49da-bd1a-cc6b4f302261-original-pull-secret podName:e1d6b94e-7add-49da-bd1a-cc6b4f302261 nodeName:}" failed. No retries permitted until 2026-06-02 21:42:03.93447219 +0000 UTC m=+16.103425899 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1d6b94e-7add-49da-bd1a-cc6b4f302261-original-pull-secret") pod "global-pull-secret-syncer-nk9h6" (UID: "e1d6b94e-7add-49da-bd1a-cc6b4f302261") : object "kube-system"/"original-pull-secret" not registered Jun 02 21:42:00.336955 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:00.336692 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:42:00.336955 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:00.336836 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jr88" podUID="b9038487-6455-44d7-8c00-1323fb060fd9" Jun 02 21:42:01.337304 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:01.337223 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:42:01.337725 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:01.337223 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:42:01.337725 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:01.337343 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk9h6" podUID="e1d6b94e-7add-49da-bd1a-cc6b4f302261" Jun 02 21:42:01.337725 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:01.337444 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db2qf" podUID="fd65e214-8d99-48d4-a62a-e86376de6a80" Jun 02 21:42:02.337352 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:02.337306 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:42:02.337740 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:02.337443 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jr88" podUID="b9038487-6455-44d7-8c00-1323fb060fd9" Jun 02 21:42:03.337045 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:03.337005 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:42:03.337236 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:03.337008 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:42:03.337236 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:03.337124 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db2qf" podUID="fd65e214-8d99-48d4-a62a-e86376de6a80" Jun 02 21:42:03.337236 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:03.337209 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk9h6" podUID="e1d6b94e-7add-49da-bd1a-cc6b4f302261" Jun 02 21:42:03.965724 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:03.965688 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1d6b94e-7add-49da-bd1a-cc6b4f302261-original-pull-secret\") pod \"global-pull-secret-syncer-nk9h6\" (UID: \"e1d6b94e-7add-49da-bd1a-cc6b4f302261\") " pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:42:03.966187 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:03.965824 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 21:42:03.966187 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:03.965894 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d6b94e-7add-49da-bd1a-cc6b4f302261-original-pull-secret podName:e1d6b94e-7add-49da-bd1a-cc6b4f302261 nodeName:}" failed. No retries permitted until 2026-06-02 21:42:11.96587375 +0000 UTC m=+24.134827451 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1d6b94e-7add-49da-bd1a-cc6b4f302261-original-pull-secret") pod "global-pull-secret-syncer-nk9h6" (UID: "e1d6b94e-7add-49da-bd1a-cc6b4f302261") : object "kube-system"/"original-pull-secret" not registered Jun 02 21:42:04.337546 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:04.337468 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:42:04.337728 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:04.337612 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jr88" podUID="b9038487-6455-44d7-8c00-1323fb060fd9" Jun 02 21:42:05.336753 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:05.336675 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:42:05.337140 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:05.336676 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:42:05.337140 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:05.336809 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk9h6" podUID="e1d6b94e-7add-49da-bd1a-cc6b4f302261" Jun 02 21:42:05.337140 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:05.336924 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db2qf" podUID="fd65e214-8d99-48d4-a62a-e86376de6a80" Jun 02 21:42:06.084342 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:06.084290 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fc6zn\" (UniqueName: \"kubernetes.io/projected/fd65e214-8d99-48d4-a62a-e86376de6a80-kube-api-access-fc6zn\") pod \"network-check-target-db2qf\" (UID: \"fd65e214-8d99-48d4-a62a-e86376de6a80\") " pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:42:06.084510 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:06.084361 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs\") pod \"network-metrics-daemon-4jr88\" (UID: \"b9038487-6455-44d7-8c00-1323fb060fd9\") " pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:42:06.084510 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:06.084467 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:42:06.084510 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:06.084471 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:42:06.084510 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:06.084497 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:42:06.084510 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:06.084512 2553 projected.go:194] Error preparing data for projected volume kube-api-access-fc6zn for pod openshift-network-diagnostics/network-check-target-db2qf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:42:06.084799 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:06.084528 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs podName:b9038487-6455-44d7-8c00-1323fb060fd9 nodeName:}" failed. No retries permitted until 2026-06-02 21:42:22.08450903 +0000 UTC m=+34.253462722 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs") pod "network-metrics-daemon-4jr88" (UID: "b9038487-6455-44d7-8c00-1323fb060fd9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:42:06.084799 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:06.084562 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd65e214-8d99-48d4-a62a-e86376de6a80-kube-api-access-fc6zn podName:fd65e214-8d99-48d4-a62a-e86376de6a80 nodeName:}" failed. No retries permitted until 2026-06-02 21:42:22.084545575 +0000 UTC m=+34.253499276 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fc6zn" (UniqueName: "kubernetes.io/projected/fd65e214-8d99-48d4-a62a-e86376de6a80-kube-api-access-fc6zn") pod "network-check-target-db2qf" (UID: "fd65e214-8d99-48d4-a62a-e86376de6a80") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:42:06.337063 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:06.336982 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:42:06.337502 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:06.337120 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jr88" podUID="b9038487-6455-44d7-8c00-1323fb060fd9" Jun 02 21:42:07.336423 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:07.336395 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:42:07.336423 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:07.336430 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:42:07.336667 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:07.336493 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db2qf" podUID="fd65e214-8d99-48d4-a62a-e86376de6a80" Jun 02 21:42:07.336667 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:07.336572 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk9h6" podUID="e1d6b94e-7add-49da-bd1a-cc6b4f302261" Jun 02 21:42:08.337523 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:08.337485 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:42:08.337943 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:08.337634 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jr88" podUID="b9038487-6455-44d7-8c00-1323fb060fd9" Jun 02 21:42:09.337410 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:09.337207 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:42:09.337541 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:09.337516 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk9h6" podUID="e1d6b94e-7add-49da-bd1a-cc6b4f302261" Jun 02 21:42:09.338169 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:09.337658 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:42:09.338169 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:09.337732 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db2qf" podUID="fd65e214-8d99-48d4-a62a-e86376de6a80" Jun 02 21:42:09.406143 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:09.406043 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xzspb" event={"ID":"1111ee31-ecfc-4c23-9f47-f29df074bb53","Type":"ContainerStarted","Data":"180131a8c19ea156b6dd867b849ed7e4a3e02333b572f80e4ffe5724bb102b2f"} Jun 02 21:42:09.410400 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:09.410372 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" event={"ID":"94556912-e14c-4114-9af1-b0c7be76b545","Type":"ContainerStarted","Data":"49975fb2893f68f3ae0e6d7aa190b5bb972d47600318cacaa17687e128c750da"} Jun 02 21:42:09.414180 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:09.414017 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4jt68" event={"ID":"ab949e00-2922-4650-bb9e-71830cb21bf8","Type":"ContainerStarted","Data":"1c14527ec9afe249e201d5eeaead9880544ceb9d958230790980740d2137414b"} Jun 02 21:42:09.427925 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:09.427887 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xzspb" podStartSLOduration=3.228722906 podStartE2EDuration="21.427873733s" podCreationTimestamp="2026-06-02 21:41:48 +0000 UTC" firstStartedPulling="2026-06-02 21:41:50.968576882 +0000 UTC m=+3.137530572" lastFinishedPulling="2026-06-02 21:42:09.167727707 +0000 UTC m=+21.336681399" observedRunningTime="2026-06-02 21:42:09.427558474 +0000 UTC m=+21.596512186" watchObservedRunningTime="2026-06-02 21:42:09.427873733 +0000 UTC m=+21.596827467" Jun 02 21:42:09.786165 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:09.785951 2553 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4jt68" Jun 02 21:42:09.786445 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:09.786429 2553 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4jt68" Jun 02 21:42:09.801275 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:09.801240 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4jt68" podStartSLOduration=8.411926342 podStartE2EDuration="21.801228033s" podCreationTimestamp="2026-06-02 21:41:48 +0000 UTC" firstStartedPulling="2026-06-02 21:41:50.963460815 +0000 UTC m=+3.132414519" lastFinishedPulling="2026-06-02 21:42:04.352762509 +0000 UTC m=+16.521716210" observedRunningTime="2026-06-02 21:42:09.455602942 +0000 UTC m=+21.624556653" watchObservedRunningTime="2026-06-02 21:42:09.801228033 +0000 UTC m=+21.970181745" Jun 02 21:42:10.338644 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:10.338590 2553 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 21:42:10.339874 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:10.339856 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:42:10.339967 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:10.339949 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jr88" podUID="b9038487-6455-44d7-8c00-1323fb060fd9" Jun 02 21:42:10.417732 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:10.417710 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/ovn-acl-logging/0.log" Jun 02 21:42:10.418023 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:10.418000 2553 generic.go:358] "Generic (PLEG): container finished" podID="f861eb36-c26d-4d0e-9b5e-64543a169fb2" containerID="fac40c9d80120f35de8d3bf9c56513152697a0d40081ce40d35b29d89d58411e" exitCode=1 Jun 02 21:42:10.418094 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:10.418064 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" event={"ID":"f861eb36-c26d-4d0e-9b5e-64543a169fb2","Type":"ContainerStarted","Data":"4e8823d51ea9eda89f422670f31ea84f1eb043fed8ac5142efd2aaacd778e6df"} Jun 02 21:42:10.418094 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:10.418091 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" event={"ID":"f861eb36-c26d-4d0e-9b5e-64543a169fb2","Type":"ContainerStarted","Data":"9616d750243860e818d74685c497f784393b7ab6686593652c9b5d9f8dddfee8"} Jun 02 21:42:10.418181 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:10.418105 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" event={"ID":"f861eb36-c26d-4d0e-9b5e-64543a169fb2","Type":"ContainerStarted","Data":"44645f034b0f43752058d012cd2e39f3b2ff2e949cf7306d9ffbc6e72bab2496"} Jun 02 21:42:10.418181 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:10.418119 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" event={"ID":"f861eb36-c26d-4d0e-9b5e-64543a169fb2","Type":"ContainerStarted","Data":"80a1519de0296e838d29e273687d13597b2e72972b7f97e2b17dc63537eac1bf"} Jun 02 21:42:10.418181 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:10.418131 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" event={"ID":"f861eb36-c26d-4d0e-9b5e-64543a169fb2","Type":"ContainerDied","Data":"fac40c9d80120f35de8d3bf9c56513152697a0d40081ce40d35b29d89d58411e"} Jun 02 21:42:10.418181 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:10.418143 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" event={"ID":"f861eb36-c26d-4d0e-9b5e-64543a169fb2","Type":"ContainerStarted","Data":"21bcd24f323a2e1363d1301b8be1efef79e29f25a7a67f5d44f45ca125c7f990"} Jun 02 21:42:10.419309 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:10.419290 2553 generic.go:358] "Generic (PLEG): container finished" podID="f5f436e1-413c-4e03-8555-fd576d4a697d" containerID="e222b003228555c423d7b75cdb0fa3db6f3b2c6e180f708ae33534425a699baa" exitCode=0 Jun 02 21:42:10.419402 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:10.419358 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q52sb" event={"ID":"f5f436e1-413c-4e03-8555-fd576d4a697d","Type":"ContainerDied","Data":"e222b003228555c423d7b75cdb0fa3db6f3b2c6e180f708ae33534425a699baa"} Jun 02 21:42:10.420747 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:10.420725 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jz744" event={"ID":"896e8971-2598-4454-9661-2b3329ccc4f1","Type":"ContainerStarted","Data":"2464fb07a8b1da9dbaf551940586688939f1ed3425357a22c0ef49550bac4f74"} Jun 02 21:42:10.422030 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:10.421998 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7wp2q" event={"ID":"c23fe6dd-65fe-43e4-b687-5ddc4cef6c1a","Type":"ContainerStarted","Data":"bc0596aa932ddb8422ba14c30e44eb1a929934bae23185942224e6bd56ea9473"} Jun 02 21:42:10.423489 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:10.423469 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" event={"ID":"94556912-e14c-4114-9af1-b0c7be76b545","Type":"ContainerStarted","Data":"b69e4256f48ddb58745955f2277716934288758ee3719f63c9c9f3e5209bcdeb"} Jun 02 21:42:10.424783 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:10.424664 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-824lv" event={"ID":"83f2febb-89fb-452c-833e-facb9d8bb557","Type":"ContainerStarted","Data":"b244dd05d29884466e96de2da51e1f736bd1231962251b330fa5b747ad34d81f"} Jun 02 21:42:10.425196 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:10.425173 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4jt68" Jun 02 21:42:10.425409 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:10.425337 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4jt68" Jun 02 21:42:10.476000 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:10.475957 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-824lv" podStartSLOduration=4.273507842 podStartE2EDuration="22.475946103s" podCreationTimestamp="2026-06-02 21:41:48 +0000 UTC" firstStartedPulling="2026-06-02 21:41:50.964144842 +0000 UTC m=+3.133098545" lastFinishedPulling="2026-06-02 21:42:09.166583116 +0000 UTC m=+21.335536806" observedRunningTime="2026-06-02 21:42:10.475934006 +0000 UTC m=+22.644887715" watchObservedRunningTime="2026-06-02 21:42:10.475946103 +0000 UTC m=+22.644899814" Jun 02 21:42:10.490668 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:10.490633 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7wp2q" podStartSLOduration=4.2924453830000004 podStartE2EDuration="22.490608898s" podCreationTimestamp="2026-06-02 21:41:48 +0000 UTC" firstStartedPulling="2026-06-02 21:41:50.967898095 +0000 UTC m=+3.136851790" lastFinishedPulling="2026-06-02 21:42:09.166061613 +0000 UTC m=+21.335015305" observedRunningTime="2026-06-02 21:42:10.490226482 +0000 UTC m=+22.659180194" watchObservedRunningTime="2026-06-02 21:42:10.490608898 +0000 UTC m=+22.659562609" Jun 02 21:42:10.507761 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:10.507728 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-jz744" podStartSLOduration=4.29164342 podStartE2EDuration="22.507719811s" podCreationTimestamp="2026-06-02 21:41:48 +0000 UTC" firstStartedPulling="2026-06-02 21:41:50.971199085 +0000 UTC m=+3.140152779" lastFinishedPulling="2026-06-02 21:42:09.187275471 +0000 UTC m=+21.356229170" observedRunningTime="2026-06-02 21:42:10.507372574 +0000 UTC m=+22.676326286" watchObservedRunningTime="2026-06-02 21:42:10.507719811 +0000 UTC m=+22.676673522" Jun 02 21:42:11.331473 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:11.331252 2553 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T21:42:10.338614062Z","UUID":"2698678e-74b7-4ead-9d01-0400f1bf2639","Handler":null,"Name":"","Endpoint":""} Jun 02 21:42:11.334050 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:11.334032 2553 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 21:42:11.334050 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:11.334059 2553 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 21:42:11.336389 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:11.336370 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:42:11.336460 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:11.336370 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:42:11.336511 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:11.336459 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk9h6" podUID="e1d6b94e-7add-49da-bd1a-cc6b4f302261" Jun 02 21:42:11.336549 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:11.336517 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db2qf" podUID="fd65e214-8d99-48d4-a62a-e86376de6a80" Jun 02 21:42:11.427563 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:11.427525 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s48gg" event={"ID":"1bb1fdcd-7ba6-48e4-8421-d364035b2c78","Type":"ContainerStarted","Data":"2cf2d37742e2bb3d93e261ba2f2c7b1d3572a1c53dc2f58aa04c47bc6fad4dba"} Jun 02 21:42:11.429568 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:11.429521 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" event={"ID":"94556912-e14c-4114-9af1-b0c7be76b545","Type":"ContainerStarted","Data":"94ad2f24c2eae5e741cdf84d84df232d4bd9ab54fee74b56af9a48684cf8df98"} Jun 02 21:42:11.445755 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:11.443777 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s48gg" podStartSLOduration=5.247881813 podStartE2EDuration="23.443761405s" podCreationTimestamp="2026-06-02 21:41:48 +0000 UTC" firstStartedPulling="2026-06-02 21:41:50.970322111 +0000 UTC m=+3.139275807" lastFinishedPulling="2026-06-02 21:42:09.166201694 +0000 UTC m=+21.335155399" observedRunningTime="2026-06-02 21:42:11.443670101 +0000 UTC m=+23.612623813" watchObservedRunningTime="2026-06-02 21:42:11.443761405 +0000 UTC m=+23.612715119" Jun 02 21:42:11.459648 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:11.459559 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-67qj5" podStartSLOduration=3.223315737 podStartE2EDuration="23.45954621s" podCreationTimestamp="2026-06-02 21:41:48 +0000 UTC" firstStartedPulling="2026-06-02 21:41:50.969728841 +0000 UTC m=+3.138682538" lastFinishedPulling="2026-06-02 21:42:11.205959318 +0000 UTC m=+23.374913011" observedRunningTime="2026-06-02 21:42:11.459258978 +0000 UTC m=+23.628212711" watchObservedRunningTime="2026-06-02 21:42:11.45954621 +0000 UTC m=+23.628499922" Jun 02 21:42:12.033996 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:12.033963 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1d6b94e-7add-49da-bd1a-cc6b4f302261-original-pull-secret\") pod \"global-pull-secret-syncer-nk9h6\" (UID: \"e1d6b94e-7add-49da-bd1a-cc6b4f302261\") " pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:42:12.034142 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:12.034097 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 21:42:12.034182 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:12.034151 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d6b94e-7add-49da-bd1a-cc6b4f302261-original-pull-secret podName:e1d6b94e-7add-49da-bd1a-cc6b4f302261 nodeName:}" failed. No retries permitted until 2026-06-02 21:42:28.034136413 +0000 UTC m=+40.203090106 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1d6b94e-7add-49da-bd1a-cc6b4f302261-original-pull-secret") pod "global-pull-secret-syncer-nk9h6" (UID: "e1d6b94e-7add-49da-bd1a-cc6b4f302261") : object "kube-system"/"original-pull-secret" not registered Jun 02 21:42:12.337106 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:12.337070 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:42:12.337281 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:12.337217 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jr88" podUID="b9038487-6455-44d7-8c00-1323fb060fd9" Jun 02 21:42:12.433781 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:12.433756 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/ovn-acl-logging/0.log" Jun 02 21:42:12.434319 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:12.434073 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" event={"ID":"f861eb36-c26d-4d0e-9b5e-64543a169fb2","Type":"ContainerStarted","Data":"46cdeb6c4b85277120c4c71b196f576355041de26a9ca29bae3522507e24a89b"} Jun 02 21:42:13.336774 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:13.336745 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:42:13.336774 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:13.336745 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:42:13.336955 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:13.336834 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk9h6" podUID="e1d6b94e-7add-49da-bd1a-cc6b4f302261" Jun 02 21:42:13.336955 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:13.336936 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db2qf" podUID="fd65e214-8d99-48d4-a62a-e86376de6a80" Jun 02 21:42:14.336672 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:14.336433 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:42:14.337257 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:14.336789 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jr88" podUID="b9038487-6455-44d7-8c00-1323fb060fd9" Jun 02 21:42:14.440520 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:14.440492 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/ovn-acl-logging/0.log" Jun 02 21:42:14.440844 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:14.440822 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" event={"ID":"f861eb36-c26d-4d0e-9b5e-64543a169fb2","Type":"ContainerStarted","Data":"7b848454930e35118847cc10c1792b6ced113751ab3be115a42711312fc61caf"} Jun 02 21:42:14.441092 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:14.441067 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:42:14.441198 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:14.441106 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:42:14.441297 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:14.441279 2553 scope.go:117] "RemoveContainer" containerID="fac40c9d80120f35de8d3bf9c56513152697a0d40081ce40d35b29d89d58411e" Jun 02 21:42:14.457668 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:14.457649 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:42:15.336571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:15.336536 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:42:15.336795 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:15.336536 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:42:15.336795 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:15.336709 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db2qf" podUID="fd65e214-8d99-48d4-a62a-e86376de6a80" Jun 02 21:42:15.336795 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:15.336756 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk9h6" podUID="e1d6b94e-7add-49da-bd1a-cc6b4f302261" Jun 02 21:42:15.446869 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:15.446842 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/ovn-acl-logging/0.log" Jun 02 21:42:15.447242 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:15.447212 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" event={"ID":"f861eb36-c26d-4d0e-9b5e-64543a169fb2","Type":"ContainerStarted","Data":"b821fd5853be3b93bb83a8d75c60156e7c5809832cba78397087444f07ad2177"} Jun 02 21:42:15.447580 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:15.447554 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:42:15.464919 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:15.464892 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:42:15.474616 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:15.474571 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" podStartSLOduration=9.233129017 podStartE2EDuration="27.474557733s" podCreationTimestamp="2026-06-02 21:41:48 +0000 UTC" firstStartedPulling="2026-06-02 21:41:50.974069599 +0000 UTC m=+3.143023301" lastFinishedPulling="2026-06-02 21:42:09.215498316 +0000 UTC m=+21.384452017" observedRunningTime="2026-06-02 21:42:15.473055182 +0000 UTC m=+27.642008933" watchObservedRunningTime="2026-06-02 21:42:15.474557733 +0000 UTC m=+27.643511445" Jun 02 21:42:16.120605 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:16.120571 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-db2qf"] Jun 02 21:42:16.120768 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:16.120750 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:42:16.120889 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:16.120861 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db2qf" podUID="fd65e214-8d99-48d4-a62a-e86376de6a80" Jun 02 21:42:16.123432 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:16.123406 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4jr88"] Jun 02 21:42:16.123560 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:16.123532 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:42:16.123712 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:16.123688 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jr88" podUID="b9038487-6455-44d7-8c00-1323fb060fd9" Jun 02 21:42:16.124074 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:16.124051 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nk9h6"] Jun 02 21:42:16.124163 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:16.124133 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:42:16.124248 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:16.124224 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk9h6" podUID="e1d6b94e-7add-49da-bd1a-cc6b4f302261" Jun 02 21:42:17.336526 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:17.336504 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:42:17.336839 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:17.336594 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db2qf" podUID="fd65e214-8d99-48d4-a62a-e86376de6a80" Jun 02 21:42:17.452549 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:17.452402 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q52sb" event={"ID":"f5f436e1-413c-4e03-8555-fd576d4a697d","Type":"ContainerStarted","Data":"6f917f7f5d2d544eb0d5304947700ea92acaa0c34865e823dafc687064cb2aaa"} Jun 02 21:42:18.337556 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:18.337482 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:42:18.337939 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:18.337569 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jr88" podUID="b9038487-6455-44d7-8c00-1323fb060fd9" Jun 02 21:42:18.337939 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:18.337659 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:42:18.337939 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:18.337739 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk9h6" podUID="e1d6b94e-7add-49da-bd1a-cc6b4f302261" Jun 02 21:42:18.455293 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:18.455263 2553 generic.go:358] "Generic (PLEG): container finished" podID="f5f436e1-413c-4e03-8555-fd576d4a697d" containerID="6f917f7f5d2d544eb0d5304947700ea92acaa0c34865e823dafc687064cb2aaa" exitCode=0 Jun 02 21:42:18.455417 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:18.455315 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q52sb" event={"ID":"f5f436e1-413c-4e03-8555-fd576d4a697d","Type":"ContainerDied","Data":"6f917f7f5d2d544eb0d5304947700ea92acaa0c34865e823dafc687064cb2aaa"} Jun 02 21:42:19.336445 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:19.336419 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:42:19.336599 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:19.336517 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db2qf" podUID="fd65e214-8d99-48d4-a62a-e86376de6a80" Jun 02 21:42:20.337091 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:20.337063 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:42:20.337715 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:20.337074 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:42:20.337715 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:20.337168 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jr88" podUID="b9038487-6455-44d7-8c00-1323fb060fd9" Jun 02 21:42:20.337715 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:20.337272 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk9h6" podUID="e1d6b94e-7add-49da-bd1a-cc6b4f302261" Jun 02 21:42:20.460186 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:20.460155 2553 generic.go:358] "Generic (PLEG): container finished" podID="f5f436e1-413c-4e03-8555-fd576d4a697d" containerID="98200f2caa4a122b62cc39c47e63b8f59fa81fc08902fb5fbc6aa2368f881ccc" exitCode=0 Jun 02 21:42:20.460342 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:20.460208 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q52sb" event={"ID":"f5f436e1-413c-4e03-8555-fd576d4a697d","Type":"ContainerDied","Data":"98200f2caa4a122b62cc39c47e63b8f59fa81fc08902fb5fbc6aa2368f881ccc"} Jun 02 21:42:21.336940 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:21.336914 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:42:21.337157 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:21.337004 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db2qf" podUID="fd65e214-8d99-48d4-a62a-e86376de6a80" Jun 02 21:42:22.113935 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.113864 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fc6zn\" (UniqueName: \"kubernetes.io/projected/fd65e214-8d99-48d4-a62a-e86376de6a80-kube-api-access-fc6zn\") pod \"network-check-target-db2qf\" (UID: \"fd65e214-8d99-48d4-a62a-e86376de6a80\") " pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:42:22.113935 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.113909 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs\") pod \"network-metrics-daemon-4jr88\" (UID: \"b9038487-6455-44d7-8c00-1323fb060fd9\") " pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:42:22.114103 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:22.114009 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:42:22.114103 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:22.114030 2553 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:42:22.114103 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:22.114040 2553 projected.go:194] Error preparing data for projected volume kube-api-access-fc6zn for pod openshift-network-diagnostics/network-check-target-db2qf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:42:22.114103 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:22.114081 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd65e214-8d99-48d4-a62a-e86376de6a80-kube-api-access-fc6zn podName:fd65e214-8d99-48d4-a62a-e86376de6a80 nodeName:}" failed. No retries permitted until 2026-06-02 21:42:54.114067349 +0000 UTC m=+66.283021045 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fc6zn" (UniqueName: "kubernetes.io/projected/fd65e214-8d99-48d4-a62a-e86376de6a80-kube-api-access-fc6zn") pod "network-check-target-db2qf" (UID: "fd65e214-8d99-48d4-a62a-e86376de6a80") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:42:22.114103 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:22.114016 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:42:22.114259 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:22.114131 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs podName:b9038487-6455-44d7-8c00-1323fb060fd9 nodeName:}" failed. No retries permitted until 2026-06-02 21:42:54.114119117 +0000 UTC m=+66.283072807 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs") pod "network-metrics-daemon-4jr88" (UID: "b9038487-6455-44d7-8c00-1323fb060fd9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:42:22.143062 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.143033 2553 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeReady" Jun 02 21:42:22.143183 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.143128 2553 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 21:42:22.202372 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.202339 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4dmwr"] Jun 02 21:42:22.222295 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.222271 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zwfwz"] Jun 02 21:42:22.222448 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.222336 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4dmwr" Jun 02 21:42:22.224801 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.224779 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ssb95\"" Jun 02 21:42:22.224801 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.224791 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 21:42:22.224985 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.224799 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 21:42:22.238218 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.238197 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4dmwr"] Jun 02 21:42:22.238218 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.238218 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zwfwz"] Jun 02 21:42:22.238345 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.238299 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zwfwz" Jun 02 21:42:22.240585 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.240567 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 21:42:22.240585 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.240575 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 21:42:22.240763 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.240748 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 21:42:22.240763 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.240756 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f7jrx\"" Jun 02 21:42:22.314737 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.314715 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9xml\" (UniqueName: \"kubernetes.io/projected/97b5c1c0-5909-433f-85cd-3515fd144fbd-kube-api-access-t9xml\") pod \"dns-default-4dmwr\" (UID: \"97b5c1c0-5909-433f-85cd-3515fd144fbd\") " pod="openshift-dns/dns-default-4dmwr" Jun 02 21:42:22.314850 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.314748 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert\") pod \"ingress-canary-zwfwz\" (UID: \"443958d9-a8c2-4481-98e0-b45e59abaadd\") " pod="openshift-ingress-canary/ingress-canary-zwfwz" Jun 02 21:42:22.314850 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.314777 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/97b5c1c0-5909-433f-85cd-3515fd144fbd-config-volume\") pod \"dns-default-4dmwr\" (UID: \"97b5c1c0-5909-433f-85cd-3515fd144fbd\") " pod="openshift-dns/dns-default-4dmwr" Jun 02 21:42:22.314850 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.314802 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97b5c1c0-5909-433f-85cd-3515fd144fbd-tmp-dir\") pod \"dns-default-4dmwr\" (UID: \"97b5c1c0-5909-433f-85cd-3515fd144fbd\") " pod="openshift-dns/dns-default-4dmwr" Jun 02 21:42:22.314966 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.314848 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsfxj\" (UniqueName: \"kubernetes.io/projected/443958d9-a8c2-4481-98e0-b45e59abaadd-kube-api-access-jsfxj\") pod \"ingress-canary-zwfwz\" (UID: \"443958d9-a8c2-4481-98e0-b45e59abaadd\") " pod="openshift-ingress-canary/ingress-canary-zwfwz" Jun 02 21:42:22.314966 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.314885 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls\") pod \"dns-default-4dmwr\" (UID: \"97b5c1c0-5909-433f-85cd-3515fd144fbd\") " pod="openshift-dns/dns-default-4dmwr" Jun 02 21:42:22.336763 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.336742 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:42:22.336828 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.336761 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:42:22.339298 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.339277 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 21:42:22.339615 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.339317 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-96ccb\"" Jun 02 21:42:22.339615 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.339383 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 21:42:22.415376 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.415323 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t9xml\" (UniqueName: \"kubernetes.io/projected/97b5c1c0-5909-433f-85cd-3515fd144fbd-kube-api-access-t9xml\") pod \"dns-default-4dmwr\" (UID: \"97b5c1c0-5909-433f-85cd-3515fd144fbd\") " pod="openshift-dns/dns-default-4dmwr" Jun 02 21:42:22.415376 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.415356 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert\") pod \"ingress-canary-zwfwz\" (UID: \"443958d9-a8c2-4481-98e0-b45e59abaadd\") " pod="openshift-ingress-canary/ingress-canary-zwfwz" Jun 02 21:42:22.415541 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.415377 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/97b5c1c0-5909-433f-85cd-3515fd144fbd-config-volume\") pod \"dns-default-4dmwr\" (UID: \"97b5c1c0-5909-433f-85cd-3515fd144fbd\") " pod="openshift-dns/dns-default-4dmwr" Jun 02 21:42:22.415541 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.415398 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97b5c1c0-5909-433f-85cd-3515fd144fbd-tmp-dir\") pod \"dns-default-4dmwr\" (UID: \"97b5c1c0-5909-433f-85cd-3515fd144fbd\") " pod="openshift-dns/dns-default-4dmwr" Jun 02 21:42:22.415541 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.415468 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jsfxj\" (UniqueName: \"kubernetes.io/projected/443958d9-a8c2-4481-98e0-b45e59abaadd-kube-api-access-jsfxj\") pod \"ingress-canary-zwfwz\" (UID: \"443958d9-a8c2-4481-98e0-b45e59abaadd\") " pod="openshift-ingress-canary/ingress-canary-zwfwz" Jun 02 21:42:22.415541 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:22.415473 2553 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 21:42:22.415541 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.415496 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls\") pod \"dns-default-4dmwr\" (UID: \"97b5c1c0-5909-433f-85cd-3515fd144fbd\") " pod="openshift-dns/dns-default-4dmwr" Jun 02 21:42:22.415541 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:22.415530 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert podName:443958d9-a8c2-4481-98e0-b45e59abaadd nodeName:}" failed. No retries permitted until 2026-06-02 21:42:22.915511939 +0000 UTC m=+35.084465641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert") pod "ingress-canary-zwfwz" (UID: "443958d9-a8c2-4481-98e0-b45e59abaadd") : secret "canary-serving-cert" not found Jun 02 21:42:22.415939 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:22.415571 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 21:42:22.415939 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:22.415643 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls podName:97b5c1c0-5909-433f-85cd-3515fd144fbd nodeName:}" failed. No retries permitted until 2026-06-02 21:42:22.91561439 +0000 UTC m=+35.084568091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls") pod "dns-default-4dmwr" (UID: "97b5c1c0-5909-433f-85cd-3515fd144fbd") : secret "dns-default-metrics-tls" not found Jun 02 21:42:22.415939 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.415810 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97b5c1c0-5909-433f-85cd-3515fd144fbd-tmp-dir\") pod \"dns-default-4dmwr\" (UID: \"97b5c1c0-5909-433f-85cd-3515fd144fbd\") " pod="openshift-dns/dns-default-4dmwr" Jun 02 21:42:22.416091 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.416075 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/97b5c1c0-5909-433f-85cd-3515fd144fbd-config-volume\") pod \"dns-default-4dmwr\" (UID: \"97b5c1c0-5909-433f-85cd-3515fd144fbd\") " pod="openshift-dns/dns-default-4dmwr" Jun 02 21:42:22.428554 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.428529 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9xml\" (UniqueName: \"kubernetes.io/projected/97b5c1c0-5909-433f-85cd-3515fd144fbd-kube-api-access-t9xml\") pod \"dns-default-4dmwr\" (UID: \"97b5c1c0-5909-433f-85cd-3515fd144fbd\") " pod="openshift-dns/dns-default-4dmwr" Jun 02 21:42:22.428673 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.428560 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsfxj\" (UniqueName: \"kubernetes.io/projected/443958d9-a8c2-4481-98e0-b45e59abaadd-kube-api-access-jsfxj\") pod \"ingress-canary-zwfwz\" (UID: \"443958d9-a8c2-4481-98e0-b45e59abaadd\") " pod="openshift-ingress-canary/ingress-canary-zwfwz" Jun 02 21:42:22.465868 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.465839 2553 generic.go:358] "Generic (PLEG): container finished" podID="f5f436e1-413c-4e03-8555-fd576d4a697d" containerID="15800e8698e2ac1b2209499a2fc3cf82c87c00735f69ee31f86fb794b5e38308" exitCode=0 Jun 02 21:42:22.465962 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.465897 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q52sb" event={"ID":"f5f436e1-413c-4e03-8555-fd576d4a697d","Type":"ContainerDied","Data":"15800e8698e2ac1b2209499a2fc3cf82c87c00735f69ee31f86fb794b5e38308"} Jun 02 21:42:22.919490 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.919320 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls\") pod \"dns-default-4dmwr\" (UID: \"97b5c1c0-5909-433f-85cd-3515fd144fbd\") " pod="openshift-dns/dns-default-4dmwr" Jun 02 21:42:22.919675 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:22.919537 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert\") pod \"ingress-canary-zwfwz\" (UID: \"443958d9-a8c2-4481-98e0-b45e59abaadd\") " pod="openshift-ingress-canary/ingress-canary-zwfwz" Jun 02 21:42:22.919675 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:22.919467 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 21:42:22.919675 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:22.919606 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls podName:97b5c1c0-5909-433f-85cd-3515fd144fbd nodeName:}" failed. No retries permitted until 2026-06-02 21:42:23.919590041 +0000 UTC m=+36.088543735 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls") pod "dns-default-4dmwr" (UID: "97b5c1c0-5909-433f-85cd-3515fd144fbd") : secret "dns-default-metrics-tls" not found Jun 02 21:42:22.919675 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:22.919635 2553 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 21:42:22.919841 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:22.919686 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert podName:443958d9-a8c2-4481-98e0-b45e59abaadd nodeName:}" failed. No retries permitted until 2026-06-02 21:42:23.919674541 +0000 UTC m=+36.088628231 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert") pod "ingress-canary-zwfwz" (UID: "443958d9-a8c2-4481-98e0-b45e59abaadd") : secret "canary-serving-cert" not found Jun 02 21:42:23.336677 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:23.336588 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:42:23.339449 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:23.339425 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 21:42:23.340326 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:23.340306 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8cvg9\"" Jun 02 21:42:23.340326 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:23.340321 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 21:42:23.928758 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:23.928723 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls\") pod \"dns-default-4dmwr\" (UID: \"97b5c1c0-5909-433f-85cd-3515fd144fbd\") " pod="openshift-dns/dns-default-4dmwr" Jun 02 21:42:23.928950 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:23.928826 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert\") pod \"ingress-canary-zwfwz\" (UID: \"443958d9-a8c2-4481-98e0-b45e59abaadd\") " pod="openshift-ingress-canary/ingress-canary-zwfwz" Jun 02 21:42:23.928950 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:23.928889 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 21:42:23.928950 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:23.928930 2553 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 21:42:23.929086 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:23.928965 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls podName:97b5c1c0-5909-433f-85cd-3515fd144fbd nodeName:}" failed. No retries permitted until 2026-06-02 21:42:25.928950321 +0000 UTC m=+38.097904012 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls") pod "dns-default-4dmwr" (UID: "97b5c1c0-5909-433f-85cd-3515fd144fbd") : secret "dns-default-metrics-tls" not found Jun 02 21:42:23.929086 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:23.928980 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert podName:443958d9-a8c2-4481-98e0-b45e59abaadd nodeName:}" failed. No retries permitted until 2026-06-02 21:42:25.928973737 +0000 UTC m=+38.097927426 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert") pod "ingress-canary-zwfwz" (UID: "443958d9-a8c2-4481-98e0-b45e59abaadd") : secret "canary-serving-cert" not found Jun 02 21:42:25.943111 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:25.943071 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert\") pod \"ingress-canary-zwfwz\" (UID: \"443958d9-a8c2-4481-98e0-b45e59abaadd\") " pod="openshift-ingress-canary/ingress-canary-zwfwz" Jun 02 21:42:25.943560 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:25.943139 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls\") pod \"dns-default-4dmwr\" (UID: \"97b5c1c0-5909-433f-85cd-3515fd144fbd\") " pod="openshift-dns/dns-default-4dmwr" Jun 02 21:42:25.943560 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:25.943271 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 21:42:25.943560 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:25.943337 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls podName:97b5c1c0-5909-433f-85cd-3515fd144fbd nodeName:}" failed. No retries permitted until 2026-06-02 21:42:29.94331935 +0000 UTC m=+42.112273039 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls") pod "dns-default-4dmwr" (UID: "97b5c1c0-5909-433f-85cd-3515fd144fbd") : secret "dns-default-metrics-tls" not found Jun 02 21:42:25.945347 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:25.943948 2553 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 21:42:25.945347 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:25.944009 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert podName:443958d9-a8c2-4481-98e0-b45e59abaadd nodeName:}" failed. No retries permitted until 2026-06-02 21:42:29.943987311 +0000 UTC m=+42.112941018 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert") pod "ingress-canary-zwfwz" (UID: "443958d9-a8c2-4481-98e0-b45e59abaadd") : secret "canary-serving-cert" not found Jun 02 21:42:28.058137 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:28.058101 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1d6b94e-7add-49da-bd1a-cc6b4f302261-original-pull-secret\") pod \"global-pull-secret-syncer-nk9h6\" (UID: \"e1d6b94e-7add-49da-bd1a-cc6b4f302261\") " pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:42:28.061569 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:28.061540 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1d6b94e-7add-49da-bd1a-cc6b4f302261-original-pull-secret\") pod \"global-pull-secret-syncer-nk9h6\" (UID: \"e1d6b94e-7add-49da-bd1a-cc6b4f302261\") " pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:42:28.349764 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:28.349687 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk9h6" Jun 02 21:42:29.359017 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:29.358984 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nk9h6"] Jun 02 21:42:29.362043 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:42:29.362007 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1d6b94e_7add_49da_bd1a_cc6b4f302261.slice/crio-ce98b16eecafb2606db482b64c286233dd073904f1c69a8135c8f24743d60767 WatchSource:0}: Error finding container ce98b16eecafb2606db482b64c286233dd073904f1c69a8135c8f24743d60767: Status 404 returned error can't find the container with id ce98b16eecafb2606db482b64c286233dd073904f1c69a8135c8f24743d60767 Jun 02 21:42:29.478805 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:29.478767 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nk9h6" event={"ID":"e1d6b94e-7add-49da-bd1a-cc6b4f302261","Type":"ContainerStarted","Data":"ce98b16eecafb2606db482b64c286233dd073904f1c69a8135c8f24743d60767"} Jun 02 21:42:29.481204 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:29.481177 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q52sb" event={"ID":"f5f436e1-413c-4e03-8555-fd576d4a697d","Type":"ContainerStarted","Data":"30a7dce64345944e8b7cd9e22810cbfd18f7d40abf5e88f3e15049ac5865bbc6"} Jun 02 21:42:29.972686 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:29.972638 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert\") pod \"ingress-canary-zwfwz\" (UID: \"443958d9-a8c2-4481-98e0-b45e59abaadd\") " pod="openshift-ingress-canary/ingress-canary-zwfwz" Jun 02 21:42:29.972870 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:29.972713 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls\") pod \"dns-default-4dmwr\" (UID: \"97b5c1c0-5909-433f-85cd-3515fd144fbd\") " pod="openshift-dns/dns-default-4dmwr" Jun 02 21:42:29.972870 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:29.972736 2553 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 21:42:29.972870 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:29.972806 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert podName:443958d9-a8c2-4481-98e0-b45e59abaadd nodeName:}" failed. No retries permitted until 2026-06-02 21:42:37.972786212 +0000 UTC m=+50.141739908 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert") pod "ingress-canary-zwfwz" (UID: "443958d9-a8c2-4481-98e0-b45e59abaadd") : secret "canary-serving-cert" not found Jun 02 21:42:29.973020 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:29.972873 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 21:42:29.973020 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:29.972922 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls podName:97b5c1c0-5909-433f-85cd-3515fd144fbd nodeName:}" failed. No retries permitted until 2026-06-02 21:42:37.972909937 +0000 UTC m=+50.141863628 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls") pod "dns-default-4dmwr" (UID: "97b5c1c0-5909-433f-85cd-3515fd144fbd") : secret "dns-default-metrics-tls" not found Jun 02 21:42:30.486653 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:30.486599 2553 generic.go:358] "Generic (PLEG): container finished" podID="f5f436e1-413c-4e03-8555-fd576d4a697d" containerID="30a7dce64345944e8b7cd9e22810cbfd18f7d40abf5e88f3e15049ac5865bbc6" exitCode=0 Jun 02 21:42:30.487154 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:30.486672 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q52sb" event={"ID":"f5f436e1-413c-4e03-8555-fd576d4a697d","Type":"ContainerDied","Data":"30a7dce64345944e8b7cd9e22810cbfd18f7d40abf5e88f3e15049ac5865bbc6"} Jun 02 21:42:31.492336 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:31.492288 2553 generic.go:358] "Generic (PLEG): container finished" podID="f5f436e1-413c-4e03-8555-fd576d4a697d" containerID="0dbe2e0a9e310be3952354ff91b9809fc4626a46f401849cf9dc80c971498cac" exitCode=0 Jun 02 21:42:31.492819 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:31.492363 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q52sb" event={"ID":"f5f436e1-413c-4e03-8555-fd576d4a697d","Type":"ContainerDied","Data":"0dbe2e0a9e310be3952354ff91b9809fc4626a46f401849cf9dc80c971498cac"} Jun 02 21:42:33.496971 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:33.496932 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nk9h6" event={"ID":"e1d6b94e-7add-49da-bd1a-cc6b4f302261","Type":"ContainerStarted","Data":"a1862c0e618787beaf3f2caf6ef8ead292544fd24591eb86456bb57eaed40dcc"} Jun 02 21:42:33.499592 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:33.499567 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q52sb" event={"ID":"f5f436e1-413c-4e03-8555-fd576d4a697d","Type":"ContainerStarted","Data":"7f9eef7c9acd300ecb28335642cfd6e53bab9b77e3320a5fb44e5bca99cae18f"} Jun 02 21:42:33.510756 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:33.510711 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nk9h6" podStartSLOduration=34.174574104 podStartE2EDuration="37.510698441s" podCreationTimestamp="2026-06-02 21:41:56 +0000 UTC" firstStartedPulling="2026-06-02 21:42:29.363785214 +0000 UTC m=+41.532738904" lastFinishedPulling="2026-06-02 21:42:32.699909547 +0000 UTC m=+44.868863241" observedRunningTime="2026-06-02 21:42:33.510349866 +0000 UTC m=+45.679303578" watchObservedRunningTime="2026-06-02 21:42:33.510698441 +0000 UTC m=+45.679652146" Jun 02 21:42:33.530432 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:33.530394 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-q52sb" podStartSLOduration=7.133981856 podStartE2EDuration="45.530383753s" podCreationTimestamp="2026-06-02 21:41:48 +0000 UTC" firstStartedPulling="2026-06-02 21:41:50.972638646 +0000 UTC m=+3.141592341" lastFinishedPulling="2026-06-02 21:42:29.369040548 +0000 UTC m=+41.537994238" observedRunningTime="2026-06-02 21:42:33.529024746 +0000 UTC m=+45.697978460" watchObservedRunningTime="2026-06-02 21:42:33.530383753 +0000 UTC m=+45.699337464" Jun 02 21:42:35.221562 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.221524 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b5f46db-lhsjl"] Jun 02 21:42:35.223354 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.223338 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b5f46db-lhsjl" Jun 02 21:42:35.226993 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.226973 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-29wrr\"" Jun 02 21:42:35.227123 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.227046 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 02 21:42:35.227123 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.227065 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 02 21:42:35.227123 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.227071 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 02 21:42:35.227123 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.227047 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 02 21:42:35.233774 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.233755 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b5f46db-lhsjl"] Jun 02 21:42:35.237147 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.237126 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb44b94d8-4m9bs"] Jun 02 21:42:35.238719 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.238701 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb44b94d8-4m9bs" Jun 02 21:42:35.240830 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.240813 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 02 21:42:35.249039 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.249019 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb44b94d8-4m9bs"] Jun 02 21:42:35.409584 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.409555 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a2fb76c0-f4d5-4744-b0c7-9d41bf5bfe3c-klusterlet-config\") pod \"klusterlet-addon-workmgr-fb44b94d8-4m9bs\" (UID: \"a2fb76c0-f4d5-4744-b0c7-9d41bf5bfe3c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb44b94d8-4m9bs" Jun 02 21:42:35.409746 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.409598 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l46tn\" (UniqueName: \"kubernetes.io/projected/012acc63-6a53-4d70-add1-ccf8c2137154-kube-api-access-l46tn\") pod \"managed-serviceaccount-addon-agent-796b5f46db-lhsjl\" (UID: \"012acc63-6a53-4d70-add1-ccf8c2137154\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b5f46db-lhsjl" Jun 02 21:42:35.409746 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.409706 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mmsp\" (UniqueName: \"kubernetes.io/projected/a2fb76c0-f4d5-4744-b0c7-9d41bf5bfe3c-kube-api-access-4mmsp\") pod \"klusterlet-addon-workmgr-fb44b94d8-4m9bs\" (UID: \"a2fb76c0-f4d5-4744-b0c7-9d41bf5bfe3c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb44b94d8-4m9bs" Jun 02 21:42:35.409862 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.409745 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2fb76c0-f4d5-4744-b0c7-9d41bf5bfe3c-tmp\") pod \"klusterlet-addon-workmgr-fb44b94d8-4m9bs\" (UID: \"a2fb76c0-f4d5-4744-b0c7-9d41bf5bfe3c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb44b94d8-4m9bs" Jun 02 21:42:35.409862 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.409792 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/012acc63-6a53-4d70-add1-ccf8c2137154-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-796b5f46db-lhsjl\" (UID: \"012acc63-6a53-4d70-add1-ccf8c2137154\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b5f46db-lhsjl" Jun 02 21:42:35.511085 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.511015 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2fb76c0-f4d5-4744-b0c7-9d41bf5bfe3c-tmp\") pod \"klusterlet-addon-workmgr-fb44b94d8-4m9bs\" (UID: \"a2fb76c0-f4d5-4744-b0c7-9d41bf5bfe3c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb44b94d8-4m9bs" Jun 02 21:42:35.511085 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.511059 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/012acc63-6a53-4d70-add1-ccf8c2137154-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-796b5f46db-lhsjl\" (UID: \"012acc63-6a53-4d70-add1-ccf8c2137154\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b5f46db-lhsjl" Jun 02 21:42:35.511284 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.511094 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a2fb76c0-f4d5-4744-b0c7-9d41bf5bfe3c-klusterlet-config\") pod \"klusterlet-addon-workmgr-fb44b94d8-4m9bs\" (UID: \"a2fb76c0-f4d5-4744-b0c7-9d41bf5bfe3c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb44b94d8-4m9bs" Jun 02 21:42:35.511284 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.511113 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l46tn\" (UniqueName: \"kubernetes.io/projected/012acc63-6a53-4d70-add1-ccf8c2137154-kube-api-access-l46tn\") pod \"managed-serviceaccount-addon-agent-796b5f46db-lhsjl\" (UID: \"012acc63-6a53-4d70-add1-ccf8c2137154\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b5f46db-lhsjl" Jun 02 21:42:35.511284 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.511151 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4mmsp\" (UniqueName: \"kubernetes.io/projected/a2fb76c0-f4d5-4744-b0c7-9d41bf5bfe3c-kube-api-access-4mmsp\") pod \"klusterlet-addon-workmgr-fb44b94d8-4m9bs\" (UID: \"a2fb76c0-f4d5-4744-b0c7-9d41bf5bfe3c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb44b94d8-4m9bs" Jun 02 21:42:35.511468 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.511447 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2fb76c0-f4d5-4744-b0c7-9d41bf5bfe3c-tmp\") pod \"klusterlet-addon-workmgr-fb44b94d8-4m9bs\" (UID: \"a2fb76c0-f4d5-4744-b0c7-9d41bf5bfe3c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb44b94d8-4m9bs" Jun 02 21:42:35.513454 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.513437 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/012acc63-6a53-4d70-add1-ccf8c2137154-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-796b5f46db-lhsjl\" (UID: \"012acc63-6a53-4d70-add1-ccf8c2137154\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b5f46db-lhsjl" Jun 02 21:42:35.513603 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.513585 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a2fb76c0-f4d5-4744-b0c7-9d41bf5bfe3c-klusterlet-config\") pod \"klusterlet-addon-workmgr-fb44b94d8-4m9bs\" (UID: \"a2fb76c0-f4d5-4744-b0c7-9d41bf5bfe3c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb44b94d8-4m9bs" Jun 02 21:42:35.519560 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.519535 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mmsp\" (UniqueName: \"kubernetes.io/projected/a2fb76c0-f4d5-4744-b0c7-9d41bf5bfe3c-kube-api-access-4mmsp\") pod \"klusterlet-addon-workmgr-fb44b94d8-4m9bs\" (UID: \"a2fb76c0-f4d5-4744-b0c7-9d41bf5bfe3c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb44b94d8-4m9bs" Jun 02 21:42:35.519758 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.519734 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l46tn\" (UniqueName: \"kubernetes.io/projected/012acc63-6a53-4d70-add1-ccf8c2137154-kube-api-access-l46tn\") pod \"managed-serviceaccount-addon-agent-796b5f46db-lhsjl\" (UID: \"012acc63-6a53-4d70-add1-ccf8c2137154\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b5f46db-lhsjl" Jun 02 21:42:35.542442 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.542424 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b5f46db-lhsjl" Jun 02 21:42:35.550214 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.550189 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb44b94d8-4m9bs" Jun 02 21:42:35.686534 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.686500 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb44b94d8-4m9bs"] Jun 02 21:42:35.690944 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:42:35.690916 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2fb76c0_f4d5_4744_b0c7_9d41bf5bfe3c.slice/crio-d193fd43d717fe383b97777967dba6a72e9d3a03fd7db230fae8a35e574338d2 WatchSource:0}: Error finding container d193fd43d717fe383b97777967dba6a72e9d3a03fd7db230fae8a35e574338d2: Status 404 returned error can't find the container with id d193fd43d717fe383b97777967dba6a72e9d3a03fd7db230fae8a35e574338d2 Jun 02 21:42:35.701279 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:35.701256 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b5f46db-lhsjl"] Jun 02 21:42:35.703994 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:42:35.703970 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod012acc63_6a53_4d70_add1_ccf8c2137154.slice/crio-ecf49cf838451b0de965e2850b58a742b88a4632fff997f19fd10b71a9c7ac3a WatchSource:0}: Error finding container ecf49cf838451b0de965e2850b58a742b88a4632fff997f19fd10b71a9c7ac3a: Status 404 returned error can't find the container with id ecf49cf838451b0de965e2850b58a742b88a4632fff997f19fd10b71a9c7ac3a Jun 02 21:42:36.505820 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:36.505782 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb44b94d8-4m9bs" event={"ID":"a2fb76c0-f4d5-4744-b0c7-9d41bf5bfe3c","Type":"ContainerStarted","Data":"d193fd43d717fe383b97777967dba6a72e9d3a03fd7db230fae8a35e574338d2"} Jun 02 21:42:36.506715 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:36.506694 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b5f46db-lhsjl" event={"ID":"012acc63-6a53-4d70-add1-ccf8c2137154","Type":"ContainerStarted","Data":"ecf49cf838451b0de965e2850b58a742b88a4632fff997f19fd10b71a9c7ac3a"} Jun 02 21:42:38.033520 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:38.032740 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls\") pod \"dns-default-4dmwr\" (UID: \"97b5c1c0-5909-433f-85cd-3515fd144fbd\") " pod="openshift-dns/dns-default-4dmwr" Jun 02 21:42:38.033520 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:38.032847 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert\") pod \"ingress-canary-zwfwz\" (UID: \"443958d9-a8c2-4481-98e0-b45e59abaadd\") " pod="openshift-ingress-canary/ingress-canary-zwfwz" Jun 02 21:42:38.033520 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:38.032977 2553 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 21:42:38.033520 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:38.033037 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert podName:443958d9-a8c2-4481-98e0-b45e59abaadd nodeName:}" failed. No retries permitted until 2026-06-02 21:42:54.033017747 +0000 UTC m=+66.201971442 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert") pod "ingress-canary-zwfwz" (UID: "443958d9-a8c2-4481-98e0-b45e59abaadd") : secret "canary-serving-cert" not found Jun 02 21:42:38.033520 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:38.033434 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 21:42:38.033520 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:38.033482 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls podName:97b5c1c0-5909-433f-85cd-3515fd144fbd nodeName:}" failed. No retries permitted until 2026-06-02 21:42:54.033467987 +0000 UTC m=+66.202421683 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls") pod "dns-default-4dmwr" (UID: "97b5c1c0-5909-433f-85cd-3515fd144fbd") : secret "dns-default-metrics-tls" not found Jun 02 21:42:42.520076 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:42.520040 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb44b94d8-4m9bs" event={"ID":"a2fb76c0-f4d5-4744-b0c7-9d41bf5bfe3c","Type":"ContainerStarted","Data":"ad26be273b0e7766d82889ff3c8e5cf56d2e6c48282f0e88cbb929ec56211d2a"} Jun 02 21:42:42.520518 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:42.520253 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb44b94d8-4m9bs" Jun 02 21:42:42.521423 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:42.521396 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b5f46db-lhsjl" event={"ID":"012acc63-6a53-4d70-add1-ccf8c2137154","Type":"ContainerStarted","Data":"3d1c236aed643e0a77f3df9cee4934572b6050910348b6beb9611932a6700fe4"} Jun 02 21:42:42.522103 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:42.522085 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb44b94d8-4m9bs" Jun 02 21:42:42.535435 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:42.535391 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb44b94d8-4m9bs" podStartSLOduration=1.304743886 podStartE2EDuration="7.535379744s" podCreationTimestamp="2026-06-02 21:42:35 +0000 UTC" firstStartedPulling="2026-06-02 21:42:35.692815081 +0000 UTC m=+47.861768771" lastFinishedPulling="2026-06-02 21:42:41.923450927 +0000 UTC m=+54.092404629" observedRunningTime="2026-06-02 21:42:42.534544355 +0000 UTC m=+54.703498067" watchObservedRunningTime="2026-06-02 21:42:42.535379744 +0000 UTC m=+54.704333466" Jun 02 21:42:42.561030 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:42.560996 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b5f46db-lhsjl" podStartSLOduration=1.822041468 podStartE2EDuration="7.560985744s" podCreationTimestamp="2026-06-02 21:42:35 +0000 UTC" firstStartedPulling="2026-06-02 21:42:35.705566155 +0000 UTC m=+47.874519848" lastFinishedPulling="2026-06-02 21:42:41.444510429 +0000 UTC m=+53.613464124" observedRunningTime="2026-06-02 21:42:42.560573929 +0000 UTC m=+54.729527642" watchObservedRunningTime="2026-06-02 21:42:42.560985744 +0000 UTC m=+54.729939455" Jun 02 21:42:47.468428 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:47.468401 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s67gg" Jun 02 21:42:54.040546 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:54.040507 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls\") pod \"dns-default-4dmwr\" (UID: \"97b5c1c0-5909-433f-85cd-3515fd144fbd\") " pod="openshift-dns/dns-default-4dmwr" Jun 02 21:42:54.041008 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:54.040579 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert\") pod \"ingress-canary-zwfwz\" (UID: \"443958d9-a8c2-4481-98e0-b45e59abaadd\") " pod="openshift-ingress-canary/ingress-canary-zwfwz" Jun 02 21:42:54.041008 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:54.040674 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 21:42:54.041008 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:54.040755 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls podName:97b5c1c0-5909-433f-85cd-3515fd144fbd nodeName:}" failed. No retries permitted until 2026-06-02 21:43:26.040739706 +0000 UTC m=+98.209693395 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls") pod "dns-default-4dmwr" (UID: "97b5c1c0-5909-433f-85cd-3515fd144fbd") : secret "dns-default-metrics-tls" not found Jun 02 21:42:54.041008 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:54.040680 2553 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 21:42:54.041008 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:54.040826 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert podName:443958d9-a8c2-4481-98e0-b45e59abaadd nodeName:}" failed. No retries permitted until 2026-06-02 21:43:26.040815069 +0000 UTC m=+98.209768758 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert") pod "ingress-canary-zwfwz" (UID: "443958d9-a8c2-4481-98e0-b45e59abaadd") : secret "canary-serving-cert" not found Jun 02 21:42:54.140972 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:54.140943 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs\") pod \"network-metrics-daemon-4jr88\" (UID: \"b9038487-6455-44d7-8c00-1323fb060fd9\") " pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:42:54.141084 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:54.141005 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fc6zn\" (UniqueName: \"kubernetes.io/projected/fd65e214-8d99-48d4-a62a-e86376de6a80-kube-api-access-fc6zn\") pod \"network-check-target-db2qf\" (UID: \"fd65e214-8d99-48d4-a62a-e86376de6a80\") " pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:42:54.143256 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:54.143238 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 21:42:54.143475 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:54.143461 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 21:42:54.152253 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:54.152233 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 21:42:54.152306 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:42:54.152296 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs podName:b9038487-6455-44d7-8c00-1323fb060fd9 nodeName:}" failed. No retries permitted until 2026-06-02 21:43:58.152277511 +0000 UTC m=+130.321231219 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs") pod "network-metrics-daemon-4jr88" (UID: "b9038487-6455-44d7-8c00-1323fb060fd9") : secret "metrics-daemon-secret" not found Jun 02 21:42:54.154203 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:54.154190 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 21:42:54.164928 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:54.164910 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc6zn\" (UniqueName: \"kubernetes.io/projected/fd65e214-8d99-48d4-a62a-e86376de6a80-kube-api-access-fc6zn\") pod \"network-check-target-db2qf\" (UID: \"fd65e214-8d99-48d4-a62a-e86376de6a80\") " pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:42:54.249608 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:54.249585 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8cvg9\"" Jun 02 21:42:54.257483 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:54.257464 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:42:54.373040 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:54.373008 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-db2qf"] Jun 02 21:42:54.376197 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:42:54.376169 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd65e214_8d99_48d4_a62a_e86376de6a80.slice/crio-a695882de8a4591de260c694efd7a18724028656c8be4b9f4a5f38b9bda9b7e7 WatchSource:0}: Error finding container a695882de8a4591de260c694efd7a18724028656c8be4b9f4a5f38b9bda9b7e7: Status 404 returned error can't find the container with id a695882de8a4591de260c694efd7a18724028656c8be4b9f4a5f38b9bda9b7e7 Jun 02 21:42:54.542769 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:54.542737 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-db2qf" event={"ID":"fd65e214-8d99-48d4-a62a-e86376de6a80","Type":"ContainerStarted","Data":"a695882de8a4591de260c694efd7a18724028656c8be4b9f4a5f38b9bda9b7e7"} Jun 02 21:42:58.552407 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:58.552375 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-db2qf" event={"ID":"fd65e214-8d99-48d4-a62a-e86376de6a80","Type":"ContainerStarted","Data":"ed3a8a14d80279353551f1d616ca55e8924d118a8c9016414d42d89fdb9f60ac"} Jun 02 21:42:58.552786 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:58.552537 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:42:58.566328 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:42:58.566290 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-db2qf" podStartSLOduration=67.140759764 podStartE2EDuration="1m10.566278343s" podCreationTimestamp="2026-06-02 21:41:48 +0000 UTC" firstStartedPulling="2026-06-02 21:42:54.377939319 +0000 UTC m=+66.546893013" lastFinishedPulling="2026-06-02 21:42:57.803457902 +0000 UTC m=+69.972411592" observedRunningTime="2026-06-02 21:42:58.565915675 +0000 UTC m=+70.734869387" watchObservedRunningTime="2026-06-02 21:42:58.566278343 +0000 UTC m=+70.735232055" Jun 02 21:43:19.357277 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:19.357243 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6nr5v"] Jun 02 21:43:19.363056 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:19.363035 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6nr5v" Jun 02 21:43:19.368433 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:19.368413 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 02 21:43:19.368553 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:19.368499 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lg6bh\"" Jun 02 21:43:19.369359 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:19.369340 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 02 21:43:19.369450 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:19.369387 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 02 21:43:19.375053 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:19.375034 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6nr5v"] Jun 02 21:43:19.412210 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:19.412185 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26qxx\" (UniqueName: \"kubernetes.io/projected/c941739d-129a-47b9-bbe4-deb08200d79f-kube-api-access-26qxx\") pod \"cluster-samples-operator-755bbf9bfb-6nr5v\" (UID: \"c941739d-129a-47b9-bbe4-deb08200d79f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6nr5v" Jun 02 21:43:19.412326 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:19.412232 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c941739d-129a-47b9-bbe4-deb08200d79f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-6nr5v\" (UID: \"c941739d-129a-47b9-bbe4-deb08200d79f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6nr5v" Jun 02 21:43:19.512941 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:19.512918 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-26qxx\" (UniqueName: \"kubernetes.io/projected/c941739d-129a-47b9-bbe4-deb08200d79f-kube-api-access-26qxx\") pod \"cluster-samples-operator-755bbf9bfb-6nr5v\" (UID: \"c941739d-129a-47b9-bbe4-deb08200d79f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6nr5v" Jun 02 21:43:19.513035 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:19.512957 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c941739d-129a-47b9-bbe4-deb08200d79f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-6nr5v\" (UID: \"c941739d-129a-47b9-bbe4-deb08200d79f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6nr5v" Jun 02 21:43:19.513079 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:43:19.513056 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 21:43:19.513114 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:43:19.513110 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c941739d-129a-47b9-bbe4-deb08200d79f-samples-operator-tls podName:c941739d-129a-47b9-bbe4-deb08200d79f nodeName:}" failed. No retries permitted until 2026-06-02 21:43:20.013096338 +0000 UTC m=+92.182050028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c941739d-129a-47b9-bbe4-deb08200d79f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-6nr5v" (UID: "c941739d-129a-47b9-bbe4-deb08200d79f") : secret "samples-operator-tls" not found Jun 02 21:43:19.521708 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:19.521690 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26qxx\" (UniqueName: \"kubernetes.io/projected/c941739d-129a-47b9-bbe4-deb08200d79f-kube-api-access-26qxx\") pod \"cluster-samples-operator-755bbf9bfb-6nr5v\" (UID: \"c941739d-129a-47b9-bbe4-deb08200d79f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6nr5v" Jun 02 21:43:20.017640 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:20.017581 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c941739d-129a-47b9-bbe4-deb08200d79f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-6nr5v\" (UID: \"c941739d-129a-47b9-bbe4-deb08200d79f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6nr5v" Jun 02 21:43:20.017805 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:43:20.017731 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 21:43:20.017805 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:43:20.017804 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c941739d-129a-47b9-bbe4-deb08200d79f-samples-operator-tls podName:c941739d-129a-47b9-bbe4-deb08200d79f nodeName:}" failed. No retries permitted until 2026-06-02 21:43:21.017789373 +0000 UTC m=+93.186743069 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c941739d-129a-47b9-bbe4-deb08200d79f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-6nr5v" (UID: "c941739d-129a-47b9-bbe4-deb08200d79f") : secret "samples-operator-tls" not found Jun 02 21:43:21.023929 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:21.023881 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c941739d-129a-47b9-bbe4-deb08200d79f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-6nr5v\" (UID: \"c941739d-129a-47b9-bbe4-deb08200d79f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6nr5v" Jun 02 21:43:21.024311 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:43:21.024026 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 21:43:21.024311 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:43:21.024088 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c941739d-129a-47b9-bbe4-deb08200d79f-samples-operator-tls podName:c941739d-129a-47b9-bbe4-deb08200d79f nodeName:}" failed. No retries permitted until 2026-06-02 21:43:23.024073438 +0000 UTC m=+95.193027127 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c941739d-129a-47b9-bbe4-deb08200d79f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-6nr5v" (UID: "c941739d-129a-47b9-bbe4-deb08200d79f") : secret "samples-operator-tls" not found Jun 02 21:43:23.039898 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:23.039860 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c941739d-129a-47b9-bbe4-deb08200d79f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-6nr5v\" (UID: \"c941739d-129a-47b9-bbe4-deb08200d79f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6nr5v" Jun 02 21:43:23.040294 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:43:23.040003 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 21:43:23.040294 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:43:23.040067 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c941739d-129a-47b9-bbe4-deb08200d79f-samples-operator-tls podName:c941739d-129a-47b9-bbe4-deb08200d79f nodeName:}" failed. No retries permitted until 2026-06-02 21:43:27.04005285 +0000 UTC m=+99.209006545 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c941739d-129a-47b9-bbe4-deb08200d79f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-6nr5v" (UID: "c941739d-129a-47b9-bbe4-deb08200d79f") : secret "samples-operator-tls" not found Jun 02 21:43:23.742839 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:23.742813 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-824lv_83f2febb-89fb-452c-833e-facb9d8bb557/dns-node-resolver/0.log" Jun 02 21:43:24.743013 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:24.742990 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7wp2q_c23fe6dd-65fe-43e4-b687-5ddc4cef6c1a/node-ca/0.log" Jun 02 21:43:25.238275 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:25.238240 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xzl5j"] Jun 02 21:43:25.239945 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:25.239930 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xzl5j" Jun 02 21:43:25.242986 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:25.242962 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 02 21:43:25.243095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:25.243001 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 02 21:43:25.244153 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:25.244138 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 02 21:43:25.244223 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:25.244146 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-6hcn8\"" Jun 02 21:43:25.244223 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:25.244140 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 02 21:43:25.249998 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:25.249978 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xzl5j"] Jun 02 21:43:25.356376 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:25.356344 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/47ec9316-976d-4247-926f-713508dac5eb-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-xzl5j\" (UID: \"47ec9316-976d-4247-926f-713508dac5eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xzl5j" Jun 02 21:43:25.356534 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:25.356394 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/47ec9316-976d-4247-926f-713508dac5eb-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-xzl5j\" (UID: \"47ec9316-976d-4247-926f-713508dac5eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xzl5j" Jun 02 21:43:25.356534 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:25.356464 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvqb4\" (UniqueName: \"kubernetes.io/projected/47ec9316-976d-4247-926f-713508dac5eb-kube-api-access-xvqb4\") pod \"kube-storage-version-migrator-operator-96ddc787c-xzl5j\" (UID: \"47ec9316-976d-4247-926f-713508dac5eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xzl5j" Jun 02 21:43:25.457519 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:25.457492 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xvqb4\" (UniqueName: \"kubernetes.io/projected/47ec9316-976d-4247-926f-713508dac5eb-kube-api-access-xvqb4\") pod \"kube-storage-version-migrator-operator-96ddc787c-xzl5j\" (UID: \"47ec9316-976d-4247-926f-713508dac5eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xzl5j" Jun 02 21:43:25.457677 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:25.457525 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/47ec9316-976d-4247-926f-713508dac5eb-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-xzl5j\" (UID: \"47ec9316-976d-4247-926f-713508dac5eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xzl5j" Jun 02 21:43:25.457677 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:25.457564 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/47ec9316-976d-4247-926f-713508dac5eb-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-xzl5j\" (UID: \"47ec9316-976d-4247-926f-713508dac5eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xzl5j" Jun 02 21:43:25.458164 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:25.458141 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/47ec9316-976d-4247-926f-713508dac5eb-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-xzl5j\" (UID: \"47ec9316-976d-4247-926f-713508dac5eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xzl5j" Jun 02 21:43:25.459588 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:25.459568 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/47ec9316-976d-4247-926f-713508dac5eb-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-xzl5j\" (UID: \"47ec9316-976d-4247-926f-713508dac5eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xzl5j" Jun 02 21:43:25.465680 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:25.465660 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvqb4\" (UniqueName: \"kubernetes.io/projected/47ec9316-976d-4247-926f-713508dac5eb-kube-api-access-xvqb4\") pod \"kube-storage-version-migrator-operator-96ddc787c-xzl5j\" (UID: \"47ec9316-976d-4247-926f-713508dac5eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xzl5j" Jun 02 21:43:25.548792 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:25.548735 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xzl5j" Jun 02 21:43:25.667965 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:25.667934 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xzl5j"] Jun 02 21:43:25.671040 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:43:25.671009 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47ec9316_976d_4247_926f_713508dac5eb.slice/crio-e9bdd2d784e868eacc7ecb84a4885e8a87c4f32ea3fde26be1f3f811a1f556a8 WatchSource:0}: Error finding container e9bdd2d784e868eacc7ecb84a4885e8a87c4f32ea3fde26be1f3f811a1f556a8: Status 404 returned error can't find the container with id e9bdd2d784e868eacc7ecb84a4885e8a87c4f32ea3fde26be1f3f811a1f556a8 Jun 02 21:43:26.050595 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:26.050562 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-96vsd"] Jun 02 21:43:26.054091 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:26.054075 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-96vsd" Jun 02 21:43:26.057767 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:26.057748 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-shbms\"" Jun 02 21:43:26.062078 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:26.062058 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert\") pod \"ingress-canary-zwfwz\" (UID: \"443958d9-a8c2-4481-98e0-b45e59abaadd\") " pod="openshift-ingress-canary/ingress-canary-zwfwz" Jun 02 21:43:26.062177 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:26.062109 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls\") pod \"dns-default-4dmwr\" (UID: \"97b5c1c0-5909-433f-85cd-3515fd144fbd\") " pod="openshift-dns/dns-default-4dmwr" Jun 02 21:43:26.062240 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:43:26.062199 2553 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 21:43:26.062291 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:43:26.062241 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 21:43:26.062291 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:43:26.062265 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert podName:443958d9-a8c2-4481-98e0-b45e59abaadd nodeName:}" failed. No retries permitted until 2026-06-02 21:44:30.062246461 +0000 UTC m=+162.231200163 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert") pod "ingress-canary-zwfwz" (UID: "443958d9-a8c2-4481-98e0-b45e59abaadd") : secret "canary-serving-cert" not found Jun 02 21:43:26.062396 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:43:26.062298 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls podName:97b5c1c0-5909-433f-85cd-3515fd144fbd nodeName:}" failed. No retries permitted until 2026-06-02 21:44:30.062283298 +0000 UTC m=+162.231236990 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls") pod "dns-default-4dmwr" (UID: "97b5c1c0-5909-433f-85cd-3515fd144fbd") : secret "dns-default-metrics-tls" not found Jun 02 21:43:26.062687 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:26.062666 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-96vsd"] Jun 02 21:43:26.162753 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:26.162722 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kgjx\" (UniqueName: \"kubernetes.io/projected/815b8442-a3e5-4bd2-9dd4-1c3babdadda0-kube-api-access-9kgjx\") pod \"network-check-source-56d84b9f44-96vsd\" (UID: \"815b8442-a3e5-4bd2-9dd4-1c3babdadda0\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-96vsd" Jun 02 21:43:26.263516 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:26.263483 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9kgjx\" (UniqueName: \"kubernetes.io/projected/815b8442-a3e5-4bd2-9dd4-1c3babdadda0-kube-api-access-9kgjx\") pod \"network-check-source-56d84b9f44-96vsd\" (UID: \"815b8442-a3e5-4bd2-9dd4-1c3babdadda0\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-96vsd" Jun 02 21:43:26.273901 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:26.273878 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kgjx\" (UniqueName: \"kubernetes.io/projected/815b8442-a3e5-4bd2-9dd4-1c3babdadda0-kube-api-access-9kgjx\") pod \"network-check-source-56d84b9f44-96vsd\" (UID: \"815b8442-a3e5-4bd2-9dd4-1c3babdadda0\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-96vsd" Jun 02 21:43:26.362607 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:26.362535 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-96vsd" Jun 02 21:43:26.496653 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:26.496602 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-96vsd"] Jun 02 21:43:26.499939 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:43:26.499908 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod815b8442_a3e5_4bd2_9dd4_1c3babdadda0.slice/crio-a700783ed64a820b2ae06a67403bd80282517f09b7e9e64d2ac7cde05ac3f97e WatchSource:0}: Error finding container a700783ed64a820b2ae06a67403bd80282517f09b7e9e64d2ac7cde05ac3f97e: Status 404 returned error can't find the container with id a700783ed64a820b2ae06a67403bd80282517f09b7e9e64d2ac7cde05ac3f97e Jun 02 21:43:26.607801 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:26.607761 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-96vsd" event={"ID":"815b8442-a3e5-4bd2-9dd4-1c3babdadda0","Type":"ContainerStarted","Data":"3a81ff29bf9cf2b7001dfac84dcfd17eacac20e19033552cd06dfe2f75028c58"} Jun 02 21:43:26.607801 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:26.607802 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-96vsd" event={"ID":"815b8442-a3e5-4bd2-9dd4-1c3babdadda0","Type":"ContainerStarted","Data":"a700783ed64a820b2ae06a67403bd80282517f09b7e9e64d2ac7cde05ac3f97e"} Jun 02 21:43:26.609095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:26.609069 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xzl5j" event={"ID":"47ec9316-976d-4247-926f-713508dac5eb","Type":"ContainerStarted","Data":"e9bdd2d784e868eacc7ecb84a4885e8a87c4f32ea3fde26be1f3f811a1f556a8"} Jun 02 21:43:26.625118 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:26.624954 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-96vsd" podStartSLOduration=0.624936997 podStartE2EDuration="624.936997ms" podCreationTimestamp="2026-06-02 21:43:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:43:26.624138583 +0000 UTC m=+98.793092297" watchObservedRunningTime="2026-06-02 21:43:26.624936997 +0000 UTC m=+98.793890707" Jun 02 21:43:27.069552 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:27.069511 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c941739d-129a-47b9-bbe4-deb08200d79f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-6nr5v\" (UID: \"c941739d-129a-47b9-bbe4-deb08200d79f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6nr5v" Jun 02 21:43:27.070001 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:43:27.069640 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 21:43:27.070001 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:43:27.069721 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c941739d-129a-47b9-bbe4-deb08200d79f-samples-operator-tls podName:c941739d-129a-47b9-bbe4-deb08200d79f nodeName:}" failed. No retries permitted until 2026-06-02 21:43:35.069700286 +0000 UTC m=+107.238653977 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c941739d-129a-47b9-bbe4-deb08200d79f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-6nr5v" (UID: "c941739d-129a-47b9-bbe4-deb08200d79f") : secret "samples-operator-tls" not found Jun 02 21:43:28.615051 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:28.615015 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xzl5j" event={"ID":"47ec9316-976d-4247-926f-713508dac5eb","Type":"ContainerStarted","Data":"ddb139d54a348cffe0f7c2b51db9b8089232f9dc055b5f5da21c6decf12b6f5d"} Jun 02 21:43:28.631298 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:28.631253 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xzl5j" podStartSLOduration=1.7245478429999999 podStartE2EDuration="3.631240386s" podCreationTimestamp="2026-06-02 21:43:25 +0000 UTC" firstStartedPulling="2026-06-02 21:43:25.67324762 +0000 UTC m=+97.842201322" lastFinishedPulling="2026-06-02 21:43:27.579940175 +0000 UTC m=+99.748893865" observedRunningTime="2026-06-02 21:43:28.63042773 +0000 UTC m=+100.799381456" watchObservedRunningTime="2026-06-02 21:43:28.631240386 +0000 UTC m=+100.800194097" Jun 02 21:43:28.960409 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:28.960370 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-vhjcv"] Jun 02 21:43:28.962833 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:28.962812 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-vhjcv" Jun 02 21:43:28.965204 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:28.965182 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 02 21:43:28.965538 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:28.965450 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-z9k7c\"" Jun 02 21:43:28.966237 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:28.966222 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 02 21:43:28.970247 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:28.970229 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-vhjcv"] Jun 02 21:43:29.083227 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:29.083195 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br2zx\" (UniqueName: \"kubernetes.io/projected/c5876744-22d5-445c-9586-0535cf537658-kube-api-access-br2zx\") pod \"migrator-96c6f749-vhjcv\" (UID: \"c5876744-22d5-445c-9586-0535cf537658\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-vhjcv" Jun 02 21:43:29.183815 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:29.183779 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-br2zx\" (UniqueName: \"kubernetes.io/projected/c5876744-22d5-445c-9586-0535cf537658-kube-api-access-br2zx\") pod \"migrator-96c6f749-vhjcv\" (UID: \"c5876744-22d5-445c-9586-0535cf537658\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-vhjcv" Jun 02 21:43:29.191710 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:29.191683 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-br2zx\" (UniqueName: \"kubernetes.io/projected/c5876744-22d5-445c-9586-0535cf537658-kube-api-access-br2zx\") pod \"migrator-96c6f749-vhjcv\" (UID: \"c5876744-22d5-445c-9586-0535cf537658\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-vhjcv" Jun 02 21:43:29.272109 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:29.272046 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-vhjcv" Jun 02 21:43:29.388325 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:29.388296 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-vhjcv"] Jun 02 21:43:29.390963 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:43:29.390934 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5876744_22d5_445c_9586_0535cf537658.slice/crio-d49db40550253346e4793f27d50de3cfa063d8c61c51e36af256f7c618096540 WatchSource:0}: Error finding container d49db40550253346e4793f27d50de3cfa063d8c61c51e36af256f7c618096540: Status 404 returned error can't find the container with id d49db40550253346e4793f27d50de3cfa063d8c61c51e36af256f7c618096540 Jun 02 21:43:29.556056 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:29.555986 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-db2qf" Jun 02 21:43:29.621392 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:29.621355 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-vhjcv" event={"ID":"c5876744-22d5-445c-9586-0535cf537658","Type":"ContainerStarted","Data":"d49db40550253346e4793f27d50de3cfa063d8c61c51e36af256f7c618096540"} Jun 02 21:43:30.625826 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:30.625759 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-vhjcv" event={"ID":"c5876744-22d5-445c-9586-0535cf537658","Type":"ContainerStarted","Data":"daf97ebb0ac9d27d0509017a7993166299d20ecc824c21b9f7fcde42c19ae262"} Jun 02 21:43:31.629265 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:31.629225 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-vhjcv" event={"ID":"c5876744-22d5-445c-9586-0535cf537658","Type":"ContainerStarted","Data":"7ce1714855aae3d3679b91655af443db03ef8b43de31309843710b166109b9da"} Jun 02 21:43:31.649089 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:31.649036 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-vhjcv" podStartSLOduration=2.490753179 podStartE2EDuration="3.649024586s" podCreationTimestamp="2026-06-02 21:43:28 +0000 UTC" firstStartedPulling="2026-06-02 21:43:29.392791043 +0000 UTC m=+101.561744733" lastFinishedPulling="2026-06-02 21:43:30.551062447 +0000 UTC m=+102.720016140" observedRunningTime="2026-06-02 21:43:31.647204372 +0000 UTC m=+103.816158083" watchObservedRunningTime="2026-06-02 21:43:31.649024586 +0000 UTC m=+103.817978299" Jun 02 21:43:35.127737 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:35.127701 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c941739d-129a-47b9-bbe4-deb08200d79f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-6nr5v\" (UID: \"c941739d-129a-47b9-bbe4-deb08200d79f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6nr5v" Jun 02 21:43:35.128120 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:43:35.127819 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 21:43:35.128120 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:43:35.127871 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c941739d-129a-47b9-bbe4-deb08200d79f-samples-operator-tls podName:c941739d-129a-47b9-bbe4-deb08200d79f nodeName:}" failed. No retries permitted until 2026-06-02 21:43:51.127857431 +0000 UTC m=+123.296811121 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c941739d-129a-47b9-bbe4-deb08200d79f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-6nr5v" (UID: "c941739d-129a-47b9-bbe4-deb08200d79f") : secret "samples-operator-tls" not found Jun 02 21:43:51.142066 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:51.142025 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c941739d-129a-47b9-bbe4-deb08200d79f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-6nr5v\" (UID: \"c941739d-129a-47b9-bbe4-deb08200d79f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6nr5v" Jun 02 21:43:51.144309 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:51.144287 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c941739d-129a-47b9-bbe4-deb08200d79f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-6nr5v\" (UID: \"c941739d-129a-47b9-bbe4-deb08200d79f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6nr5v" Jun 02 21:43:51.173659 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:51.173612 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lg6bh\"" Jun 02 21:43:51.181591 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:51.181571 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6nr5v" Jun 02 21:43:51.303022 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:51.302992 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6nr5v"] Jun 02 21:43:51.677918 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:51.677884 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6nr5v" event={"ID":"c941739d-129a-47b9-bbe4-deb08200d79f","Type":"ContainerStarted","Data":"f4949c573d45ce46c733285346e9487c965c764250005e3f0e60226dd2280cfa"} Jun 02 21:43:52.324221 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.324189 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8844d9fcd-22448"] Jun 02 21:43:52.326136 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.326111 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.328841 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.328741 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 21:43:52.329057 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.328874 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 21:43:52.329797 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.329755 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jtd5q\"" Jun 02 21:43:52.329916 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.329833 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 21:43:52.337106 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.337085 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 21:43:52.348828 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.348803 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8844d9fcd-22448"] Jun 02 21:43:52.367686 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.367655 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9ntkt"] Jun 02 21:43:52.369862 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.369840 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9ntkt" Jun 02 21:43:52.374432 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.374411 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 21:43:52.374541 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.374460 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 21:43:52.375940 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.375865 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 21:43:52.376992 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.376972 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tbwlq\"" Jun 02 21:43:52.377090 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.377017 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 21:43:52.384923 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.384898 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9ntkt"] Jun 02 21:43:52.451704 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.451676 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dba3c819-37a3-4351-b020-ff4fc3e7f82b-image-registry-private-configuration\") pod \"image-registry-8844d9fcd-22448\" (UID: \"dba3c819-37a3-4351-b020-ff4fc3e7f82b\") " pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.451864 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.451722 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09a55432-a3be-4e87-93cb-9ac79c8d37e0-data-volume\") pod \"insights-runtime-extractor-9ntkt\" (UID: \"09a55432-a3be-4e87-93cb-9ac79c8d37e0\") " pod="openshift-insights/insights-runtime-extractor-9ntkt" Jun 02 21:43:52.451864 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.451742 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrdk8\" (UniqueName: \"kubernetes.io/projected/09a55432-a3be-4e87-93cb-9ac79c8d37e0-kube-api-access-zrdk8\") pod \"insights-runtime-extractor-9ntkt\" (UID: \"09a55432-a3be-4e87-93cb-9ac79c8d37e0\") " pod="openshift-insights/insights-runtime-extractor-9ntkt" Jun 02 21:43:52.451864 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.451824 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09a55432-a3be-4e87-93cb-9ac79c8d37e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ntkt\" (UID: \"09a55432-a3be-4e87-93cb-9ac79c8d37e0\") " pod="openshift-insights/insights-runtime-extractor-9ntkt" Jun 02 21:43:52.451995 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.451874 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dba3c819-37a3-4351-b020-ff4fc3e7f82b-bound-sa-token\") pod \"image-registry-8844d9fcd-22448\" (UID: \"dba3c819-37a3-4351-b020-ff4fc3e7f82b\") " pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.451995 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.451897 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09a55432-a3be-4e87-93cb-9ac79c8d37e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ntkt\" (UID: \"09a55432-a3be-4e87-93cb-9ac79c8d37e0\") " pod="openshift-insights/insights-runtime-extractor-9ntkt" Jun 02 21:43:52.451995 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.451924 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dba3c819-37a3-4351-b020-ff4fc3e7f82b-ca-trust-extracted\") pod \"image-registry-8844d9fcd-22448\" (UID: \"dba3c819-37a3-4351-b020-ff4fc3e7f82b\") " pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.451995 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.451954 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dba3c819-37a3-4351-b020-ff4fc3e7f82b-registry-tls\") pod \"image-registry-8844d9fcd-22448\" (UID: \"dba3c819-37a3-4351-b020-ff4fc3e7f82b\") " pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.451995 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.451991 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09a55432-a3be-4e87-93cb-9ac79c8d37e0-crio-socket\") pod \"insights-runtime-extractor-9ntkt\" (UID: \"09a55432-a3be-4e87-93cb-9ac79c8d37e0\") " pod="openshift-insights/insights-runtime-extractor-9ntkt" Jun 02 21:43:52.452167 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.452012 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgz7n\" (UniqueName: \"kubernetes.io/projected/dba3c819-37a3-4351-b020-ff4fc3e7f82b-kube-api-access-mgz7n\") pod \"image-registry-8844d9fcd-22448\" (UID: \"dba3c819-37a3-4351-b020-ff4fc3e7f82b\") " pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.452167 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.452030 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dba3c819-37a3-4351-b020-ff4fc3e7f82b-registry-certificates\") pod \"image-registry-8844d9fcd-22448\" (UID: \"dba3c819-37a3-4351-b020-ff4fc3e7f82b\") " pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.452167 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.452046 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dba3c819-37a3-4351-b020-ff4fc3e7f82b-trusted-ca\") pod \"image-registry-8844d9fcd-22448\" (UID: \"dba3c819-37a3-4351-b020-ff4fc3e7f82b\") " pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.452167 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.452097 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dba3c819-37a3-4351-b020-ff4fc3e7f82b-installation-pull-secrets\") pod \"image-registry-8844d9fcd-22448\" (UID: \"dba3c819-37a3-4351-b020-ff4fc3e7f82b\") " pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.552717 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.552684 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09a55432-a3be-4e87-93cb-9ac79c8d37e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ntkt\" (UID: \"09a55432-a3be-4e87-93cb-9ac79c8d37e0\") " pod="openshift-insights/insights-runtime-extractor-9ntkt" Jun 02 21:43:52.552901 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.552726 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dba3c819-37a3-4351-b020-ff4fc3e7f82b-bound-sa-token\") pod \"image-registry-8844d9fcd-22448\" (UID: \"dba3c819-37a3-4351-b020-ff4fc3e7f82b\") " pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.552901 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.552776 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09a55432-a3be-4e87-93cb-9ac79c8d37e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ntkt\" (UID: \"09a55432-a3be-4e87-93cb-9ac79c8d37e0\") " pod="openshift-insights/insights-runtime-extractor-9ntkt" Jun 02 21:43:52.552901 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.552807 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dba3c819-37a3-4351-b020-ff4fc3e7f82b-ca-trust-extracted\") pod \"image-registry-8844d9fcd-22448\" (UID: \"dba3c819-37a3-4351-b020-ff4fc3e7f82b\") " pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.552901 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.552839 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dba3c819-37a3-4351-b020-ff4fc3e7f82b-registry-tls\") pod \"image-registry-8844d9fcd-22448\" (UID: \"dba3c819-37a3-4351-b020-ff4fc3e7f82b\") " pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.552901 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.552860 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09a55432-a3be-4e87-93cb-9ac79c8d37e0-crio-socket\") pod \"insights-runtime-extractor-9ntkt\" (UID: \"09a55432-a3be-4e87-93cb-9ac79c8d37e0\") " pod="openshift-insights/insights-runtime-extractor-9ntkt" Jun 02 21:43:52.552901 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.552885 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mgz7n\" (UniqueName: \"kubernetes.io/projected/dba3c819-37a3-4351-b020-ff4fc3e7f82b-kube-api-access-mgz7n\") pod \"image-registry-8844d9fcd-22448\" (UID: \"dba3c819-37a3-4351-b020-ff4fc3e7f82b\") " pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.553208 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.552906 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dba3c819-37a3-4351-b020-ff4fc3e7f82b-registry-certificates\") pod \"image-registry-8844d9fcd-22448\" (UID: \"dba3c819-37a3-4351-b020-ff4fc3e7f82b\") " pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.553208 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.552929 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dba3c819-37a3-4351-b020-ff4fc3e7f82b-trusted-ca\") pod \"image-registry-8844d9fcd-22448\" (UID: \"dba3c819-37a3-4351-b020-ff4fc3e7f82b\") " pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.553208 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.552953 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dba3c819-37a3-4351-b020-ff4fc3e7f82b-installation-pull-secrets\") pod \"image-registry-8844d9fcd-22448\" (UID: \"dba3c819-37a3-4351-b020-ff4fc3e7f82b\") " pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.553208 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.553020 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dba3c819-37a3-4351-b020-ff4fc3e7f82b-image-registry-private-configuration\") pod \"image-registry-8844d9fcd-22448\" (UID: \"dba3c819-37a3-4351-b020-ff4fc3e7f82b\") " pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.553208 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.553067 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09a55432-a3be-4e87-93cb-9ac79c8d37e0-crio-socket\") pod \"insights-runtime-extractor-9ntkt\" (UID: \"09a55432-a3be-4e87-93cb-9ac79c8d37e0\") " pod="openshift-insights/insights-runtime-extractor-9ntkt" Jun 02 21:43:52.553450 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.553341 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dba3c819-37a3-4351-b020-ff4fc3e7f82b-ca-trust-extracted\") pod \"image-registry-8844d9fcd-22448\" (UID: \"dba3c819-37a3-4351-b020-ff4fc3e7f82b\") " pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.553450 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.553354 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09a55432-a3be-4e87-93cb-9ac79c8d37e0-data-volume\") pod \"insights-runtime-extractor-9ntkt\" (UID: \"09a55432-a3be-4e87-93cb-9ac79c8d37e0\") " pod="openshift-insights/insights-runtime-extractor-9ntkt" Jun 02 21:43:52.553450 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.553073 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09a55432-a3be-4e87-93cb-9ac79c8d37e0-data-volume\") pod \"insights-runtime-extractor-9ntkt\" (UID: \"09a55432-a3be-4e87-93cb-9ac79c8d37e0\") " pod="openshift-insights/insights-runtime-extractor-9ntkt" Jun 02 21:43:52.553450 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.553406 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zrdk8\" (UniqueName: \"kubernetes.io/projected/09a55432-a3be-4e87-93cb-9ac79c8d37e0-kube-api-access-zrdk8\") pod \"insights-runtime-extractor-9ntkt\" (UID: \"09a55432-a3be-4e87-93cb-9ac79c8d37e0\") " pod="openshift-insights/insights-runtime-extractor-9ntkt" Jun 02 21:43:52.553690 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.553473 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09a55432-a3be-4e87-93cb-9ac79c8d37e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ntkt\" (UID: \"09a55432-a3be-4e87-93cb-9ac79c8d37e0\") " pod="openshift-insights/insights-runtime-extractor-9ntkt" Jun 02 21:43:52.553960 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.553939 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dba3c819-37a3-4351-b020-ff4fc3e7f82b-trusted-ca\") pod \"image-registry-8844d9fcd-22448\" (UID: \"dba3c819-37a3-4351-b020-ff4fc3e7f82b\") " pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.554096 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.554073 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dba3c819-37a3-4351-b020-ff4fc3e7f82b-registry-certificates\") pod \"image-registry-8844d9fcd-22448\" (UID: \"dba3c819-37a3-4351-b020-ff4fc3e7f82b\") " pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.555563 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.555534 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dba3c819-37a3-4351-b020-ff4fc3e7f82b-installation-pull-secrets\") pod \"image-registry-8844d9fcd-22448\" (UID: \"dba3c819-37a3-4351-b020-ff4fc3e7f82b\") " pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.555699 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.555658 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dba3c819-37a3-4351-b020-ff4fc3e7f82b-image-registry-private-configuration\") pod \"image-registry-8844d9fcd-22448\" (UID: \"dba3c819-37a3-4351-b020-ff4fc3e7f82b\") " pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.555813 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.555791 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09a55432-a3be-4e87-93cb-9ac79c8d37e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ntkt\" (UID: \"09a55432-a3be-4e87-93cb-9ac79c8d37e0\") " pod="openshift-insights/insights-runtime-extractor-9ntkt" Jun 02 21:43:52.555902 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.555889 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dba3c819-37a3-4351-b020-ff4fc3e7f82b-registry-tls\") pod \"image-registry-8844d9fcd-22448\" (UID: \"dba3c819-37a3-4351-b020-ff4fc3e7f82b\") " pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.561053 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.561031 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dba3c819-37a3-4351-b020-ff4fc3e7f82b-bound-sa-token\") pod \"image-registry-8844d9fcd-22448\" (UID: \"dba3c819-37a3-4351-b020-ff4fc3e7f82b\") " pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.561379 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.561360 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgz7n\" (UniqueName: \"kubernetes.io/projected/dba3c819-37a3-4351-b020-ff4fc3e7f82b-kube-api-access-mgz7n\") pod \"image-registry-8844d9fcd-22448\" (UID: \"dba3c819-37a3-4351-b020-ff4fc3e7f82b\") " pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.562224 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.562205 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrdk8\" (UniqueName: \"kubernetes.io/projected/09a55432-a3be-4e87-93cb-9ac79c8d37e0-kube-api-access-zrdk8\") pod \"insights-runtime-extractor-9ntkt\" (UID: \"09a55432-a3be-4e87-93cb-9ac79c8d37e0\") " pod="openshift-insights/insights-runtime-extractor-9ntkt" Jun 02 21:43:52.639965 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.639894 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:52.680528 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:52.680493 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9ntkt" Jun 02 21:43:53.196912 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:53.196855 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9ntkt"] Jun 02 21:43:53.200508 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:43:53.200477 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09a55432_a3be_4e87_93cb_9ac79c8d37e0.slice/crio-6c03b762722a24e1bea637d62049ed624c4d59e65370d0c5e3b867d2896958d8 WatchSource:0}: Error finding container 6c03b762722a24e1bea637d62049ed624c4d59e65370d0c5e3b867d2896958d8: Status 404 returned error can't find the container with id 6c03b762722a24e1bea637d62049ed624c4d59e65370d0c5e3b867d2896958d8 Jun 02 21:43:53.216441 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:53.216405 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8844d9fcd-22448"] Jun 02 21:43:53.224745 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:43:53.224716 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddba3c819_37a3_4351_b020_ff4fc3e7f82b.slice/crio-a26fa379eb96387fd1da837ea87909a7539247840e2fe851b6124f3e5e73a1f7 WatchSource:0}: Error finding container a26fa379eb96387fd1da837ea87909a7539247840e2fe851b6124f3e5e73a1f7: Status 404 returned error can't find the container with id a26fa379eb96387fd1da837ea87909a7539247840e2fe851b6124f3e5e73a1f7 Jun 02 21:43:53.686133 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:53.686057 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6nr5v" event={"ID":"c941739d-129a-47b9-bbe4-deb08200d79f","Type":"ContainerStarted","Data":"d2886174da9746c59dd66ea2bb8b4b7d8487a3e319133adceeb95c06ff4a6257"} Jun 02 21:43:53.686133 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:53.686100 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6nr5v" event={"ID":"c941739d-129a-47b9-bbe4-deb08200d79f","Type":"ContainerStarted","Data":"b36cdc6f11ef73a524c3ae37ca79ae90d492086d0114896d19938e5c191203ec"} Jun 02 21:43:53.687424 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:53.687399 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9ntkt" event={"ID":"09a55432-a3be-4e87-93cb-9ac79c8d37e0","Type":"ContainerStarted","Data":"bd54748ff2efa3327af4245d2c4db65bbd3cb187162ecdb214a51ac1f9bde507"} Jun 02 21:43:53.687541 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:53.687429 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9ntkt" event={"ID":"09a55432-a3be-4e87-93cb-9ac79c8d37e0","Type":"ContainerStarted","Data":"6c03b762722a24e1bea637d62049ed624c4d59e65370d0c5e3b867d2896958d8"} Jun 02 21:43:53.688887 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:53.688855 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8844d9fcd-22448" event={"ID":"dba3c819-37a3-4351-b020-ff4fc3e7f82b","Type":"ContainerStarted","Data":"ea3699e7771645e20effeb3f3430c512d3f90a44af60e904c1835d177519c807"} Jun 02 21:43:53.688991 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:53.688895 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8844d9fcd-22448" event={"ID":"dba3c819-37a3-4351-b020-ff4fc3e7f82b","Type":"ContainerStarted","Data":"a26fa379eb96387fd1da837ea87909a7539247840e2fe851b6124f3e5e73a1f7"} Jun 02 21:43:53.688991 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:53.688979 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:43:53.704500 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:53.704445 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6nr5v" podStartSLOduration=32.946860083 podStartE2EDuration="34.704427621s" podCreationTimestamp="2026-06-02 21:43:19 +0000 UTC" firstStartedPulling="2026-06-02 21:43:51.3452349 +0000 UTC m=+123.514188591" lastFinishedPulling="2026-06-02 21:43:53.102802437 +0000 UTC m=+125.271756129" observedRunningTime="2026-06-02 21:43:53.703521175 +0000 UTC m=+125.872474933" watchObservedRunningTime="2026-06-02 21:43:53.704427621 +0000 UTC m=+125.873381334" Jun 02 21:43:53.726159 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:53.726121 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8844d9fcd-22448" podStartSLOduration=1.72610654 podStartE2EDuration="1.72610654s" podCreationTimestamp="2026-06-02 21:43:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:43:53.725347346 +0000 UTC m=+125.894301059" watchObservedRunningTime="2026-06-02 21:43:53.72610654 +0000 UTC m=+125.895060251" Jun 02 21:43:54.695960 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:54.695919 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9ntkt" event={"ID":"09a55432-a3be-4e87-93cb-9ac79c8d37e0","Type":"ContainerStarted","Data":"9d3d7238a03290f83222dc8323f1112d14843716d2a2432bf5c1f5144c589c5a"} Jun 02 21:43:55.702413 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:55.702370 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9ntkt" event={"ID":"09a55432-a3be-4e87-93cb-9ac79c8d37e0","Type":"ContainerStarted","Data":"609374574e8c04b8885ffe48ffe386eaa58a2efef65e2792382aa3474e3f9529"} Jun 02 21:43:55.724113 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:55.724063 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9ntkt" podStartSLOduration=1.917018965 podStartE2EDuration="3.724051397s" podCreationTimestamp="2026-06-02 21:43:52 +0000 UTC" firstStartedPulling="2026-06-02 21:43:53.252566168 +0000 UTC m=+125.421519864" lastFinishedPulling="2026-06-02 21:43:55.059598602 +0000 UTC m=+127.228552296" observedRunningTime="2026-06-02 21:43:55.723768242 +0000 UTC m=+127.892721958" watchObservedRunningTime="2026-06-02 21:43:55.724051397 +0000 UTC m=+127.893005131" Jun 02 21:43:58.194765 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:58.194722 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs\") pod \"network-metrics-daemon-4jr88\" (UID: \"b9038487-6455-44d7-8c00-1323fb060fd9\") " pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:43:58.197002 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:58.196981 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9038487-6455-44d7-8c00-1323fb060fd9-metrics-certs\") pod \"network-metrics-daemon-4jr88\" (UID: \"b9038487-6455-44d7-8c00-1323fb060fd9\") " pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:43:58.347495 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:58.347462 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-96ccb\"" Jun 02 21:43:58.355675 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:58.355657 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jr88" Jun 02 21:43:58.495544 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:58.495506 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4jr88"] Jun 02 21:43:58.711716 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:58.711648 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4jr88" event={"ID":"b9038487-6455-44d7-8c00-1323fb060fd9","Type":"ContainerStarted","Data":"3dd2be13a1f5cdab1d619e1bb82f3bc5eb132a65115f7663f3996449bc976768"} Jun 02 21:43:59.716241 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:43:59.716216 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4jr88" event={"ID":"b9038487-6455-44d7-8c00-1323fb060fd9","Type":"ContainerStarted","Data":"213e4a26996a5ec5cc067d2d1f1083629e21d585adb5580ffcd469a70ee59fe9"} Jun 02 21:44:00.720051 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:00.720018 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4jr88" event={"ID":"b9038487-6455-44d7-8c00-1323fb060fd9","Type":"ContainerStarted","Data":"0b739e57c5ecd583657805b5667545abb8c2860751eea265dcc24c0de3da0337"} Jun 02 21:44:00.736211 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:00.736165 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4jr88" podStartSLOduration=131.681778591 podStartE2EDuration="2m12.736150916s" podCreationTimestamp="2026-06-02 21:41:48 +0000 UTC" firstStartedPulling="2026-06-02 21:43:58.503817378 +0000 UTC m=+130.672771070" lastFinishedPulling="2026-06-02 21:43:59.558189695 +0000 UTC m=+131.727143395" observedRunningTime="2026-06-02 21:44:00.73511609 +0000 UTC m=+132.904069816" watchObservedRunningTime="2026-06-02 21:44:00.736150916 +0000 UTC m=+132.905104627" Jun 02 21:44:01.237190 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.237158 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ldqf5"] Jun 02 21:44:01.239453 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.239439 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.241975 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.241954 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 21:44:01.241975 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.241971 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 21:44:01.242469 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.242447 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 21:44:01.242631 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.242513 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z7p22\"" Jun 02 21:44:01.242631 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.242578 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 21:44:01.242739 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.242663 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 21:44:01.242908 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.242892 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 21:44:01.317098 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.317067 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.317239 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.317120 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-node-exporter-tls\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.317239 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.317160 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-node-exporter-textfile\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.317239 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.317190 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-node-exporter-accelerators-collector-config\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.317372 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.317254 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-metrics-client-ca\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.317372 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.317290 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-node-exporter-wtmp\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.317372 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.317318 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-sys\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.317372 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.317334 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzgbf\" (UniqueName: \"kubernetes.io/projected/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-kube-api-access-jzgbf\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.317372 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.317356 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-root\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.417816 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.417791 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-metrics-client-ca\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.417976 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.417822 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-node-exporter-wtmp\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.417976 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.417841 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-sys\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.417976 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.417857 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jzgbf\" (UniqueName: \"kubernetes.io/projected/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-kube-api-access-jzgbf\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.417976 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.417881 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-root\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.417976 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.417924 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-sys\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.417976 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.417929 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.417976 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.417966 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-node-exporter-wtmp\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.418306 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.418006 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-node-exporter-tls\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.418306 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.418025 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-root\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.418306 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:44:01.418116 2553 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 21:44:01.418306 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:44:01.418187 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-node-exporter-tls podName:e7d09597-e58b-461a-b0d1-ddd3ccf7cd82 nodeName:}" failed. No retries permitted until 2026-06-02 21:44:01.918167265 +0000 UTC m=+134.087120957 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-node-exporter-tls") pod "node-exporter-ldqf5" (UID: "e7d09597-e58b-461a-b0d1-ddd3ccf7cd82") : secret "node-exporter-tls" not found Jun 02 21:44:01.418306 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.418204 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-node-exporter-textfile\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.418306 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.418248 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-node-exporter-accelerators-collector-config\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.418530 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.418405 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-metrics-client-ca\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.418530 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.418479 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-node-exporter-textfile\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.418707 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.418691 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-node-exporter-accelerators-collector-config\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.420149 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.420128 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.426449 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.426430 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzgbf\" (UniqueName: \"kubernetes.io/projected/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-kube-api-access-jzgbf\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.922998 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.922945 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-node-exporter-tls\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:01.925215 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:01.925197 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e7d09597-e58b-461a-b0d1-ddd3ccf7cd82-node-exporter-tls\") pod \"node-exporter-ldqf5\" (UID: \"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82\") " pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:02.148925 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:02.148885 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ldqf5" Jun 02 21:44:02.158369 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:44:02.158338 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7d09597_e58b_461a_b0d1_ddd3ccf7cd82.slice/crio-455558fd07fcd2a58f0e74f596d145a3ae9a1edbbceca66b97c79431c72cc536 WatchSource:0}: Error finding container 455558fd07fcd2a58f0e74f596d145a3ae9a1edbbceca66b97c79431c72cc536: Status 404 returned error can't find the container with id 455558fd07fcd2a58f0e74f596d145a3ae9a1edbbceca66b97c79431c72cc536 Jun 02 21:44:02.726042 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:02.725999 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ldqf5" event={"ID":"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82","Type":"ContainerStarted","Data":"455558fd07fcd2a58f0e74f596d145a3ae9a1edbbceca66b97c79431c72cc536"} Jun 02 21:44:03.729452 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:03.729420 2553 generic.go:358] "Generic (PLEG): container finished" podID="e7d09597-e58b-461a-b0d1-ddd3ccf7cd82" containerID="79f04702d96aa18eaf2b29db26d59cf30c77aef38ea9747d5a973346ee2e3db2" exitCode=0 Jun 02 21:44:03.729452 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:03.729458 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ldqf5" event={"ID":"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82","Type":"ContainerDied","Data":"79f04702d96aa18eaf2b29db26d59cf30c77aef38ea9747d5a973346ee2e3db2"} Jun 02 21:44:04.733838 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:04.733801 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ldqf5" event={"ID":"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82","Type":"ContainerStarted","Data":"6c4bd08ae26f60eafcd91400b9ca3c9f8e27564cd8b31e1513a7332f28d5776f"} Jun 02 21:44:04.733838 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:04.733836 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ldqf5" event={"ID":"e7d09597-e58b-461a-b0d1-ddd3ccf7cd82","Type":"ContainerStarted","Data":"faa01b43c376e32fa1db0dab0d15a72c2013e9e50a5945304b88754a86c66491"} Jun 02 21:44:04.760029 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:04.759982 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ldqf5" podStartSLOduration=2.963048825 podStartE2EDuration="3.759967918s" podCreationTimestamp="2026-06-02 21:44:01 +0000 UTC" firstStartedPulling="2026-06-02 21:44:02.160284019 +0000 UTC m=+134.329237709" lastFinishedPulling="2026-06-02 21:44:02.957203109 +0000 UTC m=+135.126156802" observedRunningTime="2026-06-02 21:44:04.759567453 +0000 UTC m=+136.928521178" watchObservedRunningTime="2026-06-02 21:44:04.759967918 +0000 UTC m=+136.928921630" Jun 02 21:44:07.482453 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.482418 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 21:44:07.487075 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.487057 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.489989 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.489826 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 21:44:07.489989 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.489880 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 21:44:07.489989 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.489880 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 21:44:07.489989 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.489938 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 21:44:07.489989 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.489956 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 21:44:07.489989 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.489970 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 21:44:07.490352 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.490227 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 21:44:07.490352 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.490248 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 21:44:07.490352 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.490333 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 21:44:07.491198 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.491183 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wmd5q\"" Jun 02 21:44:07.491289 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.491218 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-aqeopmgaib67s\"" Jun 02 21:44:07.491595 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.491575 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 21:44:07.491595 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.491592 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 21:44:07.493448 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.493427 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 21:44:07.496935 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.496914 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 21:44:07.497613 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.497596 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 21:44:07.568008 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.567974 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.568139 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.568014 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.568139 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.568041 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.568139 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.568069 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mtdx\" (UniqueName: \"kubernetes.io/projected/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-kube-api-access-7mtdx\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.568139 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.568094 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-web-config\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.568139 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.568119 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.568392 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.568139 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.568392 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.568162 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.568392 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.568191 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.568392 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.568223 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.568392 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.568247 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-config-out\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.568392 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.568329 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.568392 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.568357 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.568392 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.568381 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.568703 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.568439 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.568703 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.568464 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-config\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.568703 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.568486 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.568703 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.568509 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.669470 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.669443 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.669606 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.669477 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.669606 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.669496 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.669606 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.669526 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.669606 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.669543 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-config\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.669842 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.669665 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.669842 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.669706 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.669842 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.669761 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.669842 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.669802 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.669842 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.669829 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.670074 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.669858 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7mtdx\" (UniqueName: \"kubernetes.io/projected/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-kube-api-access-7mtdx\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.670074 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.669885 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-web-config\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.670074 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.669912 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.670074 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.669935 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.670074 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.669961 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.670074 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.669991 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.670074 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.670021 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.670074 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.670040 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.670074 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.670052 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-config-out\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.670516 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.670336 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.670516 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.670457 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.673666 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.672666 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.673666 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.672690 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.673666 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.672864 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.673666 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.672933 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.673666 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.673471 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.673666 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.673576 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.673666 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.673649 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.674175 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.674128 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-config\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.674274 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.674175 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.674339 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.674316 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.675229 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.675209 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-config-out\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.675308 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.675287 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.675773 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.675754 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.675849 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.675818 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-web-config\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.686877 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.686856 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mtdx\" (UniqueName: \"kubernetes.io/projected/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-kube-api-access-7mtdx\") pod \"prometheus-k8s-0\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.797956 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.797880 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:07.926347 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:07.926317 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 21:44:07.929122 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:44:07.929094 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8be5d4a2_5025_4f8a_abcb_c78aa5cebb23.slice/crio-59061b18037d877177ea47d3570ed5c64dbd1dfb24a625fc049117d3f995c359 WatchSource:0}: Error finding container 59061b18037d877177ea47d3570ed5c64dbd1dfb24a625fc049117d3f995c359: Status 404 returned error can't find the container with id 59061b18037d877177ea47d3570ed5c64dbd1dfb24a625fc049117d3f995c359 Jun 02 21:44:08.745272 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:08.745232 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23","Type":"ContainerStarted","Data":"59061b18037d877177ea47d3570ed5c64dbd1dfb24a625fc049117d3f995c359"} Jun 02 21:44:09.749079 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:09.749043 2553 generic.go:358] "Generic (PLEG): container finished" podID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerID="360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07" exitCode=0 Jun 02 21:44:09.749438 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:09.749136 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23","Type":"ContainerDied","Data":"360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07"} Jun 02 21:44:12.644279 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:12.644192 2553 patch_prober.go:28] interesting pod/image-registry-8844d9fcd-22448 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 21:44:12.644279 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:12.644256 2553 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-8844d9fcd-22448" podUID="dba3c819-37a3-4351-b020-ff4fc3e7f82b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 21:44:12.759395 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:12.759359 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23","Type":"ContainerStarted","Data":"76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606"} Jun 02 21:44:12.759395 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:12.759402 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23","Type":"ContainerStarted","Data":"99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df"} Jun 02 21:44:14.700465 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:14.700427 2553 patch_prober.go:28] interesting pod/image-registry-8844d9fcd-22448 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 21:44:14.700854 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:14.700477 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8844d9fcd-22448" podUID="dba3c819-37a3-4351-b020-ff4fc3e7f82b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 21:44:14.768186 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:14.768156 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23","Type":"ContainerStarted","Data":"a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e"} Jun 02 21:44:14.768186 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:14.768192 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23","Type":"ContainerStarted","Data":"122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85"} Jun 02 21:44:14.768364 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:14.768204 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23","Type":"ContainerStarted","Data":"0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f"} Jun 02 21:44:14.768364 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:14.768215 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23","Type":"ContainerStarted","Data":"1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6"} Jun 02 21:44:14.795011 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:14.794952 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.776194024 podStartE2EDuration="7.794933091s" podCreationTimestamp="2026-06-02 21:44:07 +0000 UTC" firstStartedPulling="2026-06-02 21:44:07.930911847 +0000 UTC m=+140.099865537" lastFinishedPulling="2026-06-02 21:44:13.949650909 +0000 UTC m=+146.118604604" observedRunningTime="2026-06-02 21:44:14.792663794 +0000 UTC m=+146.961617488" watchObservedRunningTime="2026-06-02 21:44:14.794933091 +0000 UTC m=+146.963886804" Jun 02 21:44:17.798693 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:17.798665 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:44:22.644173 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:22.644137 2553 patch_prober.go:28] interesting pod/image-registry-8844d9fcd-22448 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 21:44:22.644571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:22.644195 2553 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-8844d9fcd-22448" podUID="dba3c819-37a3-4351-b020-ff4fc3e7f82b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 21:44:24.700355 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:24.700326 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8844d9fcd-22448" Jun 02 21:44:25.233903 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:44:25.233864 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4dmwr" podUID="97b5c1c0-5909-433f-85cd-3515fd144fbd" Jun 02 21:44:25.246030 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:44:25.246000 2553 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-zwfwz" podUID="443958d9-a8c2-4481-98e0-b45e59abaadd" Jun 02 21:44:25.796345 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:25.796315 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4dmwr" Jun 02 21:44:30.157535 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:30.157453 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert\") pod \"ingress-canary-zwfwz\" (UID: \"443958d9-a8c2-4481-98e0-b45e59abaadd\") " pod="openshift-ingress-canary/ingress-canary-zwfwz" Jun 02 21:44:30.157535 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:30.157496 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls\") pod \"dns-default-4dmwr\" (UID: \"97b5c1c0-5909-433f-85cd-3515fd144fbd\") " pod="openshift-dns/dns-default-4dmwr" Jun 02 21:44:30.159809 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:30.159789 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97b5c1c0-5909-433f-85cd-3515fd144fbd-metrics-tls\") pod \"dns-default-4dmwr\" (UID: \"97b5c1c0-5909-433f-85cd-3515fd144fbd\") " pod="openshift-dns/dns-default-4dmwr" Jun 02 21:44:30.159921 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:30.159859 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/443958d9-a8c2-4481-98e0-b45e59abaadd-cert\") pod \"ingress-canary-zwfwz\" (UID: \"443958d9-a8c2-4481-98e0-b45e59abaadd\") " pod="openshift-ingress-canary/ingress-canary-zwfwz" Jun 02 21:44:30.299740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:30.299713 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ssb95\"" Jun 02 21:44:30.307812 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:30.307794 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4dmwr" Jun 02 21:44:30.426762 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:30.426737 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4dmwr"] Jun 02 21:44:30.430276 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:44:30.430239 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97b5c1c0_5909_433f_85cd_3515fd144fbd.slice/crio-47f42e91c780cf1f3ced5ee85748f04cf4ec10922e6d391e57c1a8aee60ce4c6 WatchSource:0}: Error finding container 47f42e91c780cf1f3ced5ee85748f04cf4ec10922e6d391e57c1a8aee60ce4c6: Status 404 returned error can't find the container with id 47f42e91c780cf1f3ced5ee85748f04cf4ec10922e6d391e57c1a8aee60ce4c6 Jun 02 21:44:30.811576 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:30.811493 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4dmwr" event={"ID":"97b5c1c0-5909-433f-85cd-3515fd144fbd","Type":"ContainerStarted","Data":"47f42e91c780cf1f3ced5ee85748f04cf4ec10922e6d391e57c1a8aee60ce4c6"} Jun 02 21:44:31.816316 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:31.816285 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4dmwr" event={"ID":"97b5c1c0-5909-433f-85cd-3515fd144fbd","Type":"ContainerStarted","Data":"b21afcc644df0549f6251dcac54276041130d7a8afb2c058df1508a157a00066"} Jun 02 21:44:32.820109 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:32.820071 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4dmwr" event={"ID":"97b5c1c0-5909-433f-85cd-3515fd144fbd","Type":"ContainerStarted","Data":"f26729df3f8a661e91caf6e578ed7c119ecd3d1cf85736345174340c668a7c76"} Jun 02 21:44:32.820478 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:32.820271 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4dmwr" Jun 02 21:44:32.837510 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:32.837455 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-4dmwr" podStartSLOduration=129.617307626 podStartE2EDuration="2m10.837440661s" podCreationTimestamp="2026-06-02 21:42:22 +0000 UTC" firstStartedPulling="2026-06-02 21:44:30.432461074 +0000 UTC m=+162.601414764" lastFinishedPulling="2026-06-02 21:44:31.652594101 +0000 UTC m=+163.821547799" observedRunningTime="2026-06-02 21:44:32.836330785 +0000 UTC m=+165.005284498" watchObservedRunningTime="2026-06-02 21:44:32.837440661 +0000 UTC m=+165.006394374" Jun 02 21:44:40.336880 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:40.336846 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zwfwz" Jun 02 21:44:40.339551 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:40.339529 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f7jrx\"" Jun 02 21:44:40.347570 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:40.347550 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zwfwz" Jun 02 21:44:40.475869 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:40.475829 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zwfwz"] Jun 02 21:44:40.478888 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:44:40.478855 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod443958d9_a8c2_4481_98e0_b45e59abaadd.slice/crio-d612522badf6183f674d79db913b2bfa3f9393e8d9643ea5abda91af75433cf1 WatchSource:0}: Error finding container d612522badf6183f674d79db913b2bfa3f9393e8d9643ea5abda91af75433cf1: Status 404 returned error can't find the container with id d612522badf6183f674d79db913b2bfa3f9393e8d9643ea5abda91af75433cf1 Jun 02 21:44:40.842853 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:40.842820 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zwfwz" event={"ID":"443958d9-a8c2-4481-98e0-b45e59abaadd","Type":"ContainerStarted","Data":"d612522badf6183f674d79db913b2bfa3f9393e8d9643ea5abda91af75433cf1"} Jun 02 21:44:42.825588 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:42.825556 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4dmwr" Jun 02 21:44:42.851556 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:42.851525 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zwfwz" event={"ID":"443958d9-a8c2-4481-98e0-b45e59abaadd","Type":"ContainerStarted","Data":"3bc343727efadd107ac7dd220fe33d3bf393ed2947efa6e89a6109c44940c47b"} Jun 02 21:44:42.866578 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:42.866534 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zwfwz" podStartSLOduration=139.311325634 podStartE2EDuration="2m20.866520605s" podCreationTimestamp="2026-06-02 21:42:22 +0000 UTC" firstStartedPulling="2026-06-02 21:44:40.480755467 +0000 UTC m=+172.649709162" lastFinishedPulling="2026-06-02 21:44:42.035950429 +0000 UTC m=+174.204904133" observedRunningTime="2026-06-02 21:44:42.865336231 +0000 UTC m=+175.034289955" watchObservedRunningTime="2026-06-02 21:44:42.866520605 +0000 UTC m=+175.035474317" Jun 02 21:44:58.893593 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:58.893557 2553 generic.go:358] "Generic (PLEG): container finished" podID="47ec9316-976d-4247-926f-713508dac5eb" containerID="ddb139d54a348cffe0f7c2b51db9b8089232f9dc055b5f5da21c6decf12b6f5d" exitCode=0 Jun 02 21:44:58.894071 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:58.893604 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xzl5j" event={"ID":"47ec9316-976d-4247-926f-713508dac5eb","Type":"ContainerDied","Data":"ddb139d54a348cffe0f7c2b51db9b8089232f9dc055b5f5da21c6decf12b6f5d"} Jun 02 21:44:58.894071 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:58.893989 2553 scope.go:117] "RemoveContainer" containerID="ddb139d54a348cffe0f7c2b51db9b8089232f9dc055b5f5da21c6decf12b6f5d" Jun 02 21:44:59.897311 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:44:59.897278 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xzl5j" event={"ID":"47ec9316-976d-4247-926f-713508dac5eb","Type":"ContainerStarted","Data":"97724749fd8ae40fb4f4c6390bfdcfff7204e1751d8e88edcfa1a6bc40e9d8b9"} Jun 02 21:45:07.798105 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:07.798069 2553 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:07.819286 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:07.819259 2553 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:07.931559 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:07.931533 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:25.917237 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:25.917209 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 21:45:25.917677 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:25.917644 2553 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="kube-rbac-proxy" containerID="cri-o://122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85" gracePeriod=600 Jun 02 21:45:25.917677 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:25.917644 2553 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="prometheus" containerID="cri-o://99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df" gracePeriod=600 Jun 02 21:45:25.917836 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:25.917702 2553 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="kube-rbac-proxy-web" containerID="cri-o://0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f" gracePeriod=600 Jun 02 21:45:25.917836 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:25.917746 2553 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="thanos-sidecar" containerID="cri-o://1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6" gracePeriod=600 Jun 02 21:45:25.917836 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:25.917767 2553 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e" gracePeriod=600 Jun 02 21:45:25.917976 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:25.917850 2553 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="config-reloader" containerID="cri-o://76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606" gracePeriod=600 Jun 02 21:45:26.156234 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.156210 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:26.215599 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.215520 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-prometheus-k8s-tls\") pod \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " Jun 02 21:45:26.215599 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.215578 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-configmap-kubelet-serving-ca-bundle\") pod \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " Jun 02 21:45:26.215802 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.215610 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-thanos-prometheus-http-client-file\") pod \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " Jun 02 21:45:26.215802 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.215656 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " Jun 02 21:45:26.215802 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.215687 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-web-config\") pod \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " Jun 02 21:45:26.215802 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.215710 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-prometheus-k8s-rulefiles-0\") pod \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " Jun 02 21:45:26.215802 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.215755 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-configmap-metrics-client-ca\") pod \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " Jun 02 21:45:26.215802 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.215790 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mtdx\" (UniqueName: \"kubernetes.io/projected/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-kube-api-access-7mtdx\") pod \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " Jun 02 21:45:26.216102 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.215815 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-prometheus-trusted-ca-bundle\") pod \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " Jun 02 21:45:26.216102 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.215855 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-config\") pod \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " Jun 02 21:45:26.216102 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.215886 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-grpc-tls\") pod \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " Jun 02 21:45:26.216102 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.215915 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-config-out\") pod \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " Jun 02 21:45:26.216102 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.215944 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-kube-rbac-proxy\") pod \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " Jun 02 21:45:26.216102 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.215973 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-prometheus-k8s-db\") pod \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " Jun 02 21:45:26.216102 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.215999 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" (UID: "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:45:26.216473 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.216446 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" (UID: "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:45:26.217485 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.217434 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" (UID: "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:45:26.218315 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.217658 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-tls-assets\") pod \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " Jun 02 21:45:26.218315 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.217704 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-configmap-serving-certs-ca-bundle\") pod \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " Jun 02 21:45:26.218315 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.217746 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-metrics-client-certs\") pod \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " Jun 02 21:45:26.218315 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.217795 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\" (UID: \"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23\") " Jun 02 21:45:26.218315 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.218007 2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-prometheus-k8s-db\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:45:26.218315 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.218023 2553 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:45:26.218315 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.218039 2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:45:26.218315 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.218133 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" (UID: "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:45:26.218793 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.218583 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" (UID: "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:45:26.219732 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.219701 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" (UID: "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:45:26.219860 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.219837 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-config-out" (OuterVolumeSpecName: "config-out") pod "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" (UID: "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:45:26.220199 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.220171 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" (UID: "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:45:26.220403 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.220381 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" (UID: "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:45:26.220699 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.220594 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" (UID: "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:45:26.220878 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.220854 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-config" (OuterVolumeSpecName: "config") pod "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" (UID: "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:45:26.220993 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.220939 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-kube-api-access-7mtdx" (OuterVolumeSpecName: "kube-api-access-7mtdx") pod "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" (UID: "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23"). InnerVolumeSpecName "kube-api-access-7mtdx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:45:26.221253 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.221231 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" (UID: "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:45:26.221325 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.221269 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" (UID: "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:45:26.221553 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.221536 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" (UID: "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:45:26.222031 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.222001 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" (UID: "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:45:26.222124 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.222073 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" (UID: "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:45:26.229659 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.229608 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-web-config" (OuterVolumeSpecName: "web-config") pod "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" (UID: "8be5d4a2-5025-4f8a-abcb-c78aa5cebb23"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:45:26.319248 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.319224 2553 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-grpc-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:45:26.319248 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.319249 2553 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-config-out\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:45:26.319455 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.319262 2553 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-kube-rbac-proxy\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:45:26.319455 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.319274 2553 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-tls-assets\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:45:26.319455 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.319290 2553 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:45:26.319455 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.319305 2553 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-metrics-client-certs\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:45:26.319455 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.319318 2553 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:45:26.319455 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.319332 2553 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:45:26.319455 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.319345 2553 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:45:26.319455 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.319359 2553 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:45:26.319455 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.319372 2553 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-web-config\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:45:26.319455 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.319385 2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:45:26.319455 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.319398 2553 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-configmap-metrics-client-ca\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:45:26.319455 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.319411 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mtdx\" (UniqueName: \"kubernetes.io/projected/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-kube-api-access-7mtdx\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:45:26.319455 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.319424 2553 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23-config\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:45:26.970189 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.970151 2553 generic.go:358] "Generic (PLEG): container finished" podID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerID="a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e" exitCode=0 Jun 02 21:45:26.970189 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.970184 2553 generic.go:358] "Generic (PLEG): container finished" podID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerID="122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85" exitCode=0 Jun 02 21:45:26.970189 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.970193 2553 generic.go:358] "Generic (PLEG): container finished" podID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerID="0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f" exitCode=0 Jun 02 21:45:26.970189 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.970200 2553 generic.go:358] "Generic (PLEG): container finished" podID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerID="1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6" exitCode=0 Jun 02 21:45:26.970189 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.970209 2553 generic.go:358] "Generic (PLEG): container finished" podID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerID="76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606" exitCode=0 Jun 02 21:45:26.970800 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.970217 2553 generic.go:358] "Generic (PLEG): container finished" podID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerID="99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df" exitCode=0 Jun 02 21:45:26.970800 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.970239 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23","Type":"ContainerDied","Data":"a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e"} Jun 02 21:45:26.970800 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.970289 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23","Type":"ContainerDied","Data":"122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85"} Jun 02 21:45:26.970800 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.970298 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:26.970800 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.970306 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23","Type":"ContainerDied","Data":"0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f"} Jun 02 21:45:26.970800 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.970322 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23","Type":"ContainerDied","Data":"1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6"} Jun 02 21:45:26.970800 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.970338 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23","Type":"ContainerDied","Data":"76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606"} Jun 02 21:45:26.970800 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.970352 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23","Type":"ContainerDied","Data":"99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df"} Jun 02 21:45:26.970800 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.970357 2553 scope.go:117] "RemoveContainer" containerID="a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e" Jun 02 21:45:26.970800 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.970368 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8be5d4a2-5025-4f8a-abcb-c78aa5cebb23","Type":"ContainerDied","Data":"59061b18037d877177ea47d3570ed5c64dbd1dfb24a625fc049117d3f995c359"} Jun 02 21:45:26.977578 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.977562 2553 scope.go:117] "RemoveContainer" containerID="122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85" Jun 02 21:45:26.984403 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.984387 2553 scope.go:117] "RemoveContainer" containerID="0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f" Jun 02 21:45:26.990863 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.990847 2553 scope.go:117] "RemoveContainer" containerID="1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6" Jun 02 21:45:26.991538 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.991519 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 21:45:26.995359 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.995334 2553 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 21:45:26.997406 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:26.997390 2553 scope.go:117] "RemoveContainer" containerID="76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606" Jun 02 21:45:27.003429 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.003413 2553 scope.go:117] "RemoveContainer" containerID="99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df" Jun 02 21:45:27.009649 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.009614 2553 scope.go:117] "RemoveContainer" containerID="360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07" Jun 02 21:45:27.015637 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.015606 2553 scope.go:117] "RemoveContainer" containerID="a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e" Jun 02 21:45:27.015892 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:45:27.015872 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e\": container with ID starting with a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e not found: ID does not exist" containerID="a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e" Jun 02 21:45:27.015944 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.015904 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e"} err="failed to get container status \"a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e\": rpc error: code = NotFound desc = could not find container \"a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e\": container with ID starting with a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e not found: ID does not exist" Jun 02 21:45:27.015944 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.015936 2553 scope.go:117] "RemoveContainer" containerID="122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85" Jun 02 21:45:27.016182 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:45:27.016167 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85\": container with ID starting with 122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85 not found: ID does not exist" containerID="122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85" Jun 02 21:45:27.016225 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.016189 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85"} err="failed to get container status \"122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85\": rpc error: code = NotFound desc = could not find container \"122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85\": container with ID starting with 122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85 not found: ID does not exist" Jun 02 21:45:27.016225 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.016205 2553 scope.go:117] "RemoveContainer" containerID="0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f" Jun 02 21:45:27.016429 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:45:27.016412 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f\": container with ID starting with 0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f not found: ID does not exist" containerID="0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f" Jun 02 21:45:27.016474 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.016433 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f"} err="failed to get container status \"0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f\": rpc error: code = NotFound desc = could not find container \"0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f\": container with ID starting with 0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f not found: ID does not exist" Jun 02 21:45:27.016474 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.016449 2553 scope.go:117] "RemoveContainer" containerID="1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6" Jun 02 21:45:27.016698 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:45:27.016675 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6\": container with ID starting with 1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6 not found: ID does not exist" containerID="1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6" Jun 02 21:45:27.016745 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.016703 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6"} err="failed to get container status \"1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6\": rpc error: code = NotFound desc = could not find container \"1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6\": container with ID starting with 1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6 not found: ID does not exist" Jun 02 21:45:27.016745 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.016717 2553 scope.go:117] "RemoveContainer" containerID="76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606" Jun 02 21:45:27.016925 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:45:27.016910 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606\": container with ID starting with 76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606 not found: ID does not exist" containerID="76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606" Jun 02 21:45:27.016984 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.016927 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606"} err="failed to get container status \"76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606\": rpc error: code = NotFound desc = could not find container \"76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606\": container with ID starting with 76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606 not found: ID does not exist" Jun 02 21:45:27.016984 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.016940 2553 scope.go:117] "RemoveContainer" containerID="99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df" Jun 02 21:45:27.017215 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:45:27.017194 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df\": container with ID starting with 99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df not found: ID does not exist" containerID="99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df" Jun 02 21:45:27.017321 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.017217 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df"} err="failed to get container status \"99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df\": rpc error: code = NotFound desc = could not find container \"99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df\": container with ID starting with 99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df not found: ID does not exist" Jun 02 21:45:27.017321 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.017236 2553 scope.go:117] "RemoveContainer" containerID="360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07" Jun 02 21:45:27.017498 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:45:27.017470 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07\": container with ID starting with 360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07 not found: ID does not exist" containerID="360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07" Jun 02 21:45:27.017603 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.017514 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07"} err="failed to get container status \"360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07\": rpc error: code = NotFound desc = could not find container \"360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07\": container with ID starting with 360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07 not found: ID does not exist" Jun 02 21:45:27.017603 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.017536 2553 scope.go:117] "RemoveContainer" containerID="a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e" Jun 02 21:45:27.017866 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.017841 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e"} err="failed to get container status \"a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e\": rpc error: code = NotFound desc = could not find container \"a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e\": container with ID starting with a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e not found: ID does not exist" Jun 02 21:45:27.017866 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.017865 2553 scope.go:117] "RemoveContainer" containerID="122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85" Jun 02 21:45:27.018098 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.018072 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85"} err="failed to get container status \"122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85\": rpc error: code = NotFound desc = could not find container \"122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85\": container with ID starting with 122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85 not found: ID does not exist" Jun 02 21:45:27.018098 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.018098 2553 scope.go:117] "RemoveContainer" containerID="0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f" Jun 02 21:45:27.018327 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.018308 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f"} err="failed to get container status \"0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f\": rpc error: code = NotFound desc = could not find container \"0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f\": container with ID starting with 0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f not found: ID does not exist" Jun 02 21:45:27.018399 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.018328 2553 scope.go:117] "RemoveContainer" containerID="1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6" Jun 02 21:45:27.018555 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.018524 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6"} err="failed to get container status \"1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6\": rpc error: code = NotFound desc = could not find container \"1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6\": container with ID starting with 1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6 not found: ID does not exist" Jun 02 21:45:27.018555 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.018546 2553 scope.go:117] "RemoveContainer" containerID="76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606" Jun 02 21:45:27.018847 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.018822 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606"} err="failed to get container status \"76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606\": rpc error: code = NotFound desc = could not find container \"76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606\": container with ID starting with 76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606 not found: ID does not exist" Jun 02 21:45:27.018918 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.018848 2553 scope.go:117] "RemoveContainer" containerID="99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df" Jun 02 21:45:27.019042 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.019024 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df"} err="failed to get container status \"99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df\": rpc error: code = NotFound desc = could not find container \"99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df\": container with ID starting with 99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df not found: ID does not exist" Jun 02 21:45:27.019112 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.019053 2553 scope.go:117] "RemoveContainer" containerID="360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07" Jun 02 21:45:27.019249 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.019219 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07"} err="failed to get container status \"360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07\": rpc error: code = NotFound desc = could not find container \"360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07\": container with ID starting with 360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07 not found: ID does not exist" Jun 02 21:45:27.019249 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.019240 2553 scope.go:117] "RemoveContainer" containerID="a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e" Jun 02 21:45:27.019475 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.019453 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e"} err="failed to get container status \"a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e\": rpc error: code = NotFound desc = could not find container \"a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e\": container with ID starting with a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e not found: ID does not exist" Jun 02 21:45:27.019475 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.019468 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 21:45:27.019584 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.019476 2553 scope.go:117] "RemoveContainer" containerID="122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85" Jun 02 21:45:27.019800 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.019781 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85"} err="failed to get container status \"122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85\": rpc error: code = NotFound desc = could not find container \"122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85\": container with ID starting with 122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85 not found: ID does not exist" Jun 02 21:45:27.019888 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.019805 2553 scope.go:117] "RemoveContainer" containerID="0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f" Jun 02 21:45:27.019888 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.019788 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="config-reloader" Jun 02 21:45:27.019888 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.019845 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="config-reloader" Jun 02 21:45:27.019888 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.019860 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="thanos-sidecar" Jun 02 21:45:27.019888 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.019866 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="thanos-sidecar" Jun 02 21:45:27.019888 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.019872 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="kube-rbac-proxy-thanos" Jun 02 21:45:27.019888 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.019879 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="kube-rbac-proxy-thanos" Jun 02 21:45:27.020130 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.019893 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="kube-rbac-proxy-web" Jun 02 21:45:27.020130 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.019900 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="kube-rbac-proxy-web" Jun 02 21:45:27.020130 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.019912 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="init-config-reloader" Jun 02 21:45:27.020130 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.019918 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="init-config-reloader" Jun 02 21:45:27.020130 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.019929 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="prometheus" Jun 02 21:45:27.020130 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.019936 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="prometheus" Jun 02 21:45:27.020130 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.019942 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="kube-rbac-proxy" Jun 02 21:45:27.020130 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.019947 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="kube-rbac-proxy" Jun 02 21:45:27.020130 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.020010 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f"} err="failed to get container status \"0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f\": rpc error: code = NotFound desc = could not find container \"0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f\": container with ID starting with 0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f not found: ID does not exist" Jun 02 21:45:27.020130 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.020028 2553 memory_manager.go:356] "RemoveStaleState removing state" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="kube-rbac-proxy" Jun 02 21:45:27.020130 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.020042 2553 memory_manager.go:356] "RemoveStaleState removing state" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="kube-rbac-proxy-thanos" Jun 02 21:45:27.020130 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.020053 2553 memory_manager.go:356] "RemoveStaleState removing state" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="thanos-sidecar" Jun 02 21:45:27.020130 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.020060 2553 memory_manager.go:356] "RemoveStaleState removing state" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="prometheus" Jun 02 21:45:27.020130 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.020065 2553 memory_manager.go:356] "RemoveStaleState removing state" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="kube-rbac-proxy-web" Jun 02 21:45:27.020130 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.020072 2553 memory_manager.go:356] "RemoveStaleState removing state" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" containerName="config-reloader" Jun 02 21:45:27.020130 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.020028 2553 scope.go:117] "RemoveContainer" containerID="1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6" Jun 02 21:45:27.020689 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.020312 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6"} err="failed to get container status \"1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6\": rpc error: code = NotFound desc = could not find container \"1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6\": container with ID starting with 1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6 not found: ID does not exist" Jun 02 21:45:27.020689 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.020331 2553 scope.go:117] "RemoveContainer" containerID="76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606" Jun 02 21:45:27.020689 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.020544 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606"} err="failed to get container status \"76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606\": rpc error: code = NotFound desc = could not find container \"76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606\": container with ID starting with 76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606 not found: ID does not exist" Jun 02 21:45:27.020689 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.020561 2553 scope.go:117] "RemoveContainer" containerID="99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df" Jun 02 21:45:27.020848 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.020800 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df"} err="failed to get container status \"99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df\": rpc error: code = NotFound desc = could not find container \"99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df\": container with ID starting with 99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df not found: ID does not exist" Jun 02 21:45:27.020848 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.020817 2553 scope.go:117] "RemoveContainer" containerID="360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07" Jun 02 21:45:27.021025 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.021007 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07"} err="failed to get container status \"360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07\": rpc error: code = NotFound desc = could not find container \"360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07\": container with ID starting with 360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07 not found: ID does not exist" Jun 02 21:45:27.021025 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.021024 2553 scope.go:117] "RemoveContainer" containerID="a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e" Jun 02 21:45:27.021233 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.021212 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e"} err="failed to get container status \"a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e\": rpc error: code = NotFound desc = could not find container \"a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e\": container with ID starting with a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e not found: ID does not exist" Jun 02 21:45:27.021233 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.021231 2553 scope.go:117] "RemoveContainer" containerID="122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85" Jun 02 21:45:27.021414 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.021399 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85"} err="failed to get container status \"122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85\": rpc error: code = NotFound desc = could not find container \"122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85\": container with ID starting with 122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85 not found: ID does not exist" Jun 02 21:45:27.021454 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.021414 2553 scope.go:117] "RemoveContainer" containerID="0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f" Jun 02 21:45:27.021598 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.021582 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f"} err="failed to get container status \"0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f\": rpc error: code = NotFound desc = could not find container \"0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f\": container with ID starting with 0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f not found: ID does not exist" Jun 02 21:45:27.021666 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.021599 2553 scope.go:117] "RemoveContainer" containerID="1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6" Jun 02 21:45:27.021777 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.021758 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6"} err="failed to get container status \"1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6\": rpc error: code = NotFound desc = could not find container \"1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6\": container with ID starting with 1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6 not found: ID does not exist" Jun 02 21:45:27.021818 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.021777 2553 scope.go:117] "RemoveContainer" containerID="76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606" Jun 02 21:45:27.021939 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.021917 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606"} err="failed to get container status \"76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606\": rpc error: code = NotFound desc = could not find container \"76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606\": container with ID starting with 76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606 not found: ID does not exist" Jun 02 21:45:27.021979 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.021938 2553 scope.go:117] "RemoveContainer" containerID="99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df" Jun 02 21:45:27.022170 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.022154 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df"} err="failed to get container status \"99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df\": rpc error: code = NotFound desc = could not find container \"99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df\": container with ID starting with 99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df not found: ID does not exist" Jun 02 21:45:27.022170 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.022169 2553 scope.go:117] "RemoveContainer" containerID="360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07" Jun 02 21:45:27.022375 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.022359 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07"} err="failed to get container status \"360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07\": rpc error: code = NotFound desc = could not find container \"360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07\": container with ID starting with 360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07 not found: ID does not exist" Jun 02 21:45:27.022424 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.022376 2553 scope.go:117] "RemoveContainer" containerID="a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e" Jun 02 21:45:27.022561 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.022547 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e"} err="failed to get container status \"a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e\": rpc error: code = NotFound desc = could not find container \"a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e\": container with ID starting with a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e not found: ID does not exist" Jun 02 21:45:27.022561 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.022560 2553 scope.go:117] "RemoveContainer" containerID="122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85" Jun 02 21:45:27.022775 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.022759 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85"} err="failed to get container status \"122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85\": rpc error: code = NotFound desc = could not find container \"122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85\": container with ID starting with 122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85 not found: ID does not exist" Jun 02 21:45:27.022775 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.022774 2553 scope.go:117] "RemoveContainer" containerID="0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f" Jun 02 21:45:27.022929 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.022915 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f"} err="failed to get container status \"0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f\": rpc error: code = NotFound desc = could not find container \"0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f\": container with ID starting with 0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f not found: ID does not exist" Jun 02 21:45:27.022969 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.022929 2553 scope.go:117] "RemoveContainer" containerID="1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6" Jun 02 21:45:27.023130 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.023115 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6"} err="failed to get container status \"1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6\": rpc error: code = NotFound desc = could not find container \"1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6\": container with ID starting with 1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6 not found: ID does not exist" Jun 02 21:45:27.023172 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.023130 2553 scope.go:117] "RemoveContainer" containerID="76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606" Jun 02 21:45:27.023295 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.023280 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606"} err="failed to get container status \"76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606\": rpc error: code = NotFound desc = could not find container \"76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606\": container with ID starting with 76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606 not found: ID does not exist" Jun 02 21:45:27.023338 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.023295 2553 scope.go:117] "RemoveContainer" containerID="99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df" Jun 02 21:45:27.023464 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.023446 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df"} err="failed to get container status \"99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df\": rpc error: code = NotFound desc = could not find container \"99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df\": container with ID starting with 99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df not found: ID does not exist" Jun 02 21:45:27.023508 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.023468 2553 scope.go:117] "RemoveContainer" containerID="360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07" Jun 02 21:45:27.023808 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.023787 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07"} err="failed to get container status \"360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07\": rpc error: code = NotFound desc = could not find container \"360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07\": container with ID starting with 360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07 not found: ID does not exist" Jun 02 21:45:27.023871 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.023809 2553 scope.go:117] "RemoveContainer" containerID="a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e" Jun 02 21:45:27.023990 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.023967 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e"} err="failed to get container status \"a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e\": rpc error: code = NotFound desc = could not find container \"a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e\": container with ID starting with a4de8e335aa3f22d6f1ab695765824ad1386b075d7f2cf95eac5411084f3282e not found: ID does not exist" Jun 02 21:45:27.023990 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.023989 2553 scope.go:117] "RemoveContainer" containerID="122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85" Jun 02 21:45:27.024176 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.024162 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.024218 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.024188 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85"} err="failed to get container status \"122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85\": rpc error: code = NotFound desc = could not find container \"122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85\": container with ID starting with 122ee2fe6145ff76792ae6b906b8f96810e0c012c74bb11465dc4343af7f9a85 not found: ID does not exist" Jun 02 21:45:27.024218 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.024207 2553 scope.go:117] "RemoveContainer" containerID="0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f" Jun 02 21:45:27.024525 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.024373 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f"} err="failed to get container status \"0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f\": rpc error: code = NotFound desc = could not find container \"0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f\": container with ID starting with 0db22177fb3c9e3368a70cfe705868b33642af1b3cd6c11e564defb13cc6c02f not found: ID does not exist" Jun 02 21:45:27.024525 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.024396 2553 scope.go:117] "RemoveContainer" containerID="1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6" Jun 02 21:45:27.024807 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.024764 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6"} err="failed to get container status \"1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6\": rpc error: code = NotFound desc = could not find container \"1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6\": container with ID starting with 1dbd121a4c9a0f0262364d8b06253b3c0a5540617c9ff7264a9b2c87228fc8f6 not found: ID does not exist" Jun 02 21:45:27.024807 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.024790 2553 scope.go:117] "RemoveContainer" containerID="76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606" Jun 02 21:45:27.025049 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.025025 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606"} err="failed to get container status \"76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606\": rpc error: code = NotFound desc = could not find container \"76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606\": container with ID starting with 76d8adb918517189dbb672c1ed30ad1b34800d5815b0114130dffd283984f606 not found: ID does not exist" Jun 02 21:45:27.025049 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.025048 2553 scope.go:117] "RemoveContainer" containerID="99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df" Jun 02 21:45:27.025276 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.025248 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df"} err="failed to get container status \"99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df\": rpc error: code = NotFound desc = could not find container \"99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df\": container with ID starting with 99dbafbca9f2e2483916403796a5ec72d2f79e0d4386807e538e63edc94b40df not found: ID does not exist" Jun 02 21:45:27.025276 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.025266 2553 scope.go:117] "RemoveContainer" containerID="360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07" Jun 02 21:45:27.025456 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.025441 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07"} err="failed to get container status \"360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07\": rpc error: code = NotFound desc = could not find container \"360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07\": container with ID starting with 360aae180714af4077768cd6671086e85f4ca03bf3c82428c9910fb2695e0a07 not found: ID does not exist" Jun 02 21:45:27.026727 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.026706 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 21:45:27.026727 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.026715 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 21:45:27.026923 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.026779 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 21:45:27.026923 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.026808 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 21:45:27.026923 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.026808 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 21:45:27.027172 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.026973 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 21:45:27.027356 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.027339 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 21:45:27.027454 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.027366 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wmd5q\"" Jun 02 21:45:27.027601 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.027578 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-aqeopmgaib67s\"" Jun 02 21:45:27.027601 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.027601 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 21:45:27.027743 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.027654 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 21:45:27.027977 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.027957 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 21:45:27.028305 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.028288 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 21:45:27.030244 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.030222 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 21:45:27.032498 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.032482 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 21:45:27.036801 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.036780 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 21:45:27.124157 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.124129 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.124304 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.124167 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/beea3120-d01c-4997-915a-a6d616473f45-config-out\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.124304 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.124193 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.124304 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.124247 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-web-config\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.124304 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.124294 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beea3120-d01c-4997-915a-a6d616473f45-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.124447 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.124313 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beea3120-d01c-4997-915a-a6d616473f45-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.124447 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.124332 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.124447 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.124387 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beea3120-d01c-4997-915a-a6d616473f45-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.124447 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.124421 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/beea3120-d01c-4997-915a-a6d616473f45-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.124447 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.124444 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/beea3120-d01c-4997-915a-a6d616473f45-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.124608 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.124460 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-config\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.124608 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.124479 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpvk5\" (UniqueName: \"kubernetes.io/projected/beea3120-d01c-4997-915a-a6d616473f45-kube-api-access-qpvk5\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.124608 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.124517 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/beea3120-d01c-4997-915a-a6d616473f45-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.124608 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.124542 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beea3120-d01c-4997-915a-a6d616473f45-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.124608 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.124569 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.124608 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.124589 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.124608 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.124605 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.124851 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.124652 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.224988 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.224927 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.224988 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.224961 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.224988 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.224980 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.225842 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.225000 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/beea3120-d01c-4997-915a-a6d616473f45-config-out\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.225842 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.225027 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.225842 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.225059 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-web-config\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.225842 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.225098 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beea3120-d01c-4997-915a-a6d616473f45-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.225842 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.225122 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beea3120-d01c-4997-915a-a6d616473f45-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.225842 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.225145 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.225842 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.225174 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beea3120-d01c-4997-915a-a6d616473f45-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.225842 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.225200 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/beea3120-d01c-4997-915a-a6d616473f45-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.225842 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.225225 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/beea3120-d01c-4997-915a-a6d616473f45-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.225842 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.225254 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-config\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.225842 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.225279 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qpvk5\" (UniqueName: \"kubernetes.io/projected/beea3120-d01c-4997-915a-a6d616473f45-kube-api-access-qpvk5\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.225842 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.225306 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/beea3120-d01c-4997-915a-a6d616473f45-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.225842 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.225334 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beea3120-d01c-4997-915a-a6d616473f45-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.225842 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.225372 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.225842 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.225399 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.226576 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.225910 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beea3120-d01c-4997-915a-a6d616473f45-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.226576 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.226158 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/beea3120-d01c-4997-915a-a6d616473f45-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.227095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.227072 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beea3120-d01c-4997-915a-a6d616473f45-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.228040 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.228015 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beea3120-d01c-4997-915a-a6d616473f45-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.228713 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.228452 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.228713 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.228595 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/beea3120-d01c-4997-915a-a6d616473f45-config-out\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.228917 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.228728 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beea3120-d01c-4997-915a-a6d616473f45-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.228975 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.228921 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.229598 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.229315 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-web-config\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.229598 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.229371 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.229598 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.229545 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.229820 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.229701 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.230135 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.230113 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.230811 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.230789 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/beea3120-d01c-4997-915a-a6d616473f45-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.231031 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.231007 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.231454 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.231432 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/beea3120-d01c-4997-915a-a6d616473f45-config\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.231734 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.231715 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/beea3120-d01c-4997-915a-a6d616473f45-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.237579 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.237563 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpvk5\" (UniqueName: \"kubernetes.io/projected/beea3120-d01c-4997-915a-a6d616473f45-kube-api-access-qpvk5\") pod \"prometheus-k8s-0\" (UID: \"beea3120-d01c-4997-915a-a6d616473f45\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.334408 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.334380 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:45:27.463285 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.463244 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 21:45:27.466120 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:45:27.466090 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeea3120_d01c_4997_915a_a6d616473f45.slice/crio-f1523cc9411b08ed48a7f4b2f6beba0e8af8abd04e033d7d45367db61ae65684 WatchSource:0}: Error finding container f1523cc9411b08ed48a7f4b2f6beba0e8af8abd04e033d7d45367db61ae65684: Status 404 returned error can't find the container with id f1523cc9411b08ed48a7f4b2f6beba0e8af8abd04e033d7d45367db61ae65684 Jun 02 21:45:27.974370 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.974338 2553 generic.go:358] "Generic (PLEG): container finished" podID="beea3120-d01c-4997-915a-a6d616473f45" containerID="145f52dfc3631eacc8229cd5672c5b01d659e9814ea5d58533f464448902646d" exitCode=0 Jun 02 21:45:27.974807 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.974431 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"beea3120-d01c-4997-915a-a6d616473f45","Type":"ContainerDied","Data":"145f52dfc3631eacc8229cd5672c5b01d659e9814ea5d58533f464448902646d"} Jun 02 21:45:27.974807 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:27.974474 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"beea3120-d01c-4997-915a-a6d616473f45","Type":"ContainerStarted","Data":"f1523cc9411b08ed48a7f4b2f6beba0e8af8abd04e033d7d45367db61ae65684"} Jun 02 21:45:28.344406 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:28.344375 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8be5d4a2-5025-4f8a-abcb-c78aa5cebb23" path="/var/lib/kubelet/pods/8be5d4a2-5025-4f8a-abcb-c78aa5cebb23/volumes" Jun 02 21:45:28.982084 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:28.982047 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"beea3120-d01c-4997-915a-a6d616473f45","Type":"ContainerStarted","Data":"8fb38059d1d403bd52e3860a8fc65fc137054b18604dc5a6d28de2b36596250b"} Jun 02 21:45:28.982084 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:28.982083 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"beea3120-d01c-4997-915a-a6d616473f45","Type":"ContainerStarted","Data":"ab066c9bd1b536af19d5b6b4c090c004359ac5cdbcf8afd59c5f7c936bda80dc"} Jun 02 21:45:28.982533 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:28.982097 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"beea3120-d01c-4997-915a-a6d616473f45","Type":"ContainerStarted","Data":"71184305dc247bd7db4cf46e82a84cd1651ef08654357c5c2dfd52b3a017d880"} Jun 02 21:45:28.982533 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:28.982110 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"beea3120-d01c-4997-915a-a6d616473f45","Type":"ContainerStarted","Data":"f9171f74dc4b7713db19ee587966ce535bf8e1e7b3480b89260e2db3dc1080c9"} Jun 02 21:45:28.982533 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:28.982122 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"beea3120-d01c-4997-915a-a6d616473f45","Type":"ContainerStarted","Data":"a1b760db3f70ada254c5f2ad21d656e9f1f616d0ede1a98e040a6bf75b0ad584"} Jun 02 21:45:28.982533 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:28.982132 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"beea3120-d01c-4997-915a-a6d616473f45","Type":"ContainerStarted","Data":"537b1ff7d3cdaf8efdd0d3a2c058149035736fa39b1ec704c95df6651900e5d7"} Jun 02 21:45:29.007706 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:29.007659 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.007645768 podStartE2EDuration="2.007645768s" podCreationTimestamp="2026-06-02 21:45:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:45:29.005551755 +0000 UTC m=+221.174505467" watchObservedRunningTime="2026-06-02 21:45:29.007645768 +0000 UTC m=+221.176599476" Jun 02 21:45:32.335138 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:45:32.335103 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:46:27.335383 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:27.335349 2553 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:46:27.350120 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:27.350097 2553 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:46:28.156114 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:28.156085 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 21:46:48.258040 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:48.258014 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/ovn-acl-logging/0.log" Jun 02 21:46:48.259778 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:48.259754 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/ovn-acl-logging/0.log" Jun 02 21:46:48.264917 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:48.264895 2553 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 21:46:56.351225 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.351184 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m"] Jun 02 21:46:56.354929 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.354909 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m" Jun 02 21:46:56.358084 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.358062 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 21:46:56.358205 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.358114 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 21:46:56.358205 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.358114 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kzbcq\"" Jun 02 21:46:56.358205 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.358170 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 21:46:56.358205 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.358163 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 21:46:56.370331 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.370310 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b4lh\" (UniqueName: \"kubernetes.io/projected/963777bc-df48-41e2-abbe-1683891824e2-kube-api-access-8b4lh\") pod \"opendatahub-operator-controller-manager-6858789655-2k45m\" (UID: \"963777bc-df48-41e2-abbe-1683891824e2\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m" Jun 02 21:46:56.370422 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.370342 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/963777bc-df48-41e2-abbe-1683891824e2-webhook-cert\") pod \"opendatahub-operator-controller-manager-6858789655-2k45m\" (UID: \"963777bc-df48-41e2-abbe-1683891824e2\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m" Jun 02 21:46:56.370422 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.370373 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/963777bc-df48-41e2-abbe-1683891824e2-manifests\") pod \"opendatahub-operator-controller-manager-6858789655-2k45m\" (UID: \"963777bc-df48-41e2-abbe-1683891824e2\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m" Jun 02 21:46:56.370490 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.370422 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/963777bc-df48-41e2-abbe-1683891824e2-tmp\") pod \"opendatahub-operator-controller-manager-6858789655-2k45m\" (UID: \"963777bc-df48-41e2-abbe-1683891824e2\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m" Jun 02 21:46:56.370490 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.370449 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/963777bc-df48-41e2-abbe-1683891824e2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6858789655-2k45m\" (UID: \"963777bc-df48-41e2-abbe-1683891824e2\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m" Jun 02 21:46:56.380315 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.380291 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m"] Jun 02 21:46:56.471326 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.471296 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8b4lh\" (UniqueName: \"kubernetes.io/projected/963777bc-df48-41e2-abbe-1683891824e2-kube-api-access-8b4lh\") pod \"opendatahub-operator-controller-manager-6858789655-2k45m\" (UID: \"963777bc-df48-41e2-abbe-1683891824e2\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m" Jun 02 21:46:56.471592 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.471337 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/963777bc-df48-41e2-abbe-1683891824e2-webhook-cert\") pod \"opendatahub-operator-controller-manager-6858789655-2k45m\" (UID: \"963777bc-df48-41e2-abbe-1683891824e2\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m" Jun 02 21:46:56.471592 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.471370 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/963777bc-df48-41e2-abbe-1683891824e2-manifests\") pod \"opendatahub-operator-controller-manager-6858789655-2k45m\" (UID: \"963777bc-df48-41e2-abbe-1683891824e2\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m" Jun 02 21:46:56.471592 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.471391 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/963777bc-df48-41e2-abbe-1683891824e2-tmp\") pod \"opendatahub-operator-controller-manager-6858789655-2k45m\" (UID: \"963777bc-df48-41e2-abbe-1683891824e2\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m" Jun 02 21:46:56.471592 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.471412 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/963777bc-df48-41e2-abbe-1683891824e2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6858789655-2k45m\" (UID: \"963777bc-df48-41e2-abbe-1683891824e2\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m" Jun 02 21:46:56.471907 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.471887 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/963777bc-df48-41e2-abbe-1683891824e2-manifests\") pod \"opendatahub-operator-controller-manager-6858789655-2k45m\" (UID: \"963777bc-df48-41e2-abbe-1683891824e2\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m" Jun 02 21:46:56.473555 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.473534 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/963777bc-df48-41e2-abbe-1683891824e2-tmp\") pod \"opendatahub-operator-controller-manager-6858789655-2k45m\" (UID: \"963777bc-df48-41e2-abbe-1683891824e2\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m" Jun 02 21:46:56.473710 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.473689 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/963777bc-df48-41e2-abbe-1683891824e2-webhook-cert\") pod \"opendatahub-operator-controller-manager-6858789655-2k45m\" (UID: \"963777bc-df48-41e2-abbe-1683891824e2\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m" Jun 02 21:46:56.473876 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.473857 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/963777bc-df48-41e2-abbe-1683891824e2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6858789655-2k45m\" (UID: \"963777bc-df48-41e2-abbe-1683891824e2\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m" Jun 02 21:46:56.494768 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.494746 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b4lh\" (UniqueName: \"kubernetes.io/projected/963777bc-df48-41e2-abbe-1683891824e2-kube-api-access-8b4lh\") pod \"opendatahub-operator-controller-manager-6858789655-2k45m\" (UID: \"963777bc-df48-41e2-abbe-1683891824e2\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m" Jun 02 21:46:56.664807 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.664709 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m" Jun 02 21:46:56.788268 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.788228 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m"] Jun 02 21:46:56.792079 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:46:56.792051 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod963777bc_df48_41e2_abbe_1683891824e2.slice/crio-afdb0f8ac3b5787ff45819ce49304fe47e49a446ee11f3f641b5581b9b0128ee WatchSource:0}: Error finding container afdb0f8ac3b5787ff45819ce49304fe47e49a446ee11f3f641b5581b9b0128ee: Status 404 returned error can't find the container with id afdb0f8ac3b5787ff45819ce49304fe47e49a446ee11f3f641b5581b9b0128ee Jun 02 21:46:56.794028 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:56.794012 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 21:46:57.218267 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:46:57.218234 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m" event={"ID":"963777bc-df48-41e2-abbe-1683891824e2","Type":"ContainerStarted","Data":"afdb0f8ac3b5787ff45819ce49304fe47e49a446ee11f3f641b5581b9b0128ee"} Jun 02 21:47:00.228831 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:00.228747 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m" event={"ID":"963777bc-df48-41e2-abbe-1683891824e2","Type":"ContainerStarted","Data":"421f1553c1eeb21a48a6048089076b085956f517f7ce858af420dc0436824e2e"} Jun 02 21:47:01.232994 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:01.232910 2553 generic.go:358] "Generic (PLEG): container finished" podID="963777bc-df48-41e2-abbe-1683891824e2" containerID="421f1553c1eeb21a48a6048089076b085956f517f7ce858af420dc0436824e2e" exitCode=0 Jun 02 21:47:01.233322 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:01.233008 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m" event={"ID":"963777bc-df48-41e2-abbe-1683891824e2","Type":"ContainerDied","Data":"421f1553c1eeb21a48a6048089076b085956f517f7ce858af420dc0436824e2e"} Jun 02 21:47:02.237015 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:02.236981 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m" event={"ID":"963777bc-df48-41e2-abbe-1683891824e2","Type":"ContainerStarted","Data":"1a5087b413d140d9d5eec37b6ba096d567400d5a818701dbcef14fc2df9663da"} Jun 02 21:47:02.237410 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:02.237104 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m" Jun 02 21:47:02.259875 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:02.259824 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m" podStartSLOduration=1.511010042 podStartE2EDuration="6.259812124s" podCreationTimestamp="2026-06-02 21:46:56 +0000 UTC" firstStartedPulling="2026-06-02 21:46:56.794132956 +0000 UTC m=+308.963086646" lastFinishedPulling="2026-06-02 21:47:01.542934673 +0000 UTC m=+313.711888728" observedRunningTime="2026-06-02 21:47:02.259457388 +0000 UTC m=+314.428411101" watchObservedRunningTime="2026-06-02 21:47:02.259812124 +0000 UTC m=+314.428765836" Jun 02 21:47:13.243005 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:13.242975 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6858789655-2k45m" Jun 02 21:47:15.142273 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:15.142235 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f5cff6669-fsgfw"] Jun 02 21:47:15.150820 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:15.150792 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f5cff6669-fsgfw" Jun 02 21:47:15.155858 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:15.155825 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 21:47:15.155858 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:15.155846 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 21:47:15.156075 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:15.155825 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 02 21:47:15.156075 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:15.155833 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 02 21:47:15.156177 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:15.156140 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-f7hjq\"" Jun 02 21:47:15.156177 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:15.156141 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 02 21:47:15.158024 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:15.157787 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f5cff6669-fsgfw"] Jun 02 21:47:15.212919 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:15.212879 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzst7\" (UniqueName: \"kubernetes.io/projected/3f1de45d-c960-497a-a4bb-74041db4081b-kube-api-access-nzst7\") pod \"lws-controller-manager-5f5cff6669-fsgfw\" (UID: \"3f1de45d-c960-497a-a4bb-74041db4081b\") " pod="openshift-lws-operator/lws-controller-manager-5f5cff6669-fsgfw" Jun 02 21:47:15.213078 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:15.212924 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3f1de45d-c960-497a-a4bb-74041db4081b-metrics-cert\") pod \"lws-controller-manager-5f5cff6669-fsgfw\" (UID: \"3f1de45d-c960-497a-a4bb-74041db4081b\") " pod="openshift-lws-operator/lws-controller-manager-5f5cff6669-fsgfw" Jun 02 21:47:15.213078 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:15.212992 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3f1de45d-c960-497a-a4bb-74041db4081b-manager-config\") pod \"lws-controller-manager-5f5cff6669-fsgfw\" (UID: \"3f1de45d-c960-497a-a4bb-74041db4081b\") " pod="openshift-lws-operator/lws-controller-manager-5f5cff6669-fsgfw" Jun 02 21:47:15.213078 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:15.213043 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f1de45d-c960-497a-a4bb-74041db4081b-cert\") pod \"lws-controller-manager-5f5cff6669-fsgfw\" (UID: \"3f1de45d-c960-497a-a4bb-74041db4081b\") " pod="openshift-lws-operator/lws-controller-manager-5f5cff6669-fsgfw" Jun 02 21:47:15.313703 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:15.313672 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3f1de45d-c960-497a-a4bb-74041db4081b-manager-config\") pod \"lws-controller-manager-5f5cff6669-fsgfw\" (UID: \"3f1de45d-c960-497a-a4bb-74041db4081b\") " pod="openshift-lws-operator/lws-controller-manager-5f5cff6669-fsgfw" Jun 02 21:47:15.313875 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:15.313725 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f1de45d-c960-497a-a4bb-74041db4081b-cert\") pod \"lws-controller-manager-5f5cff6669-fsgfw\" (UID: \"3f1de45d-c960-497a-a4bb-74041db4081b\") " pod="openshift-lws-operator/lws-controller-manager-5f5cff6669-fsgfw" Jun 02 21:47:15.313875 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:15.313761 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nzst7\" (UniqueName: \"kubernetes.io/projected/3f1de45d-c960-497a-a4bb-74041db4081b-kube-api-access-nzst7\") pod \"lws-controller-manager-5f5cff6669-fsgfw\" (UID: \"3f1de45d-c960-497a-a4bb-74041db4081b\") " pod="openshift-lws-operator/lws-controller-manager-5f5cff6669-fsgfw" Jun 02 21:47:15.313875 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:15.313790 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3f1de45d-c960-497a-a4bb-74041db4081b-metrics-cert\") pod \"lws-controller-manager-5f5cff6669-fsgfw\" (UID: \"3f1de45d-c960-497a-a4bb-74041db4081b\") " pod="openshift-lws-operator/lws-controller-manager-5f5cff6669-fsgfw" Jun 02 21:47:15.314387 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:15.314362 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3f1de45d-c960-497a-a4bb-74041db4081b-manager-config\") pod \"lws-controller-manager-5f5cff6669-fsgfw\" (UID: \"3f1de45d-c960-497a-a4bb-74041db4081b\") " pod="openshift-lws-operator/lws-controller-manager-5f5cff6669-fsgfw" Jun 02 21:47:15.316151 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:15.316131 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f1de45d-c960-497a-a4bb-74041db4081b-cert\") pod \"lws-controller-manager-5f5cff6669-fsgfw\" (UID: \"3f1de45d-c960-497a-a4bb-74041db4081b\") " pod="openshift-lws-operator/lws-controller-manager-5f5cff6669-fsgfw" Jun 02 21:47:15.316248 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:15.316223 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3f1de45d-c960-497a-a4bb-74041db4081b-metrics-cert\") pod \"lws-controller-manager-5f5cff6669-fsgfw\" (UID: \"3f1de45d-c960-497a-a4bb-74041db4081b\") " pod="openshift-lws-operator/lws-controller-manager-5f5cff6669-fsgfw" Jun 02 21:47:15.325277 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:15.325255 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzst7\" (UniqueName: \"kubernetes.io/projected/3f1de45d-c960-497a-a4bb-74041db4081b-kube-api-access-nzst7\") pod \"lws-controller-manager-5f5cff6669-fsgfw\" (UID: \"3f1de45d-c960-497a-a4bb-74041db4081b\") " pod="openshift-lws-operator/lws-controller-manager-5f5cff6669-fsgfw" Jun 02 21:47:15.461188 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:15.461158 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f5cff6669-fsgfw" Jun 02 21:47:15.598109 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:15.598086 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f5cff6669-fsgfw"] Jun 02 21:47:15.600499 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:47:15.600474 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f1de45d_c960_497a_a4bb_74041db4081b.slice/crio-cf4a856f199927f68cd70a6870d2ce04d24de99fdc5467a8bf458aeec72d1bdd WatchSource:0}: Error finding container cf4a856f199927f68cd70a6870d2ce04d24de99fdc5467a8bf458aeec72d1bdd: Status 404 returned error can't find the container with id cf4a856f199927f68cd70a6870d2ce04d24de99fdc5467a8bf458aeec72d1bdd Jun 02 21:47:16.286777 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:16.286744 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f5cff6669-fsgfw" event={"ID":"3f1de45d-c960-497a-a4bb-74041db4081b","Type":"ContainerStarted","Data":"cf4a856f199927f68cd70a6870d2ce04d24de99fdc5467a8bf458aeec72d1bdd"} Jun 02 21:47:19.296489 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:19.296450 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f5cff6669-fsgfw" event={"ID":"3f1de45d-c960-497a-a4bb-74041db4081b","Type":"ContainerStarted","Data":"f6cc8028d9d10c8ae8f94f5e23ca1c02be1996eb832452829a890e4c7b437208"} Jun 02 21:47:19.296922 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:19.296724 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5f5cff6669-fsgfw" Jun 02 21:47:19.312763 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:19.312717 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5f5cff6669-fsgfw" podStartSLOduration=1.467230905 podStartE2EDuration="4.312702953s" podCreationTimestamp="2026-06-02 21:47:15 +0000 UTC" firstStartedPulling="2026-06-02 21:47:15.602130379 +0000 UTC m=+327.771084072" lastFinishedPulling="2026-06-02 21:47:18.447602421 +0000 UTC m=+330.616556120" observedRunningTime="2026-06-02 21:47:19.311107396 +0000 UTC m=+331.480061107" watchObservedRunningTime="2026-06-02 21:47:19.312702953 +0000 UTC m=+331.481656643" Jun 02 21:47:30.301822 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:30.301739 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5f5cff6669-fsgfw" Jun 02 21:47:45.532874 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:45.532839 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-659c675bb5-lktc5"] Jun 02 21:47:45.535963 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:45.535945 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-659c675bb5-lktc5" Jun 02 21:47:45.538489 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:45.538462 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-tpp75\"" Jun 02 21:47:45.538574 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:45.538472 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 21:47:45.543087 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:45.543066 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-659c675bb5-lktc5"] Jun 02 21:47:45.554996 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:45.554974 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdgb8\" (UniqueName: \"kubernetes.io/projected/0c3b7678-3c24-4bc3-80ee-0395d477831f-kube-api-access-tdgb8\") pod \"dashboard-redirect-659c675bb5-lktc5\" (UID: \"0c3b7678-3c24-4bc3-80ee-0395d477831f\") " pod="opendatahub/dashboard-redirect-659c675bb5-lktc5" Jun 02 21:47:45.555115 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:45.555030 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0c3b7678-3c24-4bc3-80ee-0395d477831f-redirect-config\") pod \"dashboard-redirect-659c675bb5-lktc5\" (UID: \"0c3b7678-3c24-4bc3-80ee-0395d477831f\") " pod="opendatahub/dashboard-redirect-659c675bb5-lktc5" Jun 02 21:47:45.655871 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:45.655836 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tdgb8\" (UniqueName: \"kubernetes.io/projected/0c3b7678-3c24-4bc3-80ee-0395d477831f-kube-api-access-tdgb8\") pod \"dashboard-redirect-659c675bb5-lktc5\" (UID: \"0c3b7678-3c24-4bc3-80ee-0395d477831f\") " pod="opendatahub/dashboard-redirect-659c675bb5-lktc5" Jun 02 21:47:45.656030 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:45.655888 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0c3b7678-3c24-4bc3-80ee-0395d477831f-redirect-config\") pod \"dashboard-redirect-659c675bb5-lktc5\" (UID: \"0c3b7678-3c24-4bc3-80ee-0395d477831f\") " pod="opendatahub/dashboard-redirect-659c675bb5-lktc5" Jun 02 21:47:45.656530 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:45.656513 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0c3b7678-3c24-4bc3-80ee-0395d477831f-redirect-config\") pod \"dashboard-redirect-659c675bb5-lktc5\" (UID: \"0c3b7678-3c24-4bc3-80ee-0395d477831f\") " pod="opendatahub/dashboard-redirect-659c675bb5-lktc5" Jun 02 21:47:45.664529 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:45.664499 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdgb8\" (UniqueName: \"kubernetes.io/projected/0c3b7678-3c24-4bc3-80ee-0395d477831f-kube-api-access-tdgb8\") pod \"dashboard-redirect-659c675bb5-lktc5\" (UID: \"0c3b7678-3c24-4bc3-80ee-0395d477831f\") " pod="opendatahub/dashboard-redirect-659c675bb5-lktc5" Jun 02 21:47:45.847095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:45.847025 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-659c675bb5-lktc5" Jun 02 21:47:45.965254 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:45.965229 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-659c675bb5-lktc5"] Jun 02 21:47:45.966680 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:47:45.966658 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c3b7678_3c24_4bc3_80ee_0395d477831f.slice/crio-e4b8ca3c6b3f2fdeb0d3911f0601c3518a75593eea2c4206bb4bc011663a53a3 WatchSource:0}: Error finding container e4b8ca3c6b3f2fdeb0d3911f0601c3518a75593eea2c4206bb4bc011663a53a3: Status 404 returned error can't find the container with id e4b8ca3c6b3f2fdeb0d3911f0601c3518a75593eea2c4206bb4bc011663a53a3 Jun 02 21:47:46.374328 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:46.374292 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-659c675bb5-lktc5" event={"ID":"0c3b7678-3c24-4bc3-80ee-0395d477831f","Type":"ContainerStarted","Data":"e4b8ca3c6b3f2fdeb0d3911f0601c3518a75593eea2c4206bb4bc011663a53a3"} Jun 02 21:47:49.393798 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:49.393764 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-659c675bb5-lktc5" event={"ID":"0c3b7678-3c24-4bc3-80ee-0395d477831f","Type":"ContainerStarted","Data":"23ed04f3f93c46c0609d7225be94633e8c766001c3f7bbaad10e6ded7479d679"} Jun 02 21:47:49.411802 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:47:49.411248 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-659c675bb5-lktc5" podStartSLOduration=2.073176221 podStartE2EDuration="4.411232966s" podCreationTimestamp="2026-06-02 21:47:45 +0000 UTC" firstStartedPulling="2026-06-02 21:47:45.967926181 +0000 UTC m=+358.136879875" lastFinishedPulling="2026-06-02 21:47:48.305982919 +0000 UTC m=+360.474936620" observedRunningTime="2026-06-02 21:47:49.409919349 +0000 UTC m=+361.578873072" watchObservedRunningTime="2026-06-02 21:47:49.411232966 +0000 UTC m=+361.580186678" Jun 02 21:48:08.066023 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.065988 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d"] Jun 02 21:48:08.069791 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.069769 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.072921 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.072722 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 21:48:08.073044 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.072962 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 21:48:08.073103 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.073064 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 21:48:08.073346 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.072962 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-d7snq\"" Jun 02 21:48:08.080477 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.080451 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d"] Jun 02 21:48:08.109575 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.109539 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.109575 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.109578 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.109789 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.109606 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkt94\" (UniqueName: \"kubernetes.io/projected/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-kube-api-access-pkt94\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.109789 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.109675 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.109789 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.109736 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.109789 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.109759 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.109789 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.109774 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.110021 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.109875 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.110021 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.109918 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.129022 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.128993 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x"] Jun 02 21:48:08.132242 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.132228 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.145940 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.145917 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x"] Jun 02 21:48:08.210813 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.210775 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b165e872-e7e5-49c2-a1f8-06f343de8b77-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.210987 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.210818 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b165e872-e7e5-49c2-a1f8-06f343de8b77-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.210987 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.210855 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.210987 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.210879 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b165e872-e7e5-49c2-a1f8-06f343de8b77-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.210987 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.210901 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b165e872-e7e5-49c2-a1f8-06f343de8b77-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.210987 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.210932 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l74n\" (UniqueName: \"kubernetes.io/projected/b165e872-e7e5-49c2-a1f8-06f343de8b77-kube-api-access-4l74n\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.210987 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.210956 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b165e872-e7e5-49c2-a1f8-06f343de8b77-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.210987 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.210986 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.211335 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.211033 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.211335 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.211081 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b165e872-e7e5-49c2-a1f8-06f343de8b77-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.211335 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.211164 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.211335 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.211209 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.211335 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.211246 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.211335 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.211274 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.211335 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.211298 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.211706 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.211337 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.211706 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.211363 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b165e872-e7e5-49c2-a1f8-06f343de8b77-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.211706 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.211409 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b165e872-e7e5-49c2-a1f8-06f343de8b77-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.211706 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.211449 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pkt94\" (UniqueName: \"kubernetes.io/projected/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-kube-api-access-pkt94\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.211706 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.211484 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.211706 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.211545 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.211706 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.211648 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.212002 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.211846 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.213431 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.213407 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.213769 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.213750 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.218288 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.218266 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.218530 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.218512 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkt94\" (UniqueName: \"kubernetes.io/projected/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-kube-api-access-pkt94\") pod \"data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.312398 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.312367 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b165e872-e7e5-49c2-a1f8-06f343de8b77-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.312551 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.312425 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b165e872-e7e5-49c2-a1f8-06f343de8b77-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.312551 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.312449 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b165e872-e7e5-49c2-a1f8-06f343de8b77-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.312551 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.312484 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b165e872-e7e5-49c2-a1f8-06f343de8b77-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.312551 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.312511 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b165e872-e7e5-49c2-a1f8-06f343de8b77-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.312551 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.312541 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b165e872-e7e5-49c2-a1f8-06f343de8b77-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.312831 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.312566 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b165e872-e7e5-49c2-a1f8-06f343de8b77-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.312831 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.312597 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4l74n\" (UniqueName: \"kubernetes.io/projected/b165e872-e7e5-49c2-a1f8-06f343de8b77-kube-api-access-4l74n\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.312831 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.312639 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b165e872-e7e5-49c2-a1f8-06f343de8b77-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.312981 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.312878 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b165e872-e7e5-49c2-a1f8-06f343de8b77-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.312981 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.312967 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b165e872-e7e5-49c2-a1f8-06f343de8b77-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.313154 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.313131 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b165e872-e7e5-49c2-a1f8-06f343de8b77-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.313233 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.313174 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b165e872-e7e5-49c2-a1f8-06f343de8b77-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.313365 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.313348 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b165e872-e7e5-49c2-a1f8-06f343de8b77-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.314720 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.314695 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b165e872-e7e5-49c2-a1f8-06f343de8b77-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.315020 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.315003 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b165e872-e7e5-49c2-a1f8-06f343de8b77-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.319810 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.319760 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b165e872-e7e5-49c2-a1f8-06f343de8b77-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.319985 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.319967 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l74n\" (UniqueName: \"kubernetes.io/projected/b165e872-e7e5-49c2-a1f8-06f343de8b77-kube-api-access-4l74n\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8q8x2x\" (UID: \"b165e872-e7e5-49c2-a1f8-06f343de8b77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.386016 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.385987 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:08.441882 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.441844 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:08.521279 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.521179 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d"] Jun 02 21:48:08.524054 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:48:08.523776 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod985fc582_ddfc_4f2f_9067_a0f1a81ebfce.slice/crio-00ad8570bc5f5882c72ba04489622b36d39ee4d21d5d7c6f6687a5b11e1030ab WatchSource:0}: Error finding container 00ad8570bc5f5882c72ba04489622b36d39ee4d21d5d7c6f6687a5b11e1030ab: Status 404 returned error can't find the container with id 00ad8570bc5f5882c72ba04489622b36d39ee4d21d5d7c6f6687a5b11e1030ab Jun 02 21:48:08.573712 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:08.573689 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x"] Jun 02 21:48:08.576902 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:48:08.576867 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb165e872_e7e5_49c2_a1f8_06f343de8b77.slice/crio-9426d7962d6ac0815e4a7f4c8d067972af831e6ef787439970763a106fa228c1 WatchSource:0}: Error finding container 9426d7962d6ac0815e4a7f4c8d067972af831e6ef787439970763a106fa228c1: Status 404 returned error can't find the container with id 9426d7962d6ac0815e4a7f4c8d067972af831e6ef787439970763a106fa228c1 Jun 02 21:48:09.454343 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:09.454305 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" event={"ID":"b165e872-e7e5-49c2-a1f8-06f343de8b77","Type":"ContainerStarted","Data":"9426d7962d6ac0815e4a7f4c8d067972af831e6ef787439970763a106fa228c1"} Jun 02 21:48:09.457317 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:09.457263 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" event={"ID":"985fc582-ddfc-4f2f-9067-a0f1a81ebfce","Type":"ContainerStarted","Data":"00ad8570bc5f5882c72ba04489622b36d39ee4d21d5d7c6f6687a5b11e1030ab"} Jun 02 21:48:11.145119 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:11.145076 2553 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 02 21:48:11.145395 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:11.145149 2553 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 02 21:48:11.145395 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:11.145174 2553 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 02 21:48:11.150888 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:11.150852 2553 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 02 21:48:11.150986 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:11.150917 2553 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 02 21:48:11.150986 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:11.150944 2553 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 02 21:48:11.465006 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:11.464967 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" event={"ID":"b165e872-e7e5-49c2-a1f8-06f343de8b77","Type":"ContainerStarted","Data":"1374eb6d85deb28c3a1507a3095d2eb356e146c3612daabe3c239564fc9997de"} Jun 02 21:48:11.466377 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:11.466350 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" event={"ID":"985fc582-ddfc-4f2f-9067-a0f1a81ebfce","Type":"ContainerStarted","Data":"d83e44403e48ea0e7061d2c3eebbf92767bc4ae559abdfb100fc8836b95be341"} Jun 02 21:48:11.485958 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:11.485912 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" podStartSLOduration=0.914271334 podStartE2EDuration="3.485899157s" podCreationTimestamp="2026-06-02 21:48:08 +0000 UTC" firstStartedPulling="2026-06-02 21:48:08.579012234 +0000 UTC m=+380.747965924" lastFinishedPulling="2026-06-02 21:48:11.150640044 +0000 UTC m=+383.319593747" observedRunningTime="2026-06-02 21:48:11.484878968 +0000 UTC m=+383.653832681" watchObservedRunningTime="2026-06-02 21:48:11.485899157 +0000 UTC m=+383.654852868" Jun 02 21:48:11.503161 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:11.503109 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" podStartSLOduration=0.884251797 podStartE2EDuration="3.503093448s" podCreationTimestamp="2026-06-02 21:48:08 +0000 UTC" firstStartedPulling="2026-06-02 21:48:08.52600683 +0000 UTC m=+380.694960537" lastFinishedPulling="2026-06-02 21:48:11.144848495 +0000 UTC m=+383.313802188" observedRunningTime="2026-06-02 21:48:11.502201601 +0000 UTC m=+383.671155351" watchObservedRunningTime="2026-06-02 21:48:11.503093448 +0000 UTC m=+383.672047163" Jun 02 21:48:12.386987 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:12.386953 2553 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:12.388509 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:12.388477 2553 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused" start-of-body= Jun 02 21:48:12.388603 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:12.388540 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" podUID="985fc582-ddfc-4f2f-9067-a0f1a81ebfce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused" Jun 02 21:48:12.443225 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:12.443190 2553 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:12.447612 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:12.447589 2553 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:12.469672 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:12.469648 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:12.470371 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:12.470351 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8q8x2x" Jun 02 21:48:12.515488 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:12.515459 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d"] Jun 02 21:48:13.387331 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:13.387296 2553 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused" start-of-body= Jun 02 21:48:13.387700 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:13.387376 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" podUID="985fc582-ddfc-4f2f-9067-a0f1a81ebfce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused" Jun 02 21:48:14.386832 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:14.386795 2553 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused" start-of-body= Jun 02 21:48:14.386978 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:14.386853 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" podUID="985fc582-ddfc-4f2f-9067-a0f1a81ebfce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused" Jun 02 21:48:14.475974 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:14.475940 2553 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" podUID="985fc582-ddfc-4f2f-9067-a0f1a81ebfce" containerName="istio-proxy" containerID="cri-o://d83e44403e48ea0e7061d2c3eebbf92767bc4ae559abdfb100fc8836b95be341" gracePeriod=30 Jun 02 21:48:16.686119 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:16.686085 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w4zlt"] Jun 02 21:48:16.689446 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:16.689429 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-w4zlt" Jun 02 21:48:16.692096 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:16.692073 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 21:48:16.692229 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:16.692076 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 21:48:16.693018 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:16.692998 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-5kdgh\"" Jun 02 21:48:16.699997 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:16.699970 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w4zlt"] Jun 02 21:48:16.783492 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:16.783453 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-286jz\" (UniqueName: \"kubernetes.io/projected/bf3660c1-d334-4a21-bc59-0fd6b25b8521-kube-api-access-286jz\") pod \"kuadrant-operator-catalog-w4zlt\" (UID: \"bf3660c1-d334-4a21-bc59-0fd6b25b8521\") " pod="kuadrant-system/kuadrant-operator-catalog-w4zlt" Jun 02 21:48:16.884864 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:16.884828 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-286jz\" (UniqueName: \"kubernetes.io/projected/bf3660c1-d334-4a21-bc59-0fd6b25b8521-kube-api-access-286jz\") pod \"kuadrant-operator-catalog-w4zlt\" (UID: \"bf3660c1-d334-4a21-bc59-0fd6b25b8521\") " pod="kuadrant-system/kuadrant-operator-catalog-w4zlt" Jun 02 21:48:16.893347 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:16.893317 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-286jz\" (UniqueName: \"kubernetes.io/projected/bf3660c1-d334-4a21-bc59-0fd6b25b8521-kube-api-access-286jz\") pod \"kuadrant-operator-catalog-w4zlt\" (UID: \"bf3660c1-d334-4a21-bc59-0fd6b25b8521\") " pod="kuadrant-system/kuadrant-operator-catalog-w4zlt" Jun 02 21:48:17.000701 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:17.000572 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-w4zlt" Jun 02 21:48:17.053253 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:17.053212 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w4zlt"] Jun 02 21:48:17.126258 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:17.126229 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w4zlt"] Jun 02 21:48:17.128861 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:48:17.128833 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf3660c1_d334_4a21_bc59_0fd6b25b8521.slice/crio-2bd25f2ba05c9af4e4ae4fcb5b37dfdeb4d807b2bd21d2f0a2887c0849d6904f WatchSource:0}: Error finding container 2bd25f2ba05c9af4e4ae4fcb5b37dfdeb4d807b2bd21d2f0a2887c0849d6904f: Status 404 returned error can't find the container with id 2bd25f2ba05c9af4e4ae4fcb5b37dfdeb4d807b2bd21d2f0a2887c0849d6904f Jun 02 21:48:17.261952 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:17.261861 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pz5fb"] Jun 02 21:48:17.266285 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:17.266263 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pz5fb" Jun 02 21:48:17.271080 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:17.271056 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pz5fb"] Jun 02 21:48:17.389022 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:17.388982 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bmzm\" (UniqueName: \"kubernetes.io/projected/d921f555-db5f-4a22-8206-a52b23e62855-kube-api-access-7bmzm\") pod \"kuadrant-operator-catalog-pz5fb\" (UID: \"d921f555-db5f-4a22-8206-a52b23e62855\") " pod="kuadrant-system/kuadrant-operator-catalog-pz5fb" Jun 02 21:48:17.485064 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:17.485027 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-w4zlt" event={"ID":"bf3660c1-d334-4a21-bc59-0fd6b25b8521","Type":"ContainerStarted","Data":"2bd25f2ba05c9af4e4ae4fcb5b37dfdeb4d807b2bd21d2f0a2887c0849d6904f"} Jun 02 21:48:17.489479 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:17.489451 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7bmzm\" (UniqueName: \"kubernetes.io/projected/d921f555-db5f-4a22-8206-a52b23e62855-kube-api-access-7bmzm\") pod \"kuadrant-operator-catalog-pz5fb\" (UID: \"d921f555-db5f-4a22-8206-a52b23e62855\") " pod="kuadrant-system/kuadrant-operator-catalog-pz5fb" Jun 02 21:48:17.497067 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:17.497046 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bmzm\" (UniqueName: \"kubernetes.io/projected/d921f555-db5f-4a22-8206-a52b23e62855-kube-api-access-7bmzm\") pod \"kuadrant-operator-catalog-pz5fb\" (UID: \"d921f555-db5f-4a22-8206-a52b23e62855\") " pod="kuadrant-system/kuadrant-operator-catalog-pz5fb" Jun 02 21:48:17.577012 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:17.576934 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pz5fb" Jun 02 21:48:17.710723 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:17.710544 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pz5fb"] Jun 02 21:48:17.723599 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:48:17.723564 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd921f555_db5f_4a22_8206_a52b23e62855.slice/crio-ba2b4ce5a6db51a2b7747f46926d2925c5841becad28fb9fd1e45e0bb36e109e WatchSource:0}: Error finding container ba2b4ce5a6db51a2b7747f46926d2925c5841becad28fb9fd1e45e0bb36e109e: Status 404 returned error can't find the container with id ba2b4ce5a6db51a2b7747f46926d2925c5841becad28fb9fd1e45e0bb36e109e Jun 02 21:48:18.492884 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:18.492843 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pz5fb" event={"ID":"d921f555-db5f-4a22-8206-a52b23e62855","Type":"ContainerStarted","Data":"ba2b4ce5a6db51a2b7747f46926d2925c5841becad28fb9fd1e45e0bb36e109e"} Jun 02 21:48:19.496761 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.496723 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-w4zlt" event={"ID":"bf3660c1-d334-4a21-bc59-0fd6b25b8521","Type":"ContainerStarted","Data":"f781cd8a341c61a084c2b86f9bb4c366cc9929d01994a0825af2d6d46043b90b"} Jun 02 21:48:19.497157 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.496809 2553 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-w4zlt" podUID="bf3660c1-d334-4a21-bc59-0fd6b25b8521" containerName="registry-server" containerID="cri-o://f781cd8a341c61a084c2b86f9bb4c366cc9929d01994a0825af2d6d46043b90b" gracePeriod=2 Jun 02 21:48:19.498124 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.498100 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pz5fb" event={"ID":"d921f555-db5f-4a22-8206-a52b23e62855","Type":"ContainerStarted","Data":"001a7ba1b01af97e1cf2d1d3ebddde544863046a01d5c8743b14ebbf4715e311"} Jun 02 21:48:19.510844 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.510794 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-w4zlt" podStartSLOduration=1.454082431 podStartE2EDuration="3.510782869s" podCreationTimestamp="2026-06-02 21:48:16 +0000 UTC" firstStartedPulling="2026-06-02 21:48:17.130205279 +0000 UTC m=+389.299158969" lastFinishedPulling="2026-06-02 21:48:19.186905711 +0000 UTC m=+391.355859407" observedRunningTime="2026-06-02 21:48:19.510092538 +0000 UTC m=+391.679046261" watchObservedRunningTime="2026-06-02 21:48:19.510782869 +0000 UTC m=+391.679736580" Jun 02 21:48:19.523212 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.523167 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pz5fb" podStartSLOduration=1.058035107 podStartE2EDuration="2.523155422s" podCreationTimestamp="2026-06-02 21:48:17 +0000 UTC" firstStartedPulling="2026-06-02 21:48:17.724896676 +0000 UTC m=+389.893850366" lastFinishedPulling="2026-06-02 21:48:19.190016989 +0000 UTC m=+391.358970681" observedRunningTime="2026-06-02 21:48:19.523017329 +0000 UTC m=+391.691971066" watchObservedRunningTime="2026-06-02 21:48:19.523155422 +0000 UTC m=+391.692109133" Jun 02 21:48:19.754259 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.754234 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:19.767596 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.767576 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-w4zlt" Jun 02 21:48:19.808405 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.808375 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-credential-socket\") pod \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " Jun 02 21:48:19.808587 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.808420 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-286jz\" (UniqueName: \"kubernetes.io/projected/bf3660c1-d334-4a21-bc59-0fd6b25b8521-kube-api-access-286jz\") pod \"bf3660c1-d334-4a21-bc59-0fd6b25b8521\" (UID: \"bf3660c1-d334-4a21-bc59-0fd6b25b8521\") " Jun 02 21:48:19.808587 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.808448 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istio-podinfo\") pod \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " Jun 02 21:48:19.808587 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.808469 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkt94\" (UniqueName: \"kubernetes.io/projected/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-kube-api-access-pkt94\") pod \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " Jun 02 21:48:19.808587 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.808488 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-workload-socket\") pod \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " Jun 02 21:48:19.808587 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.808502 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-workload-certs\") pod \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " Jun 02 21:48:19.808587 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.808520 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istio-token\") pod \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " Jun 02 21:48:19.808587 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.808557 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istiod-ca-cert\") pod \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " Jun 02 21:48:19.808941 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.808702 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "985fc582-ddfc-4f2f-9067-a0f1a81ebfce" (UID: "985fc582-ddfc-4f2f-9067-a0f1a81ebfce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:48:19.808941 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.808823 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istio-data\") pod \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " Jun 02 21:48:19.808941 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.808848 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "985fc582-ddfc-4f2f-9067-a0f1a81ebfce" (UID: "985fc582-ddfc-4f2f-9067-a0f1a81ebfce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:48:19.808941 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.808877 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "985fc582-ddfc-4f2f-9067-a0f1a81ebfce" (UID: "985fc582-ddfc-4f2f-9067-a0f1a81ebfce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:48:19.808941 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.808911 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istio-envoy\") pod \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\" (UID: \"985fc582-ddfc-4f2f-9067-a0f1a81ebfce\") " Jun 02 21:48:19.809177 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.809040 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istio-data" (OuterVolumeSpecName: "istio-data") pod "985fc582-ddfc-4f2f-9067-a0f1a81ebfce" (UID: "985fc582-ddfc-4f2f-9067-a0f1a81ebfce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:48:19.809344 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.809261 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istio-data\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:48:19.809344 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.809287 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-credential-socket\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:48:19.809344 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.809305 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-workload-socket\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:48:19.809344 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.809321 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-workload-certs\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:48:19.809640 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.809387 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "985fc582-ddfc-4f2f-9067-a0f1a81ebfce" (UID: "985fc582-ddfc-4f2f-9067-a0f1a81ebfce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:48:19.810883 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.810851 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf3660c1-d334-4a21-bc59-0fd6b25b8521-kube-api-access-286jz" (OuterVolumeSpecName: "kube-api-access-286jz") pod "bf3660c1-d334-4a21-bc59-0fd6b25b8521" (UID: "bf3660c1-d334-4a21-bc59-0fd6b25b8521"). InnerVolumeSpecName "kube-api-access-286jz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:48:19.810957 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.810889 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "985fc582-ddfc-4f2f-9067-a0f1a81ebfce" (UID: "985fc582-ddfc-4f2f-9067-a0f1a81ebfce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:48:19.811110 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.811090 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istio-token" (OuterVolumeSpecName: "istio-token") pod "985fc582-ddfc-4f2f-9067-a0f1a81ebfce" (UID: "985fc582-ddfc-4f2f-9067-a0f1a81ebfce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:48:19.811186 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.811169 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "985fc582-ddfc-4f2f-9067-a0f1a81ebfce" (UID: "985fc582-ddfc-4f2f-9067-a0f1a81ebfce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 02 21:48:19.811186 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.811176 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-kube-api-access-pkt94" (OuterVolumeSpecName: "kube-api-access-pkt94") pod "985fc582-ddfc-4f2f-9067-a0f1a81ebfce" (UID: "985fc582-ddfc-4f2f-9067-a0f1a81ebfce"). InnerVolumeSpecName "kube-api-access-pkt94". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:48:19.910428 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.910395 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-286jz\" (UniqueName: \"kubernetes.io/projected/bf3660c1-d334-4a21-bc59-0fd6b25b8521-kube-api-access-286jz\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:48:19.910428 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.910424 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istio-podinfo\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:48:19.910428 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.910433 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkt94\" (UniqueName: \"kubernetes.io/projected/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-kube-api-access-pkt94\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:48:19.910717 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.910443 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istio-token\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:48:19.910717 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.910452 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istiod-ca-cert\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:48:19.910717 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:19.910460 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/985fc582-ddfc-4f2f-9067-a0f1a81ebfce-istio-envoy\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:48:20.502409 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:20.502318 2553 generic.go:358] "Generic (PLEG): container finished" podID="bf3660c1-d334-4a21-bc59-0fd6b25b8521" containerID="f781cd8a341c61a084c2b86f9bb4c366cc9929d01994a0825af2d6d46043b90b" exitCode=0 Jun 02 21:48:20.502409 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:20.502384 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-w4zlt" Jun 02 21:48:20.502409 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:20.502397 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-w4zlt" event={"ID":"bf3660c1-d334-4a21-bc59-0fd6b25b8521","Type":"ContainerDied","Data":"f781cd8a341c61a084c2b86f9bb4c366cc9929d01994a0825af2d6d46043b90b"} Jun 02 21:48:20.502971 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:20.502429 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-w4zlt" event={"ID":"bf3660c1-d334-4a21-bc59-0fd6b25b8521","Type":"ContainerDied","Data":"2bd25f2ba05c9af4e4ae4fcb5b37dfdeb4d807b2bd21d2f0a2887c0849d6904f"} Jun 02 21:48:20.502971 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:20.502445 2553 scope.go:117] "RemoveContainer" containerID="f781cd8a341c61a084c2b86f9bb4c366cc9929d01994a0825af2d6d46043b90b" Jun 02 21:48:20.503596 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:20.503572 2553 generic.go:358] "Generic (PLEG): container finished" podID="985fc582-ddfc-4f2f-9067-a0f1a81ebfce" containerID="d83e44403e48ea0e7061d2c3eebbf92767bc4ae559abdfb100fc8836b95be341" exitCode=0 Jun 02 21:48:20.503682 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:20.503641 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" Jun 02 21:48:20.503682 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:20.503662 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" event={"ID":"985fc582-ddfc-4f2f-9067-a0f1a81ebfce","Type":"ContainerDied","Data":"d83e44403e48ea0e7061d2c3eebbf92767bc4ae559abdfb100fc8836b95be341"} Jun 02 21:48:20.503773 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:20.503697 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d" event={"ID":"985fc582-ddfc-4f2f-9067-a0f1a81ebfce","Type":"ContainerDied","Data":"00ad8570bc5f5882c72ba04489622b36d39ee4d21d5d7c6f6687a5b11e1030ab"} Jun 02 21:48:20.510902 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:20.510887 2553 scope.go:117] "RemoveContainer" containerID="f781cd8a341c61a084c2b86f9bb4c366cc9929d01994a0825af2d6d46043b90b" Jun 02 21:48:20.511161 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:48:20.511143 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f781cd8a341c61a084c2b86f9bb4c366cc9929d01994a0825af2d6d46043b90b\": container with ID starting with f781cd8a341c61a084c2b86f9bb4c366cc9929d01994a0825af2d6d46043b90b not found: ID does not exist" containerID="f781cd8a341c61a084c2b86f9bb4c366cc9929d01994a0825af2d6d46043b90b" Jun 02 21:48:20.511204 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:20.511169 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f781cd8a341c61a084c2b86f9bb4c366cc9929d01994a0825af2d6d46043b90b"} err="failed to get container status \"f781cd8a341c61a084c2b86f9bb4c366cc9929d01994a0825af2d6d46043b90b\": rpc error: code = NotFound desc = could not find container \"f781cd8a341c61a084c2b86f9bb4c366cc9929d01994a0825af2d6d46043b90b\": container with ID starting with f781cd8a341c61a084c2b86f9bb4c366cc9929d01994a0825af2d6d46043b90b not found: ID does not exist" Jun 02 21:48:20.511204 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:20.511186 2553 scope.go:117] "RemoveContainer" containerID="d83e44403e48ea0e7061d2c3eebbf92767bc4ae559abdfb100fc8836b95be341" Jun 02 21:48:20.518182 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:20.518162 2553 scope.go:117] "RemoveContainer" containerID="d83e44403e48ea0e7061d2c3eebbf92767bc4ae559abdfb100fc8836b95be341" Jun 02 21:48:20.518463 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:48:20.518447 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d83e44403e48ea0e7061d2c3eebbf92767bc4ae559abdfb100fc8836b95be341\": container with ID starting with d83e44403e48ea0e7061d2c3eebbf92767bc4ae559abdfb100fc8836b95be341 not found: ID does not exist" containerID="d83e44403e48ea0e7061d2c3eebbf92767bc4ae559abdfb100fc8836b95be341" Jun 02 21:48:20.518523 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:20.518473 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d83e44403e48ea0e7061d2c3eebbf92767bc4ae559abdfb100fc8836b95be341"} err="failed to get container status \"d83e44403e48ea0e7061d2c3eebbf92767bc4ae559abdfb100fc8836b95be341\": rpc error: code = NotFound desc = could not find container \"d83e44403e48ea0e7061d2c3eebbf92767bc4ae559abdfb100fc8836b95be341\": container with ID starting with d83e44403e48ea0e7061d2c3eebbf92767bc4ae559abdfb100fc8836b95be341 not found: ID does not exist" Jun 02 21:48:20.520494 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:20.520469 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d"] Jun 02 21:48:20.523944 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:20.523924 2553 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5dcfdcf8b8qxc9d"] Jun 02 21:48:20.532897 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:20.532877 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w4zlt"] Jun 02 21:48:20.536575 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:20.536555 2553 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w4zlt"] Jun 02 21:48:22.341931 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:22.341899 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="985fc582-ddfc-4f2f-9067-a0f1a81ebfce" path="/var/lib/kubelet/pods/985fc582-ddfc-4f2f-9067-a0f1a81ebfce/volumes" Jun 02 21:48:22.342279 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:22.342209 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf3660c1-d334-4a21-bc59-0fd6b25b8521" path="/var/lib/kubelet/pods/bf3660c1-d334-4a21-bc59-0fd6b25b8521/volumes" Jun 02 21:48:27.577758 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:27.577707 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-pz5fb" Jun 02 21:48:27.578228 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:27.577798 2553 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-pz5fb" Jun 02 21:48:27.599027 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:27.599000 2553 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-pz5fb" Jun 02 21:48:28.551869 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:28.551843 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-pz5fb" Jun 02 21:48:48.406191 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:48.406157 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5"] Jun 02 21:48:48.406556 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:48.406439 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="985fc582-ddfc-4f2f-9067-a0f1a81ebfce" containerName="istio-proxy" Jun 02 21:48:48.406556 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:48.406449 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="985fc582-ddfc-4f2f-9067-a0f1a81ebfce" containerName="istio-proxy" Jun 02 21:48:48.406556 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:48.406462 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf3660c1-d334-4a21-bc59-0fd6b25b8521" containerName="registry-server" Jun 02 21:48:48.406556 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:48.406467 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf3660c1-d334-4a21-bc59-0fd6b25b8521" containerName="registry-server" Jun 02 21:48:48.406556 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:48.406522 2553 memory_manager.go:356] "RemoveStaleState removing state" podUID="bf3660c1-d334-4a21-bc59-0fd6b25b8521" containerName="registry-server" Jun 02 21:48:48.406556 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:48.406529 2553 memory_manager.go:356] "RemoveStaleState removing state" podUID="985fc582-ddfc-4f2f-9067-a0f1a81ebfce" containerName="istio-proxy" Jun 02 21:48:48.414440 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:48.414378 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5" Jun 02 21:48:48.415921 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:48.415897 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5"] Jun 02 21:48:48.417004 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:48.416987 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-tnb56\"" Jun 02 21:48:48.557070 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:48.556998 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sv24\" (UniqueName: \"kubernetes.io/projected/536b8b84-a51a-4f78-ba33-c073a3cc10bf-kube-api-access-4sv24\") pod \"limitador-operator-controller-manager-85c4996f8c-92lj5\" (UID: \"536b8b84-a51a-4f78-ba33-c073a3cc10bf\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5" Jun 02 21:48:48.657997 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:48.657964 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4sv24\" (UniqueName: \"kubernetes.io/projected/536b8b84-a51a-4f78-ba33-c073a3cc10bf-kube-api-access-4sv24\") pod \"limitador-operator-controller-manager-85c4996f8c-92lj5\" (UID: \"536b8b84-a51a-4f78-ba33-c073a3cc10bf\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5" Jun 02 21:48:48.672737 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:48.672702 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sv24\" (UniqueName: \"kubernetes.io/projected/536b8b84-a51a-4f78-ba33-c073a3cc10bf-kube-api-access-4sv24\") pod \"limitador-operator-controller-manager-85c4996f8c-92lj5\" (UID: \"536b8b84-a51a-4f78-ba33-c073a3cc10bf\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5" Jun 02 21:48:48.726597 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:48.726571 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5" Jun 02 21:48:48.851500 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:48.851476 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5"] Jun 02 21:48:48.853704 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:48:48.853678 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod536b8b84_a51a_4f78_ba33_c073a3cc10bf.slice/crio-861aa4fc9b59ee992ad4c34db27c255ffd773f227c06f3c5a60e45c17afa7b76 WatchSource:0}: Error finding container 861aa4fc9b59ee992ad4c34db27c255ffd773f227c06f3c5a60e45c17afa7b76: Status 404 returned error can't find the container with id 861aa4fc9b59ee992ad4c34db27c255ffd773f227c06f3c5a60e45c17afa7b76 Jun 02 21:48:49.594504 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:49.594471 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5" event={"ID":"536b8b84-a51a-4f78-ba33-c073a3cc10bf","Type":"ContainerStarted","Data":"861aa4fc9b59ee992ad4c34db27c255ffd773f227c06f3c5a60e45c17afa7b76"} Jun 02 21:48:51.602345 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:51.602303 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5" event={"ID":"536b8b84-a51a-4f78-ba33-c073a3cc10bf","Type":"ContainerStarted","Data":"47dd4a6dc5cb5c8fc35acda91bbb9cb2d36462deaddce22bc1d884a0121f16ce"} Jun 02 21:48:51.602764 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:51.602373 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5" Jun 02 21:48:51.622119 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:51.622070 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5" podStartSLOduration=1.894452921 podStartE2EDuration="3.622053323s" podCreationTimestamp="2026-06-02 21:48:48 +0000 UTC" firstStartedPulling="2026-06-02 21:48:48.855541935 +0000 UTC m=+421.024495625" lastFinishedPulling="2026-06-02 21:48:50.583142333 +0000 UTC m=+422.752096027" observedRunningTime="2026-06-02 21:48:51.621356329 +0000 UTC m=+423.790310041" watchObservedRunningTime="2026-06-02 21:48:51.622053323 +0000 UTC m=+423.791007034" Jun 02 21:48:53.382529 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:53.382491 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z"] Jun 02 21:48:53.385890 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:53.385870 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" Jun 02 21:48:53.389734 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:53.389716 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nn8ch\"" Jun 02 21:48:53.399355 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:53.399333 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z"] Jun 02 21:48:53.410731 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:53.410706 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d26a2206-0d8e-4b69-aeb8-3240e95d130b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7v72z\" (UID: \"d26a2206-0d8e-4b69-aeb8-3240e95d130b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" Jun 02 21:48:53.410833 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:53.410750 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzkq2\" (UniqueName: \"kubernetes.io/projected/d26a2206-0d8e-4b69-aeb8-3240e95d130b-kube-api-access-nzkq2\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7v72z\" (UID: \"d26a2206-0d8e-4b69-aeb8-3240e95d130b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" Jun 02 21:48:53.511258 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:53.511213 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d26a2206-0d8e-4b69-aeb8-3240e95d130b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7v72z\" (UID: \"d26a2206-0d8e-4b69-aeb8-3240e95d130b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" Jun 02 21:48:53.511446 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:53.511301 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nzkq2\" (UniqueName: \"kubernetes.io/projected/d26a2206-0d8e-4b69-aeb8-3240e95d130b-kube-api-access-nzkq2\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7v72z\" (UID: \"d26a2206-0d8e-4b69-aeb8-3240e95d130b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" Jun 02 21:48:53.511641 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:53.511601 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d26a2206-0d8e-4b69-aeb8-3240e95d130b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7v72z\" (UID: \"d26a2206-0d8e-4b69-aeb8-3240e95d130b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" Jun 02 21:48:53.523897 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:53.523868 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzkq2\" (UniqueName: \"kubernetes.io/projected/d26a2206-0d8e-4b69-aeb8-3240e95d130b-kube-api-access-nzkq2\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7v72z\" (UID: \"d26a2206-0d8e-4b69-aeb8-3240e95d130b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" Jun 02 21:48:53.695277 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:53.695243 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" Jun 02 21:48:53.827406 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:53.827366 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z"] Jun 02 21:48:53.829655 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:48:53.829616 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd26a2206_0d8e_4b69_aeb8_3240e95d130b.slice/crio-d30d8b5842d8d7356f760f7df490498db5afcec57b176db6efa50f6ce6ec4e54 WatchSource:0}: Error finding container d30d8b5842d8d7356f760f7df490498db5afcec57b176db6efa50f6ce6ec4e54: Status 404 returned error can't find the container with id d30d8b5842d8d7356f760f7df490498db5afcec57b176db6efa50f6ce6ec4e54 Jun 02 21:48:54.614714 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:54.614657 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" event={"ID":"d26a2206-0d8e-4b69-aeb8-3240e95d130b","Type":"ContainerStarted","Data":"d30d8b5842d8d7356f760f7df490498db5afcec57b176db6efa50f6ce6ec4e54"} Jun 02 21:48:59.631413 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:59.631380 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" event={"ID":"d26a2206-0d8e-4b69-aeb8-3240e95d130b","Type":"ContainerStarted","Data":"10b2d2a07c10c8a18cfac885a7479798caf79d1c2c6b13bd98bc20b642bb6911"} Jun 02 21:48:59.631890 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:59.631500 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" Jun 02 21:48:59.655270 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:48:59.655220 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" podStartSLOduration=1.6255507 podStartE2EDuration="6.655207352s" podCreationTimestamp="2026-06-02 21:48:53 +0000 UTC" firstStartedPulling="2026-06-02 21:48:53.832055694 +0000 UTC m=+426.001009384" lastFinishedPulling="2026-06-02 21:48:58.861712341 +0000 UTC m=+431.030666036" observedRunningTime="2026-06-02 21:48:59.653601562 +0000 UTC m=+431.822555275" watchObservedRunningTime="2026-06-02 21:48:59.655207352 +0000 UTC m=+431.824161063" Jun 02 21:49:02.607694 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:02.607663 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5" Jun 02 21:49:10.637061 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:10.637035 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" Jun 02 21:49:11.681036 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:11.680994 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gchdx"] Jun 02 21:49:11.684483 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:11.684466 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gchdx" Jun 02 21:49:11.693299 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:11.693271 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gchdx"] Jun 02 21:49:11.764867 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:11.764834 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1786f45c-ea70-45f2-b0ac-63a7db62b8ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-gchdx\" (UID: \"1786f45c-ea70-45f2-b0ac-63a7db62b8ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gchdx" Jun 02 21:49:11.765019 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:11.764872 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pqtd\" (UniqueName: \"kubernetes.io/projected/1786f45c-ea70-45f2-b0ac-63a7db62b8ce-kube-api-access-9pqtd\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-gchdx\" (UID: \"1786f45c-ea70-45f2-b0ac-63a7db62b8ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gchdx" Jun 02 21:49:11.866258 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:11.866228 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1786f45c-ea70-45f2-b0ac-63a7db62b8ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-gchdx\" (UID: \"1786f45c-ea70-45f2-b0ac-63a7db62b8ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gchdx" Jun 02 21:49:11.866258 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:11.866263 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9pqtd\" (UniqueName: \"kubernetes.io/projected/1786f45c-ea70-45f2-b0ac-63a7db62b8ce-kube-api-access-9pqtd\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-gchdx\" (UID: \"1786f45c-ea70-45f2-b0ac-63a7db62b8ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gchdx" Jun 02 21:49:11.866595 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:11.866576 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1786f45c-ea70-45f2-b0ac-63a7db62b8ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-gchdx\" (UID: \"1786f45c-ea70-45f2-b0ac-63a7db62b8ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gchdx" Jun 02 21:49:11.877343 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:11.877311 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pqtd\" (UniqueName: \"kubernetes.io/projected/1786f45c-ea70-45f2-b0ac-63a7db62b8ce-kube-api-access-9pqtd\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-gchdx\" (UID: \"1786f45c-ea70-45f2-b0ac-63a7db62b8ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gchdx" Jun 02 21:49:11.995340 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:11.995254 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gchdx" Jun 02 21:49:12.119745 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.119719 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gchdx"] Jun 02 21:49:12.122176 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:49:12.122150 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1786f45c_ea70_45f2_b0ac_63a7db62b8ce.slice/crio-d029a7950e93391bf39d35f11d9bef063f897c5947da6fba608172d95d6c562f WatchSource:0}: Error finding container d029a7950e93391bf39d35f11d9bef063f897c5947da6fba608172d95d6c562f: Status 404 returned error can't find the container with id d029a7950e93391bf39d35f11d9bef063f897c5947da6fba608172d95d6c562f Jun 02 21:49:12.462185 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.462151 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z"] Jun 02 21:49:12.462420 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.462376 2553 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" podUID="d26a2206-0d8e-4b69-aeb8-3240e95d130b" containerName="manager" containerID="cri-o://10b2d2a07c10c8a18cfac885a7479798caf79d1c2c6b13bd98bc20b642bb6911" gracePeriod=2 Jun 02 21:49:12.466591 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.466556 2553 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z"] Jun 02 21:49:12.490534 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.487805 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gchdx"] Jun 02 21:49:12.490534 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.489394 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xgtrk"] Jun 02 21:49:12.490534 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.489791 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d26a2206-0d8e-4b69-aeb8-3240e95d130b" containerName="manager" Jun 02 21:49:12.490534 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.489808 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d26a2206-0d8e-4b69-aeb8-3240e95d130b" containerName="manager" Jun 02 21:49:12.490534 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.489882 2553 memory_manager.go:356] "RemoveStaleState removing state" podUID="d26a2206-0d8e-4b69-aeb8-3240e95d130b" containerName="manager" Jun 02 21:49:12.492810 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.492791 2553 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gchdx"] Jun 02 21:49:12.492907 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.492891 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xgtrk" Jun 02 21:49:12.499614 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.499592 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xgtrk"] Jun 02 21:49:12.507234 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.507209 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5"] Jun 02 21:49:12.507516 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.507492 2553 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5" podUID="536b8b84-a51a-4f78-ba33-c073a3cc10bf" containerName="manager" containerID="cri-o://47dd4a6dc5cb5c8fc35acda91bbb9cb2d36462deaddce22bc1d884a0121f16ce" gracePeriod=2 Jun 02 21:49:12.513772 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.513748 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw"] Jun 02 21:49:12.514217 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.514200 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1786f45c-ea70-45f2-b0ac-63a7db62b8ce" containerName="manager" Jun 02 21:49:12.514312 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.514221 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1786f45c-ea70-45f2-b0ac-63a7db62b8ce" containerName="manager" Jun 02 21:49:12.514371 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.514331 2553 memory_manager.go:356] "RemoveStaleState removing state" podUID="1786f45c-ea70-45f2-b0ac-63a7db62b8ce" containerName="manager" Jun 02 21:49:12.517139 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.517112 2553 status_manager.go:895] "Failed to get status for pod" podUID="d26a2206-0d8e-4b69-aeb8-3240e95d130b" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7v72z\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:12.517256 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.517239 2553 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5"] Jun 02 21:49:12.517354 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.517343 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw" Jun 02 21:49:12.519050 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.519021 2553 status_manager.go:895] "Failed to get status for pod" podUID="536b8b84-a51a-4f78-ba33-c073a3cc10bf" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5" err="pods \"limitador-operator-controller-manager-85c4996f8c-92lj5\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:12.524199 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.524167 2553 status_manager.go:895] "Failed to get status for pod" podUID="d26a2206-0d8e-4b69-aeb8-3240e95d130b" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7v72z\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:12.526178 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.526155 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw"] Jun 02 21:49:12.529967 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.529940 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-49v82"] Jun 02 21:49:12.530402 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.530385 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="536b8b84-a51a-4f78-ba33-c073a3cc10bf" containerName="manager" Jun 02 21:49:12.530531 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.530404 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="536b8b84-a51a-4f78-ba33-c073a3cc10bf" containerName="manager" Jun 02 21:49:12.530531 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.530504 2553 memory_manager.go:356] "RemoveStaleState removing state" podUID="536b8b84-a51a-4f78-ba33-c073a3cc10bf" containerName="manager" Jun 02 21:49:12.533480 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.533460 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-49v82" Jun 02 21:49:12.548097 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.548070 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-49v82"] Jun 02 21:49:12.556736 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.556704 2553 status_manager.go:895] "Failed to get status for pod" podUID="536b8b84-a51a-4f78-ba33-c073a3cc10bf" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5" err="pods \"limitador-operator-controller-manager-85c4996f8c-92lj5\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:12.558859 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.558832 2553 status_manager.go:895] "Failed to get status for pod" podUID="d26a2206-0d8e-4b69-aeb8-3240e95d130b" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7v72z\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:12.572919 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.572897 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qqcm\" (UniqueName: \"kubernetes.io/projected/7ff00f8e-f834-4388-bd24-5e31024edc40-kube-api-access-8qqcm\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw\" (UID: \"7ff00f8e-f834-4388-bd24-5e31024edc40\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw" Jun 02 21:49:12.573024 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.572934 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snts9\" (UniqueName: \"kubernetes.io/projected/4a742b7a-8ae6-4771-93eb-0cd0f2e7186f-kube-api-access-snts9\") pod \"limitador-operator-controller-manager-85c4996f8c-49v82\" (UID: \"4a742b7a-8ae6-4771-93eb-0cd0f2e7186f\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-49v82" Jun 02 21:49:12.573024 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.572960 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxkjn\" (UniqueName: \"kubernetes.io/projected/5a5ec1f6-2e23-4a74-8530-5a5348c58ac0-kube-api-access-cxkjn\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xgtrk\" (UID: \"5a5ec1f6-2e23-4a74-8530-5a5348c58ac0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xgtrk" Jun 02 21:49:12.573101 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.573039 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ff00f8e-f834-4388-bd24-5e31024edc40-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw\" (UID: \"7ff00f8e-f834-4388-bd24-5e31024edc40\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw" Jun 02 21:49:12.573101 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.573065 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a5ec1f6-2e23-4a74-8530-5a5348c58ac0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xgtrk\" (UID: \"5a5ec1f6-2e23-4a74-8530-5a5348c58ac0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xgtrk" Jun 02 21:49:12.578628 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.578584 2553 status_manager.go:895] "Failed to get status for pod" podUID="536b8b84-a51a-4f78-ba33-c073a3cc10bf" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5" err="pods \"limitador-operator-controller-manager-85c4996f8c-92lj5\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:12.580459 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.580438 2553 status_manager.go:895] "Failed to get status for pod" podUID="d26a2206-0d8e-4b69-aeb8-3240e95d130b" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7v72z\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:12.673587 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.673543 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ff00f8e-f834-4388-bd24-5e31024edc40-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw\" (UID: \"7ff00f8e-f834-4388-bd24-5e31024edc40\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw" Jun 02 21:49:12.673723 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.673613 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a5ec1f6-2e23-4a74-8530-5a5348c58ac0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xgtrk\" (UID: \"5a5ec1f6-2e23-4a74-8530-5a5348c58ac0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xgtrk" Jun 02 21:49:12.673723 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.673696 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8qqcm\" (UniqueName: \"kubernetes.io/projected/7ff00f8e-f834-4388-bd24-5e31024edc40-kube-api-access-8qqcm\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw\" (UID: \"7ff00f8e-f834-4388-bd24-5e31024edc40\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw" Jun 02 21:49:12.673861 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.673740 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snts9\" (UniqueName: \"kubernetes.io/projected/4a742b7a-8ae6-4771-93eb-0cd0f2e7186f-kube-api-access-snts9\") pod \"limitador-operator-controller-manager-85c4996f8c-49v82\" (UID: \"4a742b7a-8ae6-4771-93eb-0cd0f2e7186f\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-49v82" Jun 02 21:49:12.673861 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.673787 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cxkjn\" (UniqueName: \"kubernetes.io/projected/5a5ec1f6-2e23-4a74-8530-5a5348c58ac0-kube-api-access-cxkjn\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xgtrk\" (UID: \"5a5ec1f6-2e23-4a74-8530-5a5348c58ac0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xgtrk" Jun 02 21:49:12.674412 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.674083 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ff00f8e-f834-4388-bd24-5e31024edc40-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw\" (UID: \"7ff00f8e-f834-4388-bd24-5e31024edc40\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw" Jun 02 21:49:12.674412 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.674091 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a5ec1f6-2e23-4a74-8530-5a5348c58ac0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xgtrk\" (UID: \"5a5ec1f6-2e23-4a74-8530-5a5348c58ac0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xgtrk" Jun 02 21:49:12.674711 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.674642 2553 generic.go:358] "Generic (PLEG): container finished" podID="d26a2206-0d8e-4b69-aeb8-3240e95d130b" containerID="10b2d2a07c10c8a18cfac885a7479798caf79d1c2c6b13bd98bc20b642bb6911" exitCode=0 Jun 02 21:49:12.676199 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.676177 2553 generic.go:358] "Generic (PLEG): container finished" podID="536b8b84-a51a-4f78-ba33-c073a3cc10bf" containerID="47dd4a6dc5cb5c8fc35acda91bbb9cb2d36462deaddce22bc1d884a0121f16ce" exitCode=0 Jun 02 21:49:12.677985 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:49:12.677963 2553 kuberuntime_manager.go:623] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gchdx" container="manager" Jun 02 21:49:12.680052 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.679931 2553 status_manager.go:895] "Failed to get status for pod" podUID="536b8b84-a51a-4f78-ba33-c073a3cc10bf" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5" err="pods \"limitador-operator-controller-manager-85c4996f8c-92lj5\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:12.681804 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.681744 2553 status_manager.go:895] "Failed to get status for pod" podUID="d26a2206-0d8e-4b69-aeb8-3240e95d130b" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7v72z\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:12.682924 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.682861 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxkjn\" (UniqueName: \"kubernetes.io/projected/5a5ec1f6-2e23-4a74-8530-5a5348c58ac0-kube-api-access-cxkjn\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xgtrk\" (UID: \"5a5ec1f6-2e23-4a74-8530-5a5348c58ac0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xgtrk" Jun 02 21:49:12.682924 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.682873 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snts9\" (UniqueName: \"kubernetes.io/projected/4a742b7a-8ae6-4771-93eb-0cd0f2e7186f-kube-api-access-snts9\") pod \"limitador-operator-controller-manager-85c4996f8c-49v82\" (UID: \"4a742b7a-8ae6-4771-93eb-0cd0f2e7186f\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-49v82" Jun 02 21:49:12.682924 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.682868 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qqcm\" (UniqueName: \"kubernetes.io/projected/7ff00f8e-f834-4388-bd24-5e31024edc40-kube-api-access-8qqcm\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw\" (UID: \"7ff00f8e-f834-4388-bd24-5e31024edc40\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw" Jun 02 21:49:12.683589 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.683561 2553 status_manager.go:895] "Failed to get status for pod" podUID="1786f45c-ea70-45f2-b0ac-63a7db62b8ce" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gchdx" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-gchdx\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:12.734646 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.734598 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" Jun 02 21:49:12.736860 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.736817 2553 status_manager.go:895] "Failed to get status for pod" podUID="1786f45c-ea70-45f2-b0ac-63a7db62b8ce" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gchdx" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-gchdx\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:12.738952 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.738926 2553 status_manager.go:895] "Failed to get status for pod" podUID="536b8b84-a51a-4f78-ba33-c073a3cc10bf" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5" err="pods \"limitador-operator-controller-manager-85c4996f8c-92lj5\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:12.740019 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.740003 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5" Jun 02 21:49:12.740930 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.740909 2553 status_manager.go:895] "Failed to get status for pod" podUID="d26a2206-0d8e-4b69-aeb8-3240e95d130b" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7v72z\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:12.743361 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.743340 2553 status_manager.go:895] "Failed to get status for pod" podUID="536b8b84-a51a-4f78-ba33-c073a3cc10bf" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5" err="pods \"limitador-operator-controller-manager-85c4996f8c-92lj5\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:12.745091 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.745072 2553 status_manager.go:895] "Failed to get status for pod" podUID="d26a2206-0d8e-4b69-aeb8-3240e95d130b" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7v72z\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:12.746844 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.746825 2553 status_manager.go:895] "Failed to get status for pod" podUID="1786f45c-ea70-45f2-b0ac-63a7db62b8ce" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gchdx" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-gchdx\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:12.775182 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.775155 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sv24\" (UniqueName: \"kubernetes.io/projected/536b8b84-a51a-4f78-ba33-c073a3cc10bf-kube-api-access-4sv24\") pod \"536b8b84-a51a-4f78-ba33-c073a3cc10bf\" (UID: \"536b8b84-a51a-4f78-ba33-c073a3cc10bf\") " Jun 02 21:49:12.775289 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.775203 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzkq2\" (UniqueName: \"kubernetes.io/projected/d26a2206-0d8e-4b69-aeb8-3240e95d130b-kube-api-access-nzkq2\") pod \"d26a2206-0d8e-4b69-aeb8-3240e95d130b\" (UID: \"d26a2206-0d8e-4b69-aeb8-3240e95d130b\") " Jun 02 21:49:12.775289 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.775248 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d26a2206-0d8e-4b69-aeb8-3240e95d130b-extensions-socket-volume\") pod \"d26a2206-0d8e-4b69-aeb8-3240e95d130b\" (UID: \"d26a2206-0d8e-4b69-aeb8-3240e95d130b\") " Jun 02 21:49:12.775807 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.775779 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d26a2206-0d8e-4b69-aeb8-3240e95d130b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d26a2206-0d8e-4b69-aeb8-3240e95d130b" (UID: "d26a2206-0d8e-4b69-aeb8-3240e95d130b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:49:12.777177 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.777158 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/536b8b84-a51a-4f78-ba33-c073a3cc10bf-kube-api-access-4sv24" (OuterVolumeSpecName: "kube-api-access-4sv24") pod "536b8b84-a51a-4f78-ba33-c073a3cc10bf" (UID: "536b8b84-a51a-4f78-ba33-c073a3cc10bf"). InnerVolumeSpecName "kube-api-access-4sv24". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:49:12.777257 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.777191 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d26a2206-0d8e-4b69-aeb8-3240e95d130b-kube-api-access-nzkq2" (OuterVolumeSpecName: "kube-api-access-nzkq2") pod "d26a2206-0d8e-4b69-aeb8-3240e95d130b" (UID: "d26a2206-0d8e-4b69-aeb8-3240e95d130b"). InnerVolumeSpecName "kube-api-access-nzkq2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:49:12.876368 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.876334 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sv24\" (UniqueName: \"kubernetes.io/projected/536b8b84-a51a-4f78-ba33-c073a3cc10bf-kube-api-access-4sv24\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:49:12.876368 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.876363 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzkq2\" (UniqueName: \"kubernetes.io/projected/d26a2206-0d8e-4b69-aeb8-3240e95d130b-kube-api-access-nzkq2\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:49:12.876368 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.876374 2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d26a2206-0d8e-4b69-aeb8-3240e95d130b-extensions-socket-volume\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:49:12.905029 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.905004 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xgtrk" Jun 02 21:49:12.911719 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.911687 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw" Jun 02 21:49:12.918358 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:12.918306 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-49v82" Jun 02 21:49:13.048505 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.048455 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xgtrk"] Jun 02 21:49:13.051747 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:49:13.051705 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a5ec1f6_2e23_4a74_8530_5a5348c58ac0.slice/crio-aa835be6432d7e75f2a469db6a0257b74eb7955be8e6ccbcba242fa390f6a7bc WatchSource:0}: Error finding container aa835be6432d7e75f2a469db6a0257b74eb7955be8e6ccbcba242fa390f6a7bc: Status 404 returned error can't find the container with id aa835be6432d7e75f2a469db6a0257b74eb7955be8e6ccbcba242fa390f6a7bc Jun 02 21:49:13.087101 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.087073 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw"] Jun 02 21:49:13.089721 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:49:13.089681 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ff00f8e_f834_4388_bd24_5e31024edc40.slice/crio-99dadf147adb23b7d05e25cd476123b573fff7c57a18962c553717ecec120c0e WatchSource:0}: Error finding container 99dadf147adb23b7d05e25cd476123b573fff7c57a18962c553717ecec120c0e: Status 404 returned error can't find the container with id 99dadf147adb23b7d05e25cd476123b573fff7c57a18962c553717ecec120c0e Jun 02 21:49:13.093179 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.093157 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-49v82"] Jun 02 21:49:13.096915 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:49:13.096882 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a742b7a_8ae6_4771_93eb_0cd0f2e7186f.slice/crio-954b8566be99a15a3fe799519f0f7df35ed9ab8cef70ffcc6138d28a2eb1edd7 WatchSource:0}: Error finding container 954b8566be99a15a3fe799519f0f7df35ed9ab8cef70ffcc6138d28a2eb1edd7: Status 404 returned error can't find the container with id 954b8566be99a15a3fe799519f0f7df35ed9ab8cef70ffcc6138d28a2eb1edd7 Jun 02 21:49:13.606010 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.605965 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5" podUID="536b8b84-a51a-4f78-ba33-c073a3cc10bf" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.25:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jun 02 21:49:13.683480 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.683435 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xgtrk" event={"ID":"5a5ec1f6-2e23-4a74-8530-5a5348c58ac0","Type":"ContainerStarted","Data":"897c836e7a79e5d850a44b466a9fff52e6d42078bed7ad7359cacd6acf3a38be"} Jun 02 21:49:13.683915 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.683493 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xgtrk" event={"ID":"5a5ec1f6-2e23-4a74-8530-5a5348c58ac0","Type":"ContainerStarted","Data":"aa835be6432d7e75f2a469db6a0257b74eb7955be8e6ccbcba242fa390f6a7bc"} Jun 02 21:49:13.683915 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.683577 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xgtrk" Jun 02 21:49:13.684796 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.684773 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw" event={"ID":"7ff00f8e-f834-4388-bd24-5e31024edc40","Type":"ContainerStarted","Data":"0055c3c21f5bc9cc0062a4004da7c3605807a9ad91173e5e085cb1ab4c9941ca"} Jun 02 21:49:13.684796 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.684798 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw" event={"ID":"7ff00f8e-f834-4388-bd24-5e31024edc40","Type":"ContainerStarted","Data":"99dadf147adb23b7d05e25cd476123b573fff7c57a18962c553717ecec120c0e"} Jun 02 21:49:13.684966 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.684897 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw" Jun 02 21:49:13.686079 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.686060 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-49v82" event={"ID":"4a742b7a-8ae6-4771-93eb-0cd0f2e7186f","Type":"ContainerStarted","Data":"29fb99739fdcccbf10d88ec3fffa3e1466cefda970f1bd5e8cde7c91e7316143"} Jun 02 21:49:13.686164 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.686083 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-49v82" event={"ID":"4a742b7a-8ae6-4771-93eb-0cd0f2e7186f","Type":"ContainerStarted","Data":"954b8566be99a15a3fe799519f0f7df35ed9ab8cef70ffcc6138d28a2eb1edd7"} Jun 02 21:49:13.686210 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.686185 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-49v82" Jun 02 21:49:13.687096 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.687081 2553 scope.go:117] "RemoveContainer" containerID="47dd4a6dc5cb5c8fc35acda91bbb9cb2d36462deaddce22bc1d884a0121f16ce" Jun 02 21:49:13.687158 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.687085 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5" Jun 02 21:49:13.688604 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.688578 2553 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gchdx" podUID="1786f45c-ea70-45f2-b0ac-63a7db62b8ce" containerName="manager" containerID="cri-o://cc28a54312f2921c8dcf503fb3dd4a7290d5e054211b042d84a0ec66c54199e4" gracePeriod=2 Jun 02 21:49:13.689637 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.689602 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" Jun 02 21:49:13.695501 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.695436 2553 scope.go:117] "RemoveContainer" containerID="10b2d2a07c10c8a18cfac885a7479798caf79d1c2c6b13bd98bc20b642bb6911" Jun 02 21:49:13.709439 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.709393 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xgtrk" podStartSLOduration=1.709378582 podStartE2EDuration="1.709378582s" podCreationTimestamp="2026-06-02 21:49:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:49:13.707798475 +0000 UTC m=+445.876752189" watchObservedRunningTime="2026-06-02 21:49:13.709378582 +0000 UTC m=+445.878332296" Jun 02 21:49:13.709849 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.709822 2553 status_manager.go:895] "Failed to get status for pod" podUID="536b8b84-a51a-4f78-ba33-c073a3cc10bf" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5" err="pods \"limitador-operator-controller-manager-85c4996f8c-92lj5\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:13.711736 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.711712 2553 status_manager.go:895] "Failed to get status for pod" podUID="d26a2206-0d8e-4b69-aeb8-3240e95d130b" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7v72z\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:13.713447 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.713427 2553 status_manager.go:895] "Failed to get status for pod" podUID="1786f45c-ea70-45f2-b0ac-63a7db62b8ce" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gchdx" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-gchdx\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:13.715260 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.715240 2553 status_manager.go:895] "Failed to get status for pod" podUID="536b8b84-a51a-4f78-ba33-c073a3cc10bf" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5" err="pods \"limitador-operator-controller-manager-85c4996f8c-92lj5\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:13.717035 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.717014 2553 status_manager.go:895] "Failed to get status for pod" podUID="d26a2206-0d8e-4b69-aeb8-3240e95d130b" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7v72z\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:13.738140 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.738093 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-49v82" podStartSLOduration=1.738079833 podStartE2EDuration="1.738079833s" podCreationTimestamp="2026-06-02 21:49:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:49:13.737648357 +0000 UTC m=+445.906602071" watchObservedRunningTime="2026-06-02 21:49:13.738079833 +0000 UTC m=+445.907033544" Jun 02 21:49:13.777303 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.777254 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw" podStartSLOduration=1.777244025 podStartE2EDuration="1.777244025s" podCreationTimestamp="2026-06-02 21:49:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:49:13.775953856 +0000 UTC m=+445.944907569" watchObservedRunningTime="2026-06-02 21:49:13.777244025 +0000 UTC m=+445.946197736" Jun 02 21:49:13.778353 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.778332 2553 status_manager.go:895] "Failed to get status for pod" podUID="1786f45c-ea70-45f2-b0ac-63a7db62b8ce" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gchdx" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-gchdx\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:13.925501 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.925475 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gchdx" Jun 02 21:49:13.927779 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.927741 2553 status_manager.go:895] "Failed to get status for pod" podUID="1786f45c-ea70-45f2-b0ac-63a7db62b8ce" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gchdx" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-gchdx\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:13.929923 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.929892 2553 status_manager.go:895] "Failed to get status for pod" podUID="536b8b84-a51a-4f78-ba33-c073a3cc10bf" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-92lj5" err="pods \"limitador-operator-controller-manager-85c4996f8c-92lj5\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:13.931812 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.931790 2553 status_manager.go:895] "Failed to get status for pod" podUID="d26a2206-0d8e-4b69-aeb8-3240e95d130b" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7v72z" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7v72z\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:13.986320 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.986297 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pqtd\" (UniqueName: \"kubernetes.io/projected/1786f45c-ea70-45f2-b0ac-63a7db62b8ce-kube-api-access-9pqtd\") pod \"1786f45c-ea70-45f2-b0ac-63a7db62b8ce\" (UID: \"1786f45c-ea70-45f2-b0ac-63a7db62b8ce\") " Jun 02 21:49:13.986463 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.986405 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1786f45c-ea70-45f2-b0ac-63a7db62b8ce-extensions-socket-volume\") pod \"1786f45c-ea70-45f2-b0ac-63a7db62b8ce\" (UID: \"1786f45c-ea70-45f2-b0ac-63a7db62b8ce\") " Jun 02 21:49:13.986766 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.986742 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1786f45c-ea70-45f2-b0ac-63a7db62b8ce-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1786f45c-ea70-45f2-b0ac-63a7db62b8ce" (UID: "1786f45c-ea70-45f2-b0ac-63a7db62b8ce"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:49:13.988396 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:13.988365 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1786f45c-ea70-45f2-b0ac-63a7db62b8ce-kube-api-access-9pqtd" (OuterVolumeSpecName: "kube-api-access-9pqtd") pod "1786f45c-ea70-45f2-b0ac-63a7db62b8ce" (UID: "1786f45c-ea70-45f2-b0ac-63a7db62b8ce"). InnerVolumeSpecName "kube-api-access-9pqtd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:49:14.087960 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:14.087924 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pqtd\" (UniqueName: \"kubernetes.io/projected/1786f45c-ea70-45f2-b0ac-63a7db62b8ce-kube-api-access-9pqtd\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:49:14.087960 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:14.087956 2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1786f45c-ea70-45f2-b0ac-63a7db62b8ce-extensions-socket-volume\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:49:14.342367 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:14.342337 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1786f45c-ea70-45f2-b0ac-63a7db62b8ce" path="/var/lib/kubelet/pods/1786f45c-ea70-45f2-b0ac-63a7db62b8ce/volumes" Jun 02 21:49:14.342681 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:14.342669 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="536b8b84-a51a-4f78-ba33-c073a3cc10bf" path="/var/lib/kubelet/pods/536b8b84-a51a-4f78-ba33-c073a3cc10bf/volumes" Jun 02 21:49:14.342974 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:14.342963 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d26a2206-0d8e-4b69-aeb8-3240e95d130b" path="/var/lib/kubelet/pods/d26a2206-0d8e-4b69-aeb8-3240e95d130b/volumes" Jun 02 21:49:14.695104 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:14.695071 2553 generic.go:358] "Generic (PLEG): container finished" podID="1786f45c-ea70-45f2-b0ac-63a7db62b8ce" containerID="cc28a54312f2921c8dcf503fb3dd4a7290d5e054211b042d84a0ec66c54199e4" exitCode=0 Jun 02 21:49:14.695504 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:14.695116 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gchdx" Jun 02 21:49:14.695504 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:14.695162 2553 scope.go:117] "RemoveContainer" containerID="cc28a54312f2921c8dcf503fb3dd4a7290d5e054211b042d84a0ec66c54199e4" Jun 02 21:49:14.699764 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:14.699735 2553 status_manager.go:895] "Failed to get status for pod" podUID="1786f45c-ea70-45f2-b0ac-63a7db62b8ce" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-gchdx" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-gchdx\" is forbidden: User \"system:node:ip-10-0-139-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-67.ec2.internal' and this object" Jun 02 21:49:14.703631 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:14.703603 2553 scope.go:117] "RemoveContainer" containerID="cc28a54312f2921c8dcf503fb3dd4a7290d5e054211b042d84a0ec66c54199e4" Jun 02 21:49:14.703965 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:49:14.703946 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc28a54312f2921c8dcf503fb3dd4a7290d5e054211b042d84a0ec66c54199e4\": container with ID starting with cc28a54312f2921c8dcf503fb3dd4a7290d5e054211b042d84a0ec66c54199e4 not found: ID does not exist" containerID="cc28a54312f2921c8dcf503fb3dd4a7290d5e054211b042d84a0ec66c54199e4" Jun 02 21:49:14.704037 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:14.703978 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc28a54312f2921c8dcf503fb3dd4a7290d5e054211b042d84a0ec66c54199e4"} err="failed to get container status \"cc28a54312f2921c8dcf503fb3dd4a7290d5e054211b042d84a0ec66c54199e4\": rpc error: code = NotFound desc = could not find container \"cc28a54312f2921c8dcf503fb3dd4a7290d5e054211b042d84a0ec66c54199e4\": container with ID starting with cc28a54312f2921c8dcf503fb3dd4a7290d5e054211b042d84a0ec66c54199e4 not found: ID does not exist" Jun 02 21:49:24.698913 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:24.698881 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-49v82" Jun 02 21:49:24.699418 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:24.698943 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xgtrk" Jun 02 21:49:24.699418 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:24.699116 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw" Jun 02 21:49:24.790486 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:24.790453 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xgtrk"] Jun 02 21:49:24.790717 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:24.790675 2553 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xgtrk" podUID="5a5ec1f6-2e23-4a74-8530-5a5348c58ac0" containerName="manager" containerID="cri-o://897c836e7a79e5d850a44b466a9fff52e6d42078bed7ad7359cacd6acf3a38be" gracePeriod=10 Jun 02 21:49:25.031776 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.031727 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xgtrk" Jun 02 21:49:25.143212 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.143183 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7pvn"] Jun 02 21:49:25.143508 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.143496 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a5ec1f6-2e23-4a74-8530-5a5348c58ac0" containerName="manager" Jun 02 21:49:25.143555 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.143510 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a5ec1f6-2e23-4a74-8530-5a5348c58ac0" containerName="manager" Jun 02 21:49:25.143591 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.143561 2553 memory_manager.go:356] "RemoveStaleState removing state" podUID="5a5ec1f6-2e23-4a74-8530-5a5348c58ac0" containerName="manager" Jun 02 21:49:25.146560 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.146546 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7pvn" Jun 02 21:49:25.157361 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.157331 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7pvn"] Jun 02 21:49:25.180327 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.180303 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxkjn\" (UniqueName: \"kubernetes.io/projected/5a5ec1f6-2e23-4a74-8530-5a5348c58ac0-kube-api-access-cxkjn\") pod \"5a5ec1f6-2e23-4a74-8530-5a5348c58ac0\" (UID: \"5a5ec1f6-2e23-4a74-8530-5a5348c58ac0\") " Jun 02 21:49:25.180478 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.180385 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a5ec1f6-2e23-4a74-8530-5a5348c58ac0-extensions-socket-volume\") pod \"5a5ec1f6-2e23-4a74-8530-5a5348c58ac0\" (UID: \"5a5ec1f6-2e23-4a74-8530-5a5348c58ac0\") " Jun 02 21:49:25.180764 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.180739 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a5ec1f6-2e23-4a74-8530-5a5348c58ac0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5a5ec1f6-2e23-4a74-8530-5a5348c58ac0" (UID: "5a5ec1f6-2e23-4a74-8530-5a5348c58ac0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:49:25.182326 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.182301 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a5ec1f6-2e23-4a74-8530-5a5348c58ac0-kube-api-access-cxkjn" (OuterVolumeSpecName: "kube-api-access-cxkjn") pod "5a5ec1f6-2e23-4a74-8530-5a5348c58ac0" (UID: "5a5ec1f6-2e23-4a74-8530-5a5348c58ac0"). InnerVolumeSpecName "kube-api-access-cxkjn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:49:25.281854 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.281766 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dd0d05e-366b-44ee-8f68-ecbb521700bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-r7pvn\" (UID: \"1dd0d05e-366b-44ee-8f68-ecbb521700bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7pvn" Jun 02 21:49:25.281854 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.281807 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9qgh\" (UniqueName: \"kubernetes.io/projected/1dd0d05e-366b-44ee-8f68-ecbb521700bf-kube-api-access-h9qgh\") pod \"kuadrant-operator-controller-manager-55c7f4c975-r7pvn\" (UID: \"1dd0d05e-366b-44ee-8f68-ecbb521700bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7pvn" Jun 02 21:49:25.282025 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.281914 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxkjn\" (UniqueName: \"kubernetes.io/projected/5a5ec1f6-2e23-4a74-8530-5a5348c58ac0-kube-api-access-cxkjn\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:49:25.282025 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.281938 2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a5ec1f6-2e23-4a74-8530-5a5348c58ac0-extensions-socket-volume\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:49:25.383250 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.383209 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dd0d05e-366b-44ee-8f68-ecbb521700bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-r7pvn\" (UID: \"1dd0d05e-366b-44ee-8f68-ecbb521700bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7pvn" Jun 02 21:49:25.383250 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.383255 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h9qgh\" (UniqueName: \"kubernetes.io/projected/1dd0d05e-366b-44ee-8f68-ecbb521700bf-kube-api-access-h9qgh\") pod \"kuadrant-operator-controller-manager-55c7f4c975-r7pvn\" (UID: \"1dd0d05e-366b-44ee-8f68-ecbb521700bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7pvn" Jun 02 21:49:25.383689 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.383614 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dd0d05e-366b-44ee-8f68-ecbb521700bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-r7pvn\" (UID: \"1dd0d05e-366b-44ee-8f68-ecbb521700bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7pvn" Jun 02 21:49:25.392894 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.392869 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9qgh\" (UniqueName: \"kubernetes.io/projected/1dd0d05e-366b-44ee-8f68-ecbb521700bf-kube-api-access-h9qgh\") pod \"kuadrant-operator-controller-manager-55c7f4c975-r7pvn\" (UID: \"1dd0d05e-366b-44ee-8f68-ecbb521700bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7pvn" Jun 02 21:49:25.456138 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.456112 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7pvn" Jun 02 21:49:25.588295 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.588270 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7pvn"] Jun 02 21:49:25.590511 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:49:25.590475 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dd0d05e_366b_44ee_8f68_ecbb521700bf.slice/crio-2c2fb8851b77f7215d41b57090a450dbe111d52284171aa7a194433f4bd10ffe WatchSource:0}: Error finding container 2c2fb8851b77f7215d41b57090a450dbe111d52284171aa7a194433f4bd10ffe: Status 404 returned error can't find the container with id 2c2fb8851b77f7215d41b57090a450dbe111d52284171aa7a194433f4bd10ffe Jun 02 21:49:25.737566 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.737524 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7pvn" event={"ID":"1dd0d05e-366b-44ee-8f68-ecbb521700bf","Type":"ContainerStarted","Data":"584978d71254d98ea3e5e778b80d58e050e15ccbaf98db94ae4792f82891bedd"} Jun 02 21:49:25.737566 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.737571 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7pvn" event={"ID":"1dd0d05e-366b-44ee-8f68-ecbb521700bf","Type":"ContainerStarted","Data":"2c2fb8851b77f7215d41b57090a450dbe111d52284171aa7a194433f4bd10ffe"} Jun 02 21:49:25.738046 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.737611 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7pvn" Jun 02 21:49:25.738604 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.738582 2553 generic.go:358] "Generic (PLEG): container finished" podID="5a5ec1f6-2e23-4a74-8530-5a5348c58ac0" containerID="897c836e7a79e5d850a44b466a9fff52e6d42078bed7ad7359cacd6acf3a38be" exitCode=0 Jun 02 21:49:25.738707 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.738658 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xgtrk" Jun 02 21:49:25.738707 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.738665 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xgtrk" event={"ID":"5a5ec1f6-2e23-4a74-8530-5a5348c58ac0","Type":"ContainerDied","Data":"897c836e7a79e5d850a44b466a9fff52e6d42078bed7ad7359cacd6acf3a38be"} Jun 02 21:49:25.738707 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.738697 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xgtrk" event={"ID":"5a5ec1f6-2e23-4a74-8530-5a5348c58ac0","Type":"ContainerDied","Data":"aa835be6432d7e75f2a469db6a0257b74eb7955be8e6ccbcba242fa390f6a7bc"} Jun 02 21:49:25.739085 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.738723 2553 scope.go:117] "RemoveContainer" containerID="897c836e7a79e5d850a44b466a9fff52e6d42078bed7ad7359cacd6acf3a38be" Jun 02 21:49:25.749519 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.748806 2553 scope.go:117] "RemoveContainer" containerID="897c836e7a79e5d850a44b466a9fff52e6d42078bed7ad7359cacd6acf3a38be" Jun 02 21:49:25.749519 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:49:25.749475 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"897c836e7a79e5d850a44b466a9fff52e6d42078bed7ad7359cacd6acf3a38be\": container with ID starting with 897c836e7a79e5d850a44b466a9fff52e6d42078bed7ad7359cacd6acf3a38be not found: ID does not exist" containerID="897c836e7a79e5d850a44b466a9fff52e6d42078bed7ad7359cacd6acf3a38be" Jun 02 21:49:25.749519 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.749499 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"897c836e7a79e5d850a44b466a9fff52e6d42078bed7ad7359cacd6acf3a38be"} err="failed to get container status \"897c836e7a79e5d850a44b466a9fff52e6d42078bed7ad7359cacd6acf3a38be\": rpc error: code = NotFound desc = could not find container \"897c836e7a79e5d850a44b466a9fff52e6d42078bed7ad7359cacd6acf3a38be\": container with ID starting with 897c836e7a79e5d850a44b466a9fff52e6d42078bed7ad7359cacd6acf3a38be not found: ID does not exist" Jun 02 21:49:25.757961 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.757926 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7pvn" podStartSLOduration=0.757916319 podStartE2EDuration="757.916319ms" podCreationTimestamp="2026-06-02 21:49:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:49:25.757154545 +0000 UTC m=+457.926108258" watchObservedRunningTime="2026-06-02 21:49:25.757916319 +0000 UTC m=+457.926870030" Jun 02 21:49:25.775188 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.775164 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xgtrk"] Jun 02 21:49:25.781772 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:25.781744 2553 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xgtrk"] Jun 02 21:49:26.341252 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:26.341220 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a5ec1f6-2e23-4a74-8530-5a5348c58ac0" path="/var/lib/kubelet/pods/5a5ec1f6-2e23-4a74-8530-5a5348c58ac0/volumes" Jun 02 21:49:36.746291 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:36.746258 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7pvn" Jun 02 21:49:36.795095 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:36.795062 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw"] Jun 02 21:49:36.795331 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:36.795294 2553 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw" podUID="7ff00f8e-f834-4388-bd24-5e31024edc40" containerName="manager" containerID="cri-o://0055c3c21f5bc9cc0062a4004da7c3605807a9ad91173e5e085cb1ab4c9941ca" gracePeriod=10 Jun 02 21:49:37.044570 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:37.044548 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw" Jun 02 21:49:37.183508 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:37.183474 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ff00f8e-f834-4388-bd24-5e31024edc40-extensions-socket-volume\") pod \"7ff00f8e-f834-4388-bd24-5e31024edc40\" (UID: \"7ff00f8e-f834-4388-bd24-5e31024edc40\") " Jun 02 21:49:37.183691 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:37.183521 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qqcm\" (UniqueName: \"kubernetes.io/projected/7ff00f8e-f834-4388-bd24-5e31024edc40-kube-api-access-8qqcm\") pod \"7ff00f8e-f834-4388-bd24-5e31024edc40\" (UID: \"7ff00f8e-f834-4388-bd24-5e31024edc40\") " Jun 02 21:49:37.183879 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:37.183856 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ff00f8e-f834-4388-bd24-5e31024edc40-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7ff00f8e-f834-4388-bd24-5e31024edc40" (UID: "7ff00f8e-f834-4388-bd24-5e31024edc40"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:49:37.185557 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:37.185531 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ff00f8e-f834-4388-bd24-5e31024edc40-kube-api-access-8qqcm" (OuterVolumeSpecName: "kube-api-access-8qqcm") pod "7ff00f8e-f834-4388-bd24-5e31024edc40" (UID: "7ff00f8e-f834-4388-bd24-5e31024edc40"). InnerVolumeSpecName "kube-api-access-8qqcm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:49:37.284679 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:37.284594 2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ff00f8e-f834-4388-bd24-5e31024edc40-extensions-socket-volume\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:49:37.284679 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:37.284637 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qqcm\" (UniqueName: \"kubernetes.io/projected/7ff00f8e-f834-4388-bd24-5e31024edc40-kube-api-access-8qqcm\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:49:37.778689 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:37.778660 2553 generic.go:358] "Generic (PLEG): container finished" podID="7ff00f8e-f834-4388-bd24-5e31024edc40" containerID="0055c3c21f5bc9cc0062a4004da7c3605807a9ad91173e5e085cb1ab4c9941ca" exitCode=0 Jun 02 21:49:37.779068 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:37.778721 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw" Jun 02 21:49:37.779068 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:37.778748 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw" event={"ID":"7ff00f8e-f834-4388-bd24-5e31024edc40","Type":"ContainerDied","Data":"0055c3c21f5bc9cc0062a4004da7c3605807a9ad91173e5e085cb1ab4c9941ca"} Jun 02 21:49:37.779068 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:37.778785 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw" event={"ID":"7ff00f8e-f834-4388-bd24-5e31024edc40","Type":"ContainerDied","Data":"99dadf147adb23b7d05e25cd476123b573fff7c57a18962c553717ecec120c0e"} Jun 02 21:49:37.779068 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:37.778800 2553 scope.go:117] "RemoveContainer" containerID="0055c3c21f5bc9cc0062a4004da7c3605807a9ad91173e5e085cb1ab4c9941ca" Jun 02 21:49:37.786990 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:37.786972 2553 scope.go:117] "RemoveContainer" containerID="0055c3c21f5bc9cc0062a4004da7c3605807a9ad91173e5e085cb1ab4c9941ca" Jun 02 21:49:37.787227 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:49:37.787210 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0055c3c21f5bc9cc0062a4004da7c3605807a9ad91173e5e085cb1ab4c9941ca\": container with ID starting with 0055c3c21f5bc9cc0062a4004da7c3605807a9ad91173e5e085cb1ab4c9941ca not found: ID does not exist" containerID="0055c3c21f5bc9cc0062a4004da7c3605807a9ad91173e5e085cb1ab4c9941ca" Jun 02 21:49:37.787289 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:37.787237 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0055c3c21f5bc9cc0062a4004da7c3605807a9ad91173e5e085cb1ab4c9941ca"} err="failed to get container status \"0055c3c21f5bc9cc0062a4004da7c3605807a9ad91173e5e085cb1ab4c9941ca\": rpc error: code = NotFound desc = could not find container \"0055c3c21f5bc9cc0062a4004da7c3605807a9ad91173e5e085cb1ab4c9941ca\": container with ID starting with 0055c3c21f5bc9cc0062a4004da7c3605807a9ad91173e5e085cb1ab4c9941ca not found: ID does not exist" Jun 02 21:49:37.809392 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:37.809362 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw"] Jun 02 21:49:37.818446 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:37.818424 2553 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v6fxw"] Jun 02 21:49:38.341380 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:38.341349 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ff00f8e-f834-4388-bd24-5e31024edc40" path="/var/lib/kubelet/pods/7ff00f8e-f834-4388-bd24-5e31024edc40/volumes" Jun 02 21:49:41.177028 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.176992 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw"] Jun 02 21:49:41.177480 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.177349 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ff00f8e-f834-4388-bd24-5e31024edc40" containerName="manager" Jun 02 21:49:41.177480 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.177364 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ff00f8e-f834-4388-bd24-5e31024edc40" containerName="manager" Jun 02 21:49:41.177480 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.177452 2553 memory_manager.go:356] "RemoveStaleState removing state" podUID="7ff00f8e-f834-4388-bd24-5e31024edc40" containerName="manager" Jun 02 21:49:41.180604 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.180583 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.183113 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.183089 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-jn9xl\"" Jun 02 21:49:41.192086 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.192058 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw"] Jun 02 21:49:41.320854 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.320811 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a236dca3-20ae-4412-babc-dcd2dc6f18a7-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.320854 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.320857 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a236dca3-20ae-4412-babc-dcd2dc6f18a7-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.321065 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.320880 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a236dca3-20ae-4412-babc-dcd2dc6f18a7-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.321065 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.320904 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a236dca3-20ae-4412-babc-dcd2dc6f18a7-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.321065 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.320967 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a236dca3-20ae-4412-babc-dcd2dc6f18a7-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.321065 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.321006 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a236dca3-20ae-4412-babc-dcd2dc6f18a7-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.321065 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.321031 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a236dca3-20ae-4412-babc-dcd2dc6f18a7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.321065 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.321062 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a236dca3-20ae-4412-babc-dcd2dc6f18a7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.321294 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.321079 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcr4m\" (UniqueName: \"kubernetes.io/projected/a236dca3-20ae-4412-babc-dcd2dc6f18a7-kube-api-access-fcr4m\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.422176 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.422119 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a236dca3-20ae-4412-babc-dcd2dc6f18a7-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.422176 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.422181 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a236dca3-20ae-4412-babc-dcd2dc6f18a7-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.422417 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.422214 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a236dca3-20ae-4412-babc-dcd2dc6f18a7-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.422417 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.422238 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a236dca3-20ae-4412-babc-dcd2dc6f18a7-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.422417 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.422322 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a236dca3-20ae-4412-babc-dcd2dc6f18a7-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.422417 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.422354 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a236dca3-20ae-4412-babc-dcd2dc6f18a7-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.422417 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.422377 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a236dca3-20ae-4412-babc-dcd2dc6f18a7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.422697 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.422420 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a236dca3-20ae-4412-babc-dcd2dc6f18a7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.422697 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.422450 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fcr4m\" (UniqueName: \"kubernetes.io/projected/a236dca3-20ae-4412-babc-dcd2dc6f18a7-kube-api-access-fcr4m\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.422697 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.422673 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a236dca3-20ae-4412-babc-dcd2dc6f18a7-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.422839 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.422713 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a236dca3-20ae-4412-babc-dcd2dc6f18a7-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.422839 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.422728 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a236dca3-20ae-4412-babc-dcd2dc6f18a7-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.422839 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.422802 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a236dca3-20ae-4412-babc-dcd2dc6f18a7-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.423182 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.423159 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a236dca3-20ae-4412-babc-dcd2dc6f18a7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.424382 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.424359 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a236dca3-20ae-4412-babc-dcd2dc6f18a7-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.424861 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.424842 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a236dca3-20ae-4412-babc-dcd2dc6f18a7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.430025 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.429980 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a236dca3-20ae-4412-babc-dcd2dc6f18a7-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.430212 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.430196 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcr4m\" (UniqueName: \"kubernetes.io/projected/a236dca3-20ae-4412-babc-dcd2dc6f18a7-kube-api-access-fcr4m\") pod \"maas-default-gateway-openshift-default-7df95f575-vwdqw\" (UID: \"a236dca3-20ae-4412-babc-dcd2dc6f18a7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.493244 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.493211 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:41.625868 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.625742 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw"] Jun 02 21:49:41.628060 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:49:41.628028 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda236dca3_20ae_4412_babc_dcd2dc6f18a7.slice/crio-4315c6dec374eacbd1b47252a0ee904fd0f7ac3e309fd74dc99ed5010770eb69 WatchSource:0}: Error finding container 4315c6dec374eacbd1b47252a0ee904fd0f7ac3e309fd74dc99ed5010770eb69: Status 404 returned error can't find the container with id 4315c6dec374eacbd1b47252a0ee904fd0f7ac3e309fd74dc99ed5010770eb69 Jun 02 21:49:41.630086 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.630049 2553 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 02 21:49:41.630187 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.630141 2553 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 02 21:49:41.630251 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.630196 2553 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 02 21:49:41.795921 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.795879 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" event={"ID":"a236dca3-20ae-4412-babc-dcd2dc6f18a7","Type":"ContainerStarted","Data":"c3d7bf17d77b8a79b9109a9de6e58d5938c890a0f50b1242dc4a9b12da9858bf"} Jun 02 21:49:41.796104 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.795928 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" event={"ID":"a236dca3-20ae-4412-babc-dcd2dc6f18a7","Type":"ContainerStarted","Data":"4315c6dec374eacbd1b47252a0ee904fd0f7ac3e309fd74dc99ed5010770eb69"} Jun 02 21:49:41.815361 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:41.815308 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" podStartSLOduration=0.815290275 podStartE2EDuration="815.290275ms" podCreationTimestamp="2026-06-02 21:49:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:49:41.8138706 +0000 UTC m=+473.982824326" watchObservedRunningTime="2026-06-02 21:49:41.815290275 +0000 UTC m=+473.984243989" Jun 02 21:49:42.494018 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:42.493986 2553 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:42.498492 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:42.498469 2553 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:42.799147 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:42.799065 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:42.799949 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:42.799930 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-vwdqw" Jun 02 21:49:56.484661 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:56.484609 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 21:49:56.489537 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:56.489518 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-589cd" Jun 02 21:49:56.492449 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:56.492424 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hfbzz\"" Jun 02 21:49:56.493304 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:56.493278 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 21:49:56.494031 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:56.494007 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 21:49:56.521632 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:56.521595 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 21:49:56.538426 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:56.538395 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/167801c0-ab15-40a3-996d-2446bb3ff6a3-config-file\") pod \"limitador-limitador-78c99df468-589cd\" (UID: \"167801c0-ab15-40a3-996d-2446bb3ff6a3\") " pod="kuadrant-system/limitador-limitador-78c99df468-589cd" Jun 02 21:49:56.538571 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:56.538438 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvt52\" (UniqueName: \"kubernetes.io/projected/167801c0-ab15-40a3-996d-2446bb3ff6a3-kube-api-access-fvt52\") pod \"limitador-limitador-78c99df468-589cd\" (UID: \"167801c0-ab15-40a3-996d-2446bb3ff6a3\") " pod="kuadrant-system/limitador-limitador-78c99df468-589cd" Jun 02 21:49:56.639640 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:56.639588 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/167801c0-ab15-40a3-996d-2446bb3ff6a3-config-file\") pod \"limitador-limitador-78c99df468-589cd\" (UID: \"167801c0-ab15-40a3-996d-2446bb3ff6a3\") " pod="kuadrant-system/limitador-limitador-78c99df468-589cd" Jun 02 21:49:56.639807 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:56.639658 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fvt52\" (UniqueName: \"kubernetes.io/projected/167801c0-ab15-40a3-996d-2446bb3ff6a3-kube-api-access-fvt52\") pod \"limitador-limitador-78c99df468-589cd\" (UID: \"167801c0-ab15-40a3-996d-2446bb3ff6a3\") " pod="kuadrant-system/limitador-limitador-78c99df468-589cd" Jun 02 21:49:56.640189 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:56.640170 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/167801c0-ab15-40a3-996d-2446bb3ff6a3-config-file\") pod \"limitador-limitador-78c99df468-589cd\" (UID: \"167801c0-ab15-40a3-996d-2446bb3ff6a3\") " pod="kuadrant-system/limitador-limitador-78c99df468-589cd" Jun 02 21:49:56.647740 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:56.647715 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvt52\" (UniqueName: \"kubernetes.io/projected/167801c0-ab15-40a3-996d-2446bb3ff6a3-kube-api-access-fvt52\") pod \"limitador-limitador-78c99df468-589cd\" (UID: \"167801c0-ab15-40a3-996d-2446bb3ff6a3\") " pod="kuadrant-system/limitador-limitador-78c99df468-589cd" Jun 02 21:49:56.800844 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:56.800752 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-589cd" Jun 02 21:49:56.923442 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:56.923396 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 21:49:56.925732 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:49:56.925699 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod167801c0_ab15_40a3_996d_2446bb3ff6a3.slice/crio-dd59b7a90808f38dbcb7fe977ddddad0d17800c32ba23dd0a34cf0b993985176 WatchSource:0}: Error finding container dd59b7a90808f38dbcb7fe977ddddad0d17800c32ba23dd0a34cf0b993985176: Status 404 returned error can't find the container with id dd59b7a90808f38dbcb7fe977ddddad0d17800c32ba23dd0a34cf0b993985176 Jun 02 21:49:57.849119 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:57.849081 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-589cd" event={"ID":"167801c0-ab15-40a3-996d-2446bb3ff6a3","Type":"ContainerStarted","Data":"dd59b7a90808f38dbcb7fe977ddddad0d17800c32ba23dd0a34cf0b993985176"} Jun 02 21:49:59.860600 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:59.860562 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-589cd" event={"ID":"167801c0-ab15-40a3-996d-2446bb3ff6a3","Type":"ContainerStarted","Data":"9251e64732812a399464ebaac1b4006b6f14318a8faaabfd8288d6ddfd2820bd"} Jun 02 21:49:59.861045 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:59.860641 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-589cd" Jun 02 21:49:59.877276 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:49:59.877215 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-589cd" podStartSLOduration=1.472805342 podStartE2EDuration="3.877197765s" podCreationTimestamp="2026-06-02 21:49:56 +0000 UTC" firstStartedPulling="2026-06-02 21:49:56.927518182 +0000 UTC m=+489.096471875" lastFinishedPulling="2026-06-02 21:49:59.331910606 +0000 UTC m=+491.500864298" observedRunningTime="2026-06-02 21:49:59.876075213 +0000 UTC m=+492.045028917" watchObservedRunningTime="2026-06-02 21:49:59.877197765 +0000 UTC m=+492.046151480" Jun 02 21:50:10.865758 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:50:10.865728 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-589cd" Jun 02 21:51:23.150212 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:23.150179 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c678685b6-tpjkw"] Jun 02 21:51:23.153379 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:23.153357 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c678685b6-tpjkw" Jun 02 21:51:23.155819 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:23.155798 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 02 21:51:23.155929 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:23.155830 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rlljd\"" Jun 02 21:51:23.155929 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:23.155830 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 02 21:51:23.160434 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:23.160411 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c678685b6-tpjkw"] Jun 02 21:51:23.276178 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:23.276125 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d3b3ff0-8c52-476d-960c-a646e7883b03-webhook-cert\") pod \"maas-controller-c678685b6-tpjkw\" (UID: \"8d3b3ff0-8c52-476d-960c-a646e7883b03\") " pod="opendatahub/maas-controller-c678685b6-tpjkw" Jun 02 21:51:23.276178 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:23.276187 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx7z5\" (UniqueName: \"kubernetes.io/projected/8d3b3ff0-8c52-476d-960c-a646e7883b03-kube-api-access-kx7z5\") pod \"maas-controller-c678685b6-tpjkw\" (UID: \"8d3b3ff0-8c52-476d-960c-a646e7883b03\") " pod="opendatahub/maas-controller-c678685b6-tpjkw" Jun 02 21:51:23.377592 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:23.377551 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d3b3ff0-8c52-476d-960c-a646e7883b03-webhook-cert\") pod \"maas-controller-c678685b6-tpjkw\" (UID: \"8d3b3ff0-8c52-476d-960c-a646e7883b03\") " pod="opendatahub/maas-controller-c678685b6-tpjkw" Jun 02 21:51:23.377592 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:23.377609 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kx7z5\" (UniqueName: \"kubernetes.io/projected/8d3b3ff0-8c52-476d-960c-a646e7883b03-kube-api-access-kx7z5\") pod \"maas-controller-c678685b6-tpjkw\" (UID: \"8d3b3ff0-8c52-476d-960c-a646e7883b03\") " pod="opendatahub/maas-controller-c678685b6-tpjkw" Jun 02 21:51:23.379958 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:23.379936 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d3b3ff0-8c52-476d-960c-a646e7883b03-webhook-cert\") pod \"maas-controller-c678685b6-tpjkw\" (UID: \"8d3b3ff0-8c52-476d-960c-a646e7883b03\") " pod="opendatahub/maas-controller-c678685b6-tpjkw" Jun 02 21:51:23.385100 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:23.385076 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx7z5\" (UniqueName: \"kubernetes.io/projected/8d3b3ff0-8c52-476d-960c-a646e7883b03-kube-api-access-kx7z5\") pod \"maas-controller-c678685b6-tpjkw\" (UID: \"8d3b3ff0-8c52-476d-960c-a646e7883b03\") " pod="opendatahub/maas-controller-c678685b6-tpjkw" Jun 02 21:51:23.464726 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:23.464701 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c678685b6-tpjkw" Jun 02 21:51:23.596905 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:23.590496 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c678685b6-tpjkw"] Jun 02 21:51:24.142401 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:24.142361 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c678685b6-tpjkw" event={"ID":"8d3b3ff0-8c52-476d-960c-a646e7883b03","Type":"ContainerStarted","Data":"3cfe7adff50a6a2c87a028768343e0cbcea8bf1028f026bc08de5fd4db084814"} Jun 02 21:51:26.151696 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:26.151653 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c678685b6-tpjkw" event={"ID":"8d3b3ff0-8c52-476d-960c-a646e7883b03","Type":"ContainerStarted","Data":"5094f41c2fae2d3248c9809201162a97786c89c5922efd16a0374176be3a5265"} Jun 02 21:51:26.152100 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:26.151781 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c678685b6-tpjkw" Jun 02 21:51:26.171081 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:26.171031 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-c678685b6-tpjkw" podStartSLOduration=0.705444204 podStartE2EDuration="3.171017637s" podCreationTimestamp="2026-06-02 21:51:23 +0000 UTC" firstStartedPulling="2026-06-02 21:51:23.595905776 +0000 UTC m=+575.764859468" lastFinishedPulling="2026-06-02 21:51:26.061479195 +0000 UTC m=+578.230432901" observedRunningTime="2026-06-02 21:51:26.169783521 +0000 UTC m=+578.338737234" watchObservedRunningTime="2026-06-02 21:51:26.171017637 +0000 UTC m=+578.339971349" Jun 02 21:51:37.159566 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:37.159540 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c678685b6-tpjkw" Jun 02 21:51:37.903040 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:37.903003 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c678685b6-tpjkw"] Jun 02 21:51:37.903273 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:37.903226 2553 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-c678685b6-tpjkw" podUID="8d3b3ff0-8c52-476d-960c-a646e7883b03" containerName="manager" containerID="cri-o://5094f41c2fae2d3248c9809201162a97786c89c5922efd16a0374176be3a5265" gracePeriod=30 Jun 02 21:51:38.140198 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:38.140175 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c678685b6-tpjkw" Jun 02 21:51:38.193685 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:38.193656 2553 generic.go:358] "Generic (PLEG): container finished" podID="8d3b3ff0-8c52-476d-960c-a646e7883b03" containerID="5094f41c2fae2d3248c9809201162a97786c89c5922efd16a0374176be3a5265" exitCode=0 Jun 02 21:51:38.194042 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:38.193730 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c678685b6-tpjkw" event={"ID":"8d3b3ff0-8c52-476d-960c-a646e7883b03","Type":"ContainerDied","Data":"5094f41c2fae2d3248c9809201162a97786c89c5922efd16a0374176be3a5265"} Jun 02 21:51:38.194042 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:38.193759 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c678685b6-tpjkw" event={"ID":"8d3b3ff0-8c52-476d-960c-a646e7883b03","Type":"ContainerDied","Data":"3cfe7adff50a6a2c87a028768343e0cbcea8bf1028f026bc08de5fd4db084814"} Jun 02 21:51:38.194042 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:38.193780 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c678685b6-tpjkw" Jun 02 21:51:38.194042 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:38.193787 2553 scope.go:117] "RemoveContainer" containerID="5094f41c2fae2d3248c9809201162a97786c89c5922efd16a0374176be3a5265" Jun 02 21:51:38.194493 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:38.194474 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d3b3ff0-8c52-476d-960c-a646e7883b03-webhook-cert\") pod \"8d3b3ff0-8c52-476d-960c-a646e7883b03\" (UID: \"8d3b3ff0-8c52-476d-960c-a646e7883b03\") " Jun 02 21:51:38.194574 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:38.194557 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kx7z5\" (UniqueName: \"kubernetes.io/projected/8d3b3ff0-8c52-476d-960c-a646e7883b03-kube-api-access-kx7z5\") pod \"8d3b3ff0-8c52-476d-960c-a646e7883b03\" (UID: \"8d3b3ff0-8c52-476d-960c-a646e7883b03\") " Jun 02 21:51:38.197194 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:38.197167 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d3b3ff0-8c52-476d-960c-a646e7883b03-kube-api-access-kx7z5" (OuterVolumeSpecName: "kube-api-access-kx7z5") pod "8d3b3ff0-8c52-476d-960c-a646e7883b03" (UID: "8d3b3ff0-8c52-476d-960c-a646e7883b03"). InnerVolumeSpecName "kube-api-access-kx7z5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:51:38.197194 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:38.197177 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d3b3ff0-8c52-476d-960c-a646e7883b03-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8d3b3ff0-8c52-476d-960c-a646e7883b03" (UID: "8d3b3ff0-8c52-476d-960c-a646e7883b03"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:51:38.208091 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:38.208072 2553 scope.go:117] "RemoveContainer" containerID="5094f41c2fae2d3248c9809201162a97786c89c5922efd16a0374176be3a5265" Jun 02 21:51:38.208344 ip-10-0-139-67 kubenswrapper[2553]: E0602 21:51:38.208326 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5094f41c2fae2d3248c9809201162a97786c89c5922efd16a0374176be3a5265\": container with ID starting with 5094f41c2fae2d3248c9809201162a97786c89c5922efd16a0374176be3a5265 not found: ID does not exist" containerID="5094f41c2fae2d3248c9809201162a97786c89c5922efd16a0374176be3a5265" Jun 02 21:51:38.208410 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:38.208353 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5094f41c2fae2d3248c9809201162a97786c89c5922efd16a0374176be3a5265"} err="failed to get container status \"5094f41c2fae2d3248c9809201162a97786c89c5922efd16a0374176be3a5265\": rpc error: code = NotFound desc = could not find container \"5094f41c2fae2d3248c9809201162a97786c89c5922efd16a0374176be3a5265\": container with ID starting with 5094f41c2fae2d3248c9809201162a97786c89c5922efd16a0374176be3a5265 not found: ID does not exist" Jun 02 21:51:38.295640 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:38.295600 2553 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d3b3ff0-8c52-476d-960c-a646e7883b03-webhook-cert\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:51:38.295640 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:38.295634 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kx7z5\" (UniqueName: \"kubernetes.io/projected/8d3b3ff0-8c52-476d-960c-a646e7883b03-kube-api-access-kx7z5\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 21:51:38.508333 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:38.508259 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c678685b6-tpjkw"] Jun 02 21:51:38.510535 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:38.510513 2553 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c678685b6-tpjkw"] Jun 02 21:51:40.340713 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:40.340681 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d3b3ff0-8c52-476d-960c-a646e7883b03" path="/var/lib/kubelet/pods/8d3b3ff0-8c52-476d-960c-a646e7883b03/volumes" Jun 02 21:51:48.282911 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:48.282881 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/ovn-acl-logging/0.log" Jun 02 21:51:48.283310 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:48.283123 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/ovn-acl-logging/0.log" Jun 02 21:51:57.730868 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:51:57.730832 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 21:52:52.403583 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:52:52.403553 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 21:53:08.291456 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:08.291423 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 21:53:12.486956 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.486918 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2"] Jun 02 21:53:12.487319 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.487305 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d3b3ff0-8c52-476d-960c-a646e7883b03" containerName="manager" Jun 02 21:53:12.487362 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.487322 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d3b3ff0-8c52-476d-960c-a646e7883b03" containerName="manager" Jun 02 21:53:12.487396 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.487375 2553 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d3b3ff0-8c52-476d-960c-a646e7883b03" containerName="manager" Jun 02 21:53:12.489455 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.489429 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" Jun 02 21:53:12.492146 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.492121 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pmq97\"" Jun 02 21:53:12.492362 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.492324 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 21:53:12.493297 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.493273 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 21:53:12.493401 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.493321 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 02 21:53:12.504532 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.504508 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2"] Jun 02 21:53:12.569130 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.569105 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r9hm\" (UniqueName: \"kubernetes.io/projected/9ba8e3b9-f79a-490e-aa02-540ed8d37f83-kube-api-access-7r9hm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2\" (UID: \"9ba8e3b9-f79a-490e-aa02-540ed8d37f83\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" Jun 02 21:53:12.569265 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.569148 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9ba8e3b9-f79a-490e-aa02-540ed8d37f83-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2\" (UID: \"9ba8e3b9-f79a-490e-aa02-540ed8d37f83\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" Jun 02 21:53:12.569265 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.569184 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ba8e3b9-f79a-490e-aa02-540ed8d37f83-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2\" (UID: \"9ba8e3b9-f79a-490e-aa02-540ed8d37f83\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" Jun 02 21:53:12.569265 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.569218 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ba8e3b9-f79a-490e-aa02-540ed8d37f83-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2\" (UID: \"9ba8e3b9-f79a-490e-aa02-540ed8d37f83\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" Jun 02 21:53:12.569372 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.569287 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ba8e3b9-f79a-490e-aa02-540ed8d37f83-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2\" (UID: \"9ba8e3b9-f79a-490e-aa02-540ed8d37f83\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" Jun 02 21:53:12.569372 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.569320 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ba8e3b9-f79a-490e-aa02-540ed8d37f83-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2\" (UID: \"9ba8e3b9-f79a-490e-aa02-540ed8d37f83\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" Jun 02 21:53:12.670704 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.670676 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ba8e3b9-f79a-490e-aa02-540ed8d37f83-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2\" (UID: \"9ba8e3b9-f79a-490e-aa02-540ed8d37f83\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" Jun 02 21:53:12.670891 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.670727 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7r9hm\" (UniqueName: \"kubernetes.io/projected/9ba8e3b9-f79a-490e-aa02-540ed8d37f83-kube-api-access-7r9hm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2\" (UID: \"9ba8e3b9-f79a-490e-aa02-540ed8d37f83\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" Jun 02 21:53:12.670891 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.670770 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9ba8e3b9-f79a-490e-aa02-540ed8d37f83-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2\" (UID: \"9ba8e3b9-f79a-490e-aa02-540ed8d37f83\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" Jun 02 21:53:12.670891 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.670816 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ba8e3b9-f79a-490e-aa02-540ed8d37f83-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2\" (UID: \"9ba8e3b9-f79a-490e-aa02-540ed8d37f83\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" Jun 02 21:53:12.670891 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.670839 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ba8e3b9-f79a-490e-aa02-540ed8d37f83-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2\" (UID: \"9ba8e3b9-f79a-490e-aa02-540ed8d37f83\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" Jun 02 21:53:12.670891 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.670886 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ba8e3b9-f79a-490e-aa02-540ed8d37f83-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2\" (UID: \"9ba8e3b9-f79a-490e-aa02-540ed8d37f83\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" Jun 02 21:53:12.671135 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.671105 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ba8e3b9-f79a-490e-aa02-540ed8d37f83-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2\" (UID: \"9ba8e3b9-f79a-490e-aa02-540ed8d37f83\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" Jun 02 21:53:12.671190 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.671155 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ba8e3b9-f79a-490e-aa02-540ed8d37f83-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2\" (UID: \"9ba8e3b9-f79a-490e-aa02-540ed8d37f83\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" Jun 02 21:53:12.671248 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.671187 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9ba8e3b9-f79a-490e-aa02-540ed8d37f83-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2\" (UID: \"9ba8e3b9-f79a-490e-aa02-540ed8d37f83\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" Jun 02 21:53:12.673198 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.673178 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ba8e3b9-f79a-490e-aa02-540ed8d37f83-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2\" (UID: \"9ba8e3b9-f79a-490e-aa02-540ed8d37f83\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" Jun 02 21:53:12.673346 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.673330 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ba8e3b9-f79a-490e-aa02-540ed8d37f83-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2\" (UID: \"9ba8e3b9-f79a-490e-aa02-540ed8d37f83\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" Jun 02 21:53:12.679867 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.679844 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r9hm\" (UniqueName: \"kubernetes.io/projected/9ba8e3b9-f79a-490e-aa02-540ed8d37f83-kube-api-access-7r9hm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2\" (UID: \"9ba8e3b9-f79a-490e-aa02-540ed8d37f83\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" Jun 02 21:53:12.800102 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.800006 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" Jun 02 21:53:12.929731 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.929697 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2"] Jun 02 21:53:12.933210 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:53:12.933184 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ba8e3b9_f79a_490e_aa02_540ed8d37f83.slice/crio-9dad6de4a452be195d3c614575e159e209e5356a4baaf1e14ae78cf387e096ae WatchSource:0}: Error finding container 9dad6de4a452be195d3c614575e159e209e5356a4baaf1e14ae78cf387e096ae: Status 404 returned error can't find the container with id 9dad6de4a452be195d3c614575e159e209e5356a4baaf1e14ae78cf387e096ae Jun 02 21:53:12.935273 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:12.935254 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 21:53:13.497764 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:13.497727 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" event={"ID":"9ba8e3b9-f79a-490e-aa02-540ed8d37f83","Type":"ContainerStarted","Data":"9dad6de4a452be195d3c614575e159e209e5356a4baaf1e14ae78cf387e096ae"} Jun 02 21:53:13.677773 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:13.677734 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 21:53:17.514205 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:17.514170 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" event={"ID":"9ba8e3b9-f79a-490e-aa02-540ed8d37f83","Type":"ContainerStarted","Data":"42f46688732dff8cd6c4a7b80032a16bf9a49a3b5063fc4953db5fc4c440b189"} Jun 02 21:53:28.578959 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:28.578923 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 21:53:31.562442 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:31.562408 2553 generic.go:358] "Generic (PLEG): container finished" podID="9ba8e3b9-f79a-490e-aa02-540ed8d37f83" containerID="42f46688732dff8cd6c4a7b80032a16bf9a49a3b5063fc4953db5fc4c440b189" exitCode=0 Jun 02 21:53:31.562910 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:31.562489 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" event={"ID":"9ba8e3b9-f79a-490e-aa02-540ed8d37f83","Type":"ContainerDied","Data":"42f46688732dff8cd6c4a7b80032a16bf9a49a3b5063fc4953db5fc4c440b189"} Jun 02 21:53:33.571028 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:33.570992 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" event={"ID":"9ba8e3b9-f79a-490e-aa02-540ed8d37f83","Type":"ContainerStarted","Data":"d67af5ede617631c6304e2243355c9e51f0f1f6d3b044b16c7d795d9a3cad116"} Jun 02 21:53:33.611434 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:33.611385 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" podStartSLOduration=1.930247155 podStartE2EDuration="21.611369256s" podCreationTimestamp="2026-06-02 21:53:12 +0000 UTC" firstStartedPulling="2026-06-02 21:53:12.935379884 +0000 UTC m=+685.104333575" lastFinishedPulling="2026-06-02 21:53:32.616501986 +0000 UTC m=+704.785455676" observedRunningTime="2026-06-02 21:53:33.610648999 +0000 UTC m=+705.779602708" watchObservedRunningTime="2026-06-02 21:53:33.611369256 +0000 UTC m=+705.780323010" Jun 02 21:53:42.800886 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:42.800851 2553 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" Jun 02 21:53:42.800886 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:42.800896 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" Jun 02 21:53:42.813192 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:42.813169 2553 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" Jun 02 21:53:43.615657 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:43.615631 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2" Jun 02 21:53:53.485200 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:53.485162 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 21:53:59.298335 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:59.298301 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh"] Jun 02 21:53:59.318200 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:59.318166 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh"] Jun 02 21:53:59.318369 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:59.318312 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" Jun 02 21:53:59.326184 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:59.326156 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 02 21:53:59.387700 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:59.387667 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c3c876a-3a25-4387-934e-b8685a7cb94b-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh\" (UID: \"5c3c876a-3a25-4387-934e-b8685a7cb94b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" Jun 02 21:53:59.387700 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:59.387701 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c3c876a-3a25-4387-934e-b8685a7cb94b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh\" (UID: \"5c3c876a-3a25-4387-934e-b8685a7cb94b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" Jun 02 21:53:59.387887 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:59.387718 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrlpk\" (UniqueName: \"kubernetes.io/projected/5c3c876a-3a25-4387-934e-b8685a7cb94b-kube-api-access-vrlpk\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh\" (UID: \"5c3c876a-3a25-4387-934e-b8685a7cb94b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" Jun 02 21:53:59.387887 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:59.387833 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c3c876a-3a25-4387-934e-b8685a7cb94b-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh\" (UID: \"5c3c876a-3a25-4387-934e-b8685a7cb94b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" Jun 02 21:53:59.387957 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:59.387913 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5c3c876a-3a25-4387-934e-b8685a7cb94b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh\" (UID: \"5c3c876a-3a25-4387-934e-b8685a7cb94b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" Jun 02 21:53:59.387957 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:59.387945 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c3c876a-3a25-4387-934e-b8685a7cb94b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh\" (UID: \"5c3c876a-3a25-4387-934e-b8685a7cb94b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" Jun 02 21:53:59.488877 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:59.488843 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5c3c876a-3a25-4387-934e-b8685a7cb94b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh\" (UID: \"5c3c876a-3a25-4387-934e-b8685a7cb94b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" Jun 02 21:53:59.489042 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:59.488893 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c3c876a-3a25-4387-934e-b8685a7cb94b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh\" (UID: \"5c3c876a-3a25-4387-934e-b8685a7cb94b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" Jun 02 21:53:59.489042 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:59.488920 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c3c876a-3a25-4387-934e-b8685a7cb94b-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh\" (UID: \"5c3c876a-3a25-4387-934e-b8685a7cb94b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" Jun 02 21:53:59.489042 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:59.488936 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c3c876a-3a25-4387-934e-b8685a7cb94b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh\" (UID: \"5c3c876a-3a25-4387-934e-b8685a7cb94b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" Jun 02 21:53:59.489042 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:59.488952 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrlpk\" (UniqueName: \"kubernetes.io/projected/5c3c876a-3a25-4387-934e-b8685a7cb94b-kube-api-access-vrlpk\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh\" (UID: \"5c3c876a-3a25-4387-934e-b8685a7cb94b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" Jun 02 21:53:59.489042 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:59.489005 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c3c876a-3a25-4387-934e-b8685a7cb94b-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh\" (UID: \"5c3c876a-3a25-4387-934e-b8685a7cb94b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" Jun 02 21:53:59.489307 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:59.489289 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5c3c876a-3a25-4387-934e-b8685a7cb94b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh\" (UID: \"5c3c876a-3a25-4387-934e-b8685a7cb94b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" Jun 02 21:53:59.489372 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:59.489299 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c3c876a-3a25-4387-934e-b8685a7cb94b-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh\" (UID: \"5c3c876a-3a25-4387-934e-b8685a7cb94b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" Jun 02 21:53:59.489429 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:59.489398 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c3c876a-3a25-4387-934e-b8685a7cb94b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh\" (UID: \"5c3c876a-3a25-4387-934e-b8685a7cb94b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" Jun 02 21:53:59.491247 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:59.491224 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c3c876a-3a25-4387-934e-b8685a7cb94b-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh\" (UID: \"5c3c876a-3a25-4387-934e-b8685a7cb94b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" Jun 02 21:53:59.491498 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:59.491481 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c3c876a-3a25-4387-934e-b8685a7cb94b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh\" (UID: \"5c3c876a-3a25-4387-934e-b8685a7cb94b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" Jun 02 21:53:59.497847 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:59.497828 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrlpk\" (UniqueName: \"kubernetes.io/projected/5c3c876a-3a25-4387-934e-b8685a7cb94b-kube-api-access-vrlpk\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh\" (UID: \"5c3c876a-3a25-4387-934e-b8685a7cb94b\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" Jun 02 21:53:59.634485 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:59.634416 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" Jun 02 21:53:59.771725 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:53:59.771699 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh"] Jun 02 21:53:59.774424 ip-10-0-139-67 kubenswrapper[2553]: W0602 21:53:59.774396 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c3c876a_3a25_4387_934e_b8685a7cb94b.slice/crio-ada9dc213e2bb470665e3fbdcb37439f479d3a21608776938fb2965ba4d8042f WatchSource:0}: Error finding container ada9dc213e2bb470665e3fbdcb37439f479d3a21608776938fb2965ba4d8042f: Status 404 returned error can't find the container with id ada9dc213e2bb470665e3fbdcb37439f479d3a21608776938fb2965ba4d8042f Jun 02 21:54:00.663637 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:54:00.663583 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" event={"ID":"5c3c876a-3a25-4387-934e-b8685a7cb94b","Type":"ContainerStarted","Data":"001980fa543f68ed8f6476dcb839d897be38fe0d111065ab7f96d9df5a9c9fff"} Jun 02 21:54:00.663637 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:54:00.663643 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" event={"ID":"5c3c876a-3a25-4387-934e-b8685a7cb94b","Type":"ContainerStarted","Data":"ada9dc213e2bb470665e3fbdcb37439f479d3a21608776938fb2965ba4d8042f"} Jun 02 21:54:01.569468 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:54:01.569429 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 21:55:47.021215 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:55:47.021122 2553 generic.go:358] "Generic (PLEG): container finished" podID="5c3c876a-3a25-4387-934e-b8685a7cb94b" containerID="001980fa543f68ed8f6476dcb839d897be38fe0d111065ab7f96d9df5a9c9fff" exitCode=0 Jun 02 21:55:47.021738 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:55:47.021203 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" event={"ID":"5c3c876a-3a25-4387-934e-b8685a7cb94b","Type":"ContainerDied","Data":"001980fa543f68ed8f6476dcb839d897be38fe0d111065ab7f96d9df5a9c9fff"} Jun 02 21:55:48.025905 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:55:48.025871 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" event={"ID":"5c3c876a-3a25-4387-934e-b8685a7cb94b","Type":"ContainerStarted","Data":"fea813d8608e840788139560c02410c1bfda231c2bdbee32e4dd227524652fa7"} Jun 02 21:55:48.045179 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:55:48.045130 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" podStartSLOduration=108.843794917 podStartE2EDuration="1m49.045114832s" podCreationTimestamp="2026-06-02 21:53:59 +0000 UTC" firstStartedPulling="2026-06-02 21:55:47.022093724 +0000 UTC m=+839.191047419" lastFinishedPulling="2026-06-02 21:55:47.223413641 +0000 UTC m=+839.392367334" observedRunningTime="2026-06-02 21:55:48.044480783 +0000 UTC m=+840.213434506" watchObservedRunningTime="2026-06-02 21:55:48.045114832 +0000 UTC m=+840.214068537" Jun 02 21:55:49.635446 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:55:49.635411 2553 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" Jun 02 21:55:49.635446 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:55:49.635449 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" Jun 02 21:55:49.648048 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:55:49.648018 2553 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" Jun 02 21:55:50.043362 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:55:50.043323 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh" Jun 02 21:56:24.979975 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:56:24.979939 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 21:56:35.923473 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:56:35.923385 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 21:56:44.074705 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:56:44.074671 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 21:56:48.306371 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:56:48.306343 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/ovn-acl-logging/0.log" Jun 02 21:56:48.307015 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:56:48.306996 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/ovn-acl-logging/0.log" Jun 02 21:56:54.772268 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:56:54.772236 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 21:57:03.178810 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:57:03.178778 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 21:57:13.967293 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:57:13.967247 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 21:57:44.879949 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:57:44.879912 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 21:57:52.702054 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:57:52.702020 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 21:58:29.869696 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:58:29.869659 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 21:58:45.176116 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:58:45.176076 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 21:59:23.069603 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:59:23.069566 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 21:59:41.082044 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:59:41.081951 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 21:59:54.974336 ip-10-0-139-67 kubenswrapper[2553]: I0602 21:59:54.974300 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:00:00.143937 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:00:00.143903 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29673960-74lhz"] Jun 02 22:00:00.147899 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:00:00.147879 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673960-74lhz" Jun 02 22:00:00.150259 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:00:00.150239 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-5wnpb\"" Jun 02 22:00:00.163077 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:00:00.163047 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29673960-74lhz"] Jun 02 22:00:00.233197 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:00:00.233158 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr67r\" (UniqueName: \"kubernetes.io/projected/26c6dddf-8a67-48db-b528-276ad2796713-kube-api-access-sr67r\") pod \"maas-api-key-cleanup-29673960-74lhz\" (UID: \"26c6dddf-8a67-48db-b528-276ad2796713\") " pod="opendatahub/maas-api-key-cleanup-29673960-74lhz" Jun 02 22:00:00.334075 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:00:00.334037 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sr67r\" (UniqueName: \"kubernetes.io/projected/26c6dddf-8a67-48db-b528-276ad2796713-kube-api-access-sr67r\") pod \"maas-api-key-cleanup-29673960-74lhz\" (UID: \"26c6dddf-8a67-48db-b528-276ad2796713\") " pod="opendatahub/maas-api-key-cleanup-29673960-74lhz" Jun 02 22:00:00.342430 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:00:00.342398 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr67r\" (UniqueName: \"kubernetes.io/projected/26c6dddf-8a67-48db-b528-276ad2796713-kube-api-access-sr67r\") pod \"maas-api-key-cleanup-29673960-74lhz\" (UID: \"26c6dddf-8a67-48db-b528-276ad2796713\") " pod="opendatahub/maas-api-key-cleanup-29673960-74lhz" Jun 02 22:00:00.458994 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:00:00.458965 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673960-74lhz" Jun 02 22:00:00.598256 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:00:00.598222 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29673960-74lhz"] Jun 02 22:00:00.601340 ip-10-0-139-67 kubenswrapper[2553]: W0602 22:00:00.601307 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26c6dddf_8a67_48db_b528_276ad2796713.slice/crio-b98682cce69b0ce17c814e2716e4bddb368ee38d496bc4e011bbd37bf3eb61b2 WatchSource:0}: Error finding container b98682cce69b0ce17c814e2716e4bddb368ee38d496bc4e011bbd37bf3eb61b2: Status 404 returned error can't find the container with id b98682cce69b0ce17c814e2716e4bddb368ee38d496bc4e011bbd37bf3eb61b2 Jun 02 22:00:00.603185 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:00:00.603164 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 22:00:00.862077 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:00:00.861993 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673960-74lhz" event={"ID":"26c6dddf-8a67-48db-b528-276ad2796713","Type":"ContainerStarted","Data":"b98682cce69b0ce17c814e2716e4bddb368ee38d496bc4e011bbd37bf3eb61b2"} Jun 02 22:00:04.877394 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:00:04.877303 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673960-74lhz" event={"ID":"26c6dddf-8a67-48db-b528-276ad2796713","Type":"ContainerStarted","Data":"f48ffc62ea931824540e0fccd944e87c14be557f2ea693d516957242dbde0ae1"} Jun 02 22:00:04.893063 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:00:04.893014 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29673960-74lhz" podStartSLOduration=1.171682932 podStartE2EDuration="4.893002179s" podCreationTimestamp="2026-06-02 22:00:00 +0000 UTC" firstStartedPulling="2026-06-02 22:00:00.603290017 +0000 UTC m=+1092.772243706" lastFinishedPulling="2026-06-02 22:00:04.324609259 +0000 UTC m=+1096.493562953" observedRunningTime="2026-06-02 22:00:04.891532823 +0000 UTC m=+1097.060486537" watchObservedRunningTime="2026-06-02 22:00:04.893002179 +0000 UTC m=+1097.061955890" Jun 02 22:00:05.887479 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:00:05.887441 2553 generic.go:358] "Generic (PLEG): container finished" podID="26c6dddf-8a67-48db-b528-276ad2796713" containerID="f48ffc62ea931824540e0fccd944e87c14be557f2ea693d516957242dbde0ae1" exitCode=0 Jun 02 22:00:05.887479 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:00:05.887483 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673960-74lhz" event={"ID":"26c6dddf-8a67-48db-b528-276ad2796713","Type":"ContainerDied","Data":"f48ffc62ea931824540e0fccd944e87c14be557f2ea693d516957242dbde0ae1"} Jun 02 22:00:07.023673 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:00:07.023640 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673960-74lhz" Jun 02 22:00:07.088614 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:00:07.088581 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sr67r\" (UniqueName: \"kubernetes.io/projected/26c6dddf-8a67-48db-b528-276ad2796713-kube-api-access-sr67r\") pod \"26c6dddf-8a67-48db-b528-276ad2796713\" (UID: \"26c6dddf-8a67-48db-b528-276ad2796713\") " Jun 02 22:00:07.090558 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:00:07.090530 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26c6dddf-8a67-48db-b528-276ad2796713-kube-api-access-sr67r" (OuterVolumeSpecName: "kube-api-access-sr67r") pod "26c6dddf-8a67-48db-b528-276ad2796713" (UID: "26c6dddf-8a67-48db-b528-276ad2796713"). InnerVolumeSpecName "kube-api-access-sr67r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 22:00:07.189896 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:00:07.189867 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sr67r\" (UniqueName: \"kubernetes.io/projected/26c6dddf-8a67-48db-b528-276ad2796713-kube-api-access-sr67r\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 22:00:07.895361 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:00:07.895327 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673960-74lhz" Jun 02 22:00:07.895361 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:00:07.895343 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673960-74lhz" event={"ID":"26c6dddf-8a67-48db-b528-276ad2796713","Type":"ContainerDied","Data":"b98682cce69b0ce17c814e2716e4bddb368ee38d496bc4e011bbd37bf3eb61b2"} Jun 02 22:00:07.895713 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:00:07.895376 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b98682cce69b0ce17c814e2716e4bddb368ee38d496bc4e011bbd37bf3eb61b2" Jun 02 22:00:10.479823 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:00:10.479740 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:01:21.170090 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:01:21.170058 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:01:30.475473 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:01:30.475437 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:01:46.466306 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:01:46.466271 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:01:48.329366 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:01:48.329339 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/ovn-acl-logging/0.log" Jun 02 22:01:48.332873 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:01:48.332848 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/ovn-acl-logging/0.log" Jun 02 22:01:55.372928 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:01:55.372892 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:02:12.173939 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:02:12.173904 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:02:18.473026 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:02:18.472988 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:02:52.572111 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:02:52.572029 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:03:01.479960 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:03:01.479929 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:03:09.577532 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:03:09.577498 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:03:17.771422 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:03:17.771376 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:03:26.476658 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:03:26.476612 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:03:43.974192 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:03:43.974152 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:03:56.887037 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:03:56.886999 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:04:43.890492 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:04:43.890454 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:04:51.671651 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:04:51.671588 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:04:57.171001 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:04:57.170964 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:05:05.370365 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:05:05.370328 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:05:15.372684 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:05:15.372647 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:05:24.169512 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:05:24.169478 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:05:33.572735 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:05:33.572652 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:05:39.775721 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:05:39.775684 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:05:50.374829 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:05:50.374799 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:05:59.475066 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:05:59.475029 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:06:08.176130 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:06:08.176094 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:06:14.977953 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:06:14.977923 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:06:24.874557 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:06:24.874522 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:06:33.480176 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:06:33.480142 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:06:41.873037 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:06:41.872999 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:06:48.353740 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:06:48.353711 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/ovn-acl-logging/0.log" Jun 02 22:06:48.356295 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:06:48.356275 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/ovn-acl-logging/0.log" Jun 02 22:06:50.375942 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:06:50.375909 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:07:00.275734 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:07:00.275657 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:07:08.776887 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:07:08.776849 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:07:59.184910 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:07:59.184877 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7pvn"] Jun 02 22:07:59.186892 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:07:59.185124 2553 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7pvn" podUID="1dd0d05e-366b-44ee-8f68-ecbb521700bf" containerName="manager" containerID="cri-o://584978d71254d98ea3e5e778b80d58e050e15ccbaf98db94ae4792f82891bedd" gracePeriod=10 Jun 02 22:08:00.431498 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:08:00.431473 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7pvn" Jun 02 22:08:00.485353 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:08:00.485322 2553 generic.go:358] "Generic (PLEG): container finished" podID="1dd0d05e-366b-44ee-8f68-ecbb521700bf" containerID="584978d71254d98ea3e5e778b80d58e050e15ccbaf98db94ae4792f82891bedd" exitCode=0 Jun 02 22:08:00.485507 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:08:00.485386 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7pvn" event={"ID":"1dd0d05e-366b-44ee-8f68-ecbb521700bf","Type":"ContainerDied","Data":"584978d71254d98ea3e5e778b80d58e050e15ccbaf98db94ae4792f82891bedd"} Jun 02 22:08:00.485507 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:08:00.485405 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7pvn" Jun 02 22:08:00.485507 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:08:00.485426 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7pvn" event={"ID":"1dd0d05e-366b-44ee-8f68-ecbb521700bf","Type":"ContainerDied","Data":"2c2fb8851b77f7215d41b57090a450dbe111d52284171aa7a194433f4bd10ffe"} Jun 02 22:08:00.485507 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:08:00.485444 2553 scope.go:117] "RemoveContainer" containerID="584978d71254d98ea3e5e778b80d58e050e15ccbaf98db94ae4792f82891bedd" Jun 02 22:08:00.493846 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:08:00.493828 2553 scope.go:117] "RemoveContainer" containerID="584978d71254d98ea3e5e778b80d58e050e15ccbaf98db94ae4792f82891bedd" Jun 02 22:08:00.494108 ip-10-0-139-67 kubenswrapper[2553]: E0602 22:08:00.494090 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"584978d71254d98ea3e5e778b80d58e050e15ccbaf98db94ae4792f82891bedd\": container with ID starting with 584978d71254d98ea3e5e778b80d58e050e15ccbaf98db94ae4792f82891bedd not found: ID does not exist" containerID="584978d71254d98ea3e5e778b80d58e050e15ccbaf98db94ae4792f82891bedd" Jun 02 22:08:00.494160 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:08:00.494127 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"584978d71254d98ea3e5e778b80d58e050e15ccbaf98db94ae4792f82891bedd"} err="failed to get container status \"584978d71254d98ea3e5e778b80d58e050e15ccbaf98db94ae4792f82891bedd\": rpc error: code = NotFound desc = could not find container \"584978d71254d98ea3e5e778b80d58e050e15ccbaf98db94ae4792f82891bedd\": container with ID starting with 584978d71254d98ea3e5e778b80d58e050e15ccbaf98db94ae4792f82891bedd not found: ID does not exist" Jun 02 22:08:00.553493 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:08:00.553428 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dd0d05e-366b-44ee-8f68-ecbb521700bf-extensions-socket-volume\") pod \"1dd0d05e-366b-44ee-8f68-ecbb521700bf\" (UID: \"1dd0d05e-366b-44ee-8f68-ecbb521700bf\") " Jun 02 22:08:00.553608 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:08:00.553502 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9qgh\" (UniqueName: \"kubernetes.io/projected/1dd0d05e-366b-44ee-8f68-ecbb521700bf-kube-api-access-h9qgh\") pod \"1dd0d05e-366b-44ee-8f68-ecbb521700bf\" (UID: \"1dd0d05e-366b-44ee-8f68-ecbb521700bf\") " Jun 02 22:08:00.553803 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:08:00.553783 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dd0d05e-366b-44ee-8f68-ecbb521700bf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1dd0d05e-366b-44ee-8f68-ecbb521700bf" (UID: "1dd0d05e-366b-44ee-8f68-ecbb521700bf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 22:08:00.555430 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:08:00.555403 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dd0d05e-366b-44ee-8f68-ecbb521700bf-kube-api-access-h9qgh" (OuterVolumeSpecName: "kube-api-access-h9qgh") pod "1dd0d05e-366b-44ee-8f68-ecbb521700bf" (UID: "1dd0d05e-366b-44ee-8f68-ecbb521700bf"). InnerVolumeSpecName "kube-api-access-h9qgh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 22:08:00.660144 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:08:00.656023 2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dd0d05e-366b-44ee-8f68-ecbb521700bf-extensions-socket-volume\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 22:08:00.660144 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:08:00.656067 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9qgh\" (UniqueName: \"kubernetes.io/projected/1dd0d05e-366b-44ee-8f68-ecbb521700bf-kube-api-access-h9qgh\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 22:08:00.807808 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:08:00.807743 2553 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7pvn"] Jun 02 22:08:00.811457 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:08:00.811436 2553 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7pvn"] Jun 02 22:08:02.341581 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:08:02.341550 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dd0d05e-366b-44ee-8f68-ecbb521700bf" path="/var/lib/kubelet/pods/1dd0d05e-366b-44ee-8f68-ecbb521700bf/volumes" Jun 02 22:09:05.313787 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:05.313750 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rj52v"] Jun 02 22:09:05.314168 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:05.314073 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dd0d05e-366b-44ee-8f68-ecbb521700bf" containerName="manager" Jun 02 22:09:05.314168 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:05.314085 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dd0d05e-366b-44ee-8f68-ecbb521700bf" containerName="manager" Jun 02 22:09:05.314168 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:05.314108 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26c6dddf-8a67-48db-b528-276ad2796713" containerName="cleanup" Jun 02 22:09:05.314168 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:05.314113 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="26c6dddf-8a67-48db-b528-276ad2796713" containerName="cleanup" Jun 02 22:09:05.314168 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:05.314166 2553 memory_manager.go:356] "RemoveStaleState removing state" podUID="26c6dddf-8a67-48db-b528-276ad2796713" containerName="cleanup" Jun 02 22:09:05.314338 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:05.314177 2553 memory_manager.go:356] "RemoveStaleState removing state" podUID="1dd0d05e-366b-44ee-8f68-ecbb521700bf" containerName="manager" Jun 02 22:09:05.317580 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:05.317563 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rj52v" Jun 02 22:09:05.320296 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:05.320275 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nn8ch\"" Jun 02 22:09:05.336308 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:05.336278 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rj52v"] Jun 02 22:09:05.382327 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:05.382299 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58sc2\" (UniqueName: \"kubernetes.io/projected/14c582cb-b92e-4e30-af21-f90cfd8b1bcb-kube-api-access-58sc2\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rj52v\" (UID: \"14c582cb-b92e-4e30-af21-f90cfd8b1bcb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rj52v" Jun 02 22:09:05.382457 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:05.382376 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14c582cb-b92e-4e30-af21-f90cfd8b1bcb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rj52v\" (UID: \"14c582cb-b92e-4e30-af21-f90cfd8b1bcb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rj52v" Jun 02 22:09:05.482759 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:05.482731 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14c582cb-b92e-4e30-af21-f90cfd8b1bcb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rj52v\" (UID: \"14c582cb-b92e-4e30-af21-f90cfd8b1bcb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rj52v" Jun 02 22:09:05.482902 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:05.482780 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-58sc2\" (UniqueName: \"kubernetes.io/projected/14c582cb-b92e-4e30-af21-f90cfd8b1bcb-kube-api-access-58sc2\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rj52v\" (UID: \"14c582cb-b92e-4e30-af21-f90cfd8b1bcb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rj52v" Jun 02 22:09:05.483087 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:05.483067 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14c582cb-b92e-4e30-af21-f90cfd8b1bcb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rj52v\" (UID: \"14c582cb-b92e-4e30-af21-f90cfd8b1bcb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rj52v" Jun 02 22:09:05.493574 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:05.493552 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58sc2\" (UniqueName: \"kubernetes.io/projected/14c582cb-b92e-4e30-af21-f90cfd8b1bcb-kube-api-access-58sc2\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rj52v\" (UID: \"14c582cb-b92e-4e30-af21-f90cfd8b1bcb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rj52v" Jun 02 22:09:05.627923 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:05.627850 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rj52v" Jun 02 22:09:05.758683 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:05.758658 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rj52v"] Jun 02 22:09:05.760927 ip-10-0-139-67 kubenswrapper[2553]: W0602 22:09:05.760897 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14c582cb_b92e_4e30_af21_f90cfd8b1bcb.slice/crio-d1599fbf9f288fe8dfd1bcebcdf5dc528e489f6060d5235cf6040e0916c2c3bc WatchSource:0}: Error finding container d1599fbf9f288fe8dfd1bcebcdf5dc528e489f6060d5235cf6040e0916c2c3bc: Status 404 returned error can't find the container with id d1599fbf9f288fe8dfd1bcebcdf5dc528e489f6060d5235cf6040e0916c2c3bc Jun 02 22:09:05.763167 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:05.763149 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 22:09:06.705739 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:06.705700 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rj52v" event={"ID":"14c582cb-b92e-4e30-af21-f90cfd8b1bcb","Type":"ContainerStarted","Data":"b22f8342cbf3c8640ef90ea5b2af3f26e663e5679a013103996d1d76ca45cf03"} Jun 02 22:09:06.705739 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:06.705741 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rj52v" event={"ID":"14c582cb-b92e-4e30-af21-f90cfd8b1bcb","Type":"ContainerStarted","Data":"d1599fbf9f288fe8dfd1bcebcdf5dc528e489f6060d5235cf6040e0916c2c3bc"} Jun 02 22:09:06.706183 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:06.705842 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rj52v" Jun 02 22:09:06.725876 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:06.725829 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rj52v" podStartSLOduration=1.7258142269999999 podStartE2EDuration="1.725814227s" podCreationTimestamp="2026-06-02 22:09:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 22:09:06.72420269 +0000 UTC m=+1638.893156402" watchObservedRunningTime="2026-06-02 22:09:06.725814227 +0000 UTC m=+1638.894767941" Jun 02 22:09:17.710966 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:17.710932 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rj52v" Jun 02 22:09:26.575517 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:26.575483 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:09:35.369531 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:35.369493 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:09:56.676396 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:09:56.676362 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:10:03.072984 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:10:03.072902 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:10:13.578055 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:10:13.578016 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:10:24.279993 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:10:24.279952 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:10:33.177882 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:10:33.177851 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:10:42.276961 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:10:42.276926 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:10:52.374478 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:10:52.374444 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:11:03.176511 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:11:03.176472 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:11:12.377158 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:11:12.377123 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:11:21.574519 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:11:21.574483 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:11:30.196259 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:11:30.196183 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:11:37.275995 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:11:37.275960 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:11:48.376988 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:11:48.376960 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/ovn-acl-logging/0.log" Jun 02 22:11:48.380294 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:11:48.380268 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/ovn-acl-logging/0.log" Jun 02 22:12:07.171074 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:12:07.171041 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:12:48.077023 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:12:48.076983 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:12:57.474362 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:12:57.474326 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:13:06.368615 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:13:06.368579 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:13:16.174713 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:13:16.174679 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:13:22.577720 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:13:22.577683 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:13:36.769430 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:13:36.769397 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:13:45.370561 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:13:45.370526 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:13:56.277019 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:13:56.276982 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:14:04.481150 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:14:04.481112 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:14:10.979155 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:14:10.979119 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:14:21.367142 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:14:21.367107 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:14:33.774030 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:14:33.773952 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:14:51.671101 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:14:51.671064 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:15:00.137910 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:00.137873 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29673975-7krvp"] Jun 02 22:15:00.141406 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:00.141390 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673975-7krvp" Jun 02 22:15:00.143971 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:00.143950 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-5wnpb\"" Jun 02 22:15:00.156832 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:00.156803 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29673975-7krvp"] Jun 02 22:15:00.273317 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:00.273282 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rm95\" (UniqueName: \"kubernetes.io/projected/c39fcf74-c936-482c-8bfb-9f1574847758-kube-api-access-9rm95\") pod \"maas-api-key-cleanup-29673975-7krvp\" (UID: \"c39fcf74-c936-482c-8bfb-9f1574847758\") " pod="opendatahub/maas-api-key-cleanup-29673975-7krvp" Jun 02 22:15:00.373755 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:00.373717 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9rm95\" (UniqueName: \"kubernetes.io/projected/c39fcf74-c936-482c-8bfb-9f1574847758-kube-api-access-9rm95\") pod \"maas-api-key-cleanup-29673975-7krvp\" (UID: \"c39fcf74-c936-482c-8bfb-9f1574847758\") " pod="opendatahub/maas-api-key-cleanup-29673975-7krvp" Jun 02 22:15:00.381600 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:00.381573 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rm95\" (UniqueName: \"kubernetes.io/projected/c39fcf74-c936-482c-8bfb-9f1574847758-kube-api-access-9rm95\") pod \"maas-api-key-cleanup-29673975-7krvp\" (UID: \"c39fcf74-c936-482c-8bfb-9f1574847758\") " pod="opendatahub/maas-api-key-cleanup-29673975-7krvp" Jun 02 22:15:00.450577 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:00.450552 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673975-7krvp" Jun 02 22:15:00.578159 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:00.578114 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29673975-7krvp"] Jun 02 22:15:00.579775 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:00.579749 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:15:00.581841 ip-10-0-139-67 kubenswrapper[2553]: W0602 22:15:00.581813 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc39fcf74_c936_482c_8bfb_9f1574847758.slice/crio-0739c40550275a655c4e76ca56517c327bae1d86b41bd090f33f4c61f161929e WatchSource:0}: Error finding container 0739c40550275a655c4e76ca56517c327bae1d86b41bd090f33f4c61f161929e: Status 404 returned error can't find the container with id 0739c40550275a655c4e76ca56517c327bae1d86b41bd090f33f4c61f161929e Jun 02 22:15:00.583699 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:00.583679 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 22:15:00.882754 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:00.882714 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673975-7krvp" event={"ID":"c39fcf74-c936-482c-8bfb-9f1574847758","Type":"ContainerStarted","Data":"0739c40550275a655c4e76ca56517c327bae1d86b41bd090f33f4c61f161929e"} Jun 02 22:15:01.887396 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:01.887359 2553 generic.go:358] "Generic (PLEG): container finished" podID="c39fcf74-c936-482c-8bfb-9f1574847758" containerID="ba57ea41fd336bb3a1784464fbdb52f12a7690701708d15bbf1f4bc6240eaff1" exitCode=0 Jun 02 22:15:01.887827 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:01.887421 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673975-7krvp" event={"ID":"c39fcf74-c936-482c-8bfb-9f1574847758","Type":"ContainerDied","Data":"ba57ea41fd336bb3a1784464fbdb52f12a7690701708d15bbf1f4bc6240eaff1"} Jun 02 22:15:03.024632 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:03.024597 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673975-7krvp" Jun 02 22:15:03.099530 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:03.099489 2553 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rm95\" (UniqueName: \"kubernetes.io/projected/c39fcf74-c936-482c-8bfb-9f1574847758-kube-api-access-9rm95\") pod \"c39fcf74-c936-482c-8bfb-9f1574847758\" (UID: \"c39fcf74-c936-482c-8bfb-9f1574847758\") " Jun 02 22:15:03.101579 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:03.101550 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c39fcf74-c936-482c-8bfb-9f1574847758-kube-api-access-9rm95" (OuterVolumeSpecName: "kube-api-access-9rm95") pod "c39fcf74-c936-482c-8bfb-9f1574847758" (UID: "c39fcf74-c936-482c-8bfb-9f1574847758"). InnerVolumeSpecName "kube-api-access-9rm95". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 22:15:03.201151 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:03.201125 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rm95\" (UniqueName: \"kubernetes.io/projected/c39fcf74-c936-482c-8bfb-9f1574847758-kube-api-access-9rm95\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Jun 02 22:15:03.894423 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:03.894394 2553 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673975-7krvp" Jun 02 22:15:03.894612 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:03.894401 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673975-7krvp" event={"ID":"c39fcf74-c936-482c-8bfb-9f1574847758","Type":"ContainerDied","Data":"0739c40550275a655c4e76ca56517c327bae1d86b41bd090f33f4c61f161929e"} Jun 02 22:15:03.894612 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:03.894503 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0739c40550275a655c4e76ca56517c327bae1d86b41bd090f33f4c61f161929e" Jun 02 22:15:07.177643 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:07.177586 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:15:15.478295 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:15.478257 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:15:34.277153 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:34.277118 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:15:42.878024 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:42.877987 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:15:51.686934 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:51.686896 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:15:58.380363 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:15:58.380327 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:16:08.585769 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:16:08.585730 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:16:17.770949 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:16:17.770916 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:16:26.481039 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:16:26.481001 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:16:39.468375 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:16:39.468340 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:16:47.886269 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:16:47.882766 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:16:48.399635 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:16:48.399595 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/ovn-acl-logging/0.log" Jun 02 22:16:48.403230 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:16:48.403209 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/ovn-acl-logging/0.log" Jun 02 22:17:01.172429 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:17:01.172390 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:17:09.776302 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:17:09.776265 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:17:20.977640 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:17:20.977589 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:17:29.567055 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:17:29.566970 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:17:40.276339 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:17:40.276304 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:17:56.879919 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:17:56.879881 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:18:03.686548 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:18:03.686512 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:18:14.385742 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:18:14.385703 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:18:22.668735 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:18:22.668697 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:18:47.375231 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:18:47.375195 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:18:59.678672 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:18:59.678568 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-589cd"] Jun 02 22:19:10.224947 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:10.224914 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-659c675bb5-lktc5_0c3b7678-3c24-4bc3-80ee-0395d477831f/nginx/0.log" Jun 02 22:19:10.688286 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:10.688260 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29673960-74lhz_26c6dddf-8a67-48db-b528-276ad2796713/cleanup/0.log" Jun 02 22:19:10.799259 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:10.799229 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29673975-7krvp_c39fcf74-c936-482c-8bfb-9f1574847758/cleanup/0.log" Jun 02 22:19:11.268403 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:11.268375 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6858789655-2k45m_963777bc-df48-41e2-abbe-1683891824e2/copy-manifests/0.log" Jun 02 22:19:11.275480 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:11.275447 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6858789655-2k45m_963777bc-df48-41e2-abbe-1683891824e2/manager/0.log" Jun 02 22:19:13.464456 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:13.464425 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pz5fb_d921f555-db5f-4a22-8206-a52b23e62855/registry-server/0.log" Jun 02 22:19:13.596131 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:13.596103 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-rj52v_14c582cb-b92e-4e30-af21-f90cfd8b1bcb/manager/0.log" Jun 02 22:19:13.715204 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:13.715131 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-589cd_167801c0-ab15-40a3-996d-2446bb3ff6a3/limitador/0.log" Jun 02 22:19:13.831459 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:13.831428 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-49v82_4a742b7a-8ae6-4771-93eb-0cd0f2e7186f/manager/0.log" Jun 02 22:19:14.188432 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:14.188407 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-595b7776f8q8x2x_b165e872-e7e5-49c2-a1f8-06f343de8b77/istio-proxy/0.log" Jun 02 22:19:14.667289 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:14.667263 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7df95f575-vwdqw_a236dca3-20ae-4412-babc-dcd2dc6f18a7/istio-proxy/0.log" Jun 02 22:19:15.533234 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:15.533208 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2_9ba8e3b9-f79a-490e-aa02-540ed8d37f83/storage-initializer/0.log" Jun 02 22:19:15.539887 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:15.539868 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-g5nl2_9ba8e3b9-f79a-490e-aa02-540ed8d37f83/main/0.log" Jun 02 22:19:15.929351 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:15.929323 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh_5c3c876a-3a25-4387-934e-b8685a7cb94b/main/0.log" Jun 02 22:19:15.936058 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:15.936037 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-772qh_5c3c876a-3a25-4387-934e-b8685a7cb94b/storage-initializer/0.log" Jun 02 22:19:20.376271 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:20.376237 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5dzbc/must-gather-pj5hv"] Jun 02 22:19:20.376767 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:20.376567 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c39fcf74-c936-482c-8bfb-9f1574847758" containerName="cleanup" Jun 02 22:19:20.376767 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:20.376578 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c39fcf74-c936-482c-8bfb-9f1574847758" containerName="cleanup" Jun 02 22:19:20.376767 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:20.376652 2553 memory_manager.go:356] "RemoveStaleState removing state" podUID="c39fcf74-c936-482c-8bfb-9f1574847758" containerName="cleanup" Jun 02 22:19:20.379602 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:20.379586 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5dzbc/must-gather-pj5hv" Jun 02 22:19:20.382156 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:20.382134 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5dzbc\"/\"openshift-service-ca.crt\"" Jun 02 22:19:20.383279 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:20.383260 2553 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5dzbc\"/\"default-dockercfg-q565p\"" Jun 02 22:19:20.383339 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:20.383296 2553 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5dzbc\"/\"kube-root-ca.crt\"" Jun 02 22:19:20.398450 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:20.398428 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5dzbc/must-gather-pj5hv"] Jun 02 22:19:20.503592 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:20.503559 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/72be9265-90d7-42e9-950f-d520adc3e368-must-gather-output\") pod \"must-gather-pj5hv\" (UID: \"72be9265-90d7-42e9-950f-d520adc3e368\") " pod="openshift-must-gather-5dzbc/must-gather-pj5hv" Jun 02 22:19:20.503786 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:20.503599 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvwdx\" (UniqueName: \"kubernetes.io/projected/72be9265-90d7-42e9-950f-d520adc3e368-kube-api-access-qvwdx\") pod \"must-gather-pj5hv\" (UID: \"72be9265-90d7-42e9-950f-d520adc3e368\") " pod="openshift-must-gather-5dzbc/must-gather-pj5hv" Jun 02 22:19:20.604584 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:20.604554 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qvwdx\" (UniqueName: \"kubernetes.io/projected/72be9265-90d7-42e9-950f-d520adc3e368-kube-api-access-qvwdx\") pod \"must-gather-pj5hv\" (UID: \"72be9265-90d7-42e9-950f-d520adc3e368\") " pod="openshift-must-gather-5dzbc/must-gather-pj5hv" Jun 02 22:19:20.604771 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:20.604687 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/72be9265-90d7-42e9-950f-d520adc3e368-must-gather-output\") pod \"must-gather-pj5hv\" (UID: \"72be9265-90d7-42e9-950f-d520adc3e368\") " pod="openshift-must-gather-5dzbc/must-gather-pj5hv" Jun 02 22:19:20.605005 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:20.604985 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/72be9265-90d7-42e9-950f-d520adc3e368-must-gather-output\") pod \"must-gather-pj5hv\" (UID: \"72be9265-90d7-42e9-950f-d520adc3e368\") " pod="openshift-must-gather-5dzbc/must-gather-pj5hv" Jun 02 22:19:20.612755 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:20.612737 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvwdx\" (UniqueName: \"kubernetes.io/projected/72be9265-90d7-42e9-950f-d520adc3e368-kube-api-access-qvwdx\") pod \"must-gather-pj5hv\" (UID: \"72be9265-90d7-42e9-950f-d520adc3e368\") " pod="openshift-must-gather-5dzbc/must-gather-pj5hv" Jun 02 22:19:20.688611 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:20.688584 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5dzbc/must-gather-pj5hv" Jun 02 22:19:20.815142 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:20.815117 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5dzbc/must-gather-pj5hv"] Jun 02 22:19:20.816980 ip-10-0-139-67 kubenswrapper[2553]: W0602 22:19:20.816953 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72be9265_90d7_42e9_950f_d520adc3e368.slice/crio-5bdf33ba57cc85e52650ee3f3ce8193149c7623d37c8f3634ec38cdfc945e705 WatchSource:0}: Error finding container 5bdf33ba57cc85e52650ee3f3ce8193149c7623d37c8f3634ec38cdfc945e705: Status 404 returned error can't find the container with id 5bdf33ba57cc85e52650ee3f3ce8193149c7623d37c8f3634ec38cdfc945e705 Jun 02 22:19:21.762300 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:21.762261 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5dzbc/must-gather-pj5hv" event={"ID":"72be9265-90d7-42e9-950f-d520adc3e368","Type":"ContainerStarted","Data":"5bdf33ba57cc85e52650ee3f3ce8193149c7623d37c8f3634ec38cdfc945e705"} Jun 02 22:19:22.768083 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:22.768049 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5dzbc/must-gather-pj5hv" event={"ID":"72be9265-90d7-42e9-950f-d520adc3e368","Type":"ContainerStarted","Data":"6761ac539b684a510b42707dde0b58bc15856fa75be66a4d83c8eee17f575595"} Jun 02 22:19:22.768487 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:22.768088 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5dzbc/must-gather-pj5hv" event={"ID":"72be9265-90d7-42e9-950f-d520adc3e368","Type":"ContainerStarted","Data":"8786303eed3ed9d90683218039700f4844f52e6d444bb6b1507d2cb597a826b8"} Jun 02 22:19:22.789505 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:22.789442 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-5dzbc/must-gather-pj5hv" podStartSLOduration=1.824558465 podStartE2EDuration="2.789423732s" podCreationTimestamp="2026-06-02 22:19:20 +0000 UTC" firstStartedPulling="2026-06-02 22:19:20.819240021 +0000 UTC m=+2252.988193711" lastFinishedPulling="2026-06-02 22:19:21.784105283 +0000 UTC m=+2253.953058978" observedRunningTime="2026-06-02 22:19:22.786306405 +0000 UTC m=+2254.955260118" watchObservedRunningTime="2026-06-02 22:19:22.789423732 +0000 UTC m=+2254.958377445" Jun 02 22:19:23.607482 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:23.607449 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nk9h6_e1d6b94e-7add-49da-bd1a-cc6b4f302261/global-pull-secret-syncer/0.log" Jun 02 22:19:23.746171 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:23.746147 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4jt68_ab949e00-2922-4650-bb9e-71830cb21bf8/konnectivity-agent/0.log" Jun 02 22:19:23.842765 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:23.842728 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-67.ec2.internal_4885e4402645ea72c822907b9a1090f4/haproxy/0.log" Jun 02 22:19:28.527644 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:28.524276 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pz5fb_d921f555-db5f-4a22-8206-a52b23e62855/registry-server/0.log" Jun 02 22:19:28.607341 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:28.607154 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-rj52v_14c582cb-b92e-4e30-af21-f90cfd8b1bcb/manager/0.log" Jun 02 22:19:28.628209 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:28.628173 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-589cd_167801c0-ab15-40a3-996d-2446bb3ff6a3/limitador/0.log" Jun 02 22:19:28.703693 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:28.703118 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-49v82_4a742b7a-8ae6-4771-93eb-0cd0f2e7186f/manager/0.log" Jun 02 22:19:30.307431 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:30.307345 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ldqf5_e7d09597-e58b-461a-b0d1-ddd3ccf7cd82/node-exporter/0.log" Jun 02 22:19:30.326083 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:30.326046 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ldqf5_e7d09597-e58b-461a-b0d1-ddd3ccf7cd82/kube-rbac-proxy/0.log" Jun 02 22:19:30.349045 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:30.349013 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ldqf5_e7d09597-e58b-461a-b0d1-ddd3ccf7cd82/init-textfile/0.log" Jun 02 22:19:30.626762 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:30.626730 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_beea3120-d01c-4997-915a-a6d616473f45/prometheus/0.log" Jun 02 22:19:30.662519 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:30.662037 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_beea3120-d01c-4997-915a-a6d616473f45/config-reloader/0.log" Jun 02 22:19:30.684143 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:30.684109 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_beea3120-d01c-4997-915a-a6d616473f45/thanos-sidecar/0.log" Jun 02 22:19:30.715137 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:30.715078 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_beea3120-d01c-4997-915a-a6d616473f45/kube-rbac-proxy-web/0.log" Jun 02 22:19:30.745327 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:30.745251 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_beea3120-d01c-4997-915a-a6d616473f45/kube-rbac-proxy/0.log" Jun 02 22:19:30.770847 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:30.770816 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_beea3120-d01c-4997-915a-a6d616473f45/kube-rbac-proxy-thanos/0.log" Jun 02 22:19:30.794264 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:30.794233 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_beea3120-d01c-4997-915a-a6d616473f45/init-config-reloader/0.log" Jun 02 22:19:34.540345 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:34.540289 2553 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5dzbc/perf-node-gather-daemonset-r6r5r"] Jun 02 22:19:34.546922 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:34.546895 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-r6r5r" Jun 02 22:19:34.552910 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:34.552883 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5dzbc/perf-node-gather-daemonset-r6r5r"] Jun 02 22:19:34.655982 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:34.655944 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c86d564-fe84-477e-b5cc-d466a0c7d747-sys\") pod \"perf-node-gather-daemonset-r6r5r\" (UID: \"7c86d564-fe84-477e-b5cc-d466a0c7d747\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-r6r5r" Jun 02 22:19:34.656154 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:34.656001 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7c86d564-fe84-477e-b5cc-d466a0c7d747-proc\") pod \"perf-node-gather-daemonset-r6r5r\" (UID: \"7c86d564-fe84-477e-b5cc-d466a0c7d747\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-r6r5r" Jun 02 22:19:34.656154 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:34.656116 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6q5d\" (UniqueName: \"kubernetes.io/projected/7c86d564-fe84-477e-b5cc-d466a0c7d747-kube-api-access-z6q5d\") pod \"perf-node-gather-daemonset-r6r5r\" (UID: \"7c86d564-fe84-477e-b5cc-d466a0c7d747\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-r6r5r" Jun 02 22:19:34.656352 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:34.656180 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7c86d564-fe84-477e-b5cc-d466a0c7d747-podres\") pod \"perf-node-gather-daemonset-r6r5r\" (UID: \"7c86d564-fe84-477e-b5cc-d466a0c7d747\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-r6r5r" Jun 02 22:19:34.656352 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:34.656224 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c86d564-fe84-477e-b5cc-d466a0c7d747-lib-modules\") pod \"perf-node-gather-daemonset-r6r5r\" (UID: \"7c86d564-fe84-477e-b5cc-d466a0c7d747\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-r6r5r" Jun 02 22:19:34.739097 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:34.739067 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4dmwr_97b5c1c0-5909-433f-85cd-3515fd144fbd/dns/0.log" Jun 02 22:19:34.757197 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:34.757162 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7c86d564-fe84-477e-b5cc-d466a0c7d747-proc\") pod \"perf-node-gather-daemonset-r6r5r\" (UID: \"7c86d564-fe84-477e-b5cc-d466a0c7d747\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-r6r5r" Jun 02 22:19:34.757359 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:34.757229 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6q5d\" (UniqueName: \"kubernetes.io/projected/7c86d564-fe84-477e-b5cc-d466a0c7d747-kube-api-access-z6q5d\") pod \"perf-node-gather-daemonset-r6r5r\" (UID: \"7c86d564-fe84-477e-b5cc-d466a0c7d747\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-r6r5r" Jun 02 22:19:34.757359 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:34.757264 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7c86d564-fe84-477e-b5cc-d466a0c7d747-podres\") pod \"perf-node-gather-daemonset-r6r5r\" (UID: \"7c86d564-fe84-477e-b5cc-d466a0c7d747\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-r6r5r" Jun 02 22:19:34.757359 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:34.757296 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7c86d564-fe84-477e-b5cc-d466a0c7d747-proc\") pod \"perf-node-gather-daemonset-r6r5r\" (UID: \"7c86d564-fe84-477e-b5cc-d466a0c7d747\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-r6r5r" Jun 02 22:19:34.757359 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:34.757313 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c86d564-fe84-477e-b5cc-d466a0c7d747-lib-modules\") pod \"perf-node-gather-daemonset-r6r5r\" (UID: \"7c86d564-fe84-477e-b5cc-d466a0c7d747\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-r6r5r" Jun 02 22:19:34.757569 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:34.757384 2553 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c86d564-fe84-477e-b5cc-d466a0c7d747-sys\") pod \"perf-node-gather-daemonset-r6r5r\" (UID: \"7c86d564-fe84-477e-b5cc-d466a0c7d747\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-r6r5r" Jun 02 22:19:34.757569 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:34.757434 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7c86d564-fe84-477e-b5cc-d466a0c7d747-podres\") pod \"perf-node-gather-daemonset-r6r5r\" (UID: \"7c86d564-fe84-477e-b5cc-d466a0c7d747\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-r6r5r" Jun 02 22:19:34.757569 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:34.757465 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c86d564-fe84-477e-b5cc-d466a0c7d747-sys\") pod \"perf-node-gather-daemonset-r6r5r\" (UID: \"7c86d564-fe84-477e-b5cc-d466a0c7d747\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-r6r5r" Jun 02 22:19:34.757569 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:34.757520 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c86d564-fe84-477e-b5cc-d466a0c7d747-lib-modules\") pod \"perf-node-gather-daemonset-r6r5r\" (UID: \"7c86d564-fe84-477e-b5cc-d466a0c7d747\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-r6r5r" Jun 02 22:19:34.757740 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:34.757700 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4dmwr_97b5c1c0-5909-433f-85cd-3515fd144fbd/kube-rbac-proxy/0.log" Jun 02 22:19:34.764409 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:34.764388 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6q5d\" (UniqueName: \"kubernetes.io/projected/7c86d564-fe84-477e-b5cc-d466a0c7d747-kube-api-access-z6q5d\") pod \"perf-node-gather-daemonset-r6r5r\" (UID: \"7c86d564-fe84-477e-b5cc-d466a0c7d747\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-r6r5r" Jun 02 22:19:34.857245 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:34.857180 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-824lv_83f2febb-89fb-452c-833e-facb9d8bb557/dns-node-resolver/0.log" Jun 02 22:19:34.861205 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:34.861185 2553 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-r6r5r" Jun 02 22:19:35.012546 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:35.012485 2553 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5dzbc/perf-node-gather-daemonset-r6r5r"] Jun 02 22:19:35.017609 ip-10-0-139-67 kubenswrapper[2553]: W0602 22:19:35.017581 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7c86d564_fe84_477e_b5cc_d466a0c7d747.slice/crio-e67676cb245f02cd2ecd7bec1b39e7bdba286cbf012d2e246b317ac85cc211e9 WatchSource:0}: Error finding container e67676cb245f02cd2ecd7bec1b39e7bdba286cbf012d2e246b317ac85cc211e9: Status 404 returned error can't find the container with id e67676cb245f02cd2ecd7bec1b39e7bdba286cbf012d2e246b317ac85cc211e9 Jun 02 22:19:35.385581 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:35.385498 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-8844d9fcd-22448_dba3c819-37a3-4351-b020-ff4fc3e7f82b/registry/0.log" Jun 02 22:19:35.425855 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:35.425824 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7wp2q_c23fe6dd-65fe-43e4-b687-5ddc4cef6c1a/node-ca/0.log" Jun 02 22:19:35.855594 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:35.855553 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-r6r5r" event={"ID":"7c86d564-fe84-477e-b5cc-d466a0c7d747","Type":"ContainerStarted","Data":"ffd321d5e1d23bb56bce87545c4dbc1f8f7657f5ab38d4827a1fe41856fad84e"} Jun 02 22:19:35.856079 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:35.855604 2553 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-r6r5r" event={"ID":"7c86d564-fe84-477e-b5cc-d466a0c7d747","Type":"ContainerStarted","Data":"e67676cb245f02cd2ecd7bec1b39e7bdba286cbf012d2e246b317ac85cc211e9"} Jun 02 22:19:35.856432 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:35.856403 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-r6r5r" Jun 02 22:19:35.871679 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:35.871604 2553 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-r6r5r" podStartSLOduration=1.871591337 podStartE2EDuration="1.871591337s" podCreationTimestamp="2026-06-02 22:19:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 22:19:35.86990865 +0000 UTC m=+2268.038862361" watchObservedRunningTime="2026-06-02 22:19:35.871591337 +0000 UTC m=+2268.040545061" Jun 02 22:19:36.324053 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:36.324013 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-595b7776f8q8x2x_b165e872-e7e5-49c2-a1f8-06f343de8b77/istio-proxy/0.log" Jun 02 22:19:36.513176 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:36.513148 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7df95f575-vwdqw_a236dca3-20ae-4412-babc-dcd2dc6f18a7/istio-proxy/0.log" Jun 02 22:19:37.158461 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:37.158431 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zwfwz_443958d9-a8c2-4481-98e0-b45e59abaadd/serve-healthcheck-canary/0.log" Jun 02 22:19:37.613380 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:37.613347 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9ntkt_09a55432-a3be-4e87-93cb-9ac79c8d37e0/kube-rbac-proxy/0.log" Jun 02 22:19:37.633662 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:37.633636 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9ntkt_09a55432-a3be-4e87-93cb-9ac79c8d37e0/exporter/0.log" Jun 02 22:19:37.654013 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:37.653987 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9ntkt_09a55432-a3be-4e87-93cb-9ac79c8d37e0/extractor/0.log" Jun 02 22:19:39.782680 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:39.782653 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-659c675bb5-lktc5_0c3b7678-3c24-4bc3-80ee-0395d477831f/nginx/0.log" Jun 02 22:19:39.928129 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:39.928096 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29673960-74lhz_26c6dddf-8a67-48db-b528-276ad2796713/cleanup/0.log" Jun 02 22:19:39.949136 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:39.949103 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29673975-7krvp_c39fcf74-c936-482c-8bfb-9f1574847758/cleanup/0.log" Jun 02 22:19:40.103213 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:40.103141 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6858789655-2k45m_963777bc-df48-41e2-abbe-1683891824e2/manager/0.log" Jun 02 22:19:40.120829 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:40.120805 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6858789655-2k45m_963777bc-df48-41e2-abbe-1683891824e2/copy-manifests/0.log" Jun 02 22:19:41.594185 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:41.594157 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5f5cff6669-fsgfw_3f1de45d-c960-497a-a4bb-74041db4081b/manager/0.log" Jun 02 22:19:42.872105 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:42.872077 2553 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-r6r5r" Jun 02 22:19:46.297070 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:46.297038 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-vhjcv_c5876744-22d5-445c-9586-0535cf537658/migrator/0.log" Jun 02 22:19:46.314758 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:46.314726 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-vhjcv_c5876744-22d5-445c-9586-0535cf537658/graceful-termination/0.log" Jun 02 22:19:46.711828 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:46.711794 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-xzl5j_47ec9316-976d-4247-926f-713508dac5eb/kube-storage-version-migrator-operator/1.log" Jun 02 22:19:46.712987 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:46.712912 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-xzl5j_47ec9316-976d-4247-926f-713508dac5eb/kube-storage-version-migrator-operator/0.log" Jun 02 22:19:48.121855 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:48.121828 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q52sb_f5f436e1-413c-4e03-8555-fd576d4a697d/kube-multus-additional-cni-plugins/0.log" Jun 02 22:19:48.141001 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:48.140978 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q52sb_f5f436e1-413c-4e03-8555-fd576d4a697d/egress-router-binary-copy/0.log" Jun 02 22:19:48.158926 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:48.158906 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q52sb_f5f436e1-413c-4e03-8555-fd576d4a697d/cni-plugins/0.log" Jun 02 22:19:48.177963 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:48.177942 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q52sb_f5f436e1-413c-4e03-8555-fd576d4a697d/bond-cni-plugin/0.log" Jun 02 22:19:48.197707 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:48.197690 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q52sb_f5f436e1-413c-4e03-8555-fd576d4a697d/routeoverride-cni/0.log" Jun 02 22:19:48.215284 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:48.215261 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q52sb_f5f436e1-413c-4e03-8555-fd576d4a697d/whereabouts-cni-bincopy/0.log" Jun 02 22:19:48.236162 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:48.236139 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q52sb_f5f436e1-413c-4e03-8555-fd576d4a697d/whereabouts-cni/0.log" Jun 02 22:19:48.268290 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:48.268264 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jz744_896e8971-2598-4454-9661-2b3329ccc4f1/kube-multus/0.log" Jun 02 22:19:48.339099 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:48.339069 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4jr88_b9038487-6455-44d7-8c00-1323fb060fd9/network-metrics-daemon/0.log" Jun 02 22:19:48.357493 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:48.357470 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4jr88_b9038487-6455-44d7-8c00-1323fb060fd9/kube-rbac-proxy/0.log" Jun 02 22:19:49.499639 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:49.499588 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/ovn-controller/0.log" Jun 02 22:19:49.514584 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:49.514558 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/ovn-acl-logging/0.log" Jun 02 22:19:49.530886 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:49.530861 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/ovn-acl-logging/1.log" Jun 02 22:19:49.554607 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:49.554584 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/kube-rbac-proxy-node/0.log" Jun 02 22:19:49.573576 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:49.573551 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 22:19:49.595402 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:49.595353 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/northd/0.log" Jun 02 22:19:49.615435 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:49.615412 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/nbdb/0.log" Jun 02 22:19:49.638154 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:49.638136 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/sbdb/0.log" Jun 02 22:19:49.764351 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:49.764269 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s67gg_f861eb36-c26d-4d0e-9b5e-64543a169fb2/ovnkube-controller/0.log" Jun 02 22:19:51.170553 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:51.170527 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-56d84b9f44-96vsd_815b8442-a3e5-4bd2-9dd4-1c3babdadda0/check-endpoints/0.log" Jun 02 22:19:51.190652 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:51.190610 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-db2qf_fd65e214-8d99-48d4-a62a-e86376de6a80/network-check-target-container/0.log" Jun 02 22:19:52.252121 ip-10-0-139-67 kubenswrapper[2553]: I0602 22:19:52.252096 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-s48gg_1bb1fdcd-7ba6-48e4-8421-d364035b2c78/iptables-alerter/0.log"