Jun 03 14:42:43.421371 ip-10-0-134-32 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 14:42:43.421383 ip-10-0-134-32 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 14:42:43.421389 ip-10-0-134-32 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 14:42:43.421605 ip-10-0-134-32 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 14:42:53.507482 ip-10-0-134-32 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 14:42:53.507499 ip-10-0-134-32 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 2d92520e15c244f787b6a46f697cce1a -- Jun 03 14:45:16.225012 ip-10-0-134-32 systemd[1]: Starting Kubernetes Kubelet... Jun 03 14:45:16.636351 ip-10-0-134-32 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 14:45:16.636351 ip-10-0-134-32 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 14:45:16.636351 ip-10-0-134-32 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 14:45:16.636351 ip-10-0-134-32 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 14:45:16.636351 ip-10-0-134-32 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 14:45:16.638083 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.637995 2580 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 14:45:16.641975 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.641955 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 14:45:16.641975 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.641975 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 14:45:16.642045 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.641979 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 14:45:16.642045 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.641983 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 14:45:16.642045 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.641986 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 14:45:16.642045 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.641989 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 14:45:16.642045 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.641995 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 14:45:16.642045 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.641998 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 14:45:16.642045 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642001 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 14:45:16.642045 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642003 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 14:45:16.642045 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642006 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 14:45:16.642045 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642009 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 14:45:16.642045 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642011 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 14:45:16.642045 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642014 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 14:45:16.642045 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642017 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 14:45:16.642045 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642019 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 14:45:16.642045 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642023 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 14:45:16.642045 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642025 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 14:45:16.642045 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642028 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 14:45:16.642045 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642030 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 14:45:16.642045 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642033 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 14:45:16.642045 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642035 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 03 14:45:16.642555 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642037 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 14:45:16.642555 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642040 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 14:45:16.642555 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642043 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 14:45:16.642555 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642046 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 14:45:16.642555 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642048 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 14:45:16.642555 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642051 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 14:45:16.642555 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642054 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 14:45:16.642555 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642058 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 14:45:16.642555 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642061 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 14:45:16.642555 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642064 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 14:45:16.642555 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642066 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 14:45:16.642555 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642068 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 14:45:16.642555 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642071 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 14:45:16.642555 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642073 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 14:45:16.642555 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642076 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 14:45:16.642555 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642079 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 14:45:16.642555 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642082 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 14:45:16.642555 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642085 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 14:45:16.642555 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642087 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 14:45:16.642555 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642090 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 14:45:16.643065 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642093 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 14:45:16.643065 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642095 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 14:45:16.643065 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642098 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 14:45:16.643065 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642100 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 14:45:16.643065 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642104 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 14:45:16.643065 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642107 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 14:45:16.643065 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642109 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 14:45:16.643065 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642112 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 14:45:16.643065 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642114 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 14:45:16.643065 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642117 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 14:45:16.643065 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642119 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 14:45:16.643065 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642121 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 14:45:16.643065 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642124 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 14:45:16.643065 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642127 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 14:45:16.643065 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642130 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 14:45:16.643065 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642132 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 14:45:16.643065 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642136 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 14:45:16.643065 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642140 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 14:45:16.643065 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642142 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 14:45:16.643065 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642145 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 14:45:16.643544 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642147 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 14:45:16.643544 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642150 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 14:45:16.643544 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642152 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 14:45:16.643544 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642155 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 14:45:16.643544 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642157 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 14:45:16.643544 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642160 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 14:45:16.643544 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642162 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 14:45:16.643544 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642165 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 14:45:16.643544 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642167 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 14:45:16.643544 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642170 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 14:45:16.643544 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642173 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 14:45:16.643544 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642175 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 14:45:16.643544 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642178 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 14:45:16.643544 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642180 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 14:45:16.643544 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642182 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 14:45:16.643544 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642185 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 14:45:16.643544 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642187 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 14:45:16.643544 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642189 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 14:45:16.643544 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642192 2580 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 14:45:16.643544 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642194 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 14:45:16.644046 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642197 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 14:45:16.644046 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642199 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 14:45:16.644046 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642202 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 14:45:16.644046 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.642204 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 14:45:16.644430 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644417 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 14:45:16.644430 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644429 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 14:45:16.644488 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644433 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 14:45:16.644488 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644436 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 14:45:16.644488 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644438 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 14:45:16.644488 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644441 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 14:45:16.644488 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644443 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 14:45:16.644488 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644446 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 14:45:16.644488 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644448 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 14:45:16.644488 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644451 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 14:45:16.644488 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644453 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 14:45:16.644488 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644456 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 14:45:16.644488 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644459 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 14:45:16.644488 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644462 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 14:45:16.644488 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644465 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 14:45:16.644488 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644468 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 14:45:16.644488 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644471 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 14:45:16.644488 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644473 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 14:45:16.644488 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644476 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 14:45:16.644488 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644479 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 14:45:16.644488 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644482 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 03 14:45:16.644957 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644485 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 14:45:16.644957 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644487 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 14:45:16.644957 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644490 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 14:45:16.644957 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644493 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 14:45:16.644957 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644496 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 14:45:16.644957 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644499 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 14:45:16.644957 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644502 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 14:45:16.644957 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644506 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 14:45:16.644957 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644509 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 14:45:16.644957 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644512 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 14:45:16.644957 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644515 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 14:45:16.644957 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644517 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 14:45:16.644957 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644520 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 14:45:16.644957 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644522 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 14:45:16.644957 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644525 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 14:45:16.644957 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644527 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 14:45:16.644957 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644529 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 14:45:16.644957 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644532 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 14:45:16.644957 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644534 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 14:45:16.644957 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644536 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 14:45:16.645493 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644539 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 14:45:16.645493 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644541 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 14:45:16.645493 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644544 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 14:45:16.645493 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644546 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 14:45:16.645493 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644549 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 14:45:16.645493 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644551 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 14:45:16.645493 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644554 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 14:45:16.645493 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644556 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 14:45:16.645493 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644559 2580 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 14:45:16.645493 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644561 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 14:45:16.645493 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644564 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 14:45:16.645493 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644566 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 14:45:16.645493 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644569 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 14:45:16.645493 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644572 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 14:45:16.645493 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644575 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 14:45:16.645493 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644577 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 14:45:16.645493 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644580 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 14:45:16.645493 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644582 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 14:45:16.645493 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644585 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 14:45:16.645493 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644587 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 14:45:16.646019 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644604 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 14:45:16.646019 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644607 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 14:45:16.646019 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644611 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 14:45:16.646019 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644614 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 14:45:16.646019 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644616 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 14:45:16.646019 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644619 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 14:45:16.646019 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644621 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 14:45:16.646019 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644624 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 14:45:16.646019 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644626 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 14:45:16.646019 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644629 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 14:45:16.646019 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644631 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 14:45:16.646019 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644634 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 14:45:16.646019 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644636 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 14:45:16.646019 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644639 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 14:45:16.646019 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644641 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 14:45:16.646019 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644643 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 14:45:16.646019 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644646 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 14:45:16.646019 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644648 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 14:45:16.646019 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644666 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 14:45:16.646019 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644672 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 14:45:16.646512 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644676 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 14:45:16.646512 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644681 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 14:45:16.646512 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644686 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 14:45:16.646512 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644689 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 14:45:16.646512 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.644691 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 14:45:16.646512 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644766 2580 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 14:45:16.646512 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644774 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 14:45:16.646512 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644781 2580 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 14:45:16.646512 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644786 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 14:45:16.646512 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644790 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 14:45:16.646512 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644793 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 14:45:16.646512 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644797 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 14:45:16.646512 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644801 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 14:45:16.646512 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644804 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 14:45:16.646512 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644807 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 14:45:16.646512 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644810 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 14:45:16.646512 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644814 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 14:45:16.646512 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644817 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 14:45:16.646512 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644820 2580 flags.go:64] FLAG: --cgroup-root="" Jun 03 14:45:16.646512 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644822 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 14:45:16.646512 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644825 2580 flags.go:64] FLAG: --client-ca-file="" Jun 03 14:45:16.646512 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644828 2580 flags.go:64] FLAG: --cloud-config="" Jun 03 14:45:16.646512 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644830 2580 flags.go:64] FLAG: --cloud-provider="external" Jun 03 14:45:16.646512 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644833 2580 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 14:45:16.647122 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644837 2580 flags.go:64] FLAG: --cluster-domain="" Jun 03 14:45:16.647122 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644839 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 14:45:16.647122 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644842 2580 flags.go:64] FLAG: --config-dir="" Jun 03 14:45:16.647122 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644845 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 14:45:16.647122 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644849 2580 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 14:45:16.647122 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644853 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 14:45:16.647122 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644855 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 14:45:16.647122 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644858 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 14:45:16.647122 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644861 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 14:45:16.647122 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644864 2580 flags.go:64] FLAG: --contention-profiling="false" Jun 03 14:45:16.647122 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644867 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 14:45:16.647122 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644870 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 14:45:16.647122 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644874 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 14:45:16.647122 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644877 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 14:45:16.647122 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644882 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 14:45:16.647122 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644884 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 14:45:16.647122 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644887 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 14:45:16.647122 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644890 2580 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 14:45:16.647122 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644894 2580 flags.go:64] FLAG: --enable-server="true" Jun 03 14:45:16.647122 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644898 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 14:45:16.647122 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644902 2580 flags.go:64] FLAG: --event-burst="100" Jun 03 14:45:16.647122 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644905 2580 flags.go:64] FLAG: --event-qps="50" Jun 03 14:45:16.647122 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644908 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 14:45:16.647122 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644911 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 14:45:16.647122 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644914 2580 flags.go:64] FLAG: --eviction-hard="" Jun 03 14:45:16.647739 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644918 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 14:45:16.647739 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644921 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 14:45:16.647739 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644923 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 14:45:16.647739 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644926 2580 flags.go:64] FLAG: --eviction-soft="" Jun 03 14:45:16.647739 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644929 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 14:45:16.647739 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644932 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 14:45:16.647739 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644935 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 14:45:16.647739 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644937 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 14:45:16.647739 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644940 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 14:45:16.647739 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644943 2580 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 14:45:16.647739 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644945 2580 flags.go:64] FLAG: --feature-gates="" Jun 03 14:45:16.647739 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644949 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 14:45:16.647739 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644952 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 14:45:16.647739 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644955 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 14:45:16.647739 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644958 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 14:45:16.647739 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644961 2580 flags.go:64] FLAG: --healthz-port="10248" Jun 03 14:45:16.647739 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644964 2580 flags.go:64] FLAG: --help="false" Jun 03 14:45:16.647739 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644967 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-134-32.ec2.internal" Jun 03 14:45:16.647739 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644971 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 14:45:16.647739 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644974 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 14:45:16.647739 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644978 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 14:45:16.647739 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644982 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 14:45:16.647739 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644985 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 14:45:16.648290 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644988 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 14:45:16.648290 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644991 2580 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 14:45:16.648290 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644994 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 14:45:16.648290 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644996 2580 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 14:45:16.648290 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.644999 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 14:45:16.648290 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645003 2580 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 14:45:16.648290 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645005 2580 flags.go:64] FLAG: --kube-reserved="" Jun 03 14:45:16.648290 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645008 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 14:45:16.648290 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645011 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 14:45:16.648290 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645014 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 14:45:16.648290 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645017 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 14:45:16.648290 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645020 2580 flags.go:64] FLAG: --lock-file="" Jun 03 14:45:16.648290 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645023 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 14:45:16.648290 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645025 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 14:45:16.648290 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645028 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 14:45:16.648290 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645033 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 14:45:16.648290 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645036 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 14:45:16.648290 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645039 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 14:45:16.648290 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645042 2580 flags.go:64] FLAG: --logging-format="text" Jun 03 14:45:16.648290 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645045 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 14:45:16.648290 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645048 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 14:45:16.648290 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645051 2580 flags.go:64] FLAG: --manifest-url="" Jun 03 14:45:16.648290 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645053 2580 flags.go:64] FLAG: --manifest-url-header="" Jun 03 14:45:16.648290 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645057 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 14:45:16.648290 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645060 2580 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 14:45:16.649012 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645064 2580 flags.go:64] FLAG: --max-pods="110" Jun 03 14:45:16.649012 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645068 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 14:45:16.649012 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645071 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 14:45:16.649012 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645074 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 14:45:16.649012 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645077 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 14:45:16.649012 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645088 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 14:45:16.649012 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645091 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 14:45:16.649012 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645094 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 14:45:16.649012 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645106 2580 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 14:45:16.649012 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645109 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 14:45:16.649012 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645112 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 14:45:16.649012 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645114 2580 flags.go:64] FLAG: --pod-cidr="" Jun 03 14:45:16.649012 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645117 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 14:45:16.649012 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645123 2580 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 14:45:16.649012 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645126 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 14:45:16.649012 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645129 2580 flags.go:64] FLAG: --pods-per-core="0" Jun 03 14:45:16.649012 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645132 2580 flags.go:64] FLAG: --port="10250" Jun 03 14:45:16.649012 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645135 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 14:45:16.649012 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645138 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-065cc39308f2654ee" Jun 03 14:45:16.649012 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645141 2580 flags.go:64] FLAG: --qos-reserved="" Jun 03 14:45:16.649012 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645144 2580 flags.go:64] FLAG: --read-only-port="10255" Jun 03 14:45:16.649012 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645147 2580 flags.go:64] FLAG: --register-node="true" Jun 03 14:45:16.649012 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645150 2580 flags.go:64] FLAG: --register-schedulable="true" Jun 03 14:45:16.649012 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645154 2580 flags.go:64] FLAG: --register-with-taints="" Jun 03 14:45:16.649603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645157 2580 flags.go:64] FLAG: --registry-burst="10" Jun 03 14:45:16.649603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645160 2580 flags.go:64] FLAG: --registry-qps="5" Jun 03 14:45:16.649603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645162 2580 flags.go:64] FLAG: --reserved-cpus="" Jun 03 14:45:16.649603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645165 2580 flags.go:64] FLAG: --reserved-memory="" Jun 03 14:45:16.649603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645169 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 14:45:16.649603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645171 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 14:45:16.649603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645174 2580 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 14:45:16.649603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645177 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 14:45:16.649603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645180 2580 flags.go:64] FLAG: --runonce="false" Jun 03 14:45:16.649603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645182 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 14:45:16.649603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645185 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 14:45:16.649603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645188 2580 flags.go:64] FLAG: --seccomp-default="false" Jun 03 14:45:16.649603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645191 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 14:45:16.649603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645194 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 14:45:16.649603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645198 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 14:45:16.649603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645201 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 14:45:16.649603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645204 2580 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 14:45:16.649603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645207 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 14:45:16.649603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645209 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 14:45:16.649603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645212 2580 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 14:45:16.649603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645215 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 14:45:16.649603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645218 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 14:45:16.649603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645220 2580 flags.go:64] FLAG: --system-cgroups="" Jun 03 14:45:16.649603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645223 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 14:45:16.649603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645228 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 14:45:16.650210 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645231 2580 flags.go:64] FLAG: --tls-cert-file="" Jun 03 14:45:16.650210 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645234 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 14:45:16.650210 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645253 2580 flags.go:64] FLAG: --tls-min-version="" Jun 03 14:45:16.650210 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645257 2580 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 14:45:16.650210 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645260 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 14:45:16.650210 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645263 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 14:45:16.650210 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645265 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 14:45:16.650210 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645268 2580 flags.go:64] FLAG: --v="2" Jun 03 14:45:16.650210 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645273 2580 flags.go:64] FLAG: --version="false" Jun 03 14:45:16.650210 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645277 2580 flags.go:64] FLAG: --vmodule="" Jun 03 14:45:16.650210 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645281 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 14:45:16.650210 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.645284 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 14:45:16.650210 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645376 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 14:45:16.650210 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645381 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 14:45:16.650210 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645384 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 14:45:16.650210 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645387 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 14:45:16.650210 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645390 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 14:45:16.650210 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645393 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 14:45:16.650210 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645396 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 14:45:16.650210 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645399 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 14:45:16.650210 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645401 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 14:45:16.650210 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645404 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 14:45:16.650799 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645407 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 14:45:16.650799 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645410 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 14:45:16.650799 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645413 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 14:45:16.650799 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645415 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 14:45:16.650799 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645417 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 14:45:16.650799 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645420 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 14:45:16.650799 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645422 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 14:45:16.650799 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645425 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 14:45:16.650799 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645427 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 14:45:16.650799 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645430 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 14:45:16.650799 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645432 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 14:45:16.650799 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645435 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 14:45:16.650799 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645437 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 14:45:16.650799 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645440 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 14:45:16.650799 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645443 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 14:45:16.650799 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645445 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 14:45:16.650799 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645448 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 14:45:16.650799 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645450 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 14:45:16.650799 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645452 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 14:45:16.650799 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645455 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 14:45:16.651319 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645457 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 14:45:16.651319 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645460 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 14:45:16.651319 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645462 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 14:45:16.651319 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645465 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 14:45:16.651319 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645467 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 14:45:16.651319 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645469 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 14:45:16.651319 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645472 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 14:45:16.651319 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645474 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 14:45:16.651319 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645477 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 14:45:16.651319 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645479 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 14:45:16.651319 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645482 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 14:45:16.651319 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645485 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 14:45:16.651319 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645487 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 14:45:16.651319 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645490 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 14:45:16.651319 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645493 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 14:45:16.651319 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645495 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 14:45:16.651319 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645499 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 14:45:16.651319 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645501 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 14:45:16.651319 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645504 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 14:45:16.651319 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645506 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 14:45:16.651890 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645509 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 14:45:16.651890 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645511 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 14:45:16.651890 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645514 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 14:45:16.651890 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645517 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 14:45:16.651890 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645519 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 14:45:16.651890 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645522 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 14:45:16.651890 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645525 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 14:45:16.651890 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645527 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 03 14:45:16.651890 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645530 2580 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 14:45:16.651890 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645532 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 14:45:16.651890 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645534 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 14:45:16.651890 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645537 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 14:45:16.651890 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645539 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 14:45:16.651890 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645542 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 14:45:16.651890 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645544 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 14:45:16.651890 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645546 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 14:45:16.651890 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645549 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 14:45:16.651890 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645551 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 14:45:16.651890 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645554 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 14:45:16.651890 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645556 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 14:45:16.652768 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645561 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 14:45:16.652768 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645563 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 14:45:16.652768 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645566 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 14:45:16.652768 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645568 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 14:45:16.652768 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645571 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 14:45:16.652768 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645573 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 14:45:16.652768 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645576 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 14:45:16.652768 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645580 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 14:45:16.652768 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645583 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 14:45:16.652768 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645586 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 14:45:16.652768 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645589 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 14:45:16.652768 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645591 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 14:45:16.652768 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645594 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 14:45:16.652768 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645597 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 14:45:16.652768 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645599 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 14:45:16.652768 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.645602 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 14:45:16.653314 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.646241 2580 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 14:45:16.655296 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.655274 2580 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 14:45:16.655334 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.655299 2580 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 14:45:16.655370 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655355 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 14:45:16.655370 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655361 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 14:45:16.655370 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655364 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 14:45:16.655370 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655367 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 14:45:16.655370 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655370 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 14:45:16.655505 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655373 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 14:45:16.655505 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655377 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 14:45:16.655505 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655380 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 14:45:16.655505 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655383 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 14:45:16.655505 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655385 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 14:45:16.655505 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655388 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 14:45:16.655505 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655391 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 14:45:16.655505 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655393 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 14:45:16.655505 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655396 2580 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 14:45:16.655505 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655398 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 14:45:16.655505 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655401 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 14:45:16.655505 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655403 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 14:45:16.655505 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655406 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 14:45:16.655505 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655409 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 14:45:16.655505 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655411 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 14:45:16.655505 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655414 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 14:45:16.655505 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655417 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 14:45:16.655505 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655420 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 14:45:16.655505 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655423 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 14:45:16.655505 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655425 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 14:45:16.656023 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655427 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 14:45:16.656023 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655430 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 14:45:16.656023 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655432 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 14:45:16.656023 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655435 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 14:45:16.656023 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655437 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 14:45:16.656023 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655440 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 14:45:16.656023 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655443 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 14:45:16.656023 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655445 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 14:45:16.656023 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655447 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 14:45:16.656023 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655450 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 14:45:16.656023 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655452 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 14:45:16.656023 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655455 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 14:45:16.656023 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655457 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 14:45:16.656023 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655461 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 14:45:16.656023 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655464 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 14:45:16.656023 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655468 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 14:45:16.656023 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655472 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 14:45:16.656023 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655475 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 14:45:16.656023 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655479 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 14:45:16.656489 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655481 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 14:45:16.656489 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655484 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 14:45:16.656489 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655488 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 14:45:16.656489 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655492 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 14:45:16.656489 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655495 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 14:45:16.656489 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655498 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 14:45:16.656489 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655501 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 14:45:16.656489 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655504 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 14:45:16.656489 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655507 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 14:45:16.656489 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655510 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 14:45:16.656489 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655512 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 14:45:16.656489 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655515 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 14:45:16.656489 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655518 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 14:45:16.656489 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655520 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 14:45:16.656489 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655523 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 14:45:16.656489 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655526 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 14:45:16.656489 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655528 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 14:45:16.656489 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655531 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 14:45:16.656489 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655533 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 14:45:16.656489 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655536 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 14:45:16.657006 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655538 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 14:45:16.657006 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655541 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 14:45:16.657006 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655543 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 14:45:16.657006 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655546 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 14:45:16.657006 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655549 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 14:45:16.657006 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655551 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 14:45:16.657006 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655554 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 14:45:16.657006 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655557 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 14:45:16.657006 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655559 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 14:45:16.657006 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655562 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 14:45:16.657006 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655564 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 14:45:16.657006 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655567 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 14:45:16.657006 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655570 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 03 14:45:16.657006 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655572 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 14:45:16.657006 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655575 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 14:45:16.657006 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655577 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 14:45:16.657006 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655580 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 14:45:16.657006 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655583 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 14:45:16.657006 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655585 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 14:45:16.657006 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655588 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 14:45:16.657498 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655590 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 14:45:16.657498 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655593 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 14:45:16.657498 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.655598 2580 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 14:45:16.657498 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655741 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 14:45:16.657498 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655747 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 14:45:16.657498 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655750 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 14:45:16.657498 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655753 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 14:45:16.657498 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655756 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 14:45:16.657498 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655759 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 14:45:16.657498 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655761 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 14:45:16.657498 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655764 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 14:45:16.657498 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655767 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 14:45:16.657498 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655771 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 14:45:16.657498 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655774 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 14:45:16.657498 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655776 2580 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 14:45:16.657984 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655780 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 14:45:16.657984 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655783 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 14:45:16.657984 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655786 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 14:45:16.657984 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655789 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 14:45:16.657984 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655792 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 14:45:16.657984 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655795 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 14:45:16.657984 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655798 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 14:45:16.657984 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655800 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 14:45:16.657984 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655803 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 14:45:16.657984 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655806 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 14:45:16.657984 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655809 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 14:45:16.657984 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655812 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 14:45:16.657984 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655814 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 14:45:16.657984 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655816 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 14:45:16.657984 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655819 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 14:45:16.657984 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655822 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 14:45:16.657984 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655824 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 14:45:16.657984 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655827 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 03 14:45:16.657984 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655829 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 14:45:16.657984 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655832 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 14:45:16.658471 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655834 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 14:45:16.658471 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655837 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 14:45:16.658471 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655839 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 14:45:16.658471 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655842 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 14:45:16.658471 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655844 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 14:45:16.658471 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655846 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 14:45:16.658471 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655849 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 14:45:16.658471 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655851 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 14:45:16.658471 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655854 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 14:45:16.658471 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655856 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 14:45:16.658471 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655858 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 14:45:16.658471 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655861 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 14:45:16.658471 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655863 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 14:45:16.658471 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655866 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 14:45:16.658471 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655869 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 14:45:16.658471 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655871 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 14:45:16.658471 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655874 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 14:45:16.658471 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655876 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 14:45:16.658471 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655879 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 14:45:16.658960 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655882 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 14:45:16.658960 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655884 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 14:45:16.658960 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655887 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 14:45:16.658960 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655889 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 14:45:16.658960 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655893 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 14:45:16.658960 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655895 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 14:45:16.658960 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655898 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 14:45:16.658960 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655900 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 14:45:16.658960 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655902 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 14:45:16.658960 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655904 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 14:45:16.658960 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655907 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 14:45:16.658960 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655909 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 14:45:16.658960 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655912 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 14:45:16.658960 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655914 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 14:45:16.658960 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655916 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 14:45:16.658960 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655919 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 14:45:16.658960 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655921 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 14:45:16.658960 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655923 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 14:45:16.658960 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655926 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 14:45:16.658960 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655928 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 14:45:16.659454 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655931 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 14:45:16.659454 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655933 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 14:45:16.659454 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655936 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 14:45:16.659454 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655938 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 14:45:16.659454 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655940 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 14:45:16.659454 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655943 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 14:45:16.659454 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655946 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 14:45:16.659454 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655948 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 14:45:16.659454 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655951 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 14:45:16.659454 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655954 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 14:45:16.659454 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655956 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 14:45:16.659454 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655959 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 14:45:16.659454 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655961 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 14:45:16.659454 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655964 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 14:45:16.659454 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:16.655966 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 14:45:16.659841 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.655971 2580 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 14:45:16.659841 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.656741 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 14:45:16.659841 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.659620 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 14:45:16.660484 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.660472 2580 server.go:1019] "Starting client certificate rotation" Jun 03 14:45:16.660595 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.660574 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 14:45:16.660627 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.660621 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 14:45:16.682758 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.682736 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 14:45:16.686183 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.686156 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 14:45:16.695857 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.695833 2580 log.go:25] "Validated CRI v1 runtime API" Jun 03 14:45:16.700974 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.700954 2580 log.go:25] "Validated CRI v1 image API" Jun 03 14:45:16.703616 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.703602 2580 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 14:45:16.706623 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.706600 2580 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 892d0e7b-be10-41e5-9e87-5cd76ed46244:/dev/nvme0n1p3 a9d5317a-1c84-4c98-bce6-8cbddbef598c:/dev/nvme0n1p4] Jun 03 14:45:16.706713 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.706621 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 14:45:16.712940 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.712919 2580 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 14:45:16.713171 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.713051 2580 manager.go:217] Machine: {Timestamp:2026-06-03 14:45:16.712499252 +0000 UTC m=+0.375601717 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100099 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f8d722bce829764b957f62b7befe5 SystemUUID:ec2f8d72-2bce-8297-64b9-57f62b7befe5 BootID:2d92520e-15c2-44f7-87b6-a46f697cce1a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:db:eb:c3:fb:d9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:db:eb:c3:fb:d9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:a9:af:fc:76:c2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 14:45:16.713783 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.713759 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 14:45:16.713875 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.713863 2580 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 14:45:16.717389 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.717366 2580 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 14:45:16.717531 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.717393 2580 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-32.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 14:45:16.717583 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.717541 2580 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 14:45:16.717583 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.717550 2580 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 14:45:16.717583 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.717558 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 14:45:16.718326 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.718316 2580 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 14:45:16.719429 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.719419 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 03 14:45:16.719720 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.719710 2580 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 14:45:16.721809 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.721799 2580 kubelet.go:491] "Attempting to sync node with API server" Jun 03 14:45:16.721848 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.721813 2580 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 14:45:16.721848 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.721825 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 14:45:16.721848 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.721834 2580 kubelet.go:397] "Adding apiserver pod source" Jun 03 14:45:16.721848 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.721843 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 14:45:16.722986 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.722974 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 14:45:16.723021 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.722993 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 14:45:16.732335 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.732316 2580 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 14:45:16.734408 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.734394 2580 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 14:45:16.735996 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:16.735959 2580 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-32.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 14:45:16.736257 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:16.736236 2580 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 14:45:16.736453 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.736438 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 14:45:16.736491 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.736455 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 14:45:16.736491 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.736461 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 14:45:16.736491 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.736467 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 14:45:16.736491 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.736475 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 14:45:16.736491 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.736480 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 14:45:16.736491 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.736486 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 14:45:16.736491 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.736491 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 14:45:16.736703 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.736498 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 14:45:16.736703 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.736504 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 14:45:16.736703 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.736517 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 14:45:16.736703 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.736523 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 14:45:16.737434 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.737422 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 14:45:16.737469 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.737448 2580 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 14:45:16.740685 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.740671 2580 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 14:45:16.740768 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.740707 2580 server.go:1295] "Started kubelet" Jun 03 14:45:16.740826 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.740785 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 14:45:16.740986 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.740910 2580 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 14:45:16.741084 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.741075 2580 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 14:45:16.742395 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.742372 2580 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 14:45:16.742739 ip-10-0-134-32 systemd[1]: Started Kubernetes Kubelet. Jun 03 14:45:16.743875 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.743860 2580 server.go:317] "Adding debug handlers to kubelet server" Jun 03 14:45:16.749026 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.748990 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 14:45:16.749356 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.749333 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 14:45:16.749471 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.749412 2580 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-32.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 14:45:16.749674 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.749642 2580 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 14:45:16.749674 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.749676 2580 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 14:45:16.750000 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.749984 2580 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 14:45:16.750072 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.750020 2580 reconstruct.go:97] "Volume reconstruction finished" Jun 03 14:45:16.750072 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.750027 2580 reconciler.go:26] "Reconciler: start to sync state" Jun 03 14:45:16.750184 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:16.750167 2580 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-32.ec2.internal\" not found" Jun 03 14:45:16.750509 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.750493 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 14:45:16.750509 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.750509 2580 factory.go:55] Registering systemd factory Jun 03 14:45:16.750676 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.750517 2580 factory.go:223] Registration of the systemd container factory successfully Jun 03 14:45:16.750733 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:16.748979 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-32.ec2.internal.18b5996bfaa6c5e8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-32.ec2.internal,UID:ip-10-0-134-32.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-32.ec2.internal,},FirstTimestamp:2026-06-03 14:45:16.74068324 +0000 UTC m=+0.403785693,LastTimestamp:2026-06-03 14:45:16.74068324 +0000 UTC m=+0.403785693,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-32.ec2.internal,}" Jun 03 14:45:16.750808 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.750800 2580 factory.go:153] Registering CRI-O factory Jun 03 14:45:16.750870 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.750811 2580 factory.go:223] Registration of the crio container factory successfully Jun 03 14:45:16.750870 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.750825 2580 factory.go:103] Registering Raw factory Jun 03 14:45:16.750870 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.750837 2580 manager.go:1196] Started watching for new ooms in manager Jun 03 14:45:16.751317 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.751305 2580 manager.go:319] Starting recovery of all containers Jun 03 14:45:16.755425 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.755398 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cnzhh" Jun 03 14:45:16.757308 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:16.757235 2580 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 14:45:16.757986 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:16.757956 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-32.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 14:45:16.758325 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:16.758301 2580 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 14:45:16.761156 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.761010 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cnzhh" Jun 03 14:45:16.763673 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.763638 2580 manager.go:324] Recovery completed Jun 03 14:45:16.765115 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.765071 2580 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 14:45:16.768752 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.768737 2580 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 14:45:16.770356 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.770338 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-32.ec2.internal" event="NodeHasSufficientMemory" Jun 03 14:45:16.770447 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.770369 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-32.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 14:45:16.770447 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.770380 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-32.ec2.internal" event="NodeHasSufficientPID" Jun 03 14:45:16.770837 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.770823 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 14:45:16.770889 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.770838 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 14:45:16.770889 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.770867 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 03 14:45:16.773602 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.773590 2580 policy_none.go:49] "None policy: Start" Jun 03 14:45:16.773642 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.773606 2580 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 14:45:16.773642 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.773616 2580 state_mem.go:35] "Initializing new in-memory state store" Jun 03 14:45:16.817328 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.817309 2580 manager.go:341] "Starting Device Plugin manager" Jun 03 14:45:16.817424 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:16.817345 2580 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 14:45:16.817424 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.817358 2580 server.go:85] "Starting device plugin registration server" Jun 03 14:45:16.817629 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.817617 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 14:45:16.817759 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.817632 2580 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 14:45:16.817810 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.817793 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 14:45:16.817899 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.817879 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 14:45:16.817899 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.817891 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 14:45:16.818382 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:16.818363 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 14:45:16.818470 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:16.818404 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-32.ec2.internal\" not found" Jun 03 14:45:16.894888 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.894824 2580 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 14:45:16.894888 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.894864 2580 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 14:45:16.894888 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.894887 2580 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 14:45:16.896119 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.894894 2580 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 14:45:16.896119 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:16.894935 2580 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 14:45:16.897668 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.897633 2580 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 14:45:16.918858 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.918828 2580 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 14:45:16.919721 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.919703 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-32.ec2.internal" event="NodeHasSufficientMemory" Jun 03 14:45:16.919814 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.919732 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-32.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 14:45:16.919814 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.919746 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-32.ec2.internal" event="NodeHasSufficientPID" Jun 03 14:45:16.919814 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.919769 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-32.ec2.internal" Jun 03 14:45:16.928901 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.928876 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-32.ec2.internal" Jun 03 14:45:16.928901 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:16.928901 2580 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-32.ec2.internal\": node \"ip-10-0-134-32.ec2.internal\" not found" Jun 03 14:45:16.943935 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:16.943912 2580 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-32.ec2.internal\" not found" Jun 03 14:45:16.995256 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.995224 2580 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-32.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-32.ec2.internal"] Jun 03 14:45:16.995375 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.995292 2580 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 14:45:16.996250 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.996236 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-32.ec2.internal" event="NodeHasSufficientMemory" Jun 03 14:45:16.996322 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.996267 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-32.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 14:45:16.996322 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.996281 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-32.ec2.internal" event="NodeHasSufficientPID" Jun 03 14:45:16.997975 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.997961 2580 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 14:45:16.998143 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.998129 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-32.ec2.internal" Jun 03 14:45:16.998188 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.998157 2580 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 14:45:16.998751 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.998734 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-32.ec2.internal" event="NodeHasSufficientMemory" Jun 03 14:45:16.998831 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.998764 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-32.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 14:45:16.998831 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.998774 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-32.ec2.internal" event="NodeHasSufficientPID" Jun 03 14:45:16.998831 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.998795 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-32.ec2.internal" event="NodeHasSufficientMemory" Jun 03 14:45:16.998831 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.998824 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-32.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 14:45:16.998976 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.998857 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-32.ec2.internal" event="NodeHasSufficientPID" Jun 03 14:45:16.999967 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.999954 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-32.ec2.internal" Jun 03 14:45:17.000021 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:16.999978 2580 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 14:45:17.000582 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.000565 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-32.ec2.internal" event="NodeHasSufficientMemory" Jun 03 14:45:17.000692 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.000595 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-32.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 14:45:17.000692 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.000611 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-32.ec2.internal" event="NodeHasSufficientPID" Jun 03 14:45:17.021516 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:17.021482 2580 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-32.ec2.internal\" not found" node="ip-10-0-134-32.ec2.internal" Jun 03 14:45:17.026017 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:17.025996 2580 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-32.ec2.internal\" not found" node="ip-10-0-134-32.ec2.internal" Jun 03 14:45:17.044595 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:17.044559 2580 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-32.ec2.internal\" not found" Jun 03 14:45:17.144989 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:17.144916 2580 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-32.ec2.internal\" not found" Jun 03 14:45:17.152260 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.152243 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9354426b46095aeca51d84a99cd8e609-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-32.ec2.internal\" (UID: \"9354426b46095aeca51d84a99cd8e609\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-32.ec2.internal" Jun 03 14:45:17.152331 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.152270 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9354426b46095aeca51d84a99cd8e609-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-32.ec2.internal\" (UID: \"9354426b46095aeca51d84a99cd8e609\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-32.ec2.internal" Jun 03 14:45:17.152331 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.152289 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9bbfdd57113509939e81d22cb0c12ade-config\") pod \"kube-apiserver-proxy-ip-10-0-134-32.ec2.internal\" (UID: \"9bbfdd57113509939e81d22cb0c12ade\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-32.ec2.internal" Jun 03 14:45:17.245699 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:17.245647 2580 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-32.ec2.internal\" not found" Jun 03 14:45:17.253099 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.253066 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9354426b46095aeca51d84a99cd8e609-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-32.ec2.internal\" (UID: \"9354426b46095aeca51d84a99cd8e609\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-32.ec2.internal" Jun 03 14:45:17.253099 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.253105 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9354426b46095aeca51d84a99cd8e609-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-32.ec2.internal\" (UID: \"9354426b46095aeca51d84a99cd8e609\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-32.ec2.internal" Jun 03 14:45:17.253248 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.253121 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9bbfdd57113509939e81d22cb0c12ade-config\") pod \"kube-apiserver-proxy-ip-10-0-134-32.ec2.internal\" (UID: \"9bbfdd57113509939e81d22cb0c12ade\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-32.ec2.internal" Jun 03 14:45:17.253248 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.253156 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9bbfdd57113509939e81d22cb0c12ade-config\") pod \"kube-apiserver-proxy-ip-10-0-134-32.ec2.internal\" (UID: \"9bbfdd57113509939e81d22cb0c12ade\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-32.ec2.internal" Jun 03 14:45:17.253248 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.253175 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9354426b46095aeca51d84a99cd8e609-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-32.ec2.internal\" (UID: \"9354426b46095aeca51d84a99cd8e609\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-32.ec2.internal" Jun 03 14:45:17.253248 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.253172 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9354426b46095aeca51d84a99cd8e609-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-32.ec2.internal\" (UID: \"9354426b46095aeca51d84a99cd8e609\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-32.ec2.internal" Jun 03 14:45:17.324246 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.324210 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-32.ec2.internal" Jun 03 14:45:17.330146 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.330126 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-32.ec2.internal" Jun 03 14:45:17.346276 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:17.346251 2580 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-32.ec2.internal\" not found" Jun 03 14:45:17.446869 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:17.446773 2580 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-32.ec2.internal\" not found" Jun 03 14:45:17.547367 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:17.547329 2580 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-32.ec2.internal\" not found" Jun 03 14:45:17.647821 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:17.647794 2580 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-32.ec2.internal\" not found" Jun 03 14:45:17.661357 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.661324 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 14:45:17.661523 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.661460 2580 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 14:45:17.748063 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:17.747996 2580 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-32.ec2.internal\" not found" Jun 03 14:45:17.750184 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.750163 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 14:45:17.763289 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.763257 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 14:40:16 +0000 UTC" deadline="2027-11-28 16:49:18.631341765 +0000 UTC" Jun 03 14:45:17.763289 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.763285 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13034h4m0.868059321s" Jun 03 14:45:17.769035 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.769003 2580 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 14:45:17.795548 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.795508 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-k6d96" Jun 03 14:45:17.803221 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.803195 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-k6d96" Jun 03 14:45:17.848757 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:17.848724 2580 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-32.ec2.internal\" not found" Jun 03 14:45:17.860934 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:17.860903 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bbfdd57113509939e81d22cb0c12ade.slice/crio-d19e5933ad89a406e15e935275953953c3838da44d927af6616bf86a9bf0b4b2 WatchSource:0}: Error finding container d19e5933ad89a406e15e935275953953c3838da44d927af6616bf86a9bf0b4b2: Status 404 returned error can't find the container with id d19e5933ad89a406e15e935275953953c3838da44d927af6616bf86a9bf0b4b2 Jun 03 14:45:17.864215 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.864198 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 14:45:17.892491 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:17.892460 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9354426b46095aeca51d84a99cd8e609.slice/crio-2cf92f3022138a00c6788bb048ae0ccfae02e9baec1d92b236343192a9b876dc WatchSource:0}: Error finding container 2cf92f3022138a00c6788bb048ae0ccfae02e9baec1d92b236343192a9b876dc: Status 404 returned error can't find the container with id 2cf92f3022138a00c6788bb048ae0ccfae02e9baec1d92b236343192a9b876dc Jun 03 14:45:17.898916 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.898205 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-32.ec2.internal" event={"ID":"9354426b46095aeca51d84a99cd8e609","Type":"ContainerStarted","Data":"2cf92f3022138a00c6788bb048ae0ccfae02e9baec1d92b236343192a9b876dc"} Jun 03 14:45:17.900060 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.900036 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-32.ec2.internal" event={"ID":"9bbfdd57113509939e81d22cb0c12ade","Type":"ContainerStarted","Data":"d19e5933ad89a406e15e935275953953c3838da44d927af6616bf86a9bf0b4b2"} Jun 03 14:45:17.900153 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.900131 2580 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 14:45:17.949629 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.949593 2580 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-32.ec2.internal" Jun 03 14:45:17.966649 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.966618 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 14:45:17.968414 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.968396 2580 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-32.ec2.internal" Jun 03 14:45:17.978900 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:17.978876 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 14:45:18.048175 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.048090 2580 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 14:45:18.103902 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.103866 2580 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 14:45:18.722872 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.722835 2580 apiserver.go:52] "Watching apiserver" Jun 03 14:45:18.729610 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.729586 2580 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 14:45:18.729957 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.729937 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-wt9nf","openshift-multus/network-metrics-daemon-qlx8q","openshift-network-diagnostics/network-check-target-t4nxx","openshift-ovn-kubernetes/ovnkube-node-fc7d9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk","openshift-cluster-node-tuning-operator/tuned-d5thl","openshift-image-registry/node-ca-rvlxf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-32.ec2.internal","openshift-multus/multus-additional-cni-plugins-qp7fh","openshift-network-operator/iptables-alerter-828cc","kube-system/konnectivity-agent-xmqx7","kube-system/kube-apiserver-proxy-ip-10-0-134-32.ec2.internal"] Jun 03 14:45:18.732339 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.732324 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.733636 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.733613 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:18.733762 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:18.733707 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlx8q" podUID="bef4ffc0-2d1c-4742-abdd-1ba23bea3574" Jun 03 14:45:18.734756 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.734736 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" Jun 03 14:45:18.735891 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.735871 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.737185 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.737130 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:18.737627 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.737590 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hwk4p\"" Jun 03 14:45:18.737778 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.737640 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 14:45:18.737876 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.737767 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 14:45:18.737958 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.737941 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 14:45:18.738091 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.738062 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 14:45:18.738185 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.738137 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 14:45:18.738794 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.738581 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 14:45:18.738794 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.738581 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 14:45:18.738794 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.738618 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qvkxf\"" Jun 03 14:45:18.738794 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.738618 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c9bmz\"" Jun 03 14:45:18.738794 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.738672 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 14:45:18.739062 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.738858 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 14:45:18.739361 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.739346 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xmqx7" Jun 03 14:45:18.739453 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.739435 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:18.739536 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:18.739515 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4nxx" podUID="86de1ecb-8551-4720-b4fa-1b5cc8dd265d" Jun 03 14:45:18.739936 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.739918 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 14:45:18.740039 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.740025 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lslw4\"" Jun 03 14:45:18.740432 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.740409 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 14:45:18.741620 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.741012 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.746203 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.746179 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 14:45:18.746325 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.746292 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 14:45:18.746325 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.746309 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 14:45:18.746683 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.746645 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 14:45:18.746948 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.746926 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 14:45:18.747046 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.746977 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 14:45:18.747102 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.747046 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rvlxf" Jun 03 14:45:18.747102 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.747059 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-828cc" Jun 03 14:45:18.747102 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.746977 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 14:45:18.747102 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.747049 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 14:45:18.747268 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.747161 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hxnm8\"" Jun 03 14:45:18.747314 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.747165 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-j2g44\"" Jun 03 14:45:18.749393 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.749375 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8nlhn\"" Jun 03 14:45:18.750300 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.750282 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 14:45:18.750637 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.750621 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zvsmg\"" Jun 03 14:45:18.750865 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.750703 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 14:45:18.750950 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.750941 2580 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 14:45:18.751006 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.750704 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 14:45:18.751188 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.751165 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 14:45:18.751295 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.751282 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 14:45:18.751441 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.751426 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 14:45:18.760553 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.760532 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-cnibin\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.760676 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.760566 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-host-run-multus-certs\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.760676 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.760588 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-host-slash\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.760676 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.760610 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbb24\" (UniqueName: \"kubernetes.io/projected/c16b05d8-a603-4e5e-a431-7dfe6e86ca0b-kube-api-access-mbb24\") pod \"node-ca-rvlxf\" (UID: \"c16b05d8-a603-4e5e-a431-7dfe6e86ca0b\") " pod="openshift-image-registry/node-ca-rvlxf" Jun 03 14:45:18.760676 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.760644 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6864f29b-0e87-45fa-9de3-35e89474c9ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qp7fh\" (UID: \"6864f29b-0e87-45fa-9de3-35e89474c9ca\") " pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:18.760902 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.760687 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-cni-binary-copy\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.760902 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.760709 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-host-run-k8s-cni-cncf-io\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.760902 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.760733 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-host-var-lib-kubelet\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.760902 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.760755 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/90d7444f-d8c4-4b99-9ac7-8c437ec12eeb-socket-dir\") pod \"aws-ebs-csi-driver-node-b7hfk\" (UID: \"90d7444f-d8c4-4b99-9ac7-8c437ec12eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" Jun 03 14:45:18.760902 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.760769 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-host\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.760902 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.760784 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3a26778f-7827-4e52-bb29-96338b843709-etc-tuned\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.760902 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.760803 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-host-cni-netd\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.760902 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.760843 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f6aefca8-f383-4d02-aa41-6a49df356052-ovn-node-metrics-cert\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.760902 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.760882 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-multus-daemon-config\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.760902 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.760905 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-host-run-netns\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.761372 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.760925 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/90d7444f-d8c4-4b99-9ac7-8c437ec12eeb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b7hfk\" (UID: \"90d7444f-d8c4-4b99-9ac7-8c437ec12eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" Jun 03 14:45:18.761372 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.760950 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-etc-sysctl-d\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.761372 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.760973 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6864f29b-0e87-45fa-9de3-35e89474c9ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-qp7fh\" (UID: \"6864f29b-0e87-45fa-9de3-35e89474c9ca\") " pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:18.761372 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.760998 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-etc-sysconfig\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.761372 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761019 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a26778f-7827-4e52-bb29-96338b843709-tmp\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.761372 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761043 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xrbn\" (UniqueName: \"kubernetes.io/projected/f6aefca8-f383-4d02-aa41-6a49df356052-kube-api-access-9xrbn\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.761372 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761066 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6864f29b-0e87-45fa-9de3-35e89474c9ca-os-release\") pod \"multus-additional-cni-plugins-qp7fh\" (UID: \"6864f29b-0e87-45fa-9de3-35e89474c9ca\") " pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:18.761372 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761112 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6864f29b-0e87-45fa-9de3-35e89474c9ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qp7fh\" (UID: \"6864f29b-0e87-45fa-9de3-35e89474c9ca\") " pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:18.761372 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761137 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75jhn\" (UniqueName: \"kubernetes.io/projected/6864f29b-0e87-45fa-9de3-35e89474c9ca-kube-api-access-75jhn\") pod \"multus-additional-cni-plugins-qp7fh\" (UID: \"6864f29b-0e87-45fa-9de3-35e89474c9ca\") " pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:18.761372 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761162 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-host-var-lib-cni-multus\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.761372 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761183 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-multus-conf-dir\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.761372 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761205 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-log-socket\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.761372 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761234 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-multus-socket-dir-parent\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.761372 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761260 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-etc-kubernetes\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.761372 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761287 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-etc-sysctl-conf\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.761372 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761316 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6864f29b-0e87-45fa-9de3-35e89474c9ca-cnibin\") pod \"multus-additional-cni-plugins-qp7fh\" (UID: \"6864f29b-0e87-45fa-9de3-35e89474c9ca\") " pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:18.761931 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761352 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-run-ovn\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.761931 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761380 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-etc-modprobe-d\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.761931 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761407 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-multus-cni-dir\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.761931 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761438 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/90d7444f-d8c4-4b99-9ac7-8c437ec12eeb-registration-dir\") pod \"aws-ebs-csi-driver-node-b7hfk\" (UID: \"90d7444f-d8c4-4b99-9ac7-8c437ec12eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" Jun 03 14:45:18.761931 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761459 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-run\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.761931 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761475 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-run-openvswitch\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.761931 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761496 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-host-var-lib-cni-bin\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.761931 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761516 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-hostroot\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.761931 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761532 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-host-kubelet\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.761931 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761547 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.761931 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761562 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f6aefca8-f383-4d02-aa41-6a49df356052-ovnkube-config\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.761931 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761574 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97457295-a8d6-470b-ad98-dc1009a5ba3b-host-slash\") pod \"iptables-alerter-828cc\" (UID: \"97457295-a8d6-470b-ad98-dc1009a5ba3b\") " pod="openshift-network-operator/iptables-alerter-828cc" Jun 03 14:45:18.761931 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761593 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wflkl\" (UniqueName: \"kubernetes.io/projected/97457295-a8d6-470b-ad98-dc1009a5ba3b-kube-api-access-wflkl\") pod \"iptables-alerter-828cc\" (UID: \"97457295-a8d6-470b-ad98-dc1009a5ba3b\") " pod="openshift-network-operator/iptables-alerter-828cc" Jun 03 14:45:18.761931 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761615 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs\") pod \"network-metrics-daemon-qlx8q\" (UID: \"bef4ffc0-2d1c-4742-abdd-1ba23bea3574\") " pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:18.761931 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761636 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-system-cni-dir\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.761931 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761676 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd5sg\" (UniqueName: \"kubernetes.io/projected/3a26778f-7827-4e52-bb29-96338b843709-kube-api-access-cd5sg\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.762616 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761699 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzxmq\" (UniqueName: \"kubernetes.io/projected/86de1ecb-8551-4720-b4fa-1b5cc8dd265d-kube-api-access-fzxmq\") pod \"network-check-target-t4nxx\" (UID: \"86de1ecb-8551-4720-b4fa-1b5cc8dd265d\") " pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:18.762616 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761722 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-os-release\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.762616 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761759 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-var-lib-kubelet\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.762616 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761783 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-systemd-units\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.762616 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761806 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-host-run-netns\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.762616 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761846 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-etc-systemd\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.762616 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761869 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-etc-openvswitch\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.762616 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761898 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-host-cni-bin\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.762616 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761922 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c16b05d8-a603-4e5e-a431-7dfe6e86ca0b-serviceca\") pod \"node-ca-rvlxf\" (UID: \"c16b05d8-a603-4e5e-a431-7dfe6e86ca0b\") " pod="openshift-image-registry/node-ca-rvlxf" Jun 03 14:45:18.762616 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761946 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6864f29b-0e87-45fa-9de3-35e89474c9ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qp7fh\" (UID: \"6864f29b-0e87-45fa-9de3-35e89474c9ca\") " pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:18.762616 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761969 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzts2\" (UniqueName: \"kubernetes.io/projected/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-kube-api-access-dzts2\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.762616 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.761991 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/90d7444f-d8c4-4b99-9ac7-8c437ec12eeb-device-dir\") pod \"aws-ebs-csi-driver-node-b7hfk\" (UID: \"90d7444f-d8c4-4b99-9ac7-8c437ec12eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" Jun 03 14:45:18.762616 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.762034 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/90d7444f-d8c4-4b99-9ac7-8c437ec12eeb-sys-fs\") pod \"aws-ebs-csi-driver-node-b7hfk\" (UID: \"90d7444f-d8c4-4b99-9ac7-8c437ec12eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" Jun 03 14:45:18.762616 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.762074 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2rhz\" (UniqueName: \"kubernetes.io/projected/90d7444f-d8c4-4b99-9ac7-8c437ec12eeb-kube-api-access-c2rhz\") pod \"aws-ebs-csi-driver-node-b7hfk\" (UID: \"90d7444f-d8c4-4b99-9ac7-8c437ec12eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" Jun 03 14:45:18.762616 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.762106 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-lib-modules\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.762616 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.762126 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f6aefca8-f383-4d02-aa41-6a49df356052-ovnkube-script-lib\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.763399 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.762171 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97457295-a8d6-470b-ad98-dc1009a5ba3b-iptables-alerter-script\") pod \"iptables-alerter-828cc\" (UID: \"97457295-a8d6-470b-ad98-dc1009a5ba3b\") " pod="openshift-network-operator/iptables-alerter-828cc" Jun 03 14:45:18.763399 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.762214 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dca64948-d4ce-43d4-bbd4-b651db08a776-konnectivity-ca\") pod \"konnectivity-agent-xmqx7\" (UID: \"dca64948-d4ce-43d4-bbd4-b651db08a776\") " pod="kube-system/konnectivity-agent-xmqx7" Jun 03 14:45:18.763399 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.762248 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-run-systemd\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.763399 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.762273 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c16b05d8-a603-4e5e-a431-7dfe6e86ca0b-host\") pod \"node-ca-rvlxf\" (UID: \"c16b05d8-a603-4e5e-a431-7dfe6e86ca0b\") " pod="openshift-image-registry/node-ca-rvlxf" Jun 03 14:45:18.763399 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.762322 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/90d7444f-d8c4-4b99-9ac7-8c437ec12eeb-etc-selinux\") pod \"aws-ebs-csi-driver-node-b7hfk\" (UID: \"90d7444f-d8c4-4b99-9ac7-8c437ec12eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" Jun 03 14:45:18.763399 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.762352 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-sys\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.763399 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.762378 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-var-lib-openvswitch\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.763399 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.762407 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-node-log\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.763399 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.762433 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f6aefca8-f383-4d02-aa41-6a49df356052-env-overrides\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.763399 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.762468 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9rxl\" (UniqueName: \"kubernetes.io/projected/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-kube-api-access-c9rxl\") pod \"network-metrics-daemon-qlx8q\" (UID: \"bef4ffc0-2d1c-4742-abdd-1ba23bea3574\") " pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:18.763399 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.762495 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6864f29b-0e87-45fa-9de3-35e89474c9ca-system-cni-dir\") pod \"multus-additional-cni-plugins-qp7fh\" (UID: \"6864f29b-0e87-45fa-9de3-35e89474c9ca\") " pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:18.763399 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.762519 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-host-run-ovn-kubernetes\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.763399 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.762544 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-etc-kubernetes\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.763399 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.762570 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dca64948-d4ce-43d4-bbd4-b651db08a776-agent-certs\") pod \"konnectivity-agent-xmqx7\" (UID: \"dca64948-d4ce-43d4-bbd4-b651db08a776\") " pod="kube-system/konnectivity-agent-xmqx7" Jun 03 14:45:18.803941 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.803908 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 14:40:17 +0000 UTC" deadline="2027-12-08 11:16:05.331125821 +0000 UTC" Jun 03 14:45:18.803941 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.803937 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13268h30m46.527190971s" Jun 03 14:45:18.862908 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.862862 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cd5sg\" (UniqueName: \"kubernetes.io/projected/3a26778f-7827-4e52-bb29-96338b843709-kube-api-access-cd5sg\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.863086 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.862916 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fzxmq\" (UniqueName: \"kubernetes.io/projected/86de1ecb-8551-4720-b4fa-1b5cc8dd265d-kube-api-access-fzxmq\") pod \"network-check-target-t4nxx\" (UID: \"86de1ecb-8551-4720-b4fa-1b5cc8dd265d\") " pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:18.863086 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.862948 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-os-release\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.863086 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.862974 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-var-lib-kubelet\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.863086 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.862999 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-systemd-units\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.863086 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863026 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-host-run-netns\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.863086 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863051 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-etc-systemd\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.863086 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863078 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-etc-openvswitch\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.863086 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863076 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-os-release\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.863466 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863102 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-host-cni-bin\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.863466 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863144 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-host-run-netns\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.863466 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863153 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-host-cni-bin\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.863466 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863177 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c16b05d8-a603-4e5e-a431-7dfe6e86ca0b-serviceca\") pod \"node-ca-rvlxf\" (UID: \"c16b05d8-a603-4e5e-a431-7dfe6e86ca0b\") " pod="openshift-image-registry/node-ca-rvlxf" Jun 03 14:45:18.863466 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863199 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-etc-systemd\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.863466 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863204 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6864f29b-0e87-45fa-9de3-35e89474c9ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qp7fh\" (UID: \"6864f29b-0e87-45fa-9de3-35e89474c9ca\") " pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:18.863466 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863218 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-var-lib-kubelet\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.863466 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863230 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-etc-openvswitch\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.863466 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863233 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-systemd-units\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.863466 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863233 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dzts2\" (UniqueName: \"kubernetes.io/projected/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-kube-api-access-dzts2\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.863466 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863310 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/90d7444f-d8c4-4b99-9ac7-8c437ec12eeb-device-dir\") pod \"aws-ebs-csi-driver-node-b7hfk\" (UID: \"90d7444f-d8c4-4b99-9ac7-8c437ec12eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" Jun 03 14:45:18.863466 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863344 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/90d7444f-d8c4-4b99-9ac7-8c437ec12eeb-sys-fs\") pod \"aws-ebs-csi-driver-node-b7hfk\" (UID: \"90d7444f-d8c4-4b99-9ac7-8c437ec12eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" Jun 03 14:45:18.863466 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863370 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2rhz\" (UniqueName: \"kubernetes.io/projected/90d7444f-d8c4-4b99-9ac7-8c437ec12eeb-kube-api-access-c2rhz\") pod \"aws-ebs-csi-driver-node-b7hfk\" (UID: \"90d7444f-d8c4-4b99-9ac7-8c437ec12eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" Jun 03 14:45:18.863466 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863403 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-lib-modules\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.863466 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863410 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/90d7444f-d8c4-4b99-9ac7-8c437ec12eeb-device-dir\") pod \"aws-ebs-csi-driver-node-b7hfk\" (UID: \"90d7444f-d8c4-4b99-9ac7-8c437ec12eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" Jun 03 14:45:18.863466 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863429 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f6aefca8-f383-4d02-aa41-6a49df356052-ovnkube-script-lib\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.863466 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863456 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97457295-a8d6-470b-ad98-dc1009a5ba3b-iptables-alerter-script\") pod \"iptables-alerter-828cc\" (UID: \"97457295-a8d6-470b-ad98-dc1009a5ba3b\") " pod="openshift-network-operator/iptables-alerter-828cc" Jun 03 14:45:18.864318 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863480 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dca64948-d4ce-43d4-bbd4-b651db08a776-konnectivity-ca\") pod \"konnectivity-agent-xmqx7\" (UID: \"dca64948-d4ce-43d4-bbd4-b651db08a776\") " pod="kube-system/konnectivity-agent-xmqx7" Jun 03 14:45:18.864318 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863504 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-run-systemd\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.864318 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863537 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c16b05d8-a603-4e5e-a431-7dfe6e86ca0b-host\") pod \"node-ca-rvlxf\" (UID: \"c16b05d8-a603-4e5e-a431-7dfe6e86ca0b\") " pod="openshift-image-registry/node-ca-rvlxf" Jun 03 14:45:18.864318 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863542 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/90d7444f-d8c4-4b99-9ac7-8c437ec12eeb-sys-fs\") pod \"aws-ebs-csi-driver-node-b7hfk\" (UID: \"90d7444f-d8c4-4b99-9ac7-8c437ec12eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" Jun 03 14:45:18.864318 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863559 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c16b05d8-a603-4e5e-a431-7dfe6e86ca0b-serviceca\") pod \"node-ca-rvlxf\" (UID: \"c16b05d8-a603-4e5e-a431-7dfe6e86ca0b\") " pod="openshift-image-registry/node-ca-rvlxf" Jun 03 14:45:18.864318 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863561 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/90d7444f-d8c4-4b99-9ac7-8c437ec12eeb-etc-selinux\") pod \"aws-ebs-csi-driver-node-b7hfk\" (UID: \"90d7444f-d8c4-4b99-9ac7-8c437ec12eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" Jun 03 14:45:18.864318 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863592 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-sys\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.864318 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863617 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-var-lib-openvswitch\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.864318 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863636 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-run-systemd\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.864318 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863643 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-node-log\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.864318 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863686 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f6aefca8-f383-4d02-aa41-6a49df356052-env-overrides\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.864318 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863713 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c9rxl\" (UniqueName: \"kubernetes.io/projected/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-kube-api-access-c9rxl\") pod \"network-metrics-daemon-qlx8q\" (UID: \"bef4ffc0-2d1c-4742-abdd-1ba23bea3574\") " pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:18.864318 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863737 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6864f29b-0e87-45fa-9de3-35e89474c9ca-system-cni-dir\") pod \"multus-additional-cni-plugins-qp7fh\" (UID: \"6864f29b-0e87-45fa-9de3-35e89474c9ca\") " pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:18.864318 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863764 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-host-run-ovn-kubernetes\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.864318 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863789 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-etc-kubernetes\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.864318 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863815 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dca64948-d4ce-43d4-bbd4-b651db08a776-agent-certs\") pod \"konnectivity-agent-xmqx7\" (UID: \"dca64948-d4ce-43d4-bbd4-b651db08a776\") " pod="kube-system/konnectivity-agent-xmqx7" Jun 03 14:45:18.864318 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863838 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-cnibin\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.864318 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863866 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-host-run-multus-certs\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.865120 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863893 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-host-slash\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.865120 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863920 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mbb24\" (UniqueName: \"kubernetes.io/projected/c16b05d8-a603-4e5e-a431-7dfe6e86ca0b-kube-api-access-mbb24\") pod \"node-ca-rvlxf\" (UID: \"c16b05d8-a603-4e5e-a431-7dfe6e86ca0b\") " pod="openshift-image-registry/node-ca-rvlxf" Jun 03 14:45:18.865120 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863946 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6864f29b-0e87-45fa-9de3-35e89474c9ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qp7fh\" (UID: \"6864f29b-0e87-45fa-9de3-35e89474c9ca\") " pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:18.865120 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.863974 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-cni-binary-copy\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.865120 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864023 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-host-run-k8s-cni-cncf-io\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.865120 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864030 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97457295-a8d6-470b-ad98-dc1009a5ba3b-iptables-alerter-script\") pod \"iptables-alerter-828cc\" (UID: \"97457295-a8d6-470b-ad98-dc1009a5ba3b\") " pod="openshift-network-operator/iptables-alerter-828cc" Jun 03 14:45:18.865120 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864083 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-cnibin\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.865120 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864094 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-host-var-lib-kubelet\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.865120 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864032 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-lib-modules\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.865120 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864102 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dca64948-d4ce-43d4-bbd4-b651db08a776-konnectivity-ca\") pod \"konnectivity-agent-xmqx7\" (UID: \"dca64948-d4ce-43d4-bbd4-b651db08a776\") " pod="kube-system/konnectivity-agent-xmqx7" Jun 03 14:45:18.865120 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864050 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-host-var-lib-kubelet\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.865120 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864155 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/90d7444f-d8c4-4b99-9ac7-8c437ec12eeb-socket-dir\") pod \"aws-ebs-csi-driver-node-b7hfk\" (UID: \"90d7444f-d8c4-4b99-9ac7-8c437ec12eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" Jun 03 14:45:18.865120 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864161 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-host-slash\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.865120 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864171 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-host\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.865120 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864187 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3a26778f-7827-4e52-bb29-96338b843709-etc-tuned\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.865120 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864197 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-host-run-multus-certs\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.865120 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864203 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-host-cni-netd\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.865120 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864225 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-host-cni-netd\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.866005 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864238 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f6aefca8-f383-4d02-aa41-6a49df356052-ovn-node-metrics-cert\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.866005 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864263 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6864f29b-0e87-45fa-9de3-35e89474c9ca-system-cni-dir\") pod \"multus-additional-cni-plugins-qp7fh\" (UID: \"6864f29b-0e87-45fa-9de3-35e89474c9ca\") " pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:18.866005 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864267 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-multus-daemon-config\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.866005 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864300 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/90d7444f-d8c4-4b99-9ac7-8c437ec12eeb-socket-dir\") pod \"aws-ebs-csi-driver-node-b7hfk\" (UID: \"90d7444f-d8c4-4b99-9ac7-8c437ec12eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" Jun 03 14:45:18.866005 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864301 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-etc-kubernetes\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.866005 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864302 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-host-run-netns\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.866005 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864316 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f6aefca8-f383-4d02-aa41-6a49df356052-env-overrides\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.866005 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864327 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/90d7444f-d8c4-4b99-9ac7-8c437ec12eeb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b7hfk\" (UID: \"90d7444f-d8c4-4b99-9ac7-8c437ec12eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" Jun 03 14:45:18.866005 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864332 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-host-run-netns\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.866005 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864344 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-etc-sysctl-d\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.866005 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864365 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6864f29b-0e87-45fa-9de3-35e89474c9ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-qp7fh\" (UID: \"6864f29b-0e87-45fa-9de3-35e89474c9ca\") " pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:18.866005 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864381 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-host\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.866005 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864387 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-etc-sysconfig\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.866005 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864383 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c16b05d8-a603-4e5e-a431-7dfe6e86ca0b-host\") pod \"node-ca-rvlxf\" (UID: \"c16b05d8-a603-4e5e-a431-7dfe6e86ca0b\") " pod="openshift-image-registry/node-ca-rvlxf" Jun 03 14:45:18.866005 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864412 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a26778f-7827-4e52-bb29-96338b843709-tmp\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.866005 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864429 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9xrbn\" (UniqueName: \"kubernetes.io/projected/f6aefca8-f383-4d02-aa41-6a49df356052-kube-api-access-9xrbn\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.866005 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864448 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6864f29b-0e87-45fa-9de3-35e89474c9ca-os-release\") pod \"multus-additional-cni-plugins-qp7fh\" (UID: \"6864f29b-0e87-45fa-9de3-35e89474c9ca\") " pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:18.866798 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864458 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6864f29b-0e87-45fa-9de3-35e89474c9ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qp7fh\" (UID: \"6864f29b-0e87-45fa-9de3-35e89474c9ca\") " pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:18.866798 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864475 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/90d7444f-d8c4-4b99-9ac7-8c437ec12eeb-etc-selinux\") pod \"aws-ebs-csi-driver-node-b7hfk\" (UID: \"90d7444f-d8c4-4b99-9ac7-8c437ec12eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" Jun 03 14:45:18.866798 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864464 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6864f29b-0e87-45fa-9de3-35e89474c9ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qp7fh\" (UID: \"6864f29b-0e87-45fa-9de3-35e89474c9ca\") " pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:18.866798 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864524 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-75jhn\" (UniqueName: \"kubernetes.io/projected/6864f29b-0e87-45fa-9de3-35e89474c9ca-kube-api-access-75jhn\") pod \"multus-additional-cni-plugins-qp7fh\" (UID: \"6864f29b-0e87-45fa-9de3-35e89474c9ca\") " pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:18.866798 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864557 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-host-var-lib-cni-multus\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.866798 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864565 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 14:45:18.866798 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864572 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-sys\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.866798 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864582 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-multus-conf-dir\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.866798 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864608 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-log-socket\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.866798 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864632 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-node-log\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.866798 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864636 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-multus-socket-dir-parent\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.866798 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864684 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-etc-kubernetes\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.866798 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864689 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f6aefca8-f383-4d02-aa41-6a49df356052-ovnkube-script-lib\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.866798 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864696 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-etc-sysconfig\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.866798 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864711 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-etc-sysctl-conf\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.866798 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864735 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6864f29b-0e87-45fa-9de3-35e89474c9ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qp7fh\" (UID: \"6864f29b-0e87-45fa-9de3-35e89474c9ca\") " pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:18.866798 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864745 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/90d7444f-d8c4-4b99-9ac7-8c437ec12eeb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b7hfk\" (UID: \"90d7444f-d8c4-4b99-9ac7-8c437ec12eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" Jun 03 14:45:18.867561 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864783 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-log-socket\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.867561 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864796 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6864f29b-0e87-45fa-9de3-35e89474c9ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qp7fh\" (UID: \"6864f29b-0e87-45fa-9de3-35e89474c9ca\") " pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:18.867561 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864843 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6864f29b-0e87-45fa-9de3-35e89474c9ca-cnibin\") pod \"multus-additional-cni-plugins-qp7fh\" (UID: \"6864f29b-0e87-45fa-9de3-35e89474c9ca\") " pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:18.867561 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864869 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-etc-sysctl-d\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.867561 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864880 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-host-run-ovn-kubernetes\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.867561 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864916 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-multus-conf-dir\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.867561 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864964 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-multus-socket-dir-parent\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.867561 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.865010 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-etc-kubernetes\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.867561 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.865154 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-etc-sysctl-conf\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.867561 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.865205 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6864f29b-0e87-45fa-9de3-35e89474c9ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-qp7fh\" (UID: \"6864f29b-0e87-45fa-9de3-35e89474c9ca\") " pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:18.867561 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.865210 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-host-run-k8s-cni-cncf-io\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.867561 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864525 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-var-lib-openvswitch\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.867561 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.865265 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-host-var-lib-cni-multus\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.867561 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.864738 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6864f29b-0e87-45fa-9de3-35e89474c9ca-cnibin\") pod \"multus-additional-cni-plugins-qp7fh\" (UID: \"6864f29b-0e87-45fa-9de3-35e89474c9ca\") " pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:18.867561 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.865315 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-run-ovn\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.867561 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.865339 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-etc-modprobe-d\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.867561 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.865721 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-run-ovn\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.868283 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.865823 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-etc-modprobe-d\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.868283 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.865984 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-multus-cni-dir\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.868283 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866021 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/90d7444f-d8c4-4b99-9ac7-8c437ec12eeb-registration-dir\") pod \"aws-ebs-csi-driver-node-b7hfk\" (UID: \"90d7444f-d8c4-4b99-9ac7-8c437ec12eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" Jun 03 14:45:18.868283 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866039 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-cni-binary-copy\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.868283 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866047 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-run\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.868283 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866090 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3a26778f-7827-4e52-bb29-96338b843709-run\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.868283 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866099 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-run-openvswitch\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.868283 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866129 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-host-var-lib-cni-bin\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.868283 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866132 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6864f29b-0e87-45fa-9de3-35e89474c9ca-os-release\") pod \"multus-additional-cni-plugins-qp7fh\" (UID: \"6864f29b-0e87-45fa-9de3-35e89474c9ca\") " pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:18.868283 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866153 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/90d7444f-d8c4-4b99-9ac7-8c437ec12eeb-registration-dir\") pod \"aws-ebs-csi-driver-node-b7hfk\" (UID: \"90d7444f-d8c4-4b99-9ac7-8c437ec12eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" Jun 03 14:45:18.868283 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866155 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-hostroot\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.868283 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866194 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-host-kubelet\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.868283 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866196 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-hostroot\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.868283 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866219 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.868283 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866238 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-run-openvswitch\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.868283 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866247 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f6aefca8-f383-4d02-aa41-6a49df356052-ovnkube-config\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.868283 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866273 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97457295-a8d6-470b-ad98-dc1009a5ba3b-host-slash\") pod \"iptables-alerter-828cc\" (UID: \"97457295-a8d6-470b-ad98-dc1009a5ba3b\") " pod="openshift-network-operator/iptables-alerter-828cc" Jun 03 14:45:18.868283 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866279 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-host-var-lib-cni-bin\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.868976 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866299 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wflkl\" (UniqueName: \"kubernetes.io/projected/97457295-a8d6-470b-ad98-dc1009a5ba3b-kube-api-access-wflkl\") pod \"iptables-alerter-828cc\" (UID: \"97457295-a8d6-470b-ad98-dc1009a5ba3b\") " pod="openshift-network-operator/iptables-alerter-828cc" Jun 03 14:45:18.868976 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866320 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.868976 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866324 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs\") pod \"network-metrics-daemon-qlx8q\" (UID: \"bef4ffc0-2d1c-4742-abdd-1ba23bea3574\") " pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:18.868976 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866348 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-system-cni-dir\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.868976 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866359 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6aefca8-f383-4d02-aa41-6a49df356052-host-kubelet\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.868976 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866477 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-system-cni-dir\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.868976 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:18.866492 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 14:45:18.868976 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866522 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97457295-a8d6-470b-ad98-dc1009a5ba3b-host-slash\") pod \"iptables-alerter-828cc\" (UID: \"97457295-a8d6-470b-ad98-dc1009a5ba3b\") " pod="openshift-network-operator/iptables-alerter-828cc" Jun 03 14:45:18.868976 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:18.866597 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs podName:bef4ffc0-2d1c-4742-abdd-1ba23bea3574 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:19.366550111 +0000 UTC m=+3.029652574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs") pod "network-metrics-daemon-qlx8q" (UID: "bef4ffc0-2d1c-4742-abdd-1ba23bea3574") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 14:45:18.868976 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866699 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-multus-daemon-config\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.868976 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866770 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-multus-cni-dir\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.868976 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.866970 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f6aefca8-f383-4d02-aa41-6a49df356052-ovnkube-config\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.868976 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.868244 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3a26778f-7827-4e52-bb29-96338b843709-etc-tuned\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.868976 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.868257 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a26778f-7827-4e52-bb29-96338b843709-tmp\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.869572 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.869090 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f6aefca8-f383-4d02-aa41-6a49df356052-ovn-node-metrics-cert\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.869572 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.869247 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dca64948-d4ce-43d4-bbd4-b651db08a776-agent-certs\") pod \"konnectivity-agent-xmqx7\" (UID: \"dca64948-d4ce-43d4-bbd4-b651db08a776\") " pod="kube-system/konnectivity-agent-xmqx7" Jun 03 14:45:18.878779 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:18.878707 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 14:45:18.878779 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:18.878731 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 14:45:18.878779 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:18.878744 2580 projected.go:194] Error preparing data for projected volume kube-api-access-fzxmq for pod openshift-network-diagnostics/network-check-target-t4nxx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 14:45:18.879019 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:18.878813 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86de1ecb-8551-4720-b4fa-1b5cc8dd265d-kube-api-access-fzxmq podName:86de1ecb-8551-4720-b4fa-1b5cc8dd265d nodeName:}" failed. No retries permitted until 2026-06-03 14:45:19.378793472 +0000 UTC m=+3.041895933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fzxmq" (UniqueName: "kubernetes.io/projected/86de1ecb-8551-4720-b4fa-1b5cc8dd265d-kube-api-access-fzxmq") pod "network-check-target-t4nxx" (UID: "86de1ecb-8551-4720-b4fa-1b5cc8dd265d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 14:45:18.880410 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.879946 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xrbn\" (UniqueName: \"kubernetes.io/projected/f6aefca8-f383-4d02-aa41-6a49df356052-kube-api-access-9xrbn\") pod \"ovnkube-node-fc7d9\" (UID: \"f6aefca8-f383-4d02-aa41-6a49df356052\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:18.880410 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.879969 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzts2\" (UniqueName: \"kubernetes.io/projected/6fcad51b-5916-4694-87a8-bf3ac3cf21cf-kube-api-access-dzts2\") pod \"multus-wt9nf\" (UID: \"6fcad51b-5916-4694-87a8-bf3ac3cf21cf\") " pod="openshift-multus/multus-wt9nf" Jun 03 14:45:18.880410 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.880289 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2rhz\" (UniqueName: \"kubernetes.io/projected/90d7444f-d8c4-4b99-9ac7-8c437ec12eeb-kube-api-access-c2rhz\") pod \"aws-ebs-csi-driver-node-b7hfk\" (UID: \"90d7444f-d8c4-4b99-9ac7-8c437ec12eeb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" Jun 03 14:45:18.881386 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.881349 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75jhn\" (UniqueName: \"kubernetes.io/projected/6864f29b-0e87-45fa-9de3-35e89474c9ca-kube-api-access-75jhn\") pod \"multus-additional-cni-plugins-qp7fh\" (UID: \"6864f29b-0e87-45fa-9de3-35e89474c9ca\") " pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:18.881964 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.881927 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd5sg\" (UniqueName: \"kubernetes.io/projected/3a26778f-7827-4e52-bb29-96338b843709-kube-api-access-cd5sg\") pod \"tuned-d5thl\" (UID: \"3a26778f-7827-4e52-bb29-96338b843709\") " pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:18.882139 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.882122 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9rxl\" (UniqueName: \"kubernetes.io/projected/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-kube-api-access-c9rxl\") pod \"network-metrics-daemon-qlx8q\" (UID: \"bef4ffc0-2d1c-4742-abdd-1ba23bea3574\") " pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:18.882425 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.882404 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wflkl\" (UniqueName: \"kubernetes.io/projected/97457295-a8d6-470b-ad98-dc1009a5ba3b-kube-api-access-wflkl\") pod \"iptables-alerter-828cc\" (UID: \"97457295-a8d6-470b-ad98-dc1009a5ba3b\") " pod="openshift-network-operator/iptables-alerter-828cc" Jun 03 14:45:18.883052 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:18.883023 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbb24\" (UniqueName: \"kubernetes.io/projected/c16b05d8-a603-4e5e-a431-7dfe6e86ca0b-kube-api-access-mbb24\") pod \"node-ca-rvlxf\" (UID: \"c16b05d8-a603-4e5e-a431-7dfe6e86ca0b\") " pod="openshift-image-registry/node-ca-rvlxf" Jun 03 14:45:19.046675 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:19.046582 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wt9nf" Jun 03 14:45:19.060725 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:19.060684 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" Jun 03 14:45:19.070761 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:19.070729 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d5thl" Jun 03 14:45:19.075469 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:19.075448 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qp7fh" Jun 03 14:45:19.082218 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:19.082193 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xmqx7" Jun 03 14:45:19.088012 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:19.087989 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:19.093698 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:19.093647 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rvlxf" Jun 03 14:45:19.098361 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:19.098322 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-828cc" Jun 03 14:45:19.112211 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:19.112182 2580 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 14:45:19.133328 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:19.133296 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97457295_a8d6_470b_ad98_dc1009a5ba3b.slice/crio-caa04717a73cfa4a15b0979755a86c550bb7350741a68e74c3f153cf8803bde6 WatchSource:0}: Error finding container caa04717a73cfa4a15b0979755a86c550bb7350741a68e74c3f153cf8803bde6: Status 404 returned error can't find the container with id caa04717a73cfa4a15b0979755a86c550bb7350741a68e74c3f153cf8803bde6 Jun 03 14:45:19.135773 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:19.135750 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6864f29b_0e87_45fa_9de3_35e89474c9ca.slice/crio-b05a0b53ed131b6346cc2da20edba8f446f869c32afc07e92ec8566305ed4640 WatchSource:0}: Error finding container b05a0b53ed131b6346cc2da20edba8f446f869c32afc07e92ec8566305ed4640: Status 404 returned error can't find the container with id b05a0b53ed131b6346cc2da20edba8f446f869c32afc07e92ec8566305ed4640 Jun 03 14:45:19.140594 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:19.140452 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6aefca8_f383_4d02_aa41_6a49df356052.slice/crio-e609aef625b3f097b1c569776d14bdf6249410b5dafb210c174c7b767a642c84 WatchSource:0}: Error finding container e609aef625b3f097b1c569776d14bdf6249410b5dafb210c174c7b767a642c84: Status 404 returned error can't find the container with id e609aef625b3f097b1c569776d14bdf6249410b5dafb210c174c7b767a642c84 Jun 03 14:45:19.142804 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:19.142697 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fcad51b_5916_4694_87a8_bf3ac3cf21cf.slice/crio-bce620359f272d879e02dc60169b869df343f34576cfcb9b1d734e97611a21fd WatchSource:0}: Error finding container bce620359f272d879e02dc60169b869df343f34576cfcb9b1d734e97611a21fd: Status 404 returned error can't find the container with id bce620359f272d879e02dc60169b869df343f34576cfcb9b1d734e97611a21fd Jun 03 14:45:19.144786 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:19.144751 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc16b05d8_a603_4e5e_a431_7dfe6e86ca0b.slice/crio-94ac6665380492c30527b2258ca0e690f08c92debc247cb05f6d005aff128e6d WatchSource:0}: Error finding container 94ac6665380492c30527b2258ca0e690f08c92debc247cb05f6d005aff128e6d: Status 404 returned error can't find the container with id 94ac6665380492c30527b2258ca0e690f08c92debc247cb05f6d005aff128e6d Jun 03 14:45:19.370953 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:19.370873 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs\") pod \"network-metrics-daemon-qlx8q\" (UID: \"bef4ffc0-2d1c-4742-abdd-1ba23bea3574\") " pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:19.371111 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:19.371028 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 14:45:19.371111 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:19.371099 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs podName:bef4ffc0-2d1c-4742-abdd-1ba23bea3574 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:20.371084104 +0000 UTC m=+4.034186546 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs") pod "network-metrics-daemon-qlx8q" (UID: "bef4ffc0-2d1c-4742-abdd-1ba23bea3574") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 14:45:19.471765 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:19.471593 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fzxmq\" (UniqueName: \"kubernetes.io/projected/86de1ecb-8551-4720-b4fa-1b5cc8dd265d-kube-api-access-fzxmq\") pod \"network-check-target-t4nxx\" (UID: \"86de1ecb-8551-4720-b4fa-1b5cc8dd265d\") " pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:19.471878 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:19.471752 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 14:45:19.471878 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:19.471820 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 14:45:19.471878 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:19.471831 2580 projected.go:194] Error preparing data for projected volume kube-api-access-fzxmq for pod openshift-network-diagnostics/network-check-target-t4nxx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 14:45:19.471967 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:19.471878 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86de1ecb-8551-4720-b4fa-1b5cc8dd265d-kube-api-access-fzxmq podName:86de1ecb-8551-4720-b4fa-1b5cc8dd265d nodeName:}" failed. No retries permitted until 2026-06-03 14:45:20.471865058 +0000 UTC m=+4.134967499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fzxmq" (UniqueName: "kubernetes.io/projected/86de1ecb-8551-4720-b4fa-1b5cc8dd265d-kube-api-access-fzxmq") pod "network-check-target-t4nxx" (UID: "86de1ecb-8551-4720-b4fa-1b5cc8dd265d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 14:45:19.804520 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:19.804407 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 14:40:17 +0000 UTC" deadline="2027-12-09 07:37:51.725226598 +0000 UTC" Jun 03 14:45:19.804520 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:19.804447 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13288h52m31.920783789s" Jun 03 14:45:19.908772 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:19.908634 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xmqx7" event={"ID":"dca64948-d4ce-43d4-bbd4-b651db08a776","Type":"ContainerStarted","Data":"529e891a94aecd8b066630c02156afc23967714737fd940713c46d8d932d945a"} Jun 03 14:45:19.912228 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:19.912161 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rvlxf" event={"ID":"c16b05d8-a603-4e5e-a431-7dfe6e86ca0b","Type":"ContainerStarted","Data":"94ac6665380492c30527b2258ca0e690f08c92debc247cb05f6d005aff128e6d"} Jun 03 14:45:19.914082 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:19.914052 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" event={"ID":"f6aefca8-f383-4d02-aa41-6a49df356052","Type":"ContainerStarted","Data":"e609aef625b3f097b1c569776d14bdf6249410b5dafb210c174c7b767a642c84"} Jun 03 14:45:19.916489 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:19.916456 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" event={"ID":"90d7444f-d8c4-4b99-9ac7-8c437ec12eeb","Type":"ContainerStarted","Data":"50a80db29bf4d2739089c9a00a6e301098a97a40bb4b8be75cbc5026ff96e2e4"} Jun 03 14:45:19.926067 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:19.926040 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-828cc" event={"ID":"97457295-a8d6-470b-ad98-dc1009a5ba3b","Type":"ContainerStarted","Data":"caa04717a73cfa4a15b0979755a86c550bb7350741a68e74c3f153cf8803bde6"} Jun 03 14:45:19.937750 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:19.937640 2580 generic.go:358] "Generic (PLEG): container finished" podID="9354426b46095aeca51d84a99cd8e609" containerID="7343d52674c990eee3f527644dab075ba9707c52f7327c792497b34cb40cbb9b" exitCode=0 Jun 03 14:45:19.937893 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:19.937756 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-32.ec2.internal" event={"ID":"9354426b46095aeca51d84a99cd8e609","Type":"ContainerDied","Data":"7343d52674c990eee3f527644dab075ba9707c52f7327c792497b34cb40cbb9b"} Jun 03 14:45:19.940515 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:19.940487 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d5thl" event={"ID":"3a26778f-7827-4e52-bb29-96338b843709","Type":"ContainerStarted","Data":"c48c09abd3a3e7a6e4b5e082bd3bf97f43216eaa0af4bb2498e53e35c42886a2"} Jun 03 14:45:19.944689 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:19.944606 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wt9nf" event={"ID":"6fcad51b-5916-4694-87a8-bf3ac3cf21cf","Type":"ContainerStarted","Data":"bce620359f272d879e02dc60169b869df343f34576cfcb9b1d734e97611a21fd"} Jun 03 14:45:19.955155 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:19.955088 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qp7fh" event={"ID":"6864f29b-0e87-45fa-9de3-35e89474c9ca","Type":"ContainerStarted","Data":"b05a0b53ed131b6346cc2da20edba8f446f869c32afc07e92ec8566305ed4640"} Jun 03 14:45:20.381272 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:20.381172 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs\") pod \"network-metrics-daemon-qlx8q\" (UID: \"bef4ffc0-2d1c-4742-abdd-1ba23bea3574\") " pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:20.381476 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:20.381329 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 14:45:20.381476 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:20.381397 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs podName:bef4ffc0-2d1c-4742-abdd-1ba23bea3574 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:22.381379577 +0000 UTC m=+6.044482031 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs") pod "network-metrics-daemon-qlx8q" (UID: "bef4ffc0-2d1c-4742-abdd-1ba23bea3574") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 14:45:20.482467 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:20.482425 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fzxmq\" (UniqueName: \"kubernetes.io/projected/86de1ecb-8551-4720-b4fa-1b5cc8dd265d-kube-api-access-fzxmq\") pod \"network-check-target-t4nxx\" (UID: \"86de1ecb-8551-4720-b4fa-1b5cc8dd265d\") " pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:20.482643 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:20.482587 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 14:45:20.482643 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:20.482605 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 14:45:20.482643 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:20.482618 2580 projected.go:194] Error preparing data for projected volume kube-api-access-fzxmq for pod openshift-network-diagnostics/network-check-target-t4nxx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 14:45:20.482830 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:20.482717 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86de1ecb-8551-4720-b4fa-1b5cc8dd265d-kube-api-access-fzxmq podName:86de1ecb-8551-4720-b4fa-1b5cc8dd265d nodeName:}" failed. No retries permitted until 2026-06-03 14:45:22.482695295 +0000 UTC m=+6.145797756 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fzxmq" (UniqueName: "kubernetes.io/projected/86de1ecb-8551-4720-b4fa-1b5cc8dd265d-kube-api-access-fzxmq") pod "network-check-target-t4nxx" (UID: "86de1ecb-8551-4720-b4fa-1b5cc8dd265d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 14:45:20.897783 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:20.897748 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:20.898252 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:20.897889 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlx8q" podUID="bef4ffc0-2d1c-4742-abdd-1ba23bea3574" Jun 03 14:45:20.898310 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:20.898291 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:20.898470 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:20.898378 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4nxx" podUID="86de1ecb-8551-4720-b4fa-1b5cc8dd265d" Jun 03 14:45:20.961699 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:20.961336 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-32.ec2.internal" event={"ID":"9354426b46095aeca51d84a99cd8e609","Type":"ContainerStarted","Data":"0366d804922ca78519db516a406f6b0e043256746a052fa6a6f06e404577edb1"} Jun 03 14:45:22.400620 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:22.400579 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs\") pod \"network-metrics-daemon-qlx8q\" (UID: \"bef4ffc0-2d1c-4742-abdd-1ba23bea3574\") " pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:22.401101 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:22.400749 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 14:45:22.401101 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:22.400810 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs podName:bef4ffc0-2d1c-4742-abdd-1ba23bea3574 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:26.40079419 +0000 UTC m=+10.063896634 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs") pod "network-metrics-daemon-qlx8q" (UID: "bef4ffc0-2d1c-4742-abdd-1ba23bea3574") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 14:45:22.501728 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:22.501412 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fzxmq\" (UniqueName: \"kubernetes.io/projected/86de1ecb-8551-4720-b4fa-1b5cc8dd265d-kube-api-access-fzxmq\") pod \"network-check-target-t4nxx\" (UID: \"86de1ecb-8551-4720-b4fa-1b5cc8dd265d\") " pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:22.501728 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:22.501579 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 14:45:22.501728 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:22.501599 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 14:45:22.501728 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:22.501612 2580 projected.go:194] Error preparing data for projected volume kube-api-access-fzxmq for pod openshift-network-diagnostics/network-check-target-t4nxx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 14:45:22.501728 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:22.501695 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86de1ecb-8551-4720-b4fa-1b5cc8dd265d-kube-api-access-fzxmq podName:86de1ecb-8551-4720-b4fa-1b5cc8dd265d nodeName:}" failed. No retries permitted until 2026-06-03 14:45:26.501675623 +0000 UTC m=+10.164778077 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fzxmq" (UniqueName: "kubernetes.io/projected/86de1ecb-8551-4720-b4fa-1b5cc8dd265d-kube-api-access-fzxmq") pod "network-check-target-t4nxx" (UID: "86de1ecb-8551-4720-b4fa-1b5cc8dd265d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 14:45:22.896336 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:22.895727 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:22.896336 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:22.895885 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlx8q" podUID="bef4ffc0-2d1c-4742-abdd-1ba23bea3574" Jun 03 14:45:22.896336 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:22.896199 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:22.896336 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:22.896290 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4nxx" podUID="86de1ecb-8551-4720-b4fa-1b5cc8dd265d" Jun 03 14:45:24.895929 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:24.895888 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:24.896375 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:24.896039 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlx8q" podUID="bef4ffc0-2d1c-4742-abdd-1ba23bea3574" Jun 03 14:45:24.896375 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:24.896089 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:24.896375 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:24.896178 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4nxx" podUID="86de1ecb-8551-4720-b4fa-1b5cc8dd265d" Jun 03 14:45:25.294281 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:25.294175 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-32.ec2.internal" podStartSLOduration=8.294156406 podStartE2EDuration="8.294156406s" podCreationTimestamp="2026-06-03 14:45:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:45:20.976341918 +0000 UTC m=+4.639444382" watchObservedRunningTime="2026-06-03 14:45:25.294156406 +0000 UTC m=+8.957258873" Jun 03 14:45:25.295201 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:25.294478 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-4k4qb"] Jun 03 14:45:25.297709 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:25.297241 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:25.297709 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:25.297323 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4k4qb" podUID="db01432f-994f-414e-83ab-34ec0ca5fb26" Jun 03 14:45:25.425227 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:25.425183 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db01432f-994f-414e-83ab-34ec0ca5fb26-dbus\") pod \"global-pull-secret-syncer-4k4qb\" (UID: \"db01432f-994f-414e-83ab-34ec0ca5fb26\") " pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:25.425227 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:25.425227 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db01432f-994f-414e-83ab-34ec0ca5fb26-original-pull-secret\") pod \"global-pull-secret-syncer-4k4qb\" (UID: \"db01432f-994f-414e-83ab-34ec0ca5fb26\") " pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:25.425483 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:25.425276 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db01432f-994f-414e-83ab-34ec0ca5fb26-kubelet-config\") pod \"global-pull-secret-syncer-4k4qb\" (UID: \"db01432f-994f-414e-83ab-34ec0ca5fb26\") " pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:25.526216 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:25.526172 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db01432f-994f-414e-83ab-34ec0ca5fb26-kubelet-config\") pod \"global-pull-secret-syncer-4k4qb\" (UID: \"db01432f-994f-414e-83ab-34ec0ca5fb26\") " pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:25.526381 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:25.526318 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db01432f-994f-414e-83ab-34ec0ca5fb26-dbus\") pod \"global-pull-secret-syncer-4k4qb\" (UID: \"db01432f-994f-414e-83ab-34ec0ca5fb26\") " pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:25.526381 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:25.526343 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db01432f-994f-414e-83ab-34ec0ca5fb26-original-pull-secret\") pod \"global-pull-secret-syncer-4k4qb\" (UID: \"db01432f-994f-414e-83ab-34ec0ca5fb26\") " pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:25.526499 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:25.526430 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 14:45:25.526499 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:25.526482 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db01432f-994f-414e-83ab-34ec0ca5fb26-original-pull-secret podName:db01432f-994f-414e-83ab-34ec0ca5fb26 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:26.026467508 +0000 UTC m=+9.689569950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db01432f-994f-414e-83ab-34ec0ca5fb26-original-pull-secret") pod "global-pull-secret-syncer-4k4qb" (UID: "db01432f-994f-414e-83ab-34ec0ca5fb26") : object "kube-system"/"original-pull-secret" not registered Jun 03 14:45:25.526795 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:25.526772 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db01432f-994f-414e-83ab-34ec0ca5fb26-kubelet-config\") pod \"global-pull-secret-syncer-4k4qb\" (UID: \"db01432f-994f-414e-83ab-34ec0ca5fb26\") " pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:25.526883 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:25.526828 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db01432f-994f-414e-83ab-34ec0ca5fb26-dbus\") pod \"global-pull-secret-syncer-4k4qb\" (UID: \"db01432f-994f-414e-83ab-34ec0ca5fb26\") " pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:26.031501 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:26.031467 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db01432f-994f-414e-83ab-34ec0ca5fb26-original-pull-secret\") pod \"global-pull-secret-syncer-4k4qb\" (UID: \"db01432f-994f-414e-83ab-34ec0ca5fb26\") " pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:26.031885 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:26.031603 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 14:45:26.031885 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:26.031680 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db01432f-994f-414e-83ab-34ec0ca5fb26-original-pull-secret podName:db01432f-994f-414e-83ab-34ec0ca5fb26 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:27.031649635 +0000 UTC m=+10.694752099 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db01432f-994f-414e-83ab-34ec0ca5fb26-original-pull-secret") pod "global-pull-secret-syncer-4k4qb" (UID: "db01432f-994f-414e-83ab-34ec0ca5fb26") : object "kube-system"/"original-pull-secret" not registered Jun 03 14:45:26.434944 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:26.434834 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs\") pod \"network-metrics-daemon-qlx8q\" (UID: \"bef4ffc0-2d1c-4742-abdd-1ba23bea3574\") " pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:26.435082 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:26.435055 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 14:45:26.435119 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:26.435107 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs podName:bef4ffc0-2d1c-4742-abdd-1ba23bea3574 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:34.435093691 +0000 UTC m=+18.098196137 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs") pod "network-metrics-daemon-qlx8q" (UID: "bef4ffc0-2d1c-4742-abdd-1ba23bea3574") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 14:45:26.535784 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:26.535732 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fzxmq\" (UniqueName: \"kubernetes.io/projected/86de1ecb-8551-4720-b4fa-1b5cc8dd265d-kube-api-access-fzxmq\") pod \"network-check-target-t4nxx\" (UID: \"86de1ecb-8551-4720-b4fa-1b5cc8dd265d\") " pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:26.535956 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:26.535939 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 14:45:26.536016 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:26.535965 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 14:45:26.536016 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:26.535980 2580 projected.go:194] Error preparing data for projected volume kube-api-access-fzxmq for pod openshift-network-diagnostics/network-check-target-t4nxx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 14:45:26.536093 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:26.536040 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86de1ecb-8551-4720-b4fa-1b5cc8dd265d-kube-api-access-fzxmq podName:86de1ecb-8551-4720-b4fa-1b5cc8dd265d nodeName:}" failed. No retries permitted until 2026-06-03 14:45:34.536020037 +0000 UTC m=+18.199122480 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fzxmq" (UniqueName: "kubernetes.io/projected/86de1ecb-8551-4720-b4fa-1b5cc8dd265d-kube-api-access-fzxmq") pod "network-check-target-t4nxx" (UID: "86de1ecb-8551-4720-b4fa-1b5cc8dd265d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 14:45:26.896821 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:26.896728 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:26.896973 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:26.896879 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:26.896973 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:26.896939 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:26.897068 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:26.897028 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlx8q" podUID="bef4ffc0-2d1c-4742-abdd-1ba23bea3574" Jun 03 14:45:26.897321 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:26.897301 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4nxx" podUID="86de1ecb-8551-4720-b4fa-1b5cc8dd265d" Jun 03 14:45:26.897376 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:26.897363 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4k4qb" podUID="db01432f-994f-414e-83ab-34ec0ca5fb26" Jun 03 14:45:27.040060 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:27.040018 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db01432f-994f-414e-83ab-34ec0ca5fb26-original-pull-secret\") pod \"global-pull-secret-syncer-4k4qb\" (UID: \"db01432f-994f-414e-83ab-34ec0ca5fb26\") " pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:27.040510 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:27.040196 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 14:45:27.040510 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:27.040273 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db01432f-994f-414e-83ab-34ec0ca5fb26-original-pull-secret podName:db01432f-994f-414e-83ab-34ec0ca5fb26 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:29.040254194 +0000 UTC m=+12.703356652 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db01432f-994f-414e-83ab-34ec0ca5fb26-original-pull-secret") pod "global-pull-secret-syncer-4k4qb" (UID: "db01432f-994f-414e-83ab-34ec0ca5fb26") : object "kube-system"/"original-pull-secret" not registered Jun 03 14:45:28.123383 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:28.123346 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-knjfc"] Jun 03 14:45:28.133994 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:28.133965 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-knjfc" Jun 03 14:45:28.139371 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:28.139348 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 14:45:28.139692 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:28.139613 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-96mh2\"" Jun 03 14:45:28.141741 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:28.141719 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 14:45:28.252224 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:28.252190 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ms8p\" (UniqueName: \"kubernetes.io/projected/c8bacdf4-c8e3-4a93-8a3b-b57db3791c86-kube-api-access-8ms8p\") pod \"node-resolver-knjfc\" (UID: \"c8bacdf4-c8e3-4a93-8a3b-b57db3791c86\") " pod="openshift-dns/node-resolver-knjfc" Jun 03 14:45:28.252224 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:28.252227 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c8bacdf4-c8e3-4a93-8a3b-b57db3791c86-hosts-file\") pod \"node-resolver-knjfc\" (UID: \"c8bacdf4-c8e3-4a93-8a3b-b57db3791c86\") " pod="openshift-dns/node-resolver-knjfc" Jun 03 14:45:28.252452 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:28.252261 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8bacdf4-c8e3-4a93-8a3b-b57db3791c86-tmp-dir\") pod \"node-resolver-knjfc\" (UID: \"c8bacdf4-c8e3-4a93-8a3b-b57db3791c86\") " pod="openshift-dns/node-resolver-knjfc" Jun 03 14:45:28.353758 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:28.353717 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ms8p\" (UniqueName: \"kubernetes.io/projected/c8bacdf4-c8e3-4a93-8a3b-b57db3791c86-kube-api-access-8ms8p\") pod \"node-resolver-knjfc\" (UID: \"c8bacdf4-c8e3-4a93-8a3b-b57db3791c86\") " pod="openshift-dns/node-resolver-knjfc" Jun 03 14:45:28.353916 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:28.353775 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c8bacdf4-c8e3-4a93-8a3b-b57db3791c86-hosts-file\") pod \"node-resolver-knjfc\" (UID: \"c8bacdf4-c8e3-4a93-8a3b-b57db3791c86\") " pod="openshift-dns/node-resolver-knjfc" Jun 03 14:45:28.353916 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:28.353816 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8bacdf4-c8e3-4a93-8a3b-b57db3791c86-tmp-dir\") pod \"node-resolver-knjfc\" (UID: \"c8bacdf4-c8e3-4a93-8a3b-b57db3791c86\") " pod="openshift-dns/node-resolver-knjfc" Jun 03 14:45:28.354210 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:28.354188 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8bacdf4-c8e3-4a93-8a3b-b57db3791c86-tmp-dir\") pod \"node-resolver-knjfc\" (UID: \"c8bacdf4-c8e3-4a93-8a3b-b57db3791c86\") " pod="openshift-dns/node-resolver-knjfc" Jun 03 14:45:28.354601 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:28.354581 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c8bacdf4-c8e3-4a93-8a3b-b57db3791c86-hosts-file\") pod \"node-resolver-knjfc\" (UID: \"c8bacdf4-c8e3-4a93-8a3b-b57db3791c86\") " pod="openshift-dns/node-resolver-knjfc" Jun 03 14:45:28.374676 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:28.374598 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ms8p\" (UniqueName: \"kubernetes.io/projected/c8bacdf4-c8e3-4a93-8a3b-b57db3791c86-kube-api-access-8ms8p\") pod \"node-resolver-knjfc\" (UID: \"c8bacdf4-c8e3-4a93-8a3b-b57db3791c86\") " pod="openshift-dns/node-resolver-knjfc" Jun 03 14:45:28.444971 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:28.444924 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-knjfc" Jun 03 14:45:28.895154 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:28.895120 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:28.895154 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:28.895147 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:28.895380 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:28.895120 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:28.895380 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:28.895251 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlx8q" podUID="bef4ffc0-2d1c-4742-abdd-1ba23bea3574" Jun 03 14:45:28.895380 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:28.895316 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4nxx" podUID="86de1ecb-8551-4720-b4fa-1b5cc8dd265d" Jun 03 14:45:28.895536 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:28.895394 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4k4qb" podUID="db01432f-994f-414e-83ab-34ec0ca5fb26" Jun 03 14:45:29.058809 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:29.058767 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db01432f-994f-414e-83ab-34ec0ca5fb26-original-pull-secret\") pod \"global-pull-secret-syncer-4k4qb\" (UID: \"db01432f-994f-414e-83ab-34ec0ca5fb26\") " pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:29.059004 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:29.058915 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 14:45:29.059004 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:29.058970 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db01432f-994f-414e-83ab-34ec0ca5fb26-original-pull-secret podName:db01432f-994f-414e-83ab-34ec0ca5fb26 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:33.05895693 +0000 UTC m=+16.722059370 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db01432f-994f-414e-83ab-34ec0ca5fb26-original-pull-secret") pod "global-pull-secret-syncer-4k4qb" (UID: "db01432f-994f-414e-83ab-34ec0ca5fb26") : object "kube-system"/"original-pull-secret" not registered Jun 03 14:45:30.895834 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:30.895795 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:30.896268 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:30.895843 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:30.896268 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:30.895903 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:30.896268 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:30.896024 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlx8q" podUID="bef4ffc0-2d1c-4742-abdd-1ba23bea3574" Jun 03 14:45:30.896588 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:30.896471 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4nxx" podUID="86de1ecb-8551-4720-b4fa-1b5cc8dd265d" Jun 03 14:45:30.896588 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:30.896555 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4k4qb" podUID="db01432f-994f-414e-83ab-34ec0ca5fb26" Jun 03 14:45:32.895318 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:32.895280 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:32.895746 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:32.895280 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:32.895746 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:32.895530 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4nxx" podUID="86de1ecb-8551-4720-b4fa-1b5cc8dd265d" Jun 03 14:45:32.895746 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:32.895417 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlx8q" podUID="bef4ffc0-2d1c-4742-abdd-1ba23bea3574" Jun 03 14:45:32.895746 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:32.895572 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:32.895746 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:32.895639 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4k4qb" podUID="db01432f-994f-414e-83ab-34ec0ca5fb26" Jun 03 14:45:33.087581 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:33.087542 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db01432f-994f-414e-83ab-34ec0ca5fb26-original-pull-secret\") pod \"global-pull-secret-syncer-4k4qb\" (UID: \"db01432f-994f-414e-83ab-34ec0ca5fb26\") " pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:33.087746 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:33.087684 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 14:45:33.087798 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:33.087758 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db01432f-994f-414e-83ab-34ec0ca5fb26-original-pull-secret podName:db01432f-994f-414e-83ab-34ec0ca5fb26 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:41.087741468 +0000 UTC m=+24.750843926 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db01432f-994f-414e-83ab-34ec0ca5fb26-original-pull-secret") pod "global-pull-secret-syncer-4k4qb" (UID: "db01432f-994f-414e-83ab-34ec0ca5fb26") : object "kube-system"/"original-pull-secret" not registered Jun 03 14:45:34.497944 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:34.497903 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs\") pod \"network-metrics-daemon-qlx8q\" (UID: \"bef4ffc0-2d1c-4742-abdd-1ba23bea3574\") " pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:34.498431 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:34.498078 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 14:45:34.498431 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:34.498164 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs podName:bef4ffc0-2d1c-4742-abdd-1ba23bea3574 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:50.498142575 +0000 UTC m=+34.161245030 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs") pod "network-metrics-daemon-qlx8q" (UID: "bef4ffc0-2d1c-4742-abdd-1ba23bea3574") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 14:45:34.599214 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:34.599177 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fzxmq\" (UniqueName: \"kubernetes.io/projected/86de1ecb-8551-4720-b4fa-1b5cc8dd265d-kube-api-access-fzxmq\") pod \"network-check-target-t4nxx\" (UID: \"86de1ecb-8551-4720-b4fa-1b5cc8dd265d\") " pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:34.599397 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:34.599312 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 14:45:34.599397 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:34.599330 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 14:45:34.599397 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:34.599343 2580 projected.go:194] Error preparing data for projected volume kube-api-access-fzxmq for pod openshift-network-diagnostics/network-check-target-t4nxx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 14:45:34.599534 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:34.599406 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86de1ecb-8551-4720-b4fa-1b5cc8dd265d-kube-api-access-fzxmq podName:86de1ecb-8551-4720-b4fa-1b5cc8dd265d nodeName:}" failed. No retries permitted until 2026-06-03 14:45:50.599387908 +0000 UTC m=+34.262490349 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fzxmq" (UniqueName: "kubernetes.io/projected/86de1ecb-8551-4720-b4fa-1b5cc8dd265d-kube-api-access-fzxmq") pod "network-check-target-t4nxx" (UID: "86de1ecb-8551-4720-b4fa-1b5cc8dd265d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 14:45:34.895685 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:34.895587 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:34.895685 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:34.895641 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:34.895853 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:34.895744 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4nxx" podUID="86de1ecb-8551-4720-b4fa-1b5cc8dd265d" Jun 03 14:45:34.895889 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:34.895847 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlx8q" podUID="bef4ffc0-2d1c-4742-abdd-1ba23bea3574" Jun 03 14:45:34.899169 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:34.896385 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:34.899169 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:34.899114 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4k4qb" podUID="db01432f-994f-414e-83ab-34ec0ca5fb26" Jun 03 14:45:36.896310 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:36.896275 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:36.896927 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:36.896376 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4k4qb" podUID="db01432f-994f-414e-83ab-34ec0ca5fb26" Jun 03 14:45:36.896927 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:36.896390 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:36.896927 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:36.896437 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:36.896927 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:36.896530 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4nxx" podUID="86de1ecb-8551-4720-b4fa-1b5cc8dd265d" Jun 03 14:45:36.896927 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:36.896592 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlx8q" podUID="bef4ffc0-2d1c-4742-abdd-1ba23bea3574" Jun 03 14:45:37.967820 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:37.966954 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8bacdf4_c8e3_4a93_8a3b_b57db3791c86.slice/crio-f229c4250dbb441f0bd82a098f7c8ec4d16c2399ef3d2d264243b5e1dd2360af WatchSource:0}: Error finding container f229c4250dbb441f0bd82a098f7c8ec4d16c2399ef3d2d264243b5e1dd2360af: Status 404 returned error can't find the container with id f229c4250dbb441f0bd82a098f7c8ec4d16c2399ef3d2d264243b5e1dd2360af Jun 03 14:45:37.995868 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:37.995843 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-knjfc" event={"ID":"c8bacdf4-c8e3-4a93-8a3b-b57db3791c86","Type":"ContainerStarted","Data":"f229c4250dbb441f0bd82a098f7c8ec4d16c2399ef3d2d264243b5e1dd2360af"} Jun 03 14:45:38.895774 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:38.895436 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:38.895884 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:38.895434 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:38.895884 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:38.895825 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4nxx" podUID="86de1ecb-8551-4720-b4fa-1b5cc8dd265d" Jun 03 14:45:38.895965 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:38.895452 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:38.895965 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:38.895902 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlx8q" podUID="bef4ffc0-2d1c-4742-abdd-1ba23bea3574" Jun 03 14:45:38.896040 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:38.896004 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4k4qb" podUID="db01432f-994f-414e-83ab-34ec0ca5fb26" Jun 03 14:45:38.999645 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:38.999604 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rvlxf" event={"ID":"c16b05d8-a603-4e5e-a431-7dfe6e86ca0b","Type":"ContainerStarted","Data":"61100e6453bcd243e6c131764491dc806a6ad7484c9e6dc54bdf86909d715cf8"} Jun 03 14:45:39.002493 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.002459 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" event={"ID":"f6aefca8-f383-4d02-aa41-6a49df356052","Type":"ContainerStarted","Data":"4e3cb86f9b4793528b626ab1cde881bbcea5367a171c0ce175cbf342b4cec84f"} Jun 03 14:45:39.002629 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.002500 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" event={"ID":"f6aefca8-f383-4d02-aa41-6a49df356052","Type":"ContainerStarted","Data":"00d0bf24c7efb0a592c7cff951a16500153576c312af186634e0f9f56d7237fd"} Jun 03 14:45:39.002629 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.002511 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" event={"ID":"f6aefca8-f383-4d02-aa41-6a49df356052","Type":"ContainerStarted","Data":"bebb62ddf3e3cad8b34f0ed32c796429bd9e1115f0739bee7f7084e1ed405316"} Jun 03 14:45:39.002629 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.002519 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" event={"ID":"f6aefca8-f383-4d02-aa41-6a49df356052","Type":"ContainerStarted","Data":"69286c75289873ced27baabe49d838bff8f70434975f093751cbd48e82865acb"} Jun 03 14:45:39.002629 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.002527 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" event={"ID":"f6aefca8-f383-4d02-aa41-6a49df356052","Type":"ContainerStarted","Data":"647f16424d96582dd047cb2676b66e2a79f69a2b7636670648be25d491c601a6"} Jun 03 14:45:39.002629 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.002538 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" event={"ID":"f6aefca8-f383-4d02-aa41-6a49df356052","Type":"ContainerStarted","Data":"e6640375a3d41f2ebc7367b8f7ab0045752ab41e0a75fa708fafc64f833d7916"} Jun 03 14:45:39.003789 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.003759 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" event={"ID":"90d7444f-d8c4-4b99-9ac7-8c437ec12eeb","Type":"ContainerStarted","Data":"c9d46dbd5cd44cbc5fd3ec140793afd1eb68e3afec102a64af4e2dcedf17ba72"} Jun 03 14:45:39.005053 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.005023 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d5thl" event={"ID":"3a26778f-7827-4e52-bb29-96338b843709","Type":"ContainerStarted","Data":"febb4401edd02846ff4f4f1b8b561edc9031f265bbc33d96e79373dbeeff64fc"} Jun 03 14:45:39.006298 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.006269 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wt9nf" event={"ID":"6fcad51b-5916-4694-87a8-bf3ac3cf21cf","Type":"ContainerStarted","Data":"be86cd27bfad35f4537a7b6c5f87f78b19fa7280859796190463948ce4b17b89"} Jun 03 14:45:39.007640 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.007613 2580 generic.go:358] "Generic (PLEG): container finished" podID="6864f29b-0e87-45fa-9de3-35e89474c9ca" containerID="8ab1b1282faf3455bda3e670f5c567d730c271389a3d91715639a19c86884aec" exitCode=0 Jun 03 14:45:39.007740 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.007697 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qp7fh" event={"ID":"6864f29b-0e87-45fa-9de3-35e89474c9ca","Type":"ContainerDied","Data":"8ab1b1282faf3455bda3e670f5c567d730c271389a3d91715639a19c86884aec"} Jun 03 14:45:39.009736 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.009711 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-knjfc" event={"ID":"c8bacdf4-c8e3-4a93-8a3b-b57db3791c86","Type":"ContainerStarted","Data":"aaaf53163fed29b419141a26e14bc05117218dee96074cefb07de42f48db705f"} Jun 03 14:45:39.011343 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.011020 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-32.ec2.internal" event={"ID":"9bbfdd57113509939e81d22cb0c12ade","Type":"ContainerStarted","Data":"d6864ac063afa5a74e399be9bcad34a9da5da24a4fb27cac2b8597cb5202e5d5"} Jun 03 14:45:39.012559 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.012541 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xmqx7" event={"ID":"dca64948-d4ce-43d4-bbd4-b651db08a776","Type":"ContainerStarted","Data":"4b6b87338def1f644e72c855853136581da0cc4f0ab2956de35b50aa93f1e902"} Jun 03 14:45:39.048575 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.048528 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-d5thl" podStartSLOduration=4.231015081 podStartE2EDuration="23.048515058s" podCreationTimestamp="2026-06-03 14:45:16 +0000 UTC" firstStartedPulling="2026-06-03 14:45:19.147310036 +0000 UTC m=+2.810412484" lastFinishedPulling="2026-06-03 14:45:37.964810002 +0000 UTC m=+21.627912461" observedRunningTime="2026-06-03 14:45:39.048156223 +0000 UTC m=+22.711258679" watchObservedRunningTime="2026-06-03 14:45:39.048515058 +0000 UTC m=+22.711617521" Jun 03 14:45:39.048761 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.048628 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rvlxf" podStartSLOduration=3.231757565 podStartE2EDuration="22.048623365s" podCreationTimestamp="2026-06-03 14:45:17 +0000 UTC" firstStartedPulling="2026-06-03 14:45:19.146321683 +0000 UTC m=+2.809424124" lastFinishedPulling="2026-06-03 14:45:37.963187469 +0000 UTC m=+21.626289924" observedRunningTime="2026-06-03 14:45:39.017109541 +0000 UTC m=+22.680212005" watchObservedRunningTime="2026-06-03 14:45:39.048623365 +0000 UTC m=+22.711725827" Jun 03 14:45:39.099617 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.099570 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-knjfc" podStartSLOduration=11.099555892 podStartE2EDuration="11.099555892s" podCreationTimestamp="2026-06-03 14:45:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:45:39.077053589 +0000 UTC m=+22.740156053" watchObservedRunningTime="2026-06-03 14:45:39.099555892 +0000 UTC m=+22.762658411" Jun 03 14:45:39.128909 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.128860 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-32.ec2.internal" podStartSLOduration=22.128845945 podStartE2EDuration="22.128845945s" podCreationTimestamp="2026-06-03 14:45:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:45:39.09933086 +0000 UTC m=+22.762433323" watchObservedRunningTime="2026-06-03 14:45:39.128845945 +0000 UTC m=+22.791948420" Jun 03 14:45:39.129059 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.128931 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-wt9nf" podStartSLOduration=4.305493077 podStartE2EDuration="23.128924656s" podCreationTimestamp="2026-06-03 14:45:16 +0000 UTC" firstStartedPulling="2026-06-03 14:45:19.146301282 +0000 UTC m=+2.809403726" lastFinishedPulling="2026-06-03 14:45:37.96973286 +0000 UTC m=+21.632835305" observedRunningTime="2026-06-03 14:45:39.128760732 +0000 UTC m=+22.791863196" watchObservedRunningTime="2026-06-03 14:45:39.128924656 +0000 UTC m=+22.792027121" Jun 03 14:45:39.186975 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.186904 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xmqx7" Jun 03 14:45:39.187674 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.187632 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xmqx7" Jun 03 14:45:39.205938 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.205875 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xmqx7" podStartSLOduration=4.45981879 podStartE2EDuration="23.205858472s" podCreationTimestamp="2026-06-03 14:45:16 +0000 UTC" firstStartedPulling="2026-06-03 14:45:19.146276751 +0000 UTC m=+2.809379193" lastFinishedPulling="2026-06-03 14:45:37.892316424 +0000 UTC m=+21.555418875" observedRunningTime="2026-06-03 14:45:39.176517519 +0000 UTC m=+22.839619982" watchObservedRunningTime="2026-06-03 14:45:39.205858472 +0000 UTC m=+22.868960934" Jun 03 14:45:39.757509 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.757488 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 14:45:39.832698 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.832581 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T14:45:39.757506258Z","UUID":"57bca4c7-f734-4cb5-ab9f-e3f325b76b24","Handler":null,"Name":"","Endpoint":""} Jun 03 14:45:39.836316 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.836291 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 14:45:39.836316 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:39.836320 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 14:45:40.015905 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:40.015859 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" event={"ID":"90d7444f-d8c4-4b99-9ac7-8c437ec12eeb","Type":"ContainerStarted","Data":"12fd7e01890399081742ef1645c46415c772422dcf4c0b8b2364a15f4b2f4027"} Jun 03 14:45:40.017434 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:40.017397 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-828cc" event={"ID":"97457295-a8d6-470b-ad98-dc1009a5ba3b","Type":"ContainerStarted","Data":"978557b737d3de48e76c87e38c5f247572ab4f530cca3aafae9c60b5c2561583"} Jun 03 14:45:40.034796 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:40.034745 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-828cc" podStartSLOduration=4.20372683 podStartE2EDuration="23.03473177s" podCreationTimestamp="2026-06-03 14:45:17 +0000 UTC" firstStartedPulling="2026-06-03 14:45:19.135207555 +0000 UTC m=+2.798310000" lastFinishedPulling="2026-06-03 14:45:37.966212499 +0000 UTC m=+21.629314940" observedRunningTime="2026-06-03 14:45:40.034119731 +0000 UTC m=+23.697222194" watchObservedRunningTime="2026-06-03 14:45:40.03473177 +0000 UTC m=+23.697834231" Jun 03 14:45:40.895725 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:40.895536 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:40.895867 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:40.895838 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4k4qb" podUID="db01432f-994f-414e-83ab-34ec0ca5fb26" Jun 03 14:45:40.896203 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:40.896185 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:40.896324 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:40.896304 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlx8q" podUID="bef4ffc0-2d1c-4742-abdd-1ba23bea3574" Jun 03 14:45:40.896366 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:40.896355 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:40.896440 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:40.896424 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4nxx" podUID="86de1ecb-8551-4720-b4fa-1b5cc8dd265d" Jun 03 14:45:41.022177 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:41.022144 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" event={"ID":"f6aefca8-f383-4d02-aa41-6a49df356052","Type":"ContainerStarted","Data":"324e6805c0e24d8ac41b0261044595db97e432b97b1c2fff608ecf7accc83a52"} Jun 03 14:45:41.022538 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:41.022196 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 14:45:41.152112 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:41.152070 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db01432f-994f-414e-83ab-34ec0ca5fb26-original-pull-secret\") pod \"global-pull-secret-syncer-4k4qb\" (UID: \"db01432f-994f-414e-83ab-34ec0ca5fb26\") " pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:41.152307 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:41.152281 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 14:45:41.152377 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:41.152350 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db01432f-994f-414e-83ab-34ec0ca5fb26-original-pull-secret podName:db01432f-994f-414e-83ab-34ec0ca5fb26 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:57.152333043 +0000 UTC m=+40.815435489 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db01432f-994f-414e-83ab-34ec0ca5fb26-original-pull-secret") pod "global-pull-secret-syncer-4k4qb" (UID: "db01432f-994f-414e-83ab-34ec0ca5fb26") : object "kube-system"/"original-pull-secret" not registered Jun 03 14:45:42.025874 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:42.025835 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" event={"ID":"90d7444f-d8c4-4b99-9ac7-8c437ec12eeb","Type":"ContainerStarted","Data":"be068929577d1f023f946ac7ddca3981508034e8076db3d0433ba6eb8b904dab"} Jun 03 14:45:42.047956 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:42.047886 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7hfk" podStartSLOduration=3.7381512089999998 podStartE2EDuration="26.047865848s" podCreationTimestamp="2026-06-03 14:45:16 +0000 UTC" firstStartedPulling="2026-06-03 14:45:19.142055574 +0000 UTC m=+2.805158016" lastFinishedPulling="2026-06-03 14:45:41.451770211 +0000 UTC m=+25.114872655" observedRunningTime="2026-06-03 14:45:42.047313265 +0000 UTC m=+25.710415730" watchObservedRunningTime="2026-06-03 14:45:42.047865848 +0000 UTC m=+25.710968312" Jun 03 14:45:42.896046 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:42.896010 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:42.896214 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:42.896013 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:42.896214 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:42.896144 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4nxx" podUID="86de1ecb-8551-4720-b4fa-1b5cc8dd265d" Jun 03 14:45:42.896342 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:42.896010 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:42.896342 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:42.896250 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4k4qb" podUID="db01432f-994f-414e-83ab-34ec0ca5fb26" Jun 03 14:45:42.896447 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:42.896392 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlx8q" podUID="bef4ffc0-2d1c-4742-abdd-1ba23bea3574" Jun 03 14:45:44.807248 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:44.807044 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xmqx7" Jun 03 14:45:44.807744 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:44.807319 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 14:45:44.807744 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:44.807717 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xmqx7" Jun 03 14:45:44.895804 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:44.895773 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:44.895950 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:44.895776 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:44.895950 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:44.895883 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlx8q" podUID="bef4ffc0-2d1c-4742-abdd-1ba23bea3574" Jun 03 14:45:44.895950 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:44.895776 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:44.896041 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:44.895941 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4nxx" podUID="86de1ecb-8551-4720-b4fa-1b5cc8dd265d" Jun 03 14:45:44.896041 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:44.896012 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4k4qb" podUID="db01432f-994f-414e-83ab-34ec0ca5fb26" Jun 03 14:45:45.033058 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:45.033029 2580 generic.go:358] "Generic (PLEG): container finished" podID="6864f29b-0e87-45fa-9de3-35e89474c9ca" containerID="8ee2adfd744bd4a63eede4b8c887f687a805dfededa344bb66ce8d6aa4be725e" exitCode=0 Jun 03 14:45:45.033221 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:45.033104 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qp7fh" event={"ID":"6864f29b-0e87-45fa-9de3-35e89474c9ca","Type":"ContainerDied","Data":"8ee2adfd744bd4a63eede4b8c887f687a805dfededa344bb66ce8d6aa4be725e"} Jun 03 14:45:45.036274 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:45.036251 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" event={"ID":"f6aefca8-f383-4d02-aa41-6a49df356052","Type":"ContainerStarted","Data":"fc34ffb269f493ff3669bf70f6ffb73324a66b23682b65185023e94a26ecccd8"} Jun 03 14:45:45.036710 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:45.036690 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:45.036819 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:45.036721 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:45.036819 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:45.036733 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:45.052668 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:45.052625 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:45.052788 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:45.052712 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:45:45.113623 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:45.113261 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" podStartSLOduration=9.161882646 podStartE2EDuration="28.113224756s" podCreationTimestamp="2026-06-03 14:45:17 +0000 UTC" firstStartedPulling="2026-06-03 14:45:19.142057534 +0000 UTC m=+2.805159977" lastFinishedPulling="2026-06-03 14:45:38.093399632 +0000 UTC m=+21.756502087" observedRunningTime="2026-06-03 14:45:45.111227444 +0000 UTC m=+28.774329921" watchObservedRunningTime="2026-06-03 14:45:45.113224756 +0000 UTC m=+28.776327219" Jun 03 14:45:46.041308 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:46.041227 2580 generic.go:358] "Generic (PLEG): container finished" podID="6864f29b-0e87-45fa-9de3-35e89474c9ca" containerID="5a2a1131cd415d12910d4f07b9a5470568c161ad9ac269e421dbfc83f16997b5" exitCode=0 Jun 03 14:45:46.041692 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:46.041374 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qp7fh" event={"ID":"6864f29b-0e87-45fa-9de3-35e89474c9ca","Type":"ContainerDied","Data":"5a2a1131cd415d12910d4f07b9a5470568c161ad9ac269e421dbfc83f16997b5"} Jun 03 14:45:46.524718 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:46.524685 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t4nxx"] Jun 03 14:45:46.524884 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:46.524816 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:46.524947 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:46.524923 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4nxx" podUID="86de1ecb-8551-4720-b4fa-1b5cc8dd265d" Jun 03 14:45:46.527545 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:46.527517 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4k4qb"] Jun 03 14:45:46.527745 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:46.527620 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:46.527835 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:46.527742 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4k4qb" podUID="db01432f-994f-414e-83ab-34ec0ca5fb26" Jun 03 14:45:46.528100 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:46.528077 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qlx8q"] Jun 03 14:45:46.528202 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:46.528189 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:46.528295 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:46.528277 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlx8q" podUID="bef4ffc0-2d1c-4742-abdd-1ba23bea3574" Jun 03 14:45:47.895545 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:47.895381 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:47.895946 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:47.895424 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:47.895946 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:47.895617 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4nxx" podUID="86de1ecb-8551-4720-b4fa-1b5cc8dd265d" Jun 03 14:45:47.895946 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:47.895712 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4k4qb" podUID="db01432f-994f-414e-83ab-34ec0ca5fb26" Jun 03 14:45:48.898143 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:48.898109 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:48.898607 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:48.898237 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlx8q" podUID="bef4ffc0-2d1c-4742-abdd-1ba23bea3574" Jun 03 14:45:49.895970 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:49.895941 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:49.896152 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:49.895941 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:49.896152 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:49.896046 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4nxx" podUID="86de1ecb-8551-4720-b4fa-1b5cc8dd265d" Jun 03 14:45:49.896152 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:49.896127 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4k4qb" podUID="db01432f-994f-414e-83ab-34ec0ca5fb26" Jun 03 14:45:50.051098 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.051065 2580 generic.go:358] "Generic (PLEG): container finished" podID="6864f29b-0e87-45fa-9de3-35e89474c9ca" containerID="e2c77bc1d6139a7cca0bd0bba1e65f1471da064b9ad70ec7363d2ab0cb718d8d" exitCode=0 Jun 03 14:45:50.051601 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.051107 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qp7fh" event={"ID":"6864f29b-0e87-45fa-9de3-35e89474c9ca","Type":"ContainerDied","Data":"e2c77bc1d6139a7cca0bd0bba1e65f1471da064b9ad70ec7363d2ab0cb718d8d"} Jun 03 14:45:50.524617 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.524590 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs\") pod \"network-metrics-daemon-qlx8q\" (UID: \"bef4ffc0-2d1c-4742-abdd-1ba23bea3574\") " pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:50.524821 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:50.524746 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 14:45:50.524821 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:50.524815 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs podName:bef4ffc0-2d1c-4742-abdd-1ba23bea3574 nodeName:}" failed. No retries permitted until 2026-06-03 14:46:22.524799457 +0000 UTC m=+66.187901898 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs") pod "network-metrics-daemon-qlx8q" (UID: "bef4ffc0-2d1c-4742-abdd-1ba23bea3574") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 14:45:50.625532 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.625497 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fzxmq\" (UniqueName: \"kubernetes.io/projected/86de1ecb-8551-4720-b4fa-1b5cc8dd265d-kube-api-access-fzxmq\") pod \"network-check-target-t4nxx\" (UID: \"86de1ecb-8551-4720-b4fa-1b5cc8dd265d\") " pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:50.625690 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:50.625678 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 14:45:50.625738 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:50.625696 2580 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 14:45:50.625738 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:50.625705 2580 projected.go:194] Error preparing data for projected volume kube-api-access-fzxmq for pod openshift-network-diagnostics/network-check-target-t4nxx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 14:45:50.625847 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:50.625762 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86de1ecb-8551-4720-b4fa-1b5cc8dd265d-kube-api-access-fzxmq podName:86de1ecb-8551-4720-b4fa-1b5cc8dd265d nodeName:}" failed. No retries permitted until 2026-06-03 14:46:22.625744845 +0000 UTC m=+66.288847289 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fzxmq" (UniqueName: "kubernetes.io/projected/86de1ecb-8551-4720-b4fa-1b5cc8dd265d-kube-api-access-fzxmq") pod "network-check-target-t4nxx" (UID: "86de1ecb-8551-4720-b4fa-1b5cc8dd265d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 14:45:50.657261 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.657237 2580 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-32.ec2.internal" event="NodeReady" Jun 03 14:45:50.657380 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.657371 2580 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 14:45:50.710974 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.710948 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-798tm"] Jun 03 14:45:50.748411 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.748384 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-njv2f"] Jun 03 14:45:50.748571 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.748552 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-798tm" Jun 03 14:45:50.751112 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.751087 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 14:45:50.751285 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.751269 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 14:45:50.751348 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.751334 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dkhrx\"" Jun 03 14:45:50.759853 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.759838 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-798tm"] Jun 03 14:45:50.759930 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.759859 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-njv2f"] Jun 03 14:45:50.759964 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.759935 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-njv2f" Jun 03 14:45:50.763209 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.763192 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ljvdn\"" Jun 03 14:45:50.763609 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.763585 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 14:45:50.763609 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.763597 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 14:45:50.763792 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.763742 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 14:45:50.826468 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.826439 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls\") pod \"dns-default-798tm\" (UID: \"a3762e8b-89b7-46cf-bfff-d02b5ea63779\") " pod="openshift-dns/dns-default-798tm" Jun 03 14:45:50.826468 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.826469 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h5zz\" (UniqueName: \"kubernetes.io/projected/a3762e8b-89b7-46cf-bfff-d02b5ea63779-kube-api-access-8h5zz\") pod \"dns-default-798tm\" (UID: \"a3762e8b-89b7-46cf-bfff-d02b5ea63779\") " pod="openshift-dns/dns-default-798tm" Jun 03 14:45:50.826641 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.826558 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a3762e8b-89b7-46cf-bfff-d02b5ea63779-config-volume\") pod \"dns-default-798tm\" (UID: \"a3762e8b-89b7-46cf-bfff-d02b5ea63779\") " pod="openshift-dns/dns-default-798tm" Jun 03 14:45:50.826641 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.826592 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3762e8b-89b7-46cf-bfff-d02b5ea63779-tmp-dir\") pod \"dns-default-798tm\" (UID: \"a3762e8b-89b7-46cf-bfff-d02b5ea63779\") " pod="openshift-dns/dns-default-798tm" Jun 03 14:45:50.895928 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.895900 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:45:50.898615 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.898588 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 14:45:50.898756 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.898619 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fk4zz\"" Jun 03 14:45:50.927032 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.927003 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls\") pod \"dns-default-798tm\" (UID: \"a3762e8b-89b7-46cf-bfff-d02b5ea63779\") " pod="openshift-dns/dns-default-798tm" Jun 03 14:45:50.927032 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.927035 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8h5zz\" (UniqueName: \"kubernetes.io/projected/a3762e8b-89b7-46cf-bfff-d02b5ea63779-kube-api-access-8h5zz\") pod \"dns-default-798tm\" (UID: \"a3762e8b-89b7-46cf-bfff-d02b5ea63779\") " pod="openshift-dns/dns-default-798tm" Jun 03 14:45:50.927197 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.927079 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a3762e8b-89b7-46cf-bfff-d02b5ea63779-config-volume\") pod \"dns-default-798tm\" (UID: \"a3762e8b-89b7-46cf-bfff-d02b5ea63779\") " pod="openshift-dns/dns-default-798tm" Jun 03 14:45:50.927197 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.927095 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3762e8b-89b7-46cf-bfff-d02b5ea63779-tmp-dir\") pod \"dns-default-798tm\" (UID: \"a3762e8b-89b7-46cf-bfff-d02b5ea63779\") " pod="openshift-dns/dns-default-798tm" Jun 03 14:45:50.927197 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.927118 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert\") pod \"ingress-canary-njv2f\" (UID: \"7c67156d-cd08-4a11-b6f8-5430e5673f45\") " pod="openshift-ingress-canary/ingress-canary-njv2f" Jun 03 14:45:50.927197 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.927138 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfstq\" (UniqueName: \"kubernetes.io/projected/7c67156d-cd08-4a11-b6f8-5430e5673f45-kube-api-access-jfstq\") pod \"ingress-canary-njv2f\" (UID: \"7c67156d-cd08-4a11-b6f8-5430e5673f45\") " pod="openshift-ingress-canary/ingress-canary-njv2f" Jun 03 14:45:50.927197 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:50.927145 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 14:45:50.927371 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:50.927224 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls podName:a3762e8b-89b7-46cf-bfff-d02b5ea63779 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:51.427203051 +0000 UTC m=+35.090305522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls") pod "dns-default-798tm" (UID: "a3762e8b-89b7-46cf-bfff-d02b5ea63779") : secret "dns-default-metrics-tls" not found Jun 03 14:45:50.927451 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.927430 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3762e8b-89b7-46cf-bfff-d02b5ea63779-tmp-dir\") pod \"dns-default-798tm\" (UID: \"a3762e8b-89b7-46cf-bfff-d02b5ea63779\") " pod="openshift-dns/dns-default-798tm" Jun 03 14:45:50.927626 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.927604 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a3762e8b-89b7-46cf-bfff-d02b5ea63779-config-volume\") pod \"dns-default-798tm\" (UID: \"a3762e8b-89b7-46cf-bfff-d02b5ea63779\") " pod="openshift-dns/dns-default-798tm" Jun 03 14:45:50.939997 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:50.939968 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h5zz\" (UniqueName: \"kubernetes.io/projected/a3762e8b-89b7-46cf-bfff-d02b5ea63779-kube-api-access-8h5zz\") pod \"dns-default-798tm\" (UID: \"a3762e8b-89b7-46cf-bfff-d02b5ea63779\") " pod="openshift-dns/dns-default-798tm" Jun 03 14:45:51.028085 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:51.028007 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert\") pod \"ingress-canary-njv2f\" (UID: \"7c67156d-cd08-4a11-b6f8-5430e5673f45\") " pod="openshift-ingress-canary/ingress-canary-njv2f" Jun 03 14:45:51.028085 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:51.028060 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jfstq\" (UniqueName: \"kubernetes.io/projected/7c67156d-cd08-4a11-b6f8-5430e5673f45-kube-api-access-jfstq\") pod \"ingress-canary-njv2f\" (UID: \"7c67156d-cd08-4a11-b6f8-5430e5673f45\") " pod="openshift-ingress-canary/ingress-canary-njv2f" Jun 03 14:45:51.028296 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:51.028183 2580 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 14:45:51.028296 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:51.028269 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert podName:7c67156d-cd08-4a11-b6f8-5430e5673f45 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:51.528248846 +0000 UTC m=+35.191351311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert") pod "ingress-canary-njv2f" (UID: "7c67156d-cd08-4a11-b6f8-5430e5673f45") : secret "canary-serving-cert" not found Jun 03 14:45:51.037940 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:51.037911 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfstq\" (UniqueName: \"kubernetes.io/projected/7c67156d-cd08-4a11-b6f8-5430e5673f45-kube-api-access-jfstq\") pod \"ingress-canary-njv2f\" (UID: \"7c67156d-cd08-4a11-b6f8-5430e5673f45\") " pod="openshift-ingress-canary/ingress-canary-njv2f" Jun 03 14:45:51.432496 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:51.432462 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls\") pod \"dns-default-798tm\" (UID: \"a3762e8b-89b7-46cf-bfff-d02b5ea63779\") " pod="openshift-dns/dns-default-798tm" Jun 03 14:45:51.433051 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:51.432567 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 14:45:51.433051 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:51.432629 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls podName:a3762e8b-89b7-46cf-bfff-d02b5ea63779 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:52.432615504 +0000 UTC m=+36.095717944 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls") pod "dns-default-798tm" (UID: "a3762e8b-89b7-46cf-bfff-d02b5ea63779") : secret "dns-default-metrics-tls" not found Jun 03 14:45:51.533526 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:51.533492 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert\") pod \"ingress-canary-njv2f\" (UID: \"7c67156d-cd08-4a11-b6f8-5430e5673f45\") " pod="openshift-ingress-canary/ingress-canary-njv2f" Jun 03 14:45:51.533718 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:51.533684 2580 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 14:45:51.533791 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:51.533766 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert podName:7c67156d-cd08-4a11-b6f8-5430e5673f45 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:52.533749228 +0000 UTC m=+36.196851672 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert") pod "ingress-canary-njv2f" (UID: "7c67156d-cd08-4a11-b6f8-5430e5673f45") : secret "canary-serving-cert" not found Jun 03 14:45:51.896035 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:51.895996 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:51.896035 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:51.896029 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:45:51.898773 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:51.898747 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 14:45:51.898894 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:51.898775 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 14:45:51.899824 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:51.899806 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 14:45:51.899917 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:51.899808 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p5wkn\"" Jun 03 14:45:52.440925 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:52.440882 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls\") pod \"dns-default-798tm\" (UID: \"a3762e8b-89b7-46cf-bfff-d02b5ea63779\") " pod="openshift-dns/dns-default-798tm" Jun 03 14:45:52.441398 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:52.441036 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 14:45:52.441398 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:52.441106 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls podName:a3762e8b-89b7-46cf-bfff-d02b5ea63779 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:54.441089355 +0000 UTC m=+38.104191796 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls") pod "dns-default-798tm" (UID: "a3762e8b-89b7-46cf-bfff-d02b5ea63779") : secret "dns-default-metrics-tls" not found Jun 03 14:45:52.542275 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:52.542236 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert\") pod \"ingress-canary-njv2f\" (UID: \"7c67156d-cd08-4a11-b6f8-5430e5673f45\") " pod="openshift-ingress-canary/ingress-canary-njv2f" Jun 03 14:45:52.542474 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:52.542369 2580 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 14:45:52.542474 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:52.542437 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert podName:7c67156d-cd08-4a11-b6f8-5430e5673f45 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:54.54241709 +0000 UTC m=+38.205519547 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert") pod "ingress-canary-njv2f" (UID: "7c67156d-cd08-4a11-b6f8-5430e5673f45") : secret "canary-serving-cert" not found Jun 03 14:45:54.454832 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:54.454798 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls\") pod \"dns-default-798tm\" (UID: \"a3762e8b-89b7-46cf-bfff-d02b5ea63779\") " pod="openshift-dns/dns-default-798tm" Jun 03 14:45:54.455209 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:54.454955 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 14:45:54.455209 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:54.455019 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls podName:a3762e8b-89b7-46cf-bfff-d02b5ea63779 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:58.455003415 +0000 UTC m=+42.118105856 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls") pod "dns-default-798tm" (UID: "a3762e8b-89b7-46cf-bfff-d02b5ea63779") : secret "dns-default-metrics-tls" not found Jun 03 14:45:54.555970 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:54.555934 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert\") pod \"ingress-canary-njv2f\" (UID: \"7c67156d-cd08-4a11-b6f8-5430e5673f45\") " pod="openshift-ingress-canary/ingress-canary-njv2f" Jun 03 14:45:54.556148 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:54.556102 2580 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 14:45:54.556213 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:54.556181 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert podName:7c67156d-cd08-4a11-b6f8-5430e5673f45 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:58.556161161 +0000 UTC m=+42.219263621 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert") pod "ingress-canary-njv2f" (UID: "7c67156d-cd08-4a11-b6f8-5430e5673f45") : secret "canary-serving-cert" not found Jun 03 14:45:57.174132 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:57.173890 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db01432f-994f-414e-83ab-34ec0ca5fb26-original-pull-secret\") pod \"global-pull-secret-syncer-4k4qb\" (UID: \"db01432f-994f-414e-83ab-34ec0ca5fb26\") " pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:57.177092 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:57.177060 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db01432f-994f-414e-83ab-34ec0ca5fb26-original-pull-secret\") pod \"global-pull-secret-syncer-4k4qb\" (UID: \"db01432f-994f-414e-83ab-34ec0ca5fb26\") " pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:57.306974 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:57.306935 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4k4qb" Jun 03 14:45:58.073478 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:58.073415 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4k4qb"] Jun 03 14:45:58.156536 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:45:58.156494 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb01432f_994f_414e_83ab_34ec0ca5fb26.slice/crio-af9cb0f818304fc2d354f98d8c7914982d040e56addaaa60a4007f0aa2788e92 WatchSource:0}: Error finding container af9cb0f818304fc2d354f98d8c7914982d040e56addaaa60a4007f0aa2788e92: Status 404 returned error can't find the container with id af9cb0f818304fc2d354f98d8c7914982d040e56addaaa60a4007f0aa2788e92 Jun 03 14:45:58.485342 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:58.485257 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls\") pod \"dns-default-798tm\" (UID: \"a3762e8b-89b7-46cf-bfff-d02b5ea63779\") " pod="openshift-dns/dns-default-798tm" Jun 03 14:45:58.485704 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:58.485367 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 14:45:58.485704 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:58.485421 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls podName:a3762e8b-89b7-46cf-bfff-d02b5ea63779 nodeName:}" failed. No retries permitted until 2026-06-03 14:46:06.485406295 +0000 UTC m=+50.148508735 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls") pod "dns-default-798tm" (UID: "a3762e8b-89b7-46cf-bfff-d02b5ea63779") : secret "dns-default-metrics-tls" not found Jun 03 14:45:58.586261 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:58.586227 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert\") pod \"ingress-canary-njv2f\" (UID: \"7c67156d-cd08-4a11-b6f8-5430e5673f45\") " pod="openshift-ingress-canary/ingress-canary-njv2f" Jun 03 14:45:58.586423 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:58.586336 2580 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 14:45:58.586423 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:45:58.586390 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert podName:7c67156d-cd08-4a11-b6f8-5430e5673f45 nodeName:}" failed. No retries permitted until 2026-06-03 14:46:06.586375912 +0000 UTC m=+50.249478353 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert") pod "ingress-canary-njv2f" (UID: "7c67156d-cd08-4a11-b6f8-5430e5673f45") : secret "canary-serving-cert" not found Jun 03 14:45:59.071191 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:59.071151 2580 generic.go:358] "Generic (PLEG): container finished" podID="6864f29b-0e87-45fa-9de3-35e89474c9ca" containerID="278f76244c8e5f00acccf31eacd9f66dcf23b12b74b51392f7cca7083b5f7fa1" exitCode=0 Jun 03 14:45:59.071355 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:59.071280 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qp7fh" event={"ID":"6864f29b-0e87-45fa-9de3-35e89474c9ca","Type":"ContainerDied","Data":"278f76244c8e5f00acccf31eacd9f66dcf23b12b74b51392f7cca7083b5f7fa1"} Jun 03 14:45:59.072418 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:45:59.072392 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4k4qb" event={"ID":"db01432f-994f-414e-83ab-34ec0ca5fb26","Type":"ContainerStarted","Data":"af9cb0f818304fc2d354f98d8c7914982d040e56addaaa60a4007f0aa2788e92"} Jun 03 14:46:00.076936 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:00.076898 2580 generic.go:358] "Generic (PLEG): container finished" podID="6864f29b-0e87-45fa-9de3-35e89474c9ca" containerID="ad3537a356fe729339c056a40d09fa2f6f5a4a49911641ad9aff017b4489324c" exitCode=0 Jun 03 14:46:00.077395 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:00.076966 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qp7fh" event={"ID":"6864f29b-0e87-45fa-9de3-35e89474c9ca","Type":"ContainerDied","Data":"ad3537a356fe729339c056a40d09fa2f6f5a4a49911641ad9aff017b4489324c"} Jun 03 14:46:01.082013 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:01.081977 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qp7fh" event={"ID":"6864f29b-0e87-45fa-9de3-35e89474c9ca","Type":"ContainerStarted","Data":"eb33f67d9c62584564d6a05aeeaecb16a133aaa4af6d89c8177eb9e49e26e26f"} Jun 03 14:46:01.111195 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:01.111144 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qp7fh" podStartSLOduration=6.0637453 podStartE2EDuration="45.111129783s" podCreationTimestamp="2026-06-03 14:45:16 +0000 UTC" firstStartedPulling="2026-06-03 14:45:19.137910994 +0000 UTC m=+2.801013453" lastFinishedPulling="2026-06-03 14:45:58.185295482 +0000 UTC m=+41.848397936" observedRunningTime="2026-06-03 14:46:01.109278885 +0000 UTC m=+44.772381360" watchObservedRunningTime="2026-06-03 14:46:01.111129783 +0000 UTC m=+44.774232245" Jun 03 14:46:05.090750 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:05.090709 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4k4qb" event={"ID":"db01432f-994f-414e-83ab-34ec0ca5fb26","Type":"ContainerStarted","Data":"92b27c343f3682ba90dc034452f60d49a344862e39918c3e2f6cd78eb700f512"} Jun 03 14:46:05.109981 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:05.109910 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4k4qb" podStartSLOduration=33.778620998 podStartE2EDuration="40.109893977s" podCreationTimestamp="2026-06-03 14:45:25 +0000 UTC" firstStartedPulling="2026-06-03 14:45:58.161479348 +0000 UTC m=+41.824581792" lastFinishedPulling="2026-06-03 14:46:04.492752317 +0000 UTC m=+48.155854771" observedRunningTime="2026-06-03 14:46:05.109034003 +0000 UTC m=+48.772136465" watchObservedRunningTime="2026-06-03 14:46:05.109893977 +0000 UTC m=+48.772996441" Jun 03 14:46:06.539244 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:06.539205 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls\") pod \"dns-default-798tm\" (UID: \"a3762e8b-89b7-46cf-bfff-d02b5ea63779\") " pod="openshift-dns/dns-default-798tm" Jun 03 14:46:06.539704 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:46:06.539372 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 14:46:06.539704 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:46:06.539456 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls podName:a3762e8b-89b7-46cf-bfff-d02b5ea63779 nodeName:}" failed. No retries permitted until 2026-06-03 14:46:22.539435736 +0000 UTC m=+66.202538195 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls") pod "dns-default-798tm" (UID: "a3762e8b-89b7-46cf-bfff-d02b5ea63779") : secret "dns-default-metrics-tls" not found Jun 03 14:46:06.639833 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:06.639793 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert\") pod \"ingress-canary-njv2f\" (UID: \"7c67156d-cd08-4a11-b6f8-5430e5673f45\") " pod="openshift-ingress-canary/ingress-canary-njv2f" Jun 03 14:46:06.639997 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:46:06.639933 2580 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 14:46:06.639997 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:46:06.639994 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert podName:7c67156d-cd08-4a11-b6f8-5430e5673f45 nodeName:}" failed. No retries permitted until 2026-06-03 14:46:22.639979093 +0000 UTC m=+66.303081534 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert") pod "ingress-canary-njv2f" (UID: "7c67156d-cd08-4a11-b6f8-5430e5673f45") : secret "canary-serving-cert" not found Jun 03 14:46:17.054029 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:17.053995 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fc7d9" Jun 03 14:46:22.557263 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:22.557219 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls\") pod \"dns-default-798tm\" (UID: \"a3762e8b-89b7-46cf-bfff-d02b5ea63779\") " pod="openshift-dns/dns-default-798tm" Jun 03 14:46:22.557804 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:22.557273 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs\") pod \"network-metrics-daemon-qlx8q\" (UID: \"bef4ffc0-2d1c-4742-abdd-1ba23bea3574\") " pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:46:22.557804 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:46:22.557351 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 14:46:22.557804 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:46:22.557407 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls podName:a3762e8b-89b7-46cf-bfff-d02b5ea63779 nodeName:}" failed. No retries permitted until 2026-06-03 14:46:54.557392735 +0000 UTC m=+98.220495195 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls") pod "dns-default-798tm" (UID: "a3762e8b-89b7-46cf-bfff-d02b5ea63779") : secret "dns-default-metrics-tls" not found Jun 03 14:46:22.560328 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:22.560303 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 14:46:22.567725 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:46:22.567705 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 14:46:22.567781 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:46:22.567777 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs podName:bef4ffc0-2d1c-4742-abdd-1ba23bea3574 nodeName:}" failed. No retries permitted until 2026-06-03 14:47:26.567761931 +0000 UTC m=+130.230864372 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs") pod "network-metrics-daemon-qlx8q" (UID: "bef4ffc0-2d1c-4742-abdd-1ba23bea3574") : secret "metrics-daemon-secret" not found Jun 03 14:46:22.657780 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:22.657739 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert\") pod \"ingress-canary-njv2f\" (UID: \"7c67156d-cd08-4a11-b6f8-5430e5673f45\") " pod="openshift-ingress-canary/ingress-canary-njv2f" Jun 03 14:46:22.657910 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:22.657831 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fzxmq\" (UniqueName: \"kubernetes.io/projected/86de1ecb-8551-4720-b4fa-1b5cc8dd265d-kube-api-access-fzxmq\") pod \"network-check-target-t4nxx\" (UID: \"86de1ecb-8551-4720-b4fa-1b5cc8dd265d\") " pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:46:22.657910 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:46:22.657883 2580 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 14:46:22.657973 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:46:22.657966 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert podName:7c67156d-cd08-4a11-b6f8-5430e5673f45 nodeName:}" failed. No retries permitted until 2026-06-03 14:46:54.657946036 +0000 UTC m=+98.321048476 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert") pod "ingress-canary-njv2f" (UID: "7c67156d-cd08-4a11-b6f8-5430e5673f45") : secret "canary-serving-cert" not found Jun 03 14:46:22.660574 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:22.660557 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 14:46:22.670961 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:22.670944 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 14:46:22.681595 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:22.681567 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzxmq\" (UniqueName: \"kubernetes.io/projected/86de1ecb-8551-4720-b4fa-1b5cc8dd265d-kube-api-access-fzxmq\") pod \"network-check-target-t4nxx\" (UID: \"86de1ecb-8551-4720-b4fa-1b5cc8dd265d\") " pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:46:22.814747 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:22.814649 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p5wkn\"" Jun 03 14:46:22.822749 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:22.822727 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:46:22.962421 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:22.962389 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t4nxx"] Jun 03 14:46:22.965356 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:46:22.965320 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86de1ecb_8551_4720_b4fa_1b5cc8dd265d.slice/crio-41d476e47e936c407c4a2cd80dbfcdca45b379a5b4168d1fc5f0e344c8effb11 WatchSource:0}: Error finding container 41d476e47e936c407c4a2cd80dbfcdca45b379a5b4168d1fc5f0e344c8effb11: Status 404 returned error can't find the container with id 41d476e47e936c407c4a2cd80dbfcdca45b379a5b4168d1fc5f0e344c8effb11 Jun 03 14:46:23.127376 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:23.127336 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t4nxx" event={"ID":"86de1ecb-8551-4720-b4fa-1b5cc8dd265d","Type":"ContainerStarted","Data":"41d476e47e936c407c4a2cd80dbfcdca45b379a5b4168d1fc5f0e344c8effb11"} Jun 03 14:46:26.134458 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:26.134424 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t4nxx" event={"ID":"86de1ecb-8551-4720-b4fa-1b5cc8dd265d","Type":"ContainerStarted","Data":"8505789d6736412a3e09f6027c85a24ee36a9ca014476c7a134e24608582a447"} Jun 03 14:46:26.134841 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:26.134556 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:46:26.150572 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:26.150520 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-t4nxx" podStartSLOduration=66.399053418 podStartE2EDuration="1m9.150505237s" podCreationTimestamp="2026-06-03 14:45:17 +0000 UTC" firstStartedPulling="2026-06-03 14:46:22.967135666 +0000 UTC m=+66.630238107" lastFinishedPulling="2026-06-03 14:46:25.718587482 +0000 UTC m=+69.381689926" observedRunningTime="2026-06-03 14:46:26.149921028 +0000 UTC m=+69.813023491" watchObservedRunningTime="2026-06-03 14:46:26.150505237 +0000 UTC m=+69.813607693" Jun 03 14:46:54.584210 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:54.584153 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls\") pod \"dns-default-798tm\" (UID: \"a3762e8b-89b7-46cf-bfff-d02b5ea63779\") " pod="openshift-dns/dns-default-798tm" Jun 03 14:46:54.584740 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:46:54.584310 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 14:46:54.584740 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:46:54.584387 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls podName:a3762e8b-89b7-46cf-bfff-d02b5ea63779 nodeName:}" failed. No retries permitted until 2026-06-03 14:47:58.584371335 +0000 UTC m=+162.247473777 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls") pod "dns-default-798tm" (UID: "a3762e8b-89b7-46cf-bfff-d02b5ea63779") : secret "dns-default-metrics-tls" not found Jun 03 14:46:54.685311 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:54.685271 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert\") pod \"ingress-canary-njv2f\" (UID: \"7c67156d-cd08-4a11-b6f8-5430e5673f45\") " pod="openshift-ingress-canary/ingress-canary-njv2f" Jun 03 14:46:54.685462 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:46:54.685402 2580 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 14:46:54.685499 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:46:54.685467 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert podName:7c67156d-cd08-4a11-b6f8-5430e5673f45 nodeName:}" failed. No retries permitted until 2026-06-03 14:47:58.685449558 +0000 UTC m=+162.348552016 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert") pod "ingress-canary-njv2f" (UID: "7c67156d-cd08-4a11-b6f8-5430e5673f45") : secret "canary-serving-cert" not found Jun 03 14:46:57.139034 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:46:57.138999 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-t4nxx" Jun 03 14:47:26.604611 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:26.604563 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs\") pod \"network-metrics-daemon-qlx8q\" (UID: \"bef4ffc0-2d1c-4742-abdd-1ba23bea3574\") " pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:47:26.605115 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:26.604720 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 14:47:26.605115 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:26.604799 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs podName:bef4ffc0-2d1c-4742-abdd-1ba23bea3574 nodeName:}" failed. No retries permitted until 2026-06-03 14:49:28.604780029 +0000 UTC m=+252.267882473 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs") pod "network-metrics-daemon-qlx8q" (UID: "bef4ffc0-2d1c-4742-abdd-1ba23bea3574") : secret "metrics-daemon-secret" not found Jun 03 14:47:39.766371 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:39.766336 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5899b68489-rzt2z"] Jun 03 14:47:39.768143 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:39.768126 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:47:39.770783 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:39.770753 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 03 14:47:39.770783 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:39.770778 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 03 14:47:39.770970 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:39.770812 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 14:47:39.770970 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:39.770765 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 03 14:47:39.771073 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:39.771019 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 03 14:47:39.771131 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:39.771095 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 14:47:39.771131 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:39.771114 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-m7fcx\"" Jun 03 14:47:39.788144 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:39.788121 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5899b68489-rzt2z"] Jun 03 14:47:39.891154 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:39.891107 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-default-certificate\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:47:39.891154 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:39.891157 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-stats-auth\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:47:39.891385 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:39.891195 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml5v6\" (UniqueName: \"kubernetes.io/projected/10b236ab-1722-423e-b86d-9cb79540f191-kube-api-access-ml5v6\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:47:39.891385 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:39.891214 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10b236ab-1722-423e-b86d-9cb79540f191-service-ca-bundle\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:47:39.891385 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:39.891235 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-metrics-certs\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:47:39.991917 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:39.991875 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-default-certificate\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:47:39.991917 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:39.991925 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-stats-auth\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:47:39.992083 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:39.991956 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ml5v6\" (UniqueName: \"kubernetes.io/projected/10b236ab-1722-423e-b86d-9cb79540f191-kube-api-access-ml5v6\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:47:39.992083 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:39.991974 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10b236ab-1722-423e-b86d-9cb79540f191-service-ca-bundle\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:47:39.992083 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:39.991992 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-metrics-certs\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:47:39.992221 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:39.992136 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 14:47:39.992221 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:39.992186 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10b236ab-1722-423e-b86d-9cb79540f191-service-ca-bundle podName:10b236ab-1722-423e-b86d-9cb79540f191 nodeName:}" failed. No retries permitted until 2026-06-03 14:47:40.492162802 +0000 UTC m=+144.155265260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/10b236ab-1722-423e-b86d-9cb79540f191-service-ca-bundle") pod "router-default-5899b68489-rzt2z" (UID: "10b236ab-1722-423e-b86d-9cb79540f191") : configmap references non-existent config key: service-ca.crt Jun 03 14:47:39.992221 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:39.992218 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-metrics-certs podName:10b236ab-1722-423e-b86d-9cb79540f191 nodeName:}" failed. No retries permitted until 2026-06-03 14:47:40.492206819 +0000 UTC m=+144.155309293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-metrics-certs") pod "router-default-5899b68489-rzt2z" (UID: "10b236ab-1722-423e-b86d-9cb79540f191") : secret "router-metrics-certs-default" not found Jun 03 14:47:39.994543 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:39.994521 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-stats-auth\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:47:39.994648 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:39.994547 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-default-certificate\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:47:40.001221 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:40.001191 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml5v6\" (UniqueName: \"kubernetes.io/projected/10b236ab-1722-423e-b86d-9cb79540f191-kube-api-access-ml5v6\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:47:40.495455 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:40.495419 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-metrics-certs\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:47:40.495743 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:40.495542 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10b236ab-1722-423e-b86d-9cb79540f191-service-ca-bundle\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:47:40.495743 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:40.495568 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 14:47:40.495743 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:40.495642 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-metrics-certs podName:10b236ab-1722-423e-b86d-9cb79540f191 nodeName:}" failed. No retries permitted until 2026-06-03 14:47:41.495628513 +0000 UTC m=+145.158730954 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-metrics-certs") pod "router-default-5899b68489-rzt2z" (UID: "10b236ab-1722-423e-b86d-9cb79540f191") : secret "router-metrics-certs-default" not found Jun 03 14:47:40.495743 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:40.495678 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10b236ab-1722-423e-b86d-9cb79540f191-service-ca-bundle podName:10b236ab-1722-423e-b86d-9cb79540f191 nodeName:}" failed. No retries permitted until 2026-06-03 14:47:41.495668277 +0000 UTC m=+145.158770731 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/10b236ab-1722-423e-b86d-9cb79540f191-service-ca-bundle") pod "router-default-5899b68489-rzt2z" (UID: "10b236ab-1722-423e-b86d-9cb79540f191") : configmap references non-existent config key: service-ca.crt Jun 03 14:47:41.501426 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:41.501385 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10b236ab-1722-423e-b86d-9cb79540f191-service-ca-bundle\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:47:41.501426 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:41.501429 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-metrics-certs\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:47:41.501892 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:41.501512 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 14:47:41.501892 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:41.501551 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10b236ab-1722-423e-b86d-9cb79540f191-service-ca-bundle podName:10b236ab-1722-423e-b86d-9cb79540f191 nodeName:}" failed. No retries permitted until 2026-06-03 14:47:43.501534385 +0000 UTC m=+147.164636855 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/10b236ab-1722-423e-b86d-9cb79540f191-service-ca-bundle") pod "router-default-5899b68489-rzt2z" (UID: "10b236ab-1722-423e-b86d-9cb79540f191") : configmap references non-existent config key: service-ca.crt Jun 03 14:47:41.501892 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:41.501575 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-metrics-certs podName:10b236ab-1722-423e-b86d-9cb79540f191 nodeName:}" failed. No retries permitted until 2026-06-03 14:47:43.501565597 +0000 UTC m=+147.164668037 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-metrics-certs") pod "router-default-5899b68489-rzt2z" (UID: "10b236ab-1722-423e-b86d-9cb79540f191") : secret "router-metrics-certs-default" not found Jun 03 14:47:41.644246 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:41.644210 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-klmh7"] Jun 03 14:47:41.646400 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:41.646384 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-klmh7" Jun 03 14:47:41.648958 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:41.648937 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-s8n74\"" Jun 03 14:47:41.649070 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:41.648935 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 03 14:47:41.650058 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:41.650044 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 03 14:47:41.650325 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:41.650306 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 03 14:47:41.658492 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:41.658464 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-klmh7"] Jun 03 14:47:41.804386 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:41.804272 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da8cb13c-e0c9-44dc-8537-d2b6feee59b6-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-klmh7\" (UID: \"da8cb13c-e0c9-44dc-8537-d2b6feee59b6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-klmh7" Jun 03 14:47:41.804386 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:41.804349 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdvj4\" (UniqueName: \"kubernetes.io/projected/da8cb13c-e0c9-44dc-8537-d2b6feee59b6-kube-api-access-wdvj4\") pod \"cluster-samples-operator-755bbf9bfb-klmh7\" (UID: \"da8cb13c-e0c9-44dc-8537-d2b6feee59b6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-klmh7" Jun 03 14:47:41.904625 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:41.904583 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da8cb13c-e0c9-44dc-8537-d2b6feee59b6-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-klmh7\" (UID: \"da8cb13c-e0c9-44dc-8537-d2b6feee59b6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-klmh7" Jun 03 14:47:41.904776 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:41.904636 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdvj4\" (UniqueName: \"kubernetes.io/projected/da8cb13c-e0c9-44dc-8537-d2b6feee59b6-kube-api-access-wdvj4\") pod \"cluster-samples-operator-755bbf9bfb-klmh7\" (UID: \"da8cb13c-e0c9-44dc-8537-d2b6feee59b6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-klmh7" Jun 03 14:47:41.904776 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:41.904742 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 14:47:41.904844 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:41.904810 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da8cb13c-e0c9-44dc-8537-d2b6feee59b6-samples-operator-tls podName:da8cb13c-e0c9-44dc-8537-d2b6feee59b6 nodeName:}" failed. No retries permitted until 2026-06-03 14:47:42.404795578 +0000 UTC m=+146.067898019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/da8cb13c-e0c9-44dc-8537-d2b6feee59b6-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-klmh7" (UID: "da8cb13c-e0c9-44dc-8537-d2b6feee59b6") : secret "samples-operator-tls" not found Jun 03 14:47:41.914923 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:41.914882 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdvj4\" (UniqueName: \"kubernetes.io/projected/da8cb13c-e0c9-44dc-8537-d2b6feee59b6-kube-api-access-wdvj4\") pod \"cluster-samples-operator-755bbf9bfb-klmh7\" (UID: \"da8cb13c-e0c9-44dc-8537-d2b6feee59b6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-klmh7" Jun 03 14:47:42.409264 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:42.409203 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da8cb13c-e0c9-44dc-8537-d2b6feee59b6-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-klmh7\" (UID: \"da8cb13c-e0c9-44dc-8537-d2b6feee59b6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-klmh7" Jun 03 14:47:42.409453 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:42.409334 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 14:47:42.409453 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:42.409402 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da8cb13c-e0c9-44dc-8537-d2b6feee59b6-samples-operator-tls podName:da8cb13c-e0c9-44dc-8537-d2b6feee59b6 nodeName:}" failed. No retries permitted until 2026-06-03 14:47:43.409388504 +0000 UTC m=+147.072490945 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/da8cb13c-e0c9-44dc-8537-d2b6feee59b6-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-klmh7" (UID: "da8cb13c-e0c9-44dc-8537-d2b6feee59b6") : secret "samples-operator-tls" not found Jun 03 14:47:43.416782 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:43.416740 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da8cb13c-e0c9-44dc-8537-d2b6feee59b6-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-klmh7\" (UID: \"da8cb13c-e0c9-44dc-8537-d2b6feee59b6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-klmh7" Jun 03 14:47:43.417253 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:43.416887 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 14:47:43.417253 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:43.417003 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da8cb13c-e0c9-44dc-8537-d2b6feee59b6-samples-operator-tls podName:da8cb13c-e0c9-44dc-8537-d2b6feee59b6 nodeName:}" failed. No retries permitted until 2026-06-03 14:47:45.41698359 +0000 UTC m=+149.080086032 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/da8cb13c-e0c9-44dc-8537-d2b6feee59b6-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-klmh7" (UID: "da8cb13c-e0c9-44dc-8537-d2b6feee59b6") : secret "samples-operator-tls" not found Jun 03 14:47:43.517372 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:43.517330 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-metrics-certs\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:47:43.517577 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:43.517467 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10b236ab-1722-423e-b86d-9cb79540f191-service-ca-bundle\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:47:43.517577 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:43.517471 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 14:47:43.517577 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:43.517535 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-metrics-certs podName:10b236ab-1722-423e-b86d-9cb79540f191 nodeName:}" failed. No retries permitted until 2026-06-03 14:47:47.517519459 +0000 UTC m=+151.180621901 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-metrics-certs") pod "router-default-5899b68489-rzt2z" (UID: "10b236ab-1722-423e-b86d-9cb79540f191") : secret "router-metrics-certs-default" not found Jun 03 14:47:43.517757 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:43.517597 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10b236ab-1722-423e-b86d-9cb79540f191-service-ca-bundle podName:10b236ab-1722-423e-b86d-9cb79540f191 nodeName:}" failed. No retries permitted until 2026-06-03 14:47:47.517581264 +0000 UTC m=+151.180683722 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/10b236ab-1722-423e-b86d-9cb79540f191-service-ca-bundle") pod "router-default-5899b68489-rzt2z" (UID: "10b236ab-1722-423e-b86d-9cb79540f191") : configmap references non-existent config key: service-ca.crt Jun 03 14:47:45.430927 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:45.430875 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da8cb13c-e0c9-44dc-8537-d2b6feee59b6-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-klmh7\" (UID: \"da8cb13c-e0c9-44dc-8537-d2b6feee59b6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-klmh7" Jun 03 14:47:45.431419 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:45.431031 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 14:47:45.431419 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:45.431099 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da8cb13c-e0c9-44dc-8537-d2b6feee59b6-samples-operator-tls podName:da8cb13c-e0c9-44dc-8537-d2b6feee59b6 nodeName:}" failed. No retries permitted until 2026-06-03 14:47:49.431083133 +0000 UTC m=+153.094185574 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/da8cb13c-e0c9-44dc-8537-d2b6feee59b6-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-klmh7" (UID: "da8cb13c-e0c9-44dc-8537-d2b6feee59b6") : secret "samples-operator-tls" not found Jun 03 14:47:45.451697 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:45.451674 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-knjfc_c8bacdf4-c8e3-4a93-8a3b-b57db3791c86/dns-node-resolver/0.log" Jun 03 14:47:46.451107 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:46.451070 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rvlxf_c16b05d8-a603-4e5e-a431-7dfe6e86ca0b/node-ca/0.log" Jun 03 14:47:46.554541 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:46.554505 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-t5289"] Jun 03 14:47:46.557319 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:46.557297 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-t5289" Jun 03 14:47:46.560084 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:46.560062 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 03 14:47:46.560183 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:46.560079 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 03 14:47:46.561172 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:46.561151 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 03 14:47:46.561172 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:46.561164 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 03 14:47:46.561320 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:46.561191 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-29lkx\"" Jun 03 14:47:46.566082 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:46.566062 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-t5289"] Jun 03 14:47:46.743704 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:46.743577 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld287\" (UniqueName: \"kubernetes.io/projected/767e75c0-64a1-4662-a1cf-d24409a9c302-kube-api-access-ld287\") pod \"kube-storage-version-migrator-operator-96ddc787c-t5289\" (UID: \"767e75c0-64a1-4662-a1cf-d24409a9c302\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-t5289" Jun 03 14:47:46.743868 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:46.743732 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/767e75c0-64a1-4662-a1cf-d24409a9c302-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-t5289\" (UID: \"767e75c0-64a1-4662-a1cf-d24409a9c302\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-t5289" Jun 03 14:47:46.743868 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:46.743766 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/767e75c0-64a1-4662-a1cf-d24409a9c302-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-t5289\" (UID: \"767e75c0-64a1-4662-a1cf-d24409a9c302\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-t5289" Jun 03 14:47:46.844841 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:46.844809 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/767e75c0-64a1-4662-a1cf-d24409a9c302-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-t5289\" (UID: \"767e75c0-64a1-4662-a1cf-d24409a9c302\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-t5289" Jun 03 14:47:46.844841 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:46.844841 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/767e75c0-64a1-4662-a1cf-d24409a9c302-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-t5289\" (UID: \"767e75c0-64a1-4662-a1cf-d24409a9c302\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-t5289" Jun 03 14:47:46.845086 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:46.844906 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ld287\" (UniqueName: \"kubernetes.io/projected/767e75c0-64a1-4662-a1cf-d24409a9c302-kube-api-access-ld287\") pod \"kube-storage-version-migrator-operator-96ddc787c-t5289\" (UID: \"767e75c0-64a1-4662-a1cf-d24409a9c302\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-t5289" Jun 03 14:47:46.845434 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:46.845407 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/767e75c0-64a1-4662-a1cf-d24409a9c302-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-t5289\" (UID: \"767e75c0-64a1-4662-a1cf-d24409a9c302\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-t5289" Jun 03 14:47:46.847147 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:46.847115 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/767e75c0-64a1-4662-a1cf-d24409a9c302-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-t5289\" (UID: \"767e75c0-64a1-4662-a1cf-d24409a9c302\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-t5289" Jun 03 14:47:46.854126 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:46.854099 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld287\" (UniqueName: \"kubernetes.io/projected/767e75c0-64a1-4662-a1cf-d24409a9c302-kube-api-access-ld287\") pod \"kube-storage-version-migrator-operator-96ddc787c-t5289\" (UID: \"767e75c0-64a1-4662-a1cf-d24409a9c302\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-t5289" Jun 03 14:47:46.867172 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:46.867149 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-t5289" Jun 03 14:47:46.987967 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:46.987935 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-t5289"] Jun 03 14:47:46.990925 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:47:46.990878 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod767e75c0_64a1_4662_a1cf_d24409a9c302.slice/crio-c34a8ed380c7c3c4fe6924d37cc332610c9b42c0ab6184e0d18b613f6c32dc94 WatchSource:0}: Error finding container c34a8ed380c7c3c4fe6924d37cc332610c9b42c0ab6184e0d18b613f6c32dc94: Status 404 returned error can't find the container with id c34a8ed380c7c3c4fe6924d37cc332610c9b42c0ab6184e0d18b613f6c32dc94 Jun 03 14:47:47.282832 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:47.282751 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-t5289" event={"ID":"767e75c0-64a1-4662-a1cf-d24409a9c302","Type":"ContainerStarted","Data":"c34a8ed380c7c3c4fe6924d37cc332610c9b42c0ab6184e0d18b613f6c32dc94"} Jun 03 14:47:47.550945 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:47.550838 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10b236ab-1722-423e-b86d-9cb79540f191-service-ca-bundle\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:47:47.550945 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:47.550893 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-metrics-certs\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:47:47.551376 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:47.551021 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 14:47:47.551376 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:47.551033 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10b236ab-1722-423e-b86d-9cb79540f191-service-ca-bundle podName:10b236ab-1722-423e-b86d-9cb79540f191 nodeName:}" failed. No retries permitted until 2026-06-03 14:47:55.551015048 +0000 UTC m=+159.214117506 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/10b236ab-1722-423e-b86d-9cb79540f191-service-ca-bundle") pod "router-default-5899b68489-rzt2z" (UID: "10b236ab-1722-423e-b86d-9cb79540f191") : configmap references non-existent config key: service-ca.crt Jun 03 14:47:47.551376 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:47.551068 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-metrics-certs podName:10b236ab-1722-423e-b86d-9cb79540f191 nodeName:}" failed. No retries permitted until 2026-06-03 14:47:55.551057481 +0000 UTC m=+159.214159922 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-metrics-certs") pod "router-default-5899b68489-rzt2z" (UID: "10b236ab-1722-423e-b86d-9cb79540f191") : secret "router-metrics-certs-default" not found Jun 03 14:47:49.465911 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.465857 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da8cb13c-e0c9-44dc-8537-d2b6feee59b6-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-klmh7\" (UID: \"da8cb13c-e0c9-44dc-8537-d2b6feee59b6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-klmh7" Jun 03 14:47:49.466317 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:49.466043 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 14:47:49.466317 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:49.466143 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da8cb13c-e0c9-44dc-8537-d2b6feee59b6-samples-operator-tls podName:da8cb13c-e0c9-44dc-8537-d2b6feee59b6 nodeName:}" failed. No retries permitted until 2026-06-03 14:47:57.466121036 +0000 UTC m=+161.129223493 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/da8cb13c-e0c9-44dc-8537-d2b6feee59b6-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-klmh7" (UID: "da8cb13c-e0c9-44dc-8537-d2b6feee59b6") : secret "samples-operator-tls" not found Jun 03 14:47:49.566822 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.566785 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-flj89"] Jun 03 14:47:49.570179 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.570155 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-flj89" Jun 03 14:47:49.572921 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.572891 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-f87sl\"" Jun 03 14:47:49.579347 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.579322 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-flj89"] Jun 03 14:47:49.667667 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.667629 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z68k\" (UniqueName: \"kubernetes.io/projected/c91a1ec0-2c1f-42a7-a425-e17e9d3d135f-kube-api-access-5z68k\") pod \"network-check-source-56d84b9f44-flj89\" (UID: \"c91a1ec0-2c1f-42a7-a425-e17e9d3d135f\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-flj89" Jun 03 14:47:49.683455 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.683430 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-gbkrz"] Jun 03 14:47:49.686470 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.686454 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-gbkrz" Jun 03 14:47:49.688851 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.688837 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 03 14:47:49.689025 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.688998 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 03 14:47:49.689137 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.689037 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xgcz9\"" Jun 03 14:47:49.689325 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.689306 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 03 14:47:49.689437 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.689414 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 03 14:47:49.694488 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.694459 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-gbkrz"] Jun 03 14:47:49.768258 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.768234 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5z68k\" (UniqueName: \"kubernetes.io/projected/c91a1ec0-2c1f-42a7-a425-e17e9d3d135f-kube-api-access-5z68k\") pod \"network-check-source-56d84b9f44-flj89\" (UID: \"c91a1ec0-2c1f-42a7-a425-e17e9d3d135f\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-flj89" Jun 03 14:47:49.777096 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.777073 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z68k\" (UniqueName: \"kubernetes.io/projected/c91a1ec0-2c1f-42a7-a425-e17e9d3d135f-kube-api-access-5z68k\") pod \"network-check-source-56d84b9f44-flj89\" (UID: \"c91a1ec0-2c1f-42a7-a425-e17e9d3d135f\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-flj89" Jun 03 14:47:49.868714 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.868645 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkcbf\" (UniqueName: \"kubernetes.io/projected/62e500d7-94ab-4a0f-bbec-8aec8656e21f-kube-api-access-zkcbf\") pod \"service-ca-operator-69877444c-gbkrz\" (UID: \"62e500d7-94ab-4a0f-bbec-8aec8656e21f\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-gbkrz" Jun 03 14:47:49.868907 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.868737 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62e500d7-94ab-4a0f-bbec-8aec8656e21f-config\") pod \"service-ca-operator-69877444c-gbkrz\" (UID: \"62e500d7-94ab-4a0f-bbec-8aec8656e21f\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-gbkrz" Jun 03 14:47:49.868907 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.868771 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62e500d7-94ab-4a0f-bbec-8aec8656e21f-serving-cert\") pod \"service-ca-operator-69877444c-gbkrz\" (UID: \"62e500d7-94ab-4a0f-bbec-8aec8656e21f\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-gbkrz" Jun 03 14:47:49.881808 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.881777 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-flj89" Jun 03 14:47:49.970145 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.970111 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62e500d7-94ab-4a0f-bbec-8aec8656e21f-config\") pod \"service-ca-operator-69877444c-gbkrz\" (UID: \"62e500d7-94ab-4a0f-bbec-8aec8656e21f\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-gbkrz" Jun 03 14:47:49.970313 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.970172 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62e500d7-94ab-4a0f-bbec-8aec8656e21f-serving-cert\") pod \"service-ca-operator-69877444c-gbkrz\" (UID: \"62e500d7-94ab-4a0f-bbec-8aec8656e21f\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-gbkrz" Jun 03 14:47:49.970313 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.970268 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zkcbf\" (UniqueName: \"kubernetes.io/projected/62e500d7-94ab-4a0f-bbec-8aec8656e21f-kube-api-access-zkcbf\") pod \"service-ca-operator-69877444c-gbkrz\" (UID: \"62e500d7-94ab-4a0f-bbec-8aec8656e21f\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-gbkrz" Jun 03 14:47:49.970779 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.970730 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62e500d7-94ab-4a0f-bbec-8aec8656e21f-config\") pod \"service-ca-operator-69877444c-gbkrz\" (UID: \"62e500d7-94ab-4a0f-bbec-8aec8656e21f\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-gbkrz" Jun 03 14:47:49.973041 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.973011 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62e500d7-94ab-4a0f-bbec-8aec8656e21f-serving-cert\") pod \"service-ca-operator-69877444c-gbkrz\" (UID: \"62e500d7-94ab-4a0f-bbec-8aec8656e21f\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-gbkrz" Jun 03 14:47:49.980185 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:49.980160 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkcbf\" (UniqueName: \"kubernetes.io/projected/62e500d7-94ab-4a0f-bbec-8aec8656e21f-kube-api-access-zkcbf\") pod \"service-ca-operator-69877444c-gbkrz\" (UID: \"62e500d7-94ab-4a0f-bbec-8aec8656e21f\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-gbkrz" Jun 03 14:47:50.008562 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:50.008487 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-flj89"] Jun 03 14:47:50.011305 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:47:50.011279 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc91a1ec0_2c1f_42a7_a425_e17e9d3d135f.slice/crio-ff9ce63578fd2f9ad0289cb5539edd2b8d1b899ad6590af1e5bec3739b1cdc5d WatchSource:0}: Error finding container ff9ce63578fd2f9ad0289cb5539edd2b8d1b899ad6590af1e5bec3739b1cdc5d: Status 404 returned error can't find the container with id ff9ce63578fd2f9ad0289cb5539edd2b8d1b899ad6590af1e5bec3739b1cdc5d Jun 03 14:47:50.063441 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:50.063406 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-gbkrz" Jun 03 14:47:50.192567 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:50.192533 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-gbkrz"] Jun 03 14:47:50.195900 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:47:50.195870 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62e500d7_94ab_4a0f_bbec_8aec8656e21f.slice/crio-cdeb10f88bb8a0f68285fb7a6d029701d1d82ccd643a777226ddd8da60b62d8a WatchSource:0}: Error finding container cdeb10f88bb8a0f68285fb7a6d029701d1d82ccd643a777226ddd8da60b62d8a: Status 404 returned error can't find the container with id cdeb10f88bb8a0f68285fb7a6d029701d1d82ccd643a777226ddd8da60b62d8a Jun 03 14:47:50.289845 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:50.289746 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-gbkrz" event={"ID":"62e500d7-94ab-4a0f-bbec-8aec8656e21f","Type":"ContainerStarted","Data":"cdeb10f88bb8a0f68285fb7a6d029701d1d82ccd643a777226ddd8da60b62d8a"} Jun 03 14:47:50.291116 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:50.291082 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-t5289" event={"ID":"767e75c0-64a1-4662-a1cf-d24409a9c302","Type":"ContainerStarted","Data":"852d63a9e989163efe7d16b8a57b9ea06f95098bd3d5613eb7d49a4345008571"} Jun 03 14:47:50.292375 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:50.292341 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-flj89" event={"ID":"c91a1ec0-2c1f-42a7-a425-e17e9d3d135f","Type":"ContainerStarted","Data":"05189b7864322d2ca99a26a589254c32e64dd0b17b59ffc7777d0d02e2a48aa2"} Jun 03 14:47:50.292375 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:50.292370 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-flj89" event={"ID":"c91a1ec0-2c1f-42a7-a425-e17e9d3d135f","Type":"ContainerStarted","Data":"ff9ce63578fd2f9ad0289cb5539edd2b8d1b899ad6590af1e5bec3739b1cdc5d"} Jun 03 14:47:50.309519 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:50.309473 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-t5289" podStartSLOduration=1.629017476 podStartE2EDuration="4.30945945s" podCreationTimestamp="2026-06-03 14:47:46 +0000 UTC" firstStartedPulling="2026-06-03 14:47:46.992548196 +0000 UTC m=+150.655650651" lastFinishedPulling="2026-06-03 14:47:49.672990184 +0000 UTC m=+153.336092625" observedRunningTime="2026-06-03 14:47:50.308314924 +0000 UTC m=+153.971417388" watchObservedRunningTime="2026-06-03 14:47:50.30945945 +0000 UTC m=+153.972561912" Jun 03 14:47:50.326101 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:50.326053 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-flj89" podStartSLOduration=1.326038046 podStartE2EDuration="1.326038046s" podCreationTimestamp="2026-06-03 14:47:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:47:50.325081751 +0000 UTC m=+153.988184206" watchObservedRunningTime="2026-06-03 14:47:50.326038046 +0000 UTC m=+153.989140551" Jun 03 14:47:51.245928 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:51.245892 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-l89fz"] Jun 03 14:47:51.249212 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:51.249185 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-l89fz" Jun 03 14:47:51.251550 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:51.251521 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 03 14:47:51.252588 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:51.252567 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 03 14:47:51.252838 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:51.252821 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-42ljz\"" Jun 03 14:47:51.258943 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:51.258905 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-l89fz"] Jun 03 14:47:51.280800 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:51.280764 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8fhz\" (UniqueName: \"kubernetes.io/projected/a202206a-0f64-4e17-bbeb-7e2591cf589e-kube-api-access-k8fhz\") pod \"migrator-96c6f749-l89fz\" (UID: \"a202206a-0f64-4e17-bbeb-7e2591cf589e\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-l89fz" Jun 03 14:47:51.381465 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:51.381422 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8fhz\" (UniqueName: \"kubernetes.io/projected/a202206a-0f64-4e17-bbeb-7e2591cf589e-kube-api-access-k8fhz\") pod \"migrator-96c6f749-l89fz\" (UID: \"a202206a-0f64-4e17-bbeb-7e2591cf589e\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-l89fz" Jun 03 14:47:51.394849 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:51.394815 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8fhz\" (UniqueName: \"kubernetes.io/projected/a202206a-0f64-4e17-bbeb-7e2591cf589e-kube-api-access-k8fhz\") pod \"migrator-96c6f749-l89fz\" (UID: \"a202206a-0f64-4e17-bbeb-7e2591cf589e\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-l89fz" Jun 03 14:47:51.563076 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:51.562997 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-l89fz" Jun 03 14:47:51.700173 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:51.700143 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-l89fz"] Jun 03 14:47:51.703634 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:47:51.703607 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda202206a_0f64_4e17_bbeb_7e2591cf589e.slice/crio-701482c72c131070901e93d60b16b5e880ec4690890fe89d1313978b92e6d1ba WatchSource:0}: Error finding container 701482c72c131070901e93d60b16b5e880ec4690890fe89d1313978b92e6d1ba: Status 404 returned error can't find the container with id 701482c72c131070901e93d60b16b5e880ec4690890fe89d1313978b92e6d1ba Jun 03 14:47:52.297638 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:52.297591 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-l89fz" event={"ID":"a202206a-0f64-4e17-bbeb-7e2591cf589e","Type":"ContainerStarted","Data":"701482c72c131070901e93d60b16b5e880ec4690890fe89d1313978b92e6d1ba"} Jun 03 14:47:53.757608 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:53.757560 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-798tm" podUID="a3762e8b-89b7-46cf-bfff-d02b5ea63779" Jun 03 14:47:53.767673 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:53.767630 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-njv2f" podUID="7c67156d-cd08-4a11-b6f8-5430e5673f45" Jun 03 14:47:53.904213 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:53.904164 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qlx8q" podUID="bef4ffc0-2d1c-4742-abdd-1ba23bea3574" Jun 03 14:47:54.303898 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:54.303855 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-gbkrz" event={"ID":"62e500d7-94ab-4a0f-bbec-8aec8656e21f","Type":"ContainerStarted","Data":"0bf8d6badbcee4a9b84123ebfc93049a483ef621e787f727f461c588be64dd06"} Jun 03 14:47:54.305479 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:54.305450 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-l89fz" event={"ID":"a202206a-0f64-4e17-bbeb-7e2591cf589e","Type":"ContainerStarted","Data":"0c5ba460c888b085dafbd376659b9b1713e6c4b18600914ce1527b7d85a4bd76"} Jun 03 14:47:54.305606 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:54.305485 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-l89fz" event={"ID":"a202206a-0f64-4e17-bbeb-7e2591cf589e","Type":"ContainerStarted","Data":"cc868f3c55c0aadedfe15e842df2390b439c62f72f8274ad2ae21ef2edc393b4"} Jun 03 14:47:54.305606 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:54.305515 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-798tm" Jun 03 14:47:54.322770 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:54.322721 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-gbkrz" podStartSLOduration=2.268955128 podStartE2EDuration="5.322707336s" podCreationTimestamp="2026-06-03 14:47:49 +0000 UTC" firstStartedPulling="2026-06-03 14:47:50.197783368 +0000 UTC m=+153.860885810" lastFinishedPulling="2026-06-03 14:47:53.251535572 +0000 UTC m=+156.914638018" observedRunningTime="2026-06-03 14:47:54.321398235 +0000 UTC m=+157.984500700" watchObservedRunningTime="2026-06-03 14:47:54.322707336 +0000 UTC m=+157.985809798" Jun 03 14:47:54.339193 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:54.339137 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-l89fz" podStartSLOduration=1.7940383309999999 podStartE2EDuration="3.339119381s" podCreationTimestamp="2026-06-03 14:47:51 +0000 UTC" firstStartedPulling="2026-06-03 14:47:51.705419284 +0000 UTC m=+155.368521724" lastFinishedPulling="2026-06-03 14:47:53.25050033 +0000 UTC m=+156.913602774" observedRunningTime="2026-06-03 14:47:54.338680765 +0000 UTC m=+158.001783226" watchObservedRunningTime="2026-06-03 14:47:54.339119381 +0000 UTC m=+158.002221845" Jun 03 14:47:55.615428 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:55.615383 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10b236ab-1722-423e-b86d-9cb79540f191-service-ca-bundle\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:47:55.615428 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:55.615429 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-metrics-certs\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:47:55.615882 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:55.615527 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 14:47:55.615882 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:55.615566 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10b236ab-1722-423e-b86d-9cb79540f191-service-ca-bundle podName:10b236ab-1722-423e-b86d-9cb79540f191 nodeName:}" failed. No retries permitted until 2026-06-03 14:48:11.615547363 +0000 UTC m=+175.278649806 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/10b236ab-1722-423e-b86d-9cb79540f191-service-ca-bundle") pod "router-default-5899b68489-rzt2z" (UID: "10b236ab-1722-423e-b86d-9cb79540f191") : configmap references non-existent config key: service-ca.crt Jun 03 14:47:55.615882 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:55.615589 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-metrics-certs podName:10b236ab-1722-423e-b86d-9cb79540f191 nodeName:}" failed. No retries permitted until 2026-06-03 14:48:11.615582178 +0000 UTC m=+175.278684619 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-metrics-certs") pod "router-default-5899b68489-rzt2z" (UID: "10b236ab-1722-423e-b86d-9cb79540f191") : secret "router-metrics-certs-default" not found Jun 03 14:47:56.923795 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:56.923759 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mjfls"] Jun 03 14:47:56.927091 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:56.927067 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mjfls" Jun 03 14:47:56.930686 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:56.930644 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 14:47:56.930819 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:56.930646 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 14:47:56.930967 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:56.930951 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 14:47:56.931839 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:56.931821 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pdklw\"" Jun 03 14:47:56.931925 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:56.931825 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 14:47:56.942744 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:56.942723 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mjfls"] Jun 03 14:47:57.027209 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:57.027175 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e3bcb75-7227-4d8b-bba1-097048c0861d-crio-socket\") pod \"insights-runtime-extractor-mjfls\" (UID: \"4e3bcb75-7227-4d8b-bba1-097048c0861d\") " pod="openshift-insights/insights-runtime-extractor-mjfls" Jun 03 14:47:57.027209 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:57.027214 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e3bcb75-7227-4d8b-bba1-097048c0861d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjfls\" (UID: \"4e3bcb75-7227-4d8b-bba1-097048c0861d\") " pod="openshift-insights/insights-runtime-extractor-mjfls" Jun 03 14:47:57.027459 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:57.027235 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8sn8\" (UniqueName: \"kubernetes.io/projected/4e3bcb75-7227-4d8b-bba1-097048c0861d-kube-api-access-j8sn8\") pod \"insights-runtime-extractor-mjfls\" (UID: \"4e3bcb75-7227-4d8b-bba1-097048c0861d\") " pod="openshift-insights/insights-runtime-extractor-mjfls" Jun 03 14:47:57.027459 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:57.027349 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e3bcb75-7227-4d8b-bba1-097048c0861d-data-volume\") pod \"insights-runtime-extractor-mjfls\" (UID: \"4e3bcb75-7227-4d8b-bba1-097048c0861d\") " pod="openshift-insights/insights-runtime-extractor-mjfls" Jun 03 14:47:57.027459 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:57.027433 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e3bcb75-7227-4d8b-bba1-097048c0861d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjfls\" (UID: \"4e3bcb75-7227-4d8b-bba1-097048c0861d\") " pod="openshift-insights/insights-runtime-extractor-mjfls" Jun 03 14:47:57.128539 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:57.128501 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e3bcb75-7227-4d8b-bba1-097048c0861d-crio-socket\") pod \"insights-runtime-extractor-mjfls\" (UID: \"4e3bcb75-7227-4d8b-bba1-097048c0861d\") " pod="openshift-insights/insights-runtime-extractor-mjfls" Jun 03 14:47:57.128539 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:57.128539 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e3bcb75-7227-4d8b-bba1-097048c0861d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjfls\" (UID: \"4e3bcb75-7227-4d8b-bba1-097048c0861d\") " pod="openshift-insights/insights-runtime-extractor-mjfls" Jun 03 14:47:57.128771 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:57.128559 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j8sn8\" (UniqueName: \"kubernetes.io/projected/4e3bcb75-7227-4d8b-bba1-097048c0861d-kube-api-access-j8sn8\") pod \"insights-runtime-extractor-mjfls\" (UID: \"4e3bcb75-7227-4d8b-bba1-097048c0861d\") " pod="openshift-insights/insights-runtime-extractor-mjfls" Jun 03 14:47:57.128771 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:57.128606 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e3bcb75-7227-4d8b-bba1-097048c0861d-data-volume\") pod \"insights-runtime-extractor-mjfls\" (UID: \"4e3bcb75-7227-4d8b-bba1-097048c0861d\") " pod="openshift-insights/insights-runtime-extractor-mjfls" Jun 03 14:47:57.128771 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:57.128616 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e3bcb75-7227-4d8b-bba1-097048c0861d-crio-socket\") pod \"insights-runtime-extractor-mjfls\" (UID: \"4e3bcb75-7227-4d8b-bba1-097048c0861d\") " pod="openshift-insights/insights-runtime-extractor-mjfls" Jun 03 14:47:57.128771 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:57.128643 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 03 14:47:57.128771 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:57.128688 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e3bcb75-7227-4d8b-bba1-097048c0861d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjfls\" (UID: \"4e3bcb75-7227-4d8b-bba1-097048c0861d\") " pod="openshift-insights/insights-runtime-extractor-mjfls" Jun 03 14:47:57.128771 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:57.128721 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e3bcb75-7227-4d8b-bba1-097048c0861d-insights-runtime-extractor-tls podName:4e3bcb75-7227-4d8b-bba1-097048c0861d nodeName:}" failed. No retries permitted until 2026-06-03 14:47:57.628705515 +0000 UTC m=+161.291807957 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e3bcb75-7227-4d8b-bba1-097048c0861d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mjfls" (UID: "4e3bcb75-7227-4d8b-bba1-097048c0861d") : secret "insights-runtime-extractor-tls" not found Jun 03 14:47:57.129000 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:57.128980 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e3bcb75-7227-4d8b-bba1-097048c0861d-data-volume\") pod \"insights-runtime-extractor-mjfls\" (UID: \"4e3bcb75-7227-4d8b-bba1-097048c0861d\") " pod="openshift-insights/insights-runtime-extractor-mjfls" Jun 03 14:47:57.129173 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:57.129151 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e3bcb75-7227-4d8b-bba1-097048c0861d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjfls\" (UID: \"4e3bcb75-7227-4d8b-bba1-097048c0861d\") " pod="openshift-insights/insights-runtime-extractor-mjfls" Jun 03 14:47:57.146496 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:57.146446 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8sn8\" (UniqueName: \"kubernetes.io/projected/4e3bcb75-7227-4d8b-bba1-097048c0861d-kube-api-access-j8sn8\") pod \"insights-runtime-extractor-mjfls\" (UID: \"4e3bcb75-7227-4d8b-bba1-097048c0861d\") " pod="openshift-insights/insights-runtime-extractor-mjfls" Jun 03 14:47:57.531962 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:57.531906 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da8cb13c-e0c9-44dc-8537-d2b6feee59b6-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-klmh7\" (UID: \"da8cb13c-e0c9-44dc-8537-d2b6feee59b6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-klmh7" Jun 03 14:47:57.532157 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:57.532050 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 14:47:57.532157 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:57.532120 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da8cb13c-e0c9-44dc-8537-d2b6feee59b6-samples-operator-tls podName:da8cb13c-e0c9-44dc-8537-d2b6feee59b6 nodeName:}" failed. No retries permitted until 2026-06-03 14:48:13.532104707 +0000 UTC m=+177.195207149 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/da8cb13c-e0c9-44dc-8537-d2b6feee59b6-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-klmh7" (UID: "da8cb13c-e0c9-44dc-8537-d2b6feee59b6") : secret "samples-operator-tls" not found Jun 03 14:47:57.632912 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:57.632858 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e3bcb75-7227-4d8b-bba1-097048c0861d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjfls\" (UID: \"4e3bcb75-7227-4d8b-bba1-097048c0861d\") " pod="openshift-insights/insights-runtime-extractor-mjfls" Jun 03 14:47:57.633068 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:57.633016 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 03 14:47:57.633124 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:57.633096 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e3bcb75-7227-4d8b-bba1-097048c0861d-insights-runtime-extractor-tls podName:4e3bcb75-7227-4d8b-bba1-097048c0861d nodeName:}" failed. No retries permitted until 2026-06-03 14:47:58.633080046 +0000 UTC m=+162.296182500 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e3bcb75-7227-4d8b-bba1-097048c0861d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mjfls" (UID: "4e3bcb75-7227-4d8b-bba1-097048c0861d") : secret "insights-runtime-extractor-tls" not found Jun 03 14:47:58.639516 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:58.639482 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e3bcb75-7227-4d8b-bba1-097048c0861d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjfls\" (UID: \"4e3bcb75-7227-4d8b-bba1-097048c0861d\") " pod="openshift-insights/insights-runtime-extractor-mjfls" Jun 03 14:47:58.639516 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:58.639524 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls\") pod \"dns-default-798tm\" (UID: \"a3762e8b-89b7-46cf-bfff-d02b5ea63779\") " pod="openshift-dns/dns-default-798tm" Jun 03 14:47:58.639915 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:58.639632 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 14:47:58.639915 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:58.639636 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 03 14:47:58.639915 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:58.639703 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls podName:a3762e8b-89b7-46cf-bfff-d02b5ea63779 nodeName:}" failed. No retries permitted until 2026-06-03 14:50:00.639690218 +0000 UTC m=+284.302792659 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls") pod "dns-default-798tm" (UID: "a3762e8b-89b7-46cf-bfff-d02b5ea63779") : secret "dns-default-metrics-tls" not found Jun 03 14:47:58.639915 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:58.639719 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e3bcb75-7227-4d8b-bba1-097048c0861d-insights-runtime-extractor-tls podName:4e3bcb75-7227-4d8b-bba1-097048c0861d nodeName:}" failed. No retries permitted until 2026-06-03 14:48:00.639711879 +0000 UTC m=+164.302814320 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e3bcb75-7227-4d8b-bba1-097048c0861d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mjfls" (UID: "4e3bcb75-7227-4d8b-bba1-097048c0861d") : secret "insights-runtime-extractor-tls" not found Jun 03 14:47:58.740877 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:47:58.740838 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert\") pod \"ingress-canary-njv2f\" (UID: \"7c67156d-cd08-4a11-b6f8-5430e5673f45\") " pod="openshift-ingress-canary/ingress-canary-njv2f" Jun 03 14:47:58.741037 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:58.740981 2580 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 14:47:58.741079 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:47:58.741044 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert podName:7c67156d-cd08-4a11-b6f8-5430e5673f45 nodeName:}" failed. No retries permitted until 2026-06-03 14:50:00.741027835 +0000 UTC m=+284.404130276 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert") pod "ingress-canary-njv2f" (UID: "7c67156d-cd08-4a11-b6f8-5430e5673f45") : secret "canary-serving-cert" not found Jun 03 14:48:00.655720 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:00.655643 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e3bcb75-7227-4d8b-bba1-097048c0861d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjfls\" (UID: \"4e3bcb75-7227-4d8b-bba1-097048c0861d\") " pod="openshift-insights/insights-runtime-extractor-mjfls" Jun 03 14:48:00.656109 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:48:00.655801 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 03 14:48:00.656109 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:48:00.655870 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e3bcb75-7227-4d8b-bba1-097048c0861d-insights-runtime-extractor-tls podName:4e3bcb75-7227-4d8b-bba1-097048c0861d nodeName:}" failed. No retries permitted until 2026-06-03 14:48:04.655853987 +0000 UTC m=+168.318956428 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e3bcb75-7227-4d8b-bba1-097048c0861d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mjfls" (UID: "4e3bcb75-7227-4d8b-bba1-097048c0861d") : secret "insights-runtime-extractor-tls" not found Jun 03 14:48:04.687883 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:04.687792 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e3bcb75-7227-4d8b-bba1-097048c0861d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjfls\" (UID: \"4e3bcb75-7227-4d8b-bba1-097048c0861d\") " pod="openshift-insights/insights-runtime-extractor-mjfls" Jun 03 14:48:04.688274 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:48:04.687940 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 03 14:48:04.688274 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:48:04.688015 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e3bcb75-7227-4d8b-bba1-097048c0861d-insights-runtime-extractor-tls podName:4e3bcb75-7227-4d8b-bba1-097048c0861d nodeName:}" failed. No retries permitted until 2026-06-03 14:48:12.687997349 +0000 UTC m=+176.351099797 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e3bcb75-7227-4d8b-bba1-097048c0861d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mjfls" (UID: "4e3bcb75-7227-4d8b-bba1-097048c0861d") : secret "insights-runtime-extractor-tls" not found Jun 03 14:48:05.895953 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:05.895909 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-njv2f" Jun 03 14:48:08.895205 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:08.895165 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:48:11.643301 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:11.643259 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10b236ab-1722-423e-b86d-9cb79540f191-service-ca-bundle\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:48:11.643301 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:11.643302 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-metrics-certs\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:48:11.643953 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:11.643934 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10b236ab-1722-423e-b86d-9cb79540f191-service-ca-bundle\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:48:11.645777 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:11.645758 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10b236ab-1722-423e-b86d-9cb79540f191-metrics-certs\") pod \"router-default-5899b68489-rzt2z\" (UID: \"10b236ab-1722-423e-b86d-9cb79540f191\") " pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:48:11.876587 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:11.876549 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:48:12.000332 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:12.000299 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5899b68489-rzt2z"] Jun 03 14:48:12.003008 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:48:12.002981 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b236ab_1722_423e_b86d_9cb79540f191.slice/crio-7f979248c5262f7c0218623850d77ee07180d881d3cc6e1d08363a06b28be469 WatchSource:0}: Error finding container 7f979248c5262f7c0218623850d77ee07180d881d3cc6e1d08363a06b28be469: Status 404 returned error can't find the container with id 7f979248c5262f7c0218623850d77ee07180d881d3cc6e1d08363a06b28be469 Jun 03 14:48:12.347726 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:12.347623 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5899b68489-rzt2z" event={"ID":"10b236ab-1722-423e-b86d-9cb79540f191","Type":"ContainerStarted","Data":"7dcd3efb06c8b5925a880d0cf6c148897f3a2c465387aae518b6952a26e1334f"} Jun 03 14:48:12.347726 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:12.347676 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5899b68489-rzt2z" event={"ID":"10b236ab-1722-423e-b86d-9cb79540f191","Type":"ContainerStarted","Data":"7f979248c5262f7c0218623850d77ee07180d881d3cc6e1d08363a06b28be469"} Jun 03 14:48:12.367715 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:12.367643 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-5899b68489-rzt2z" podStartSLOduration=33.367628278 podStartE2EDuration="33.367628278s" podCreationTimestamp="2026-06-03 14:47:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:48:12.367390315 +0000 UTC m=+176.030492779" watchObservedRunningTime="2026-06-03 14:48:12.367628278 +0000 UTC m=+176.030730741" Jun 03 14:48:12.751529 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:12.751501 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e3bcb75-7227-4d8b-bba1-097048c0861d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjfls\" (UID: \"4e3bcb75-7227-4d8b-bba1-097048c0861d\") " pod="openshift-insights/insights-runtime-extractor-mjfls" Jun 03 14:48:12.753927 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:12.753907 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e3bcb75-7227-4d8b-bba1-097048c0861d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjfls\" (UID: \"4e3bcb75-7227-4d8b-bba1-097048c0861d\") " pod="openshift-insights/insights-runtime-extractor-mjfls" Jun 03 14:48:12.835244 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:12.835196 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mjfls" Jun 03 14:48:12.877311 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:12.877264 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:48:12.881054 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:12.880769 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:48:12.964819 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:12.961239 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mjfls"] Jun 03 14:48:12.965932 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:48:12.965902 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e3bcb75_7227_4d8b_bba1_097048c0861d.slice/crio-4c2334a15a4ee7f85b010523e1f518faef184767eb7f15c80a1a9010dd562878 WatchSource:0}: Error finding container 4c2334a15a4ee7f85b010523e1f518faef184767eb7f15c80a1a9010dd562878: Status 404 returned error can't find the container with id 4c2334a15a4ee7f85b010523e1f518faef184767eb7f15c80a1a9010dd562878 Jun 03 14:48:13.351301 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:13.351211 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mjfls" event={"ID":"4e3bcb75-7227-4d8b-bba1-097048c0861d","Type":"ContainerStarted","Data":"5c334608595d7958230bce6a98b376337ff6795d8798ac5f8b9c6c1b9939416b"} Jun 03 14:48:13.351301 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:13.351255 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mjfls" event={"ID":"4e3bcb75-7227-4d8b-bba1-097048c0861d","Type":"ContainerStarted","Data":"4c2334a15a4ee7f85b010523e1f518faef184767eb7f15c80a1a9010dd562878"} Jun 03 14:48:13.351558 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:13.351539 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:48:13.352887 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:13.352865 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5899b68489-rzt2z" Jun 03 14:48:13.558549 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:13.558499 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da8cb13c-e0c9-44dc-8537-d2b6feee59b6-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-klmh7\" (UID: \"da8cb13c-e0c9-44dc-8537-d2b6feee59b6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-klmh7" Jun 03 14:48:13.561523 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:13.561492 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da8cb13c-e0c9-44dc-8537-d2b6feee59b6-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-klmh7\" (UID: \"da8cb13c-e0c9-44dc-8537-d2b6feee59b6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-klmh7" Jun 03 14:48:13.755395 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:13.755374 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-klmh7" Jun 03 14:48:13.882105 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:13.882057 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-klmh7"] Jun 03 14:48:14.354417 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:14.354385 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-klmh7" event={"ID":"da8cb13c-e0c9-44dc-8537-d2b6feee59b6","Type":"ContainerStarted","Data":"2c7efc74593175747d28334f2ebe9a146035ce097a285998be9a3f41b6f35a1e"} Jun 03 14:48:14.355976 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:14.355946 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mjfls" event={"ID":"4e3bcb75-7227-4d8b-bba1-097048c0861d","Type":"ContainerStarted","Data":"9add45c3f988c619296b6a1c5e6aa3f44c7eb492b0b2dcce62418d8ccc495955"} Jun 03 14:48:16.363106 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:16.363024 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-klmh7" event={"ID":"da8cb13c-e0c9-44dc-8537-d2b6feee59b6","Type":"ContainerStarted","Data":"5e554d0cc451227871a5dfb7a8fb11f6e98f0138e1fe57cf1d9c3f8251695914"} Jun 03 14:48:16.363106 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:16.363063 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-klmh7" event={"ID":"da8cb13c-e0c9-44dc-8537-d2b6feee59b6","Type":"ContainerStarted","Data":"ddeab6cd764ff23f77fafa82d07a5cf20d02aef59821f9f5f619272a7643c87f"} Jun 03 14:48:16.364707 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:16.364681 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mjfls" event={"ID":"4e3bcb75-7227-4d8b-bba1-097048c0861d","Type":"ContainerStarted","Data":"99342c73ad8ac34fc62a77c85b59b766b144fbfe97ab929f6e42d34036bc7315"} Jun 03 14:48:16.381477 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:16.381431 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-klmh7" podStartSLOduration=33.297594162 podStartE2EDuration="35.381416935s" podCreationTimestamp="2026-06-03 14:47:41 +0000 UTC" firstStartedPulling="2026-06-03 14:48:13.919011854 +0000 UTC m=+177.582114294" lastFinishedPulling="2026-06-03 14:48:16.002834624 +0000 UTC m=+179.665937067" observedRunningTime="2026-06-03 14:48:16.380210942 +0000 UTC m=+180.043313438" watchObservedRunningTime="2026-06-03 14:48:16.381416935 +0000 UTC m=+180.044519399" Jun 03 14:48:16.399157 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:16.399102 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mjfls" podStartSLOduration=17.975670735 podStartE2EDuration="20.399086153s" podCreationTimestamp="2026-06-03 14:47:56 +0000 UTC" firstStartedPulling="2026-06-03 14:48:13.015624662 +0000 UTC m=+176.678727106" lastFinishedPulling="2026-06-03 14:48:15.43904008 +0000 UTC m=+179.102142524" observedRunningTime="2026-06-03 14:48:16.398877819 +0000 UTC m=+180.061980283" watchObservedRunningTime="2026-06-03 14:48:16.399086153 +0000 UTC m=+180.062188617" Jun 03 14:48:20.423588 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:20.423552 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9zl62"] Jun 03 14:48:20.426491 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:20.426465 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9zl62" Jun 03 14:48:20.430885 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:20.430858 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 03 14:48:20.431034 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:20.430858 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-99plx\"" Jun 03 14:48:20.433760 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:20.433736 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-s5d6z"] Jun 03 14:48:20.437483 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:20.436780 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-s5d6z" Jun 03 14:48:20.441447 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:20.440574 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 14:48:20.441447 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:20.440851 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 14:48:20.441883 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:20.441619 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9zl62"] Jun 03 14:48:20.444560 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:20.444543 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-fmgss\"" Jun 03 14:48:20.457919 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:20.457871 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-s5d6z"] Jun 03 14:48:20.511564 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:20.511530 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t48t2\" (UniqueName: \"kubernetes.io/projected/b9ed5c6c-623c-44fb-8c83-859e820789d4-kube-api-access-t48t2\") pod \"downloads-c65b8dc4b-s5d6z\" (UID: \"b9ed5c6c-623c-44fb-8c83-859e820789d4\") " pod="openshift-console/downloads-c65b8dc4b-s5d6z" Jun 03 14:48:20.511744 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:20.511716 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f2f14a8e-ea5b-4066-ba46-6d00ac8af806-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-9zl62\" (UID: \"f2f14a8e-ea5b-4066-ba46-6d00ac8af806\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9zl62" Jun 03 14:48:20.612970 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:20.612911 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t48t2\" (UniqueName: \"kubernetes.io/projected/b9ed5c6c-623c-44fb-8c83-859e820789d4-kube-api-access-t48t2\") pod \"downloads-c65b8dc4b-s5d6z\" (UID: \"b9ed5c6c-623c-44fb-8c83-859e820789d4\") " pod="openshift-console/downloads-c65b8dc4b-s5d6z" Jun 03 14:48:20.613179 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:20.613044 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f2f14a8e-ea5b-4066-ba46-6d00ac8af806-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-9zl62\" (UID: \"f2f14a8e-ea5b-4066-ba46-6d00ac8af806\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9zl62" Jun 03 14:48:20.615684 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:20.615632 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f2f14a8e-ea5b-4066-ba46-6d00ac8af806-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-9zl62\" (UID: \"f2f14a8e-ea5b-4066-ba46-6d00ac8af806\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9zl62" Jun 03 14:48:20.621067 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:20.621041 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t48t2\" (UniqueName: \"kubernetes.io/projected/b9ed5c6c-623c-44fb-8c83-859e820789d4-kube-api-access-t48t2\") pod \"downloads-c65b8dc4b-s5d6z\" (UID: \"b9ed5c6c-623c-44fb-8c83-859e820789d4\") " pod="openshift-console/downloads-c65b8dc4b-s5d6z" Jun 03 14:48:20.738718 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:20.738607 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9zl62" Jun 03 14:48:20.750441 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:20.750412 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-s5d6z" Jun 03 14:48:20.870812 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:20.870771 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9zl62"] Jun 03 14:48:20.873319 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:48:20.873289 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2f14a8e_ea5b_4066_ba46_6d00ac8af806.slice/crio-4c7d3dbaa41f17ac4f9b5d0e1c5d150f2513eaacdaa42d5efa323700f169d766 WatchSource:0}: Error finding container 4c7d3dbaa41f17ac4f9b5d0e1c5d150f2513eaacdaa42d5efa323700f169d766: Status 404 returned error can't find the container with id 4c7d3dbaa41f17ac4f9b5d0e1c5d150f2513eaacdaa42d5efa323700f169d766 Jun 03 14:48:20.889503 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:20.889390 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-s5d6z"] Jun 03 14:48:20.891899 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:48:20.891874 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ed5c6c_623c_44fb_8c83_859e820789d4.slice/crio-d94ba6c103a646ddb4daac09c21479d2479c36f00d2a9e5cde573a657467726a WatchSource:0}: Error finding container d94ba6c103a646ddb4daac09c21479d2479c36f00d2a9e5cde573a657467726a: Status 404 returned error can't find the container with id d94ba6c103a646ddb4daac09c21479d2479c36f00d2a9e5cde573a657467726a Jun 03 14:48:21.378804 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:21.378769 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-s5d6z" event={"ID":"b9ed5c6c-623c-44fb-8c83-859e820789d4","Type":"ContainerStarted","Data":"d94ba6c103a646ddb4daac09c21479d2479c36f00d2a9e5cde573a657467726a"} Jun 03 14:48:21.379737 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:21.379711 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9zl62" event={"ID":"f2f14a8e-ea5b-4066-ba46-6d00ac8af806","Type":"ContainerStarted","Data":"4c7d3dbaa41f17ac4f9b5d0e1c5d150f2513eaacdaa42d5efa323700f169d766"} Jun 03 14:48:22.384021 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:22.383967 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9zl62" event={"ID":"f2f14a8e-ea5b-4066-ba46-6d00ac8af806","Type":"ContainerStarted","Data":"234379bb46152984438c7c8d87ced7b549e9ec5a12a77c80155048715703b5fd"} Jun 03 14:48:22.384482 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:22.384178 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9zl62" Jun 03 14:48:22.389936 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:22.389906 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9zl62" Jun 03 14:48:22.399258 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:22.399214 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9zl62" podStartSLOduration=1.024501454 podStartE2EDuration="2.399200123s" podCreationTimestamp="2026-06-03 14:48:20 +0000 UTC" firstStartedPulling="2026-06-03 14:48:20.87514608 +0000 UTC m=+184.538248521" lastFinishedPulling="2026-06-03 14:48:22.249844748 +0000 UTC m=+185.912947190" observedRunningTime="2026-06-03 14:48:22.398316801 +0000 UTC m=+186.061419265" watchObservedRunningTime="2026-06-03 14:48:22.399200123 +0000 UTC m=+186.062302585" Jun 03 14:48:23.306410 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.306375 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-75f48cc9bc-wmh6h"] Jun 03 14:48:23.308748 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.308719 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:23.311437 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.311402 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 14:48:23.311578 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.311449 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 14:48:23.312522 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.312495 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 14:48:23.312522 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.312512 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g78wj\"" Jun 03 14:48:23.312956 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.312840 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 14:48:23.312956 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.312854 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 14:48:23.318561 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.318540 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 14:48:23.318907 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.318890 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75f48cc9bc-wmh6h"] Jun 03 14:48:23.399952 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.399920 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-k8tb9"] Jun 03 14:48:23.402215 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.402197 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-k8tb9" Jun 03 14:48:23.404918 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.404854 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-hn2jv\"" Jun 03 14:48:23.404918 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.404878 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 03 14:48:23.404918 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.404894 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 14:48:23.405158 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.404893 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 14:48:23.405158 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.404885 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 03 14:48:23.405158 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.404957 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 14:48:23.411675 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.411626 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-k8tb9"] Jun 03 14:48:23.437274 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.437236 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/753aadae-abde-4f37-8c50-a2afb76319a7-trusted-ca-bundle\") pod \"console-75f48cc9bc-wmh6h\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:23.437452 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.437292 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/753aadae-abde-4f37-8c50-a2afb76319a7-service-ca\") pod \"console-75f48cc9bc-wmh6h\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:23.437452 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.437371 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/753aadae-abde-4f37-8c50-a2afb76319a7-console-config\") pod \"console-75f48cc9bc-wmh6h\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:23.437570 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.437495 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xn86\" (UniqueName: \"kubernetes.io/projected/753aadae-abde-4f37-8c50-a2afb76319a7-kube-api-access-2xn86\") pod \"console-75f48cc9bc-wmh6h\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:23.437570 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.437550 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/753aadae-abde-4f37-8c50-a2afb76319a7-oauth-serving-cert\") pod \"console-75f48cc9bc-wmh6h\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:23.437691 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.437580 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/753aadae-abde-4f37-8c50-a2afb76319a7-console-oauth-config\") pod \"console-75f48cc9bc-wmh6h\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:23.437691 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.437621 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/753aadae-abde-4f37-8c50-a2afb76319a7-console-serving-cert\") pod \"console-75f48cc9bc-wmh6h\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:23.538687 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.538624 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0092d9e0-ef4c-48d4-a574-be4a63f7db96-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-k8tb9\" (UID: \"0092d9e0-ef4c-48d4-a574-be4a63f7db96\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-k8tb9" Jun 03 14:48:23.538859 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.538759 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6s5r\" (UniqueName: \"kubernetes.io/projected/0092d9e0-ef4c-48d4-a574-be4a63f7db96-kube-api-access-s6s5r\") pod \"prometheus-operator-658bcd8bdf-k8tb9\" (UID: \"0092d9e0-ef4c-48d4-a574-be4a63f7db96\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-k8tb9" Jun 03 14:48:23.538859 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.538795 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2xn86\" (UniqueName: \"kubernetes.io/projected/753aadae-abde-4f37-8c50-a2afb76319a7-kube-api-access-2xn86\") pod \"console-75f48cc9bc-wmh6h\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:23.538859 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.538825 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0092d9e0-ef4c-48d4-a574-be4a63f7db96-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-k8tb9\" (UID: \"0092d9e0-ef4c-48d4-a574-be4a63f7db96\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-k8tb9" Jun 03 14:48:23.539072 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.538863 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/753aadae-abde-4f37-8c50-a2afb76319a7-oauth-serving-cert\") pod \"console-75f48cc9bc-wmh6h\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:23.539072 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.538890 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/753aadae-abde-4f37-8c50-a2afb76319a7-console-oauth-config\") pod \"console-75f48cc9bc-wmh6h\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:23.539072 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.538935 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/753aadae-abde-4f37-8c50-a2afb76319a7-console-serving-cert\") pod \"console-75f48cc9bc-wmh6h\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:23.539072 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.538967 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/753aadae-abde-4f37-8c50-a2afb76319a7-trusted-ca-bundle\") pod \"console-75f48cc9bc-wmh6h\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:23.539072 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.539008 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/753aadae-abde-4f37-8c50-a2afb76319a7-service-ca\") pod \"console-75f48cc9bc-wmh6h\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:23.539072 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.539051 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/753aadae-abde-4f37-8c50-a2afb76319a7-console-config\") pod \"console-75f48cc9bc-wmh6h\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:23.539330 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.539103 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0092d9e0-ef4c-48d4-a574-be4a63f7db96-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-k8tb9\" (UID: \"0092d9e0-ef4c-48d4-a574-be4a63f7db96\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-k8tb9" Jun 03 14:48:23.539856 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.539809 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/753aadae-abde-4f37-8c50-a2afb76319a7-console-config\") pod \"console-75f48cc9bc-wmh6h\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:23.539969 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.539912 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/753aadae-abde-4f37-8c50-a2afb76319a7-oauth-serving-cert\") pod \"console-75f48cc9bc-wmh6h\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:23.540043 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.539961 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/753aadae-abde-4f37-8c50-a2afb76319a7-service-ca\") pod \"console-75f48cc9bc-wmh6h\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:23.540043 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.540024 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/753aadae-abde-4f37-8c50-a2afb76319a7-trusted-ca-bundle\") pod \"console-75f48cc9bc-wmh6h\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:23.541951 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.541924 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/753aadae-abde-4f37-8c50-a2afb76319a7-console-oauth-config\") pod \"console-75f48cc9bc-wmh6h\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:23.542160 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.542140 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/753aadae-abde-4f37-8c50-a2afb76319a7-console-serving-cert\") pod \"console-75f48cc9bc-wmh6h\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:23.546792 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.546772 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xn86\" (UniqueName: \"kubernetes.io/projected/753aadae-abde-4f37-8c50-a2afb76319a7-kube-api-access-2xn86\") pod \"console-75f48cc9bc-wmh6h\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:23.620144 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.620062 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:23.640157 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.640120 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0092d9e0-ef4c-48d4-a574-be4a63f7db96-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-k8tb9\" (UID: \"0092d9e0-ef4c-48d4-a574-be4a63f7db96\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-k8tb9" Jun 03 14:48:23.640288 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.640163 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0092d9e0-ef4c-48d4-a574-be4a63f7db96-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-k8tb9\" (UID: \"0092d9e0-ef4c-48d4-a574-be4a63f7db96\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-k8tb9" Jun 03 14:48:23.640288 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.640222 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s6s5r\" (UniqueName: \"kubernetes.io/projected/0092d9e0-ef4c-48d4-a574-be4a63f7db96-kube-api-access-s6s5r\") pod \"prometheus-operator-658bcd8bdf-k8tb9\" (UID: \"0092d9e0-ef4c-48d4-a574-be4a63f7db96\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-k8tb9" Jun 03 14:48:23.640288 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.640258 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0092d9e0-ef4c-48d4-a574-be4a63f7db96-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-k8tb9\" (UID: \"0092d9e0-ef4c-48d4-a574-be4a63f7db96\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-k8tb9" Jun 03 14:48:23.641144 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.641118 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0092d9e0-ef4c-48d4-a574-be4a63f7db96-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-k8tb9\" (UID: \"0092d9e0-ef4c-48d4-a574-be4a63f7db96\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-k8tb9" Jun 03 14:48:23.643223 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.643195 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0092d9e0-ef4c-48d4-a574-be4a63f7db96-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-k8tb9\" (UID: \"0092d9e0-ef4c-48d4-a574-be4a63f7db96\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-k8tb9" Jun 03 14:48:23.643385 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.643359 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0092d9e0-ef4c-48d4-a574-be4a63f7db96-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-k8tb9\" (UID: \"0092d9e0-ef4c-48d4-a574-be4a63f7db96\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-k8tb9" Jun 03 14:48:23.648406 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.648379 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6s5r\" (UniqueName: \"kubernetes.io/projected/0092d9e0-ef4c-48d4-a574-be4a63f7db96-kube-api-access-s6s5r\") pod \"prometheus-operator-658bcd8bdf-k8tb9\" (UID: \"0092d9e0-ef4c-48d4-a574-be4a63f7db96\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-k8tb9" Jun 03 14:48:23.712511 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.712053 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-k8tb9" Jun 03 14:48:23.768503 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.768378 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75f48cc9bc-wmh6h"] Jun 03 14:48:23.773501 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:48:23.773441 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod753aadae_abde_4f37_8c50_a2afb76319a7.slice/crio-53fd00e5af731a0dd4966e5b57238a3484bdec9037a66d26a93da5afb3f9648b WatchSource:0}: Error finding container 53fd00e5af731a0dd4966e5b57238a3484bdec9037a66d26a93da5afb3f9648b: Status 404 returned error can't find the container with id 53fd00e5af731a0dd4966e5b57238a3484bdec9037a66d26a93da5afb3f9648b Jun 03 14:48:23.859559 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:23.859522 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-k8tb9"] Jun 03 14:48:23.862073 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:48:23.862036 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0092d9e0_ef4c_48d4_a574_be4a63f7db96.slice/crio-acbe05c9ef813443c2b01ca20cecadf19cbf6f187d5fa3494422f0d907c4a154 WatchSource:0}: Error finding container acbe05c9ef813443c2b01ca20cecadf19cbf6f187d5fa3494422f0d907c4a154: Status 404 returned error can't find the container with id acbe05c9ef813443c2b01ca20cecadf19cbf6f187d5fa3494422f0d907c4a154 Jun 03 14:48:24.389971 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:24.389933 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75f48cc9bc-wmh6h" event={"ID":"753aadae-abde-4f37-8c50-a2afb76319a7","Type":"ContainerStarted","Data":"53fd00e5af731a0dd4966e5b57238a3484bdec9037a66d26a93da5afb3f9648b"} Jun 03 14:48:24.391132 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:24.391091 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-k8tb9" event={"ID":"0092d9e0-ef4c-48d4-a574-be4a63f7db96","Type":"ContainerStarted","Data":"acbe05c9ef813443c2b01ca20cecadf19cbf6f187d5fa3494422f0d907c4a154"} Jun 03 14:48:26.399539 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:26.399489 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-k8tb9" event={"ID":"0092d9e0-ef4c-48d4-a574-be4a63f7db96","Type":"ContainerStarted","Data":"91bedf5ae9e454e9bb444c5a695ca9eb007f15d21b9b25db830b8ccc8761acfa"} Jun 03 14:48:26.399539 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:26.399538 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-k8tb9" event={"ID":"0092d9e0-ef4c-48d4-a574-be4a63f7db96","Type":"ContainerStarted","Data":"a0c76f35398ad653ff723b03ad894381b5fe2cb3dc3b8c35382a449ea9b39a2b"} Jun 03 14:48:26.421138 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:26.421085 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-k8tb9" podStartSLOduration=1.938687672 podStartE2EDuration="3.421072045s" podCreationTimestamp="2026-06-03 14:48:23 +0000 UTC" firstStartedPulling="2026-06-03 14:48:23.8645269 +0000 UTC m=+187.527629344" lastFinishedPulling="2026-06-03 14:48:25.346911261 +0000 UTC m=+189.010013717" observedRunningTime="2026-06-03 14:48:26.41987232 +0000 UTC m=+190.082974786" watchObservedRunningTime="2026-06-03 14:48:26.421072045 +0000 UTC m=+190.084174504" Jun 03 14:48:27.403857 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:27.403815 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75f48cc9bc-wmh6h" event={"ID":"753aadae-abde-4f37-8c50-a2afb76319a7","Type":"ContainerStarted","Data":"53ca02adda800c623950e3d455f00adbc3845dc2e3f4cfd6e4b9d6d377d1eaac"} Jun 03 14:48:27.424285 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:27.424225 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-75f48cc9bc-wmh6h" podStartSLOduration=0.89226752 podStartE2EDuration="4.424204419s" podCreationTimestamp="2026-06-03 14:48:23 +0000 UTC" firstStartedPulling="2026-06-03 14:48:23.778638648 +0000 UTC m=+187.441741093" lastFinishedPulling="2026-06-03 14:48:27.31057554 +0000 UTC m=+190.973677992" observedRunningTime="2026-06-03 14:48:27.423765754 +0000 UTC m=+191.086868219" watchObservedRunningTime="2026-06-03 14:48:27.424204419 +0000 UTC m=+191.087306882" Jun 03 14:48:28.787346 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.787313 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6vlhb"] Jun 03 14:48:28.789519 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.789503 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.792225 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.792204 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 14:48:28.792392 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.792259 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 14:48:28.796649 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.796615 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 14:48:28.796649 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.796624 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xzc4b\"" Jun 03 14:48:28.890161 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.890114 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k98nq\" (UniqueName: \"kubernetes.io/projected/29c1895a-9866-4d8b-b066-5e9c6f9447ca-kube-api-access-k98nq\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.890336 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.890197 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/29c1895a-9866-4d8b-b066-5e9c6f9447ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.890336 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.890249 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/29c1895a-9866-4d8b-b066-5e9c6f9447ca-node-exporter-tls\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.890336 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.890268 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29c1895a-9866-4d8b-b066-5e9c6f9447ca-sys\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.890336 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.890285 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/29c1895a-9866-4d8b-b066-5e9c6f9447ca-node-exporter-textfile\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.890559 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.890484 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/29c1895a-9866-4d8b-b066-5e9c6f9447ca-root\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.890559 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.890527 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/29c1895a-9866-4d8b-b066-5e9c6f9447ca-node-exporter-wtmp\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.890559 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.890555 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29c1895a-9866-4d8b-b066-5e9c6f9447ca-metrics-client-ca\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.890701 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.890598 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/29c1895a-9866-4d8b-b066-5e9c6f9447ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.991242 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.991195 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/29c1895a-9866-4d8b-b066-5e9c6f9447ca-root\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.991242 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.991239 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/29c1895a-9866-4d8b-b066-5e9c6f9447ca-node-exporter-wtmp\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.991482 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.991266 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29c1895a-9866-4d8b-b066-5e9c6f9447ca-metrics-client-ca\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.991482 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.991307 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/29c1895a-9866-4d8b-b066-5e9c6f9447ca-root\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.991482 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.991319 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/29c1895a-9866-4d8b-b066-5e9c6f9447ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.991482 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.991362 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k98nq\" (UniqueName: \"kubernetes.io/projected/29c1895a-9866-4d8b-b066-5e9c6f9447ca-kube-api-access-k98nq\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.991482 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.991388 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/29c1895a-9866-4d8b-b066-5e9c6f9447ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.991482 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.991427 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/29c1895a-9866-4d8b-b066-5e9c6f9447ca-node-exporter-tls\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.991482 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.991446 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29c1895a-9866-4d8b-b066-5e9c6f9447ca-sys\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.991482 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.991467 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/29c1895a-9866-4d8b-b066-5e9c6f9447ca-node-exporter-textfile\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.991905 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.991505 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/29c1895a-9866-4d8b-b066-5e9c6f9447ca-node-exporter-wtmp\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.991905 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.991573 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29c1895a-9866-4d8b-b066-5e9c6f9447ca-sys\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.991905 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.991804 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/29c1895a-9866-4d8b-b066-5e9c6f9447ca-node-exporter-textfile\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.991905 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.991893 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29c1895a-9866-4d8b-b066-5e9c6f9447ca-metrics-client-ca\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.992089 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.991993 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/29c1895a-9866-4d8b-b066-5e9c6f9447ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.993928 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.993907 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/29c1895a-9866-4d8b-b066-5e9c6f9447ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.994079 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.994055 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/29c1895a-9866-4d8b-b066-5e9c6f9447ca-node-exporter-tls\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:28.998369 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:28.998342 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k98nq\" (UniqueName: \"kubernetes.io/projected/29c1895a-9866-4d8b-b066-5e9c6f9447ca-kube-api-access-k98nq\") pod \"node-exporter-6vlhb\" (UID: \"29c1895a-9866-4d8b-b066-5e9c6f9447ca\") " pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:29.102316 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:29.102229 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6vlhb" Jun 03 14:48:29.112448 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:48:29.112415 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29c1895a_9866_4d8b_b066_5e9c6f9447ca.slice/crio-9494118e182e0b70780a347b6ede3e585086e9dd8563db72479901464095d4fd WatchSource:0}: Error finding container 9494118e182e0b70780a347b6ede3e585086e9dd8563db72479901464095d4fd: Status 404 returned error can't find the container with id 9494118e182e0b70780a347b6ede3e585086e9dd8563db72479901464095d4fd Jun 03 14:48:29.410778 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:29.410743 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6vlhb" event={"ID":"29c1895a-9866-4d8b-b066-5e9c6f9447ca","Type":"ContainerStarted","Data":"9494118e182e0b70780a347b6ede3e585086e9dd8563db72479901464095d4fd"} Jun 03 14:48:30.415318 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:30.415281 2580 generic.go:358] "Generic (PLEG): container finished" podID="29c1895a-9866-4d8b-b066-5e9c6f9447ca" containerID="8549099cc3105ed92d12b9b2f45c64cb74052f7f37b3d7a02d2d8db3799d9f06" exitCode=0 Jun 03 14:48:30.415858 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:30.415376 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6vlhb" event={"ID":"29c1895a-9866-4d8b-b066-5e9c6f9447ca","Type":"ContainerDied","Data":"8549099cc3105ed92d12b9b2f45c64cb74052f7f37b3d7a02d2d8db3799d9f06"} Jun 03 14:48:31.421022 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:31.420981 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6vlhb" event={"ID":"29c1895a-9866-4d8b-b066-5e9c6f9447ca","Type":"ContainerStarted","Data":"a1654fdd3f7492fe208b44d09f3349e18b0c76db8cc2e40c062886a950a94023"} Jun 03 14:48:31.421022 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:31.421021 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6vlhb" event={"ID":"29c1895a-9866-4d8b-b066-5e9c6f9447ca","Type":"ContainerStarted","Data":"578b3172ff6cd6a4a7f7167ee3af9a0a11f3c49ed8267250a00b9d9646226a01"} Jun 03 14:48:31.441455 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:31.441404 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6vlhb" podStartSLOduration=2.37099743 podStartE2EDuration="3.441389628s" podCreationTimestamp="2026-06-03 14:48:28 +0000 UTC" firstStartedPulling="2026-06-03 14:48:29.114624119 +0000 UTC m=+192.777726585" lastFinishedPulling="2026-06-03 14:48:30.185016327 +0000 UTC m=+193.848118783" observedRunningTime="2026-06-03 14:48:31.439860629 +0000 UTC m=+195.102963092" watchObservedRunningTime="2026-06-03 14:48:31.441389628 +0000 UTC m=+195.104492091" Jun 03 14:48:33.164510 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.164475 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-74fbff5879-5qm8g"] Jun 03 14:48:33.166944 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.166919 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:48:33.170826 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.170789 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 03 14:48:33.170944 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.170896 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-a0sl1aonamv7j\"" Jun 03 14:48:33.171003 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.170793 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 03 14:48:33.171088 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.170793 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-62jbh\"" Jun 03 14:48:33.171148 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.170796 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 03 14:48:33.171203 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.170796 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 14:48:33.180059 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.180038 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-74fbff5879-5qm8g"] Jun 03 14:48:33.331397 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.331361 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4551f145-77cf-4717-a050-d2793d2e9b1c-audit-log\") pod \"metrics-server-74fbff5879-5qm8g\" (UID: \"4551f145-77cf-4717-a050-d2793d2e9b1c\") " pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:48:33.331596 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.331453 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4551f145-77cf-4717-a050-d2793d2e9b1c-secret-metrics-server-client-certs\") pod \"metrics-server-74fbff5879-5qm8g\" (UID: \"4551f145-77cf-4717-a050-d2793d2e9b1c\") " pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:48:33.331596 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.331485 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4551f145-77cf-4717-a050-d2793d2e9b1c-metrics-server-audit-profiles\") pod \"metrics-server-74fbff5879-5qm8g\" (UID: \"4551f145-77cf-4717-a050-d2793d2e9b1c\") " pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:48:33.331596 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.331500 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4551f145-77cf-4717-a050-d2793d2e9b1c-client-ca-bundle\") pod \"metrics-server-74fbff5879-5qm8g\" (UID: \"4551f145-77cf-4717-a050-d2793d2e9b1c\") " pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:48:33.331596 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.331527 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4551f145-77cf-4717-a050-d2793d2e9b1c-secret-metrics-server-tls\") pod \"metrics-server-74fbff5879-5qm8g\" (UID: \"4551f145-77cf-4717-a050-d2793d2e9b1c\") " pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:48:33.331596 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.331585 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4551f145-77cf-4717-a050-d2793d2e9b1c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-74fbff5879-5qm8g\" (UID: \"4551f145-77cf-4717-a050-d2793d2e9b1c\") " pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:48:33.331839 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.331635 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcpdk\" (UniqueName: \"kubernetes.io/projected/4551f145-77cf-4717-a050-d2793d2e9b1c-kube-api-access-lcpdk\") pod \"metrics-server-74fbff5879-5qm8g\" (UID: \"4551f145-77cf-4717-a050-d2793d2e9b1c\") " pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:48:33.432086 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.431999 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4551f145-77cf-4717-a050-d2793d2e9b1c-secret-metrics-server-client-certs\") pod \"metrics-server-74fbff5879-5qm8g\" (UID: \"4551f145-77cf-4717-a050-d2793d2e9b1c\") " pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:48:33.432086 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.432058 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4551f145-77cf-4717-a050-d2793d2e9b1c-metrics-server-audit-profiles\") pod \"metrics-server-74fbff5879-5qm8g\" (UID: \"4551f145-77cf-4717-a050-d2793d2e9b1c\") " pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:48:33.432086 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.432085 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4551f145-77cf-4717-a050-d2793d2e9b1c-client-ca-bundle\") pod \"metrics-server-74fbff5879-5qm8g\" (UID: \"4551f145-77cf-4717-a050-d2793d2e9b1c\") " pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:48:33.432347 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.432118 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4551f145-77cf-4717-a050-d2793d2e9b1c-secret-metrics-server-tls\") pod \"metrics-server-74fbff5879-5qm8g\" (UID: \"4551f145-77cf-4717-a050-d2793d2e9b1c\") " pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:48:33.432347 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.432144 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4551f145-77cf-4717-a050-d2793d2e9b1c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-74fbff5879-5qm8g\" (UID: \"4551f145-77cf-4717-a050-d2793d2e9b1c\") " pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:48:33.432347 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.432174 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lcpdk\" (UniqueName: \"kubernetes.io/projected/4551f145-77cf-4717-a050-d2793d2e9b1c-kube-api-access-lcpdk\") pod \"metrics-server-74fbff5879-5qm8g\" (UID: \"4551f145-77cf-4717-a050-d2793d2e9b1c\") " pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:48:33.432347 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.432253 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4551f145-77cf-4717-a050-d2793d2e9b1c-audit-log\") pod \"metrics-server-74fbff5879-5qm8g\" (UID: \"4551f145-77cf-4717-a050-d2793d2e9b1c\") " pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:48:33.432726 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.432675 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4551f145-77cf-4717-a050-d2793d2e9b1c-audit-log\") pod \"metrics-server-74fbff5879-5qm8g\" (UID: \"4551f145-77cf-4717-a050-d2793d2e9b1c\") " pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:48:33.433040 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.432919 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4551f145-77cf-4717-a050-d2793d2e9b1c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-74fbff5879-5qm8g\" (UID: \"4551f145-77cf-4717-a050-d2793d2e9b1c\") " pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:48:33.433161 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.433140 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4551f145-77cf-4717-a050-d2793d2e9b1c-metrics-server-audit-profiles\") pod \"metrics-server-74fbff5879-5qm8g\" (UID: \"4551f145-77cf-4717-a050-d2793d2e9b1c\") " pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:48:33.434923 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.434903 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4551f145-77cf-4717-a050-d2793d2e9b1c-secret-metrics-server-client-certs\") pod \"metrics-server-74fbff5879-5qm8g\" (UID: \"4551f145-77cf-4717-a050-d2793d2e9b1c\") " pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:48:33.435068 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.435052 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4551f145-77cf-4717-a050-d2793d2e9b1c-secret-metrics-server-tls\") pod \"metrics-server-74fbff5879-5qm8g\" (UID: \"4551f145-77cf-4717-a050-d2793d2e9b1c\") " pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:48:33.435198 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.435160 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4551f145-77cf-4717-a050-d2793d2e9b1c-client-ca-bundle\") pod \"metrics-server-74fbff5879-5qm8g\" (UID: \"4551f145-77cf-4717-a050-d2793d2e9b1c\") " pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:48:33.440634 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.440612 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcpdk\" (UniqueName: \"kubernetes.io/projected/4551f145-77cf-4717-a050-d2793d2e9b1c-kube-api-access-lcpdk\") pod \"metrics-server-74fbff5879-5qm8g\" (UID: \"4551f145-77cf-4717-a050-d2793d2e9b1c\") " pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:48:33.477763 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.477625 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:48:33.620670 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.620549 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:33.620670 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.620604 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:33.627310 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.627284 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:33.988160 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.988123 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2"] Jun 03 14:48:33.991173 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.991142 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:33.993521 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.993500 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 03 14:48:33.993751 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.993736 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 03 14:48:33.994253 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.994211 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 03 14:48:33.994379 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.994326 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 03 14:48:33.994452 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.994319 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-xml6v\"" Jun 03 14:48:33.994516 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.994307 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 03 14:48:33.998693 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:33.998674 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 03 14:48:34.012191 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.012166 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2"] Jun 03 14:48:34.138210 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.138178 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ctxh\" (UniqueName: \"kubernetes.io/projected/e53c3fc4-ed40-4c67-8956-f1df8517c984-kube-api-access-7ctxh\") pod \"telemeter-client-7c4b4bb8d5-ctxd2\" (UID: \"e53c3fc4-ed40-4c67-8956-f1df8517c984\") " pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:34.138413 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.138259 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e53c3fc4-ed40-4c67-8956-f1df8517c984-telemeter-client-tls\") pod \"telemeter-client-7c4b4bb8d5-ctxd2\" (UID: \"e53c3fc4-ed40-4c67-8956-f1df8517c984\") " pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:34.138413 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.138325 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e53c3fc4-ed40-4c67-8956-f1df8517c984-serving-certs-ca-bundle\") pod \"telemeter-client-7c4b4bb8d5-ctxd2\" (UID: \"e53c3fc4-ed40-4c67-8956-f1df8517c984\") " pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:34.138413 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.138346 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e53c3fc4-ed40-4c67-8956-f1df8517c984-secret-telemeter-client\") pod \"telemeter-client-7c4b4bb8d5-ctxd2\" (UID: \"e53c3fc4-ed40-4c67-8956-f1df8517c984\") " pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:34.138413 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.138387 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e53c3fc4-ed40-4c67-8956-f1df8517c984-federate-client-tls\") pod \"telemeter-client-7c4b4bb8d5-ctxd2\" (UID: \"e53c3fc4-ed40-4c67-8956-f1df8517c984\") " pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:34.138587 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.138450 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e53c3fc4-ed40-4c67-8956-f1df8517c984-metrics-client-ca\") pod \"telemeter-client-7c4b4bb8d5-ctxd2\" (UID: \"e53c3fc4-ed40-4c67-8956-f1df8517c984\") " pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:34.138587 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.138496 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e53c3fc4-ed40-4c67-8956-f1df8517c984-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c4b4bb8d5-ctxd2\" (UID: \"e53c3fc4-ed40-4c67-8956-f1df8517c984\") " pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:34.138587 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.138548 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e53c3fc4-ed40-4c67-8956-f1df8517c984-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c4b4bb8d5-ctxd2\" (UID: \"e53c3fc4-ed40-4c67-8956-f1df8517c984\") " pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:34.239257 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.239167 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e53c3fc4-ed40-4c67-8956-f1df8517c984-telemeter-client-tls\") pod \"telemeter-client-7c4b4bb8d5-ctxd2\" (UID: \"e53c3fc4-ed40-4c67-8956-f1df8517c984\") " pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:34.239257 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.239253 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e53c3fc4-ed40-4c67-8956-f1df8517c984-serving-certs-ca-bundle\") pod \"telemeter-client-7c4b4bb8d5-ctxd2\" (UID: \"e53c3fc4-ed40-4c67-8956-f1df8517c984\") " pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:34.239799 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.239281 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e53c3fc4-ed40-4c67-8956-f1df8517c984-secret-telemeter-client\") pod \"telemeter-client-7c4b4bb8d5-ctxd2\" (UID: \"e53c3fc4-ed40-4c67-8956-f1df8517c984\") " pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:34.239799 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.239393 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e53c3fc4-ed40-4c67-8956-f1df8517c984-federate-client-tls\") pod \"telemeter-client-7c4b4bb8d5-ctxd2\" (UID: \"e53c3fc4-ed40-4c67-8956-f1df8517c984\") " pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:34.239799 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.239444 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e53c3fc4-ed40-4c67-8956-f1df8517c984-metrics-client-ca\") pod \"telemeter-client-7c4b4bb8d5-ctxd2\" (UID: \"e53c3fc4-ed40-4c67-8956-f1df8517c984\") " pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:34.239799 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.239467 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e53c3fc4-ed40-4c67-8956-f1df8517c984-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c4b4bb8d5-ctxd2\" (UID: \"e53c3fc4-ed40-4c67-8956-f1df8517c984\") " pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:34.239799 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.239503 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e53c3fc4-ed40-4c67-8956-f1df8517c984-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c4b4bb8d5-ctxd2\" (UID: \"e53c3fc4-ed40-4c67-8956-f1df8517c984\") " pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:34.239799 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.239540 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ctxh\" (UniqueName: \"kubernetes.io/projected/e53c3fc4-ed40-4c67-8956-f1df8517c984-kube-api-access-7ctxh\") pod \"telemeter-client-7c4b4bb8d5-ctxd2\" (UID: \"e53c3fc4-ed40-4c67-8956-f1df8517c984\") " pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:34.240154 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.240128 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e53c3fc4-ed40-4c67-8956-f1df8517c984-serving-certs-ca-bundle\") pod \"telemeter-client-7c4b4bb8d5-ctxd2\" (UID: \"e53c3fc4-ed40-4c67-8956-f1df8517c984\") " pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:34.240633 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.240602 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e53c3fc4-ed40-4c67-8956-f1df8517c984-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c4b4bb8d5-ctxd2\" (UID: \"e53c3fc4-ed40-4c67-8956-f1df8517c984\") " pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:34.241272 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.241239 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e53c3fc4-ed40-4c67-8956-f1df8517c984-metrics-client-ca\") pod \"telemeter-client-7c4b4bb8d5-ctxd2\" (UID: \"e53c3fc4-ed40-4c67-8956-f1df8517c984\") " pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:34.242162 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.242136 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e53c3fc4-ed40-4c67-8956-f1df8517c984-secret-telemeter-client\") pod \"telemeter-client-7c4b4bb8d5-ctxd2\" (UID: \"e53c3fc4-ed40-4c67-8956-f1df8517c984\") " pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:34.242335 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.242313 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e53c3fc4-ed40-4c67-8956-f1df8517c984-telemeter-client-tls\") pod \"telemeter-client-7c4b4bb8d5-ctxd2\" (UID: \"e53c3fc4-ed40-4c67-8956-f1df8517c984\") " pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:34.242409 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.242365 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e53c3fc4-ed40-4c67-8956-f1df8517c984-federate-client-tls\") pod \"telemeter-client-7c4b4bb8d5-ctxd2\" (UID: \"e53c3fc4-ed40-4c67-8956-f1df8517c984\") " pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:34.242479 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.242446 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e53c3fc4-ed40-4c67-8956-f1df8517c984-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c4b4bb8d5-ctxd2\" (UID: \"e53c3fc4-ed40-4c67-8956-f1df8517c984\") " pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:34.247955 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.247935 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ctxh\" (UniqueName: \"kubernetes.io/projected/e53c3fc4-ed40-4c67-8956-f1df8517c984-kube-api-access-7ctxh\") pod \"telemeter-client-7c4b4bb8d5-ctxd2\" (UID: \"e53c3fc4-ed40-4c67-8956-f1df8517c984\") " pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:34.303446 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.303410 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" Jun 03 14:48:34.434844 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.434809 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:48:34.957785 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.957753 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 14:48:34.961780 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.961749 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:34.965164 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.964831 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 14:48:34.965164 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.964856 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 14:48:34.965164 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.965038 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 14:48:34.965164 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.965117 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 14:48:34.965454 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.965254 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fk81fjakkvjek\"" Jun 03 14:48:34.965454 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.965446 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-njvjn\"" Jun 03 14:48:34.965688 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.965667 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 14:48:34.966494 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.966476 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 14:48:34.966712 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.966697 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 14:48:34.967006 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.966896 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 14:48:34.973507 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.968394 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 14:48:34.973507 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.968470 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 14:48:34.973507 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.969936 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 14:48:34.977274 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.976824 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 14:48:34.978133 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:34.977563 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 14:48:35.046688 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.046629 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c90ae5f7-0c62-4c23-852b-42094b5b57b1-config-out\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.046843 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.046701 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.046843 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.046742 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.046843 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.046767 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.046843 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.046799 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sfs5\" (UniqueName: \"kubernetes.io/projected/c90ae5f7-0c62-4c23-852b-42094b5b57b1-kube-api-access-2sfs5\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.046843 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.046836 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c90ae5f7-0c62-4c23-852b-42094b5b57b1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.047117 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.046861 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.047117 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.046905 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.047117 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.046943 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.047117 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.046970 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.047117 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.047023 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-web-config\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.047117 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.047047 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.047405 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.047209 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c90ae5f7-0c62-4c23-852b-42094b5b57b1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.047405 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.047323 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.047405 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.047374 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.047545 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.047406 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.047545 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.047457 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-config\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.047545 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.047482 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.149578 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.149156 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c90ae5f7-0c62-4c23-852b-42094b5b57b1-config-out\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.149578 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.149213 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.149578 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.149245 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.149578 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.149261 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.149578 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.149288 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2sfs5\" (UniqueName: \"kubernetes.io/projected/c90ae5f7-0c62-4c23-852b-42094b5b57b1-kube-api-access-2sfs5\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.149578 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.149316 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c90ae5f7-0c62-4c23-852b-42094b5b57b1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.149578 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.149341 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.149578 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.149388 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.149578 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.149423 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.149578 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.149452 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.149578 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.149498 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-web-config\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.149578 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.149520 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.149578 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.149559 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c90ae5f7-0c62-4c23-852b-42094b5b57b1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.150257 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.149603 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.150257 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.149631 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.150257 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.149689 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.150257 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.149730 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-config\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.150257 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.149757 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.151700 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.151648 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.153465 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.152926 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.154536 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.154511 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.154761 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.154741 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c90ae5f7-0c62-4c23-852b-42094b5b57b1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.156815 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.156788 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.156941 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.156915 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.157092 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.157069 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c90ae5f7-0c62-4c23-852b-42094b5b57b1-config-out\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.157170 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.157145 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c90ae5f7-0c62-4c23-852b-42094b5b57b1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.157336 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.157308 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.157473 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.157451 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.158056 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.158028 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.158370 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.158190 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.158702 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.158682 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.158753 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.158712 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.159144 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.159053 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-web-config\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.160061 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.160037 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.160357 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.160316 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-config\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.164244 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.164203 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sfs5\" (UniqueName: \"kubernetes.io/projected/c90ae5f7-0c62-4c23-852b-42094b5b57b1-kube-api-access-2sfs5\") pod \"prometheus-k8s-0\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:35.281275 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:35.281184 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:38.761087 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:38.761050 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2"] Jun 03 14:48:38.762019 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:48:38.761987 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode53c3fc4_ed40_4c67_8956_f1df8517c984.slice/crio-607294bfbc9db11ba9ff8b599294997cc15b970fbcc6c0ce84815dd65153c681 WatchSource:0}: Error finding container 607294bfbc9db11ba9ff8b599294997cc15b970fbcc6c0ce84815dd65153c681: Status 404 returned error can't find the container with id 607294bfbc9db11ba9ff8b599294997cc15b970fbcc6c0ce84815dd65153c681 Jun 03 14:48:38.782572 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:38.782516 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 14:48:38.784571 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:48:38.784542 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc90ae5f7_0c62_4c23_852b_42094b5b57b1.slice/crio-a6ab09c1cefa840dd912b7b1afe335cd0309b1feb4ff99618985224146b10286 WatchSource:0}: Error finding container a6ab09c1cefa840dd912b7b1afe335cd0309b1feb4ff99618985224146b10286: Status 404 returned error can't find the container with id a6ab09c1cefa840dd912b7b1afe335cd0309b1feb4ff99618985224146b10286 Jun 03 14:48:38.789048 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:38.789025 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-74fbff5879-5qm8g"] Jun 03 14:48:38.791433 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:48:38.791412 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4551f145_77cf_4717_a050_d2793d2e9b1c.slice/crio-a826d984841869e66ee8758f8753e57515af8f757de3f9581b475c3d93ed681a WatchSource:0}: Error finding container a826d984841869e66ee8758f8753e57515af8f757de3f9581b475c3d93ed681a: Status 404 returned error can't find the container with id a826d984841869e66ee8758f8753e57515af8f757de3f9581b475c3d93ed681a Jun 03 14:48:39.448199 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:39.448144 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c90ae5f7-0c62-4c23-852b-42094b5b57b1","Type":"ContainerStarted","Data":"a6ab09c1cefa840dd912b7b1afe335cd0309b1feb4ff99618985224146b10286"} Jun 03 14:48:39.450703 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:39.450634 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" event={"ID":"e53c3fc4-ed40-4c67-8956-f1df8517c984","Type":"ContainerStarted","Data":"607294bfbc9db11ba9ff8b599294997cc15b970fbcc6c0ce84815dd65153c681"} Jun 03 14:48:39.452614 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:39.452570 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-s5d6z" event={"ID":"b9ed5c6c-623c-44fb-8c83-859e820789d4","Type":"ContainerStarted","Data":"60eeb16ad7ee9e5986f9733de2f8b4967fb222e1098b5ea5df8beb9094684fc5"} Jun 03 14:48:39.452911 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:39.452887 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-s5d6z" Jun 03 14:48:39.454380 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:39.454353 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" event={"ID":"4551f145-77cf-4717-a050-d2793d2e9b1c","Type":"ContainerStarted","Data":"a826d984841869e66ee8758f8753e57515af8f757de3f9581b475c3d93ed681a"} Jun 03 14:48:39.469759 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:39.469734 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-s5d6z" Jun 03 14:48:39.472263 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:39.472205 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-s5d6z" podStartSLOduration=1.699926542 podStartE2EDuration="19.472187179s" podCreationTimestamp="2026-06-03 14:48:20 +0000 UTC" firstStartedPulling="2026-06-03 14:48:20.893575093 +0000 UTC m=+184.556677534" lastFinishedPulling="2026-06-03 14:48:38.665835708 +0000 UTC m=+202.328938171" observedRunningTime="2026-06-03 14:48:39.469557392 +0000 UTC m=+203.132659922" watchObservedRunningTime="2026-06-03 14:48:39.472187179 +0000 UTC m=+203.135289643" Jun 03 14:48:43.476248 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:43.476205 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" event={"ID":"4551f145-77cf-4717-a050-d2793d2e9b1c","Type":"ContainerStarted","Data":"8f387e40cc3ffb64eed5bda3abf5ec8b8a73b049be4f7a9459fe0b3eb3e1dbb3"} Jun 03 14:48:43.477878 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:43.477848 2580 generic.go:358] "Generic (PLEG): container finished" podID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerID="056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507" exitCode=0 Jun 03 14:48:43.478025 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:43.477955 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c90ae5f7-0c62-4c23-852b-42094b5b57b1","Type":"ContainerDied","Data":"056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507"} Jun 03 14:48:43.480567 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:43.480542 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" event={"ID":"e53c3fc4-ed40-4c67-8956-f1df8517c984","Type":"ContainerStarted","Data":"cdba93b280fb6f34a9179bfea61ae117495d815f7cdde59820cf041f53ce5fdd"} Jun 03 14:48:43.480679 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:43.480574 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" event={"ID":"e53c3fc4-ed40-4c67-8956-f1df8517c984","Type":"ContainerStarted","Data":"7ebe84e7bbc64656ec68064140b677e09bf390f10e90bc2b78374c0c8bd1d802"} Jun 03 14:48:43.480679 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:43.480587 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" event={"ID":"e53c3fc4-ed40-4c67-8956-f1df8517c984","Type":"ContainerStarted","Data":"d65e843b0ddb62920240ff849b55a1ef9e3b23a74ec4aaae6ebd1384e9a6182d"} Jun 03 14:48:43.516788 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:43.516728 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7c4b4bb8d5-ctxd2" podStartSLOduration=6.856174357 podStartE2EDuration="10.516707531s" podCreationTimestamp="2026-06-03 14:48:33 +0000 UTC" firstStartedPulling="2026-06-03 14:48:38.764050431 +0000 UTC m=+202.427152888" lastFinishedPulling="2026-06-03 14:48:42.424583618 +0000 UTC m=+206.087686062" observedRunningTime="2026-06-03 14:48:43.515776332 +0000 UTC m=+207.178878796" watchObservedRunningTime="2026-06-03 14:48:43.516707531 +0000 UTC m=+207.179809996" Jun 03 14:48:43.517514 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:43.517464 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" podStartSLOduration=6.890008152 podStartE2EDuration="10.517452578s" podCreationTimestamp="2026-06-03 14:48:33 +0000 UTC" firstStartedPulling="2026-06-03 14:48:38.793164467 +0000 UTC m=+202.456266910" lastFinishedPulling="2026-06-03 14:48:42.420608896 +0000 UTC m=+206.083711336" observedRunningTime="2026-06-03 14:48:43.493195208 +0000 UTC m=+207.156297671" watchObservedRunningTime="2026-06-03 14:48:43.517452578 +0000 UTC m=+207.180555043" Jun 03 14:48:47.499410 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:47.499369 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c90ae5f7-0c62-4c23-852b-42094b5b57b1","Type":"ContainerStarted","Data":"750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be"} Jun 03 14:48:47.499969 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:47.499431 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c90ae5f7-0c62-4c23-852b-42094b5b57b1","Type":"ContainerStarted","Data":"fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244"} Jun 03 14:48:50.511026 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:50.510941 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c90ae5f7-0c62-4c23-852b-42094b5b57b1","Type":"ContainerStarted","Data":"dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d"} Jun 03 14:48:50.511026 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:50.510983 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c90ae5f7-0c62-4c23-852b-42094b5b57b1","Type":"ContainerStarted","Data":"7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b"} Jun 03 14:48:50.511026 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:50.510993 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c90ae5f7-0c62-4c23-852b-42094b5b57b1","Type":"ContainerStarted","Data":"6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093"} Jun 03 14:48:50.511026 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:50.511002 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c90ae5f7-0c62-4c23-852b-42094b5b57b1","Type":"ContainerStarted","Data":"2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b"} Jun 03 14:48:50.540087 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:50.540025 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.444768147 podStartE2EDuration="16.540011796s" podCreationTimestamp="2026-06-03 14:48:34 +0000 UTC" firstStartedPulling="2026-06-03 14:48:38.786467865 +0000 UTC m=+202.449570306" lastFinishedPulling="2026-06-03 14:48:49.881711513 +0000 UTC m=+213.544813955" observedRunningTime="2026-06-03 14:48:50.538936107 +0000 UTC m=+214.202038583" watchObservedRunningTime="2026-06-03 14:48:50.540011796 +0000 UTC m=+214.203114259" Jun 03 14:48:53.478180 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:53.478114 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:48:53.478180 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:53.478189 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:48:55.281841 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:55.281803 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:48:55.703363 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:48:55.703328 2580 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75f48cc9bc-wmh6h"] Jun 03 14:49:00.542130 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:00.542095 2580 generic.go:358] "Generic (PLEG): container finished" podID="767e75c0-64a1-4662-a1cf-d24409a9c302" containerID="852d63a9e989163efe7d16b8a57b9ea06f95098bd3d5613eb7d49a4345008571" exitCode=0 Jun 03 14:49:00.542567 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:00.542172 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-t5289" event={"ID":"767e75c0-64a1-4662-a1cf-d24409a9c302","Type":"ContainerDied","Data":"852d63a9e989163efe7d16b8a57b9ea06f95098bd3d5613eb7d49a4345008571"} Jun 03 14:49:00.542567 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:00.542541 2580 scope.go:117] "RemoveContainer" containerID="852d63a9e989163efe7d16b8a57b9ea06f95098bd3d5613eb7d49a4345008571" Jun 03 14:49:01.546322 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:01.546285 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-t5289" event={"ID":"767e75c0-64a1-4662-a1cf-d24409a9c302","Type":"ContainerStarted","Data":"9a979d37b71abbddf864c5645015175352a69acf611aa917c8b6866a91271555"} Jun 03 14:49:04.906732 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:04.906706 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-knjfc_c8bacdf4-c8e3-4a93-8a3b-b57db3791c86/dns-node-resolver/0.log" Jun 03 14:49:09.569898 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:09.569865 2580 generic.go:358] "Generic (PLEG): container finished" podID="62e500d7-94ab-4a0f-bbec-8aec8656e21f" containerID="0bf8d6badbcee4a9b84123ebfc93049a483ef621e787f727f461c588be64dd06" exitCode=0 Jun 03 14:49:09.570270 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:09.569942 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-gbkrz" event={"ID":"62e500d7-94ab-4a0f-bbec-8aec8656e21f","Type":"ContainerDied","Data":"0bf8d6badbcee4a9b84123ebfc93049a483ef621e787f727f461c588be64dd06"} Jun 03 14:49:09.570315 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:09.570306 2580 scope.go:117] "RemoveContainer" containerID="0bf8d6badbcee4a9b84123ebfc93049a483ef621e787f727f461c588be64dd06" Jun 03 14:49:10.574392 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:10.574349 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-gbkrz" event={"ID":"62e500d7-94ab-4a0f-bbec-8aec8656e21f","Type":"ContainerStarted","Data":"917e3813a17fceebe82aeca9d586492f7e354b184d247fdac448797ac367d2b8"} Jun 03 14:49:13.482896 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:13.482867 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:49:13.486754 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:13.486728 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-74fbff5879-5qm8g" Jun 03 14:49:20.724054 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:20.724009 2580 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-75f48cc9bc-wmh6h" podUID="753aadae-abde-4f37-8c50-a2afb76319a7" containerName="console" containerID="cri-o://53ca02adda800c623950e3d455f00adbc3845dc2e3f4cfd6e4b9d6d377d1eaac" gracePeriod=15 Jun 03 14:49:21.003040 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.003019 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75f48cc9bc-wmh6h_753aadae-abde-4f37-8c50-a2afb76319a7/console/0.log" Jun 03 14:49:21.003153 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.003096 2580 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:49:21.194725 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.194648 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xn86\" (UniqueName: \"kubernetes.io/projected/753aadae-abde-4f37-8c50-a2afb76319a7-kube-api-access-2xn86\") pod \"753aadae-abde-4f37-8c50-a2afb76319a7\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " Jun 03 14:49:21.194910 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.194744 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/753aadae-abde-4f37-8c50-a2afb76319a7-oauth-serving-cert\") pod \"753aadae-abde-4f37-8c50-a2afb76319a7\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " Jun 03 14:49:21.194910 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.194781 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/753aadae-abde-4f37-8c50-a2afb76319a7-console-serving-cert\") pod \"753aadae-abde-4f37-8c50-a2afb76319a7\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " Jun 03 14:49:21.194910 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.194824 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/753aadae-abde-4f37-8c50-a2afb76319a7-service-ca\") pod \"753aadae-abde-4f37-8c50-a2afb76319a7\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " Jun 03 14:49:21.194910 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.194881 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/753aadae-abde-4f37-8c50-a2afb76319a7-console-config\") pod \"753aadae-abde-4f37-8c50-a2afb76319a7\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " Jun 03 14:49:21.195115 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.194914 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/753aadae-abde-4f37-8c50-a2afb76319a7-console-oauth-config\") pod \"753aadae-abde-4f37-8c50-a2afb76319a7\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " Jun 03 14:49:21.195115 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.194952 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/753aadae-abde-4f37-8c50-a2afb76319a7-trusted-ca-bundle\") pod \"753aadae-abde-4f37-8c50-a2afb76319a7\" (UID: \"753aadae-abde-4f37-8c50-a2afb76319a7\") " Jun 03 14:49:21.195232 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.195182 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/753aadae-abde-4f37-8c50-a2afb76319a7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "753aadae-abde-4f37-8c50-a2afb76319a7" (UID: "753aadae-abde-4f37-8c50-a2afb76319a7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 14:49:21.195282 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.195253 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/753aadae-abde-4f37-8c50-a2afb76319a7-service-ca" (OuterVolumeSpecName: "service-ca") pod "753aadae-abde-4f37-8c50-a2afb76319a7" (UID: "753aadae-abde-4f37-8c50-a2afb76319a7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 14:49:21.195336 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.195295 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/753aadae-abde-4f37-8c50-a2afb76319a7-oauth-serving-cert\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:49:21.195553 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.195526 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/753aadae-abde-4f37-8c50-a2afb76319a7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "753aadae-abde-4f37-8c50-a2afb76319a7" (UID: "753aadae-abde-4f37-8c50-a2afb76319a7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 14:49:21.195765 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.195740 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/753aadae-abde-4f37-8c50-a2afb76319a7-console-config" (OuterVolumeSpecName: "console-config") pod "753aadae-abde-4f37-8c50-a2afb76319a7" (UID: "753aadae-abde-4f37-8c50-a2afb76319a7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 14:49:21.197197 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.197170 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/753aadae-abde-4f37-8c50-a2afb76319a7-kube-api-access-2xn86" (OuterVolumeSpecName: "kube-api-access-2xn86") pod "753aadae-abde-4f37-8c50-a2afb76319a7" (UID: "753aadae-abde-4f37-8c50-a2afb76319a7"). InnerVolumeSpecName "kube-api-access-2xn86". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:49:21.197197 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.197177 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/753aadae-abde-4f37-8c50-a2afb76319a7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "753aadae-abde-4f37-8c50-a2afb76319a7" (UID: "753aadae-abde-4f37-8c50-a2afb76319a7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 14:49:21.197472 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.197457 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/753aadae-abde-4f37-8c50-a2afb76319a7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "753aadae-abde-4f37-8c50-a2afb76319a7" (UID: "753aadae-abde-4f37-8c50-a2afb76319a7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 14:49:21.296294 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.296206 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/753aadae-abde-4f37-8c50-a2afb76319a7-console-serving-cert\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:49:21.296294 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.296243 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/753aadae-abde-4f37-8c50-a2afb76319a7-service-ca\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:49:21.296294 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.296253 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/753aadae-abde-4f37-8c50-a2afb76319a7-console-config\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:49:21.296294 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.296262 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/753aadae-abde-4f37-8c50-a2afb76319a7-console-oauth-config\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:49:21.296294 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.296270 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/753aadae-abde-4f37-8c50-a2afb76319a7-trusted-ca-bundle\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:49:21.296294 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.296280 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xn86\" (UniqueName: \"kubernetes.io/projected/753aadae-abde-4f37-8c50-a2afb76319a7-kube-api-access-2xn86\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:49:21.606846 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.606771 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75f48cc9bc-wmh6h_753aadae-abde-4f37-8c50-a2afb76319a7/console/0.log" Jun 03 14:49:21.606846 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.606814 2580 generic.go:358] "Generic (PLEG): container finished" podID="753aadae-abde-4f37-8c50-a2afb76319a7" containerID="53ca02adda800c623950e3d455f00adbc3845dc2e3f4cfd6e4b9d6d377d1eaac" exitCode=2 Jun 03 14:49:21.607021 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.606860 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75f48cc9bc-wmh6h" event={"ID":"753aadae-abde-4f37-8c50-a2afb76319a7","Type":"ContainerDied","Data":"53ca02adda800c623950e3d455f00adbc3845dc2e3f4cfd6e4b9d6d377d1eaac"} Jun 03 14:49:21.607021 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.606887 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75f48cc9bc-wmh6h" event={"ID":"753aadae-abde-4f37-8c50-a2afb76319a7","Type":"ContainerDied","Data":"53fd00e5af731a0dd4966e5b57238a3484bdec9037a66d26a93da5afb3f9648b"} Jun 03 14:49:21.607021 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.606891 2580 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75f48cc9bc-wmh6h" Jun 03 14:49:21.607021 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.606907 2580 scope.go:117] "RemoveContainer" containerID="53ca02adda800c623950e3d455f00adbc3845dc2e3f4cfd6e4b9d6d377d1eaac" Jun 03 14:49:21.615360 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.615342 2580 scope.go:117] "RemoveContainer" containerID="53ca02adda800c623950e3d455f00adbc3845dc2e3f4cfd6e4b9d6d377d1eaac" Jun 03 14:49:21.615620 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:49:21.615599 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53ca02adda800c623950e3d455f00adbc3845dc2e3f4cfd6e4b9d6d377d1eaac\": container with ID starting with 53ca02adda800c623950e3d455f00adbc3845dc2e3f4cfd6e4b9d6d377d1eaac not found: ID does not exist" containerID="53ca02adda800c623950e3d455f00adbc3845dc2e3f4cfd6e4b9d6d377d1eaac" Jun 03 14:49:21.615714 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.615628 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53ca02adda800c623950e3d455f00adbc3845dc2e3f4cfd6e4b9d6d377d1eaac"} err="failed to get container status \"53ca02adda800c623950e3d455f00adbc3845dc2e3f4cfd6e4b9d6d377d1eaac\": rpc error: code = NotFound desc = could not find container \"53ca02adda800c623950e3d455f00adbc3845dc2e3f4cfd6e4b9d6d377d1eaac\": container with ID starting with 53ca02adda800c623950e3d455f00adbc3845dc2e3f4cfd6e4b9d6d377d1eaac not found: ID does not exist" Jun 03 14:49:21.629379 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.629347 2580 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75f48cc9bc-wmh6h"] Jun 03 14:49:21.632965 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:21.632940 2580 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75f48cc9bc-wmh6h"] Jun 03 14:49:22.898945 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:22.898915 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="753aadae-abde-4f37-8c50-a2afb76319a7" path="/var/lib/kubelet/pods/753aadae-abde-4f37-8c50-a2afb76319a7/volumes" Jun 03 14:49:28.656891 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:28.656856 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs\") pod \"network-metrics-daemon-qlx8q\" (UID: \"bef4ffc0-2d1c-4742-abdd-1ba23bea3574\") " pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:49:28.659359 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:28.659328 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bef4ffc0-2d1c-4742-abdd-1ba23bea3574-metrics-certs\") pod \"network-metrics-daemon-qlx8q\" (UID: \"bef4ffc0-2d1c-4742-abdd-1ba23bea3574\") " pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:49:28.698781 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:28.698754 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fk4zz\"" Jun 03 14:49:28.706697 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:28.706681 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlx8q" Jun 03 14:49:28.833523 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:28.833325 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qlx8q"] Jun 03 14:49:28.835826 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:49:28.835797 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbef4ffc0_2d1c_4742_abdd_1ba23bea3574.slice/crio-d5926a5624386dc3e9fc0ebd45427027f765c891f6526b353218f0b7ec5b3a8f WatchSource:0}: Error finding container d5926a5624386dc3e9fc0ebd45427027f765c891f6526b353218f0b7ec5b3a8f: Status 404 returned error can't find the container with id d5926a5624386dc3e9fc0ebd45427027f765c891f6526b353218f0b7ec5b3a8f Jun 03 14:49:29.632146 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:29.632109 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qlx8q" event={"ID":"bef4ffc0-2d1c-4742-abdd-1ba23bea3574","Type":"ContainerStarted","Data":"d5926a5624386dc3e9fc0ebd45427027f765c891f6526b353218f0b7ec5b3a8f"} Jun 03 14:49:30.640667 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:30.640610 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qlx8q" event={"ID":"bef4ffc0-2d1c-4742-abdd-1ba23bea3574","Type":"ContainerStarted","Data":"e139d89fa5b396a58b10370e4bd773bd94cf4c13db12de59a1fdb767f7656dde"} Jun 03 14:49:30.640667 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:30.640671 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qlx8q" event={"ID":"bef4ffc0-2d1c-4742-abdd-1ba23bea3574","Type":"ContainerStarted","Data":"23278c96e42b3ff9d7fe2700f77083c07531e16f99988819b0171792a13fdfc6"} Jun 03 14:49:30.658504 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:30.658454 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qlx8q" podStartSLOduration=253.67924528 podStartE2EDuration="4m14.658441402s" podCreationTimestamp="2026-06-03 14:45:16 +0000 UTC" firstStartedPulling="2026-06-03 14:49:28.838111884 +0000 UTC m=+252.501214324" lastFinishedPulling="2026-06-03 14:49:29.817308002 +0000 UTC m=+253.480410446" observedRunningTime="2026-06-03 14:49:30.657155573 +0000 UTC m=+254.320258060" watchObservedRunningTime="2026-06-03 14:49:30.658441402 +0000 UTC m=+254.321543866" Jun 03 14:49:35.282149 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:35.282046 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:35.298472 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:35.298445 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:35.669648 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:35.669622 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.312078 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.312041 2580 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 14:49:53.312981 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.312741 2580 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="kube-rbac-proxy-thanos" containerID="cri-o://dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d" gracePeriod=600 Jun 03 14:49:53.312981 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.312792 2580 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="config-reloader" containerID="cri-o://750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be" gracePeriod=600 Jun 03 14:49:53.312981 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.312791 2580 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="kube-rbac-proxy" containerID="cri-o://7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b" gracePeriod=600 Jun 03 14:49:53.312981 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.312827 2580 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="thanos-sidecar" containerID="cri-o://2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b" gracePeriod=600 Jun 03 14:49:53.312981 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.312720 2580 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="kube-rbac-proxy-web" containerID="cri-o://6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093" gracePeriod=600 Jun 03 14:49:53.313338 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.313031 2580 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="prometheus" containerID="cri-o://fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244" gracePeriod=600 Jun 03 14:49:53.574297 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.574274 2580 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.675404 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.675375 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sfs5\" (UniqueName: \"kubernetes.io/projected/c90ae5f7-0c62-4c23-852b-42094b5b57b1-kube-api-access-2sfs5\") pod \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " Jun 03 14:49:53.675577 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.675422 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-thanos-prometheus-http-client-file\") pod \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " Jun 03 14:49:53.675577 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.675457 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-prometheus-trusted-ca-bundle\") pod \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " Jun 03 14:49:53.675577 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.675481 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-configmap-serving-certs-ca-bundle\") pod \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " Jun 03 14:49:53.675577 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.675512 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-grpc-tls\") pod \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " Jun 03 14:49:53.675577 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.675558 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " Jun 03 14:49:53.675865 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.675586 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-metrics-client-certs\") pod \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " Jun 03 14:49:53.675865 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.675615 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c90ae5f7-0c62-4c23-852b-42094b5b57b1-config-out\") pod \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " Jun 03 14:49:53.675865 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.675727 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " Jun 03 14:49:53.675865 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.675772 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-prometheus-k8s-tls\") pod \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " Jun 03 14:49:53.675865 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.675810 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c90ae5f7-0c62-4c23-852b-42094b5b57b1-prometheus-k8s-db\") pod \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " Jun 03 14:49:53.675865 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.675839 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-kube-rbac-proxy\") pod \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " Jun 03 14:49:53.676235 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.675877 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-config\") pod \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " Jun 03 14:49:53.676235 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.675926 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-configmap-metrics-client-ca\") pod \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " Jun 03 14:49:53.676235 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.675957 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-web-config\") pod \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " Jun 03 14:49:53.676235 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.675972 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c90ae5f7-0c62-4c23-852b-42094b5b57b1" (UID: "c90ae5f7-0c62-4c23-852b-42094b5b57b1"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 14:49:53.676235 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.675980 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c90ae5f7-0c62-4c23-852b-42094b5b57b1" (UID: "c90ae5f7-0c62-4c23-852b-42094b5b57b1"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 14:49:53.676235 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.675986 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c90ae5f7-0c62-4c23-852b-42094b5b57b1-tls-assets\") pod \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " Jun 03 14:49:53.676235 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.676065 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-configmap-kubelet-serving-ca-bundle\") pod \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " Jun 03 14:49:53.676235 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.676102 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-prometheus-k8s-rulefiles-0\") pod \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\" (UID: \"c90ae5f7-0c62-4c23-852b-42094b5b57b1\") " Jun 03 14:49:53.676829 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.676566 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:49:53.676829 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.676586 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:49:53.678127 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.677637 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c90ae5f7-0c62-4c23-852b-42094b5b57b1" (UID: "c90ae5f7-0c62-4c23-852b-42094b5b57b1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 14:49:53.678127 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.677784 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c90ae5f7-0c62-4c23-852b-42094b5b57b1" (UID: "c90ae5f7-0c62-4c23-852b-42094b5b57b1"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 14:49:53.678127 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.678086 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c90ae5f7-0c62-4c23-852b-42094b5b57b1" (UID: "c90ae5f7-0c62-4c23-852b-42094b5b57b1"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 14:49:53.678712 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.678684 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c90ae5f7-0c62-4c23-852b-42094b5b57b1-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c90ae5f7-0c62-4c23-852b-42094b5b57b1" (UID: "c90ae5f7-0c62-4c23-852b-42094b5b57b1"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 14:49:53.678971 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.678775 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c90ae5f7-0c62-4c23-852b-42094b5b57b1" (UID: "c90ae5f7-0c62-4c23-852b-42094b5b57b1"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 14:49:53.678971 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.678831 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c90ae5f7-0c62-4c23-852b-42094b5b57b1-config-out" (OuterVolumeSpecName: "config-out") pod "c90ae5f7-0c62-4c23-852b-42094b5b57b1" (UID: "c90ae5f7-0c62-4c23-852b-42094b5b57b1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 14:49:53.678971 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.678879 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c90ae5f7-0c62-4c23-852b-42094b5b57b1" (UID: "c90ae5f7-0c62-4c23-852b-42094b5b57b1"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 14:49:53.679160 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.679066 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c90ae5f7-0c62-4c23-852b-42094b5b57b1-kube-api-access-2sfs5" (OuterVolumeSpecName: "kube-api-access-2sfs5") pod "c90ae5f7-0c62-4c23-852b-42094b5b57b1" (UID: "c90ae5f7-0c62-4c23-852b-42094b5b57b1"). InnerVolumeSpecName "kube-api-access-2sfs5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:49:53.679418 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.679386 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c90ae5f7-0c62-4c23-852b-42094b5b57b1" (UID: "c90ae5f7-0c62-4c23-852b-42094b5b57b1"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 14:49:53.680168 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.680144 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c90ae5f7-0c62-4c23-852b-42094b5b57b1" (UID: "c90ae5f7-0c62-4c23-852b-42094b5b57b1"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 14:49:53.680881 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.680861 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c90ae5f7-0c62-4c23-852b-42094b5b57b1" (UID: "c90ae5f7-0c62-4c23-852b-42094b5b57b1"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 14:49:53.681175 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.681157 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-config" (OuterVolumeSpecName: "config") pod "c90ae5f7-0c62-4c23-852b-42094b5b57b1" (UID: "c90ae5f7-0c62-4c23-852b-42094b5b57b1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 14:49:53.681241 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.681200 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c90ae5f7-0c62-4c23-852b-42094b5b57b1" (UID: "c90ae5f7-0c62-4c23-852b-42094b5b57b1"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 14:49:53.681241 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.681228 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c90ae5f7-0c62-4c23-852b-42094b5b57b1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c90ae5f7-0c62-4c23-852b-42094b5b57b1" (UID: "c90ae5f7-0c62-4c23-852b-42094b5b57b1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:49:53.681321 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.681276 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c90ae5f7-0c62-4c23-852b-42094b5b57b1" (UID: "c90ae5f7-0c62-4c23-852b-42094b5b57b1"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 14:49:53.690957 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.690935 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-web-config" (OuterVolumeSpecName: "web-config") pod "c90ae5f7-0c62-4c23-852b-42094b5b57b1" (UID: "c90ae5f7-0c62-4c23-852b-42094b5b57b1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 14:49:53.711778 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.711747 2580 generic.go:358] "Generic (PLEG): container finished" podID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerID="dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d" exitCode=0 Jun 03 14:49:53.711778 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.711776 2580 generic.go:358] "Generic (PLEG): container finished" podID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerID="7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b" exitCode=0 Jun 03 14:49:53.711902 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.711785 2580 generic.go:358] "Generic (PLEG): container finished" podID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerID="6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093" exitCode=0 Jun 03 14:49:53.711902 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.711793 2580 generic.go:358] "Generic (PLEG): container finished" podID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerID="2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b" exitCode=0 Jun 03 14:49:53.711902 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.711801 2580 generic.go:358] "Generic (PLEG): container finished" podID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerID="750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be" exitCode=0 Jun 03 14:49:53.711902 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.711809 2580 generic.go:358] "Generic (PLEG): container finished" podID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerID="fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244" exitCode=0 Jun 03 14:49:53.711902 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.711823 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c90ae5f7-0c62-4c23-852b-42094b5b57b1","Type":"ContainerDied","Data":"dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d"} Jun 03 14:49:53.711902 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.711859 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c90ae5f7-0c62-4c23-852b-42094b5b57b1","Type":"ContainerDied","Data":"7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b"} Jun 03 14:49:53.711902 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.711870 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c90ae5f7-0c62-4c23-852b-42094b5b57b1","Type":"ContainerDied","Data":"6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093"} Jun 03 14:49:53.711902 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.711879 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c90ae5f7-0c62-4c23-852b-42094b5b57b1","Type":"ContainerDied","Data":"2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b"} Jun 03 14:49:53.711902 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.711884 2580 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.711902 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.711897 2580 scope.go:117] "RemoveContainer" containerID="dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d" Jun 03 14:49:53.712302 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.711888 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c90ae5f7-0c62-4c23-852b-42094b5b57b1","Type":"ContainerDied","Data":"750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be"} Jun 03 14:49:53.712302 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.712004 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c90ae5f7-0c62-4c23-852b-42094b5b57b1","Type":"ContainerDied","Data":"fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244"} Jun 03 14:49:53.712302 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.712021 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c90ae5f7-0c62-4c23-852b-42094b5b57b1","Type":"ContainerDied","Data":"a6ab09c1cefa840dd912b7b1afe335cd0309b1feb4ff99618985224146b10286"} Jun 03 14:49:53.719189 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.719162 2580 scope.go:117] "RemoveContainer" containerID="7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b" Jun 03 14:49:53.726906 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.726883 2580 scope.go:117] "RemoveContainer" containerID="6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093" Jun 03 14:49:53.733246 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.733230 2580 scope.go:117] "RemoveContainer" containerID="2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b" Jun 03 14:49:53.737509 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.737464 2580 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 14:49:53.739631 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.739608 2580 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 14:49:53.740835 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.740811 2580 scope.go:117] "RemoveContainer" containerID="750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be" Jun 03 14:49:53.747025 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.747008 2580 scope.go:117] "RemoveContainer" containerID="fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244" Jun 03 14:49:53.753677 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.753633 2580 scope.go:117] "RemoveContainer" containerID="056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507" Jun 03 14:49:53.759890 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.759871 2580 scope.go:117] "RemoveContainer" containerID="dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d" Jun 03 14:49:53.760140 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:49:53.760120 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d\": container with ID starting with dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d not found: ID does not exist" containerID="dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d" Jun 03 14:49:53.760203 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.760149 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d"} err="failed to get container status \"dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d\": rpc error: code = NotFound desc = could not find container \"dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d\": container with ID starting with dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d not found: ID does not exist" Jun 03 14:49:53.760203 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.760166 2580 scope.go:117] "RemoveContainer" containerID="7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b" Jun 03 14:49:53.760418 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:49:53.760403 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b\": container with ID starting with 7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b not found: ID does not exist" containerID="7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b" Jun 03 14:49:53.760462 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.760420 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b"} err="failed to get container status \"7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b\": rpc error: code = NotFound desc = could not find container \"7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b\": container with ID starting with 7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b not found: ID does not exist" Jun 03 14:49:53.760462 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.760442 2580 scope.go:117] "RemoveContainer" containerID="6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093" Jun 03 14:49:53.760627 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:49:53.760611 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093\": container with ID starting with 6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093 not found: ID does not exist" containerID="6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093" Jun 03 14:49:53.760686 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.760633 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093"} err="failed to get container status \"6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093\": rpc error: code = NotFound desc = could not find container \"6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093\": container with ID starting with 6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093 not found: ID does not exist" Jun 03 14:49:53.760686 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.760648 2580 scope.go:117] "RemoveContainer" containerID="2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b" Jun 03 14:49:53.760914 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:49:53.760899 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b\": container with ID starting with 2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b not found: ID does not exist" containerID="2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b" Jun 03 14:49:53.760964 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.760916 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b"} err="failed to get container status \"2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b\": rpc error: code = NotFound desc = could not find container \"2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b\": container with ID starting with 2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b not found: ID does not exist" Jun 03 14:49:53.760964 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.760929 2580 scope.go:117] "RemoveContainer" containerID="750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be" Jun 03 14:49:53.761133 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:49:53.761115 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be\": container with ID starting with 750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be not found: ID does not exist" containerID="750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be" Jun 03 14:49:53.761191 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.761148 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be"} err="failed to get container status \"750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be\": rpc error: code = NotFound desc = could not find container \"750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be\": container with ID starting with 750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be not found: ID does not exist" Jun 03 14:49:53.761191 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.761165 2580 scope.go:117] "RemoveContainer" containerID="fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244" Jun 03 14:49:53.761475 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:49:53.761455 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244\": container with ID starting with fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244 not found: ID does not exist" containerID="fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244" Jun 03 14:49:53.761562 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.761480 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244"} err="failed to get container status \"fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244\": rpc error: code = NotFound desc = could not find container \"fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244\": container with ID starting with fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244 not found: ID does not exist" Jun 03 14:49:53.761562 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.761499 2580 scope.go:117] "RemoveContainer" containerID="056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507" Jun 03 14:49:53.762018 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:49:53.761781 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507\": container with ID starting with 056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507 not found: ID does not exist" containerID="056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507" Jun 03 14:49:53.762018 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.761810 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507"} err="failed to get container status \"056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507\": rpc error: code = NotFound desc = could not find container \"056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507\": container with ID starting with 056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507 not found: ID does not exist" Jun 03 14:49:53.762018 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.761831 2580 scope.go:117] "RemoveContainer" containerID="dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d" Jun 03 14:49:53.762217 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.762097 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d"} err="failed to get container status \"dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d\": rpc error: code = NotFound desc = could not find container \"dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d\": container with ID starting with dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d not found: ID does not exist" Jun 03 14:49:53.762217 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.762117 2580 scope.go:117] "RemoveContainer" containerID="7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b" Jun 03 14:49:53.762386 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.762342 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b"} err="failed to get container status \"7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b\": rpc error: code = NotFound desc = could not find container \"7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b\": container with ID starting with 7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b not found: ID does not exist" Jun 03 14:49:53.762386 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.762374 2580 scope.go:117] "RemoveContainer" containerID="6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093" Jun 03 14:49:53.762624 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.762600 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093"} err="failed to get container status \"6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093\": rpc error: code = NotFound desc = could not find container \"6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093\": container with ID starting with 6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093 not found: ID does not exist" Jun 03 14:49:53.762624 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.762622 2580 scope.go:117] "RemoveContainer" containerID="2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b" Jun 03 14:49:53.762859 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.762840 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b"} err="failed to get container status \"2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b\": rpc error: code = NotFound desc = could not find container \"2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b\": container with ID starting with 2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b not found: ID does not exist" Jun 03 14:49:53.762935 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.762862 2580 scope.go:117] "RemoveContainer" containerID="750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be" Jun 03 14:49:53.763090 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.763073 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be"} err="failed to get container status \"750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be\": rpc error: code = NotFound desc = could not find container \"750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be\": container with ID starting with 750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be not found: ID does not exist" Jun 03 14:49:53.763137 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.763090 2580 scope.go:117] "RemoveContainer" containerID="fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244" Jun 03 14:49:53.763308 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.763289 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244"} err="failed to get container status \"fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244\": rpc error: code = NotFound desc = could not find container \"fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244\": container with ID starting with fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244 not found: ID does not exist" Jun 03 14:49:53.763383 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.763310 2580 scope.go:117] "RemoveContainer" containerID="056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507" Jun 03 14:49:53.763571 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.763544 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507"} err="failed to get container status \"056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507\": rpc error: code = NotFound desc = could not find container \"056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507\": container with ID starting with 056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507 not found: ID does not exist" Jun 03 14:49:53.763571 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.763571 2580 scope.go:117] "RemoveContainer" containerID="dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d" Jun 03 14:49:53.763856 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.763836 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d"} err="failed to get container status \"dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d\": rpc error: code = NotFound desc = could not find container \"dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d\": container with ID starting with dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d not found: ID does not exist" Jun 03 14:49:53.763938 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.763856 2580 scope.go:117] "RemoveContainer" containerID="7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b" Jun 03 14:49:53.764073 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764058 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b"} err="failed to get container status \"7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b\": rpc error: code = NotFound desc = could not find container \"7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b\": container with ID starting with 7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b not found: ID does not exist" Jun 03 14:49:53.764131 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764074 2580 scope.go:117] "RemoveContainer" containerID="6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093" Jun 03 14:49:53.764319 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764298 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093"} err="failed to get container status \"6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093\": rpc error: code = NotFound desc = could not find container \"6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093\": container with ID starting with 6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093 not found: ID does not exist" Jun 03 14:49:53.764319 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764319 2580 scope.go:117] "RemoveContainer" containerID="2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b" Jun 03 14:49:53.764446 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764323 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 14:49:53.764537 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764507 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b"} err="failed to get container status \"2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b\": rpc error: code = NotFound desc = could not find container \"2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b\": container with ID starting with 2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b not found: ID does not exist" Jun 03 14:49:53.764580 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764539 2580 scope.go:117] "RemoveContainer" containerID="750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be" Jun 03 14:49:53.764687 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764673 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="config-reloader" Jun 03 14:49:53.764742 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764689 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="config-reloader" Jun 03 14:49:53.764742 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764699 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="753aadae-abde-4f37-8c50-a2afb76319a7" containerName="console" Jun 03 14:49:53.764742 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764704 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="753aadae-abde-4f37-8c50-a2afb76319a7" containerName="console" Jun 03 14:49:53.764742 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764710 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="thanos-sidecar" Jun 03 14:49:53.764742 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764716 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="thanos-sidecar" Jun 03 14:49:53.764742 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764722 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="prometheus" Jun 03 14:49:53.764742 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764727 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="prometheus" Jun 03 14:49:53.764742 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764737 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="kube-rbac-proxy" Jun 03 14:49:53.764742 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764742 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="kube-rbac-proxy" Jun 03 14:49:53.765031 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764750 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="kube-rbac-proxy-thanos" Jun 03 14:49:53.765031 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764755 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="kube-rbac-proxy-thanos" Jun 03 14:49:53.765031 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764765 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="init-config-reloader" Jun 03 14:49:53.765031 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764770 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="init-config-reloader" Jun 03 14:49:53.765031 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764775 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="kube-rbac-proxy-web" Jun 03 14:49:53.765031 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764780 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="kube-rbac-proxy-web" Jun 03 14:49:53.765031 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764718 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be"} err="failed to get container status \"750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be\": rpc error: code = NotFound desc = could not find container \"750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be\": container with ID starting with 750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be not found: ID does not exist" Jun 03 14:49:53.765031 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764798 2580 scope.go:117] "RemoveContainer" containerID="fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244" Jun 03 14:49:53.765031 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764824 2580 memory_manager.go:356] "RemoveStaleState removing state" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="kube-rbac-proxy-web" Jun 03 14:49:53.765031 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764831 2580 memory_manager.go:356] "RemoveStaleState removing state" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="config-reloader" Jun 03 14:49:53.765031 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764836 2580 memory_manager.go:356] "RemoveStaleState removing state" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="kube-rbac-proxy" Jun 03 14:49:53.765031 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764842 2580 memory_manager.go:356] "RemoveStaleState removing state" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="thanos-sidecar" Jun 03 14:49:53.765031 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764849 2580 memory_manager.go:356] "RemoveStaleState removing state" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="prometheus" Jun 03 14:49:53.765031 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764856 2580 memory_manager.go:356] "RemoveStaleState removing state" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" containerName="kube-rbac-proxy-thanos" Jun 03 14:49:53.765031 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764861 2580 memory_manager.go:356] "RemoveStaleState removing state" podUID="753aadae-abde-4f37-8c50-a2afb76319a7" containerName="console" Jun 03 14:49:53.765031 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764972 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244"} err="failed to get container status \"fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244\": rpc error: code = NotFound desc = could not find container \"fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244\": container with ID starting with fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244 not found: ID does not exist" Jun 03 14:49:53.765031 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.764986 2580 scope.go:117] "RemoveContainer" containerID="056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507" Jun 03 14:49:53.765588 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.765136 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507"} err="failed to get container status \"056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507\": rpc error: code = NotFound desc = could not find container \"056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507\": container with ID starting with 056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507 not found: ID does not exist" Jun 03 14:49:53.765588 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.765151 2580 scope.go:117] "RemoveContainer" containerID="dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d" Jun 03 14:49:53.765588 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.765336 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d"} err="failed to get container status \"dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d\": rpc error: code = NotFound desc = could not find container \"dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d\": container with ID starting with dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d not found: ID does not exist" Jun 03 14:49:53.765588 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.765358 2580 scope.go:117] "RemoveContainer" containerID="7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b" Jun 03 14:49:53.765588 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.765512 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b"} err="failed to get container status \"7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b\": rpc error: code = NotFound desc = could not find container \"7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b\": container with ID starting with 7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b not found: ID does not exist" Jun 03 14:49:53.765588 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.765529 2580 scope.go:117] "RemoveContainer" containerID="6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093" Jun 03 14:49:53.765824 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.765702 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093"} err="failed to get container status \"6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093\": rpc error: code = NotFound desc = could not find container \"6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093\": container with ID starting with 6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093 not found: ID does not exist" Jun 03 14:49:53.765824 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.765713 2580 scope.go:117] "RemoveContainer" containerID="2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b" Jun 03 14:49:53.765920 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.765904 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b"} err="failed to get container status \"2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b\": rpc error: code = NotFound desc = could not find container \"2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b\": container with ID starting with 2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b not found: ID does not exist" Jun 03 14:49:53.765958 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.765920 2580 scope.go:117] "RemoveContainer" containerID="750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be" Jun 03 14:49:53.766115 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.766097 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be"} err="failed to get container status \"750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be\": rpc error: code = NotFound desc = could not find container \"750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be\": container with ID starting with 750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be not found: ID does not exist" Jun 03 14:49:53.766193 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.766116 2580 scope.go:117] "RemoveContainer" containerID="fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244" Jun 03 14:49:53.766318 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.766302 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244"} err="failed to get container status \"fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244\": rpc error: code = NotFound desc = could not find container \"fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244\": container with ID starting with fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244 not found: ID does not exist" Jun 03 14:49:53.766382 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.766319 2580 scope.go:117] "RemoveContainer" containerID="056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507" Jun 03 14:49:53.766506 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.766488 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507"} err="failed to get container status \"056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507\": rpc error: code = NotFound desc = could not find container \"056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507\": container with ID starting with 056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507 not found: ID does not exist" Jun 03 14:49:53.766569 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.766508 2580 scope.go:117] "RemoveContainer" containerID="dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d" Jun 03 14:49:53.766731 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.766712 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d"} err="failed to get container status \"dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d\": rpc error: code = NotFound desc = could not find container \"dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d\": container with ID starting with dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d not found: ID does not exist" Jun 03 14:49:53.766802 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.766733 2580 scope.go:117] "RemoveContainer" containerID="7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b" Jun 03 14:49:53.766927 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.766909 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b"} err="failed to get container status \"7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b\": rpc error: code = NotFound desc = could not find container \"7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b\": container with ID starting with 7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b not found: ID does not exist" Jun 03 14:49:53.766970 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.766929 2580 scope.go:117] "RemoveContainer" containerID="6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093" Jun 03 14:49:53.767150 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.767134 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093"} err="failed to get container status \"6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093\": rpc error: code = NotFound desc = could not find container \"6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093\": container with ID starting with 6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093 not found: ID does not exist" Jun 03 14:49:53.767150 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.767150 2580 scope.go:117] "RemoveContainer" containerID="2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b" Jun 03 14:49:53.767370 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.767353 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b"} err="failed to get container status \"2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b\": rpc error: code = NotFound desc = could not find container \"2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b\": container with ID starting with 2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b not found: ID does not exist" Jun 03 14:49:53.767413 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.767372 2580 scope.go:117] "RemoveContainer" containerID="750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be" Jun 03 14:49:53.767553 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.767537 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be"} err="failed to get container status \"750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be\": rpc error: code = NotFound desc = could not find container \"750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be\": container with ID starting with 750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be not found: ID does not exist" Jun 03 14:49:53.767601 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.767554 2580 scope.go:117] "RemoveContainer" containerID="fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244" Jun 03 14:49:53.767768 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.767752 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244"} err="failed to get container status \"fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244\": rpc error: code = NotFound desc = could not find container \"fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244\": container with ID starting with fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244 not found: ID does not exist" Jun 03 14:49:53.767823 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.767769 2580 scope.go:117] "RemoveContainer" containerID="056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507" Jun 03 14:49:53.767937 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.767922 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507"} err="failed to get container status \"056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507\": rpc error: code = NotFound desc = could not find container \"056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507\": container with ID starting with 056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507 not found: ID does not exist" Jun 03 14:49:53.767975 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.767938 2580 scope.go:117] "RemoveContainer" containerID="dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d" Jun 03 14:49:53.768107 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.768090 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d"} err="failed to get container status \"dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d\": rpc error: code = NotFound desc = could not find container \"dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d\": container with ID starting with dd00a1cb8600167cd58cd7f00cc4d16c79e1d95f70c01fa1914597d693f6df7d not found: ID does not exist" Jun 03 14:49:53.768146 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.768107 2580 scope.go:117] "RemoveContainer" containerID="7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b" Jun 03 14:49:53.768244 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.768229 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b"} err="failed to get container status \"7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b\": rpc error: code = NotFound desc = could not find container \"7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b\": container with ID starting with 7b94da8cc7a4091eb64341d59cfcedfeb37e46d50a973f293ba6db568bfe3f2b not found: ID does not exist" Jun 03 14:49:53.768284 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.768244 2580 scope.go:117] "RemoveContainer" containerID="6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093" Jun 03 14:49:53.768467 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.768451 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093"} err="failed to get container status \"6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093\": rpc error: code = NotFound desc = could not find container \"6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093\": container with ID starting with 6dc3e29e8af86bc3c24905599fffb4084fc9bd6506c627552872f0066268f093 not found: ID does not exist" Jun 03 14:49:53.768517 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.768468 2580 scope.go:117] "RemoveContainer" containerID="2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b" Jun 03 14:49:53.768720 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.768698 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b"} err="failed to get container status \"2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b\": rpc error: code = NotFound desc = could not find container \"2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b\": container with ID starting with 2665703894a6ed4b12c3031f09fdf308607df12681aa4ecedc0f5e3bfc4ef19b not found: ID does not exist" Jun 03 14:49:53.768811 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.768719 2580 scope.go:117] "RemoveContainer" containerID="750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be" Jun 03 14:49:53.768937 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.768916 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be"} err="failed to get container status \"750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be\": rpc error: code = NotFound desc = could not find container \"750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be\": container with ID starting with 750527bb0b894ddcb01d239d25e55e748cd2a32d5aa6d9dfc4ec848a427af0be not found: ID does not exist" Jun 03 14:49:53.768987 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.768937 2580 scope.go:117] "RemoveContainer" containerID="fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244" Jun 03 14:49:53.769072 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.769057 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.769141 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.769124 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244"} err="failed to get container status \"fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244\": rpc error: code = NotFound desc = could not find container \"fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244\": container with ID starting with fd0da9c1b33ada379966645f51a039a8032359c06f6c209b013f85c6274d5244 not found: ID does not exist" Jun 03 14:49:53.769175 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.769142 2580 scope.go:117] "RemoveContainer" containerID="056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507" Jun 03 14:49:53.769387 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.769354 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507"} err="failed to get container status \"056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507\": rpc error: code = NotFound desc = could not find container \"056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507\": container with ID starting with 056e866e8960a707257ceb1621624eeeaccf9aed29e3cdd5e898f8697b056507 not found: ID does not exist" Jun 03 14:49:53.771556 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.771534 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 14:49:53.771822 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.771761 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 14:49:53.771934 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.771890 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 14:49:53.771934 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.771926 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 14:49:53.772058 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.771973 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 14:49:53.772058 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.772000 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 14:49:53.772058 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.772027 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fk81fjakkvjek\"" Jun 03 14:49:53.772239 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.772056 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 14:49:53.772239 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.772180 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 14:49:53.772239 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.772227 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 14:49:53.772239 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.772235 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 14:49:53.772420 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.772247 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-njvjn\"" Jun 03 14:49:53.774618 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.774586 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 14:49:53.777463 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.777208 2580 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:49:53.777463 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.777233 2580 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-grpc-tls\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:49:53.777463 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.777251 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:49:53.777463 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.777268 2580 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-metrics-client-certs\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:49:53.777463 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.777281 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c90ae5f7-0c62-4c23-852b-42094b5b57b1-config-out\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:49:53.777463 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.777296 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:49:53.777463 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.777309 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:49:53.777463 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.777324 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c90ae5f7-0c62-4c23-852b-42094b5b57b1-prometheus-k8s-db\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:49:53.777463 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.777338 2580 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-secret-kube-rbac-proxy\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:49:53.777463 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.777353 2580 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-config\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:49:53.777463 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.777389 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-configmap-metrics-client-ca\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:49:53.777463 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.777403 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c90ae5f7-0c62-4c23-852b-42094b5b57b1-web-config\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:49:53.777463 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.777415 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c90ae5f7-0c62-4c23-852b-42094b5b57b1-tls-assets\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:49:53.777463 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.777427 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:49:53.777463 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.777440 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c90ae5f7-0c62-4c23-852b-42094b5b57b1-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:49:53.777463 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.777453 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sfs5\" (UniqueName: \"kubernetes.io/projected/c90ae5f7-0c62-4c23-852b-42094b5b57b1-kube-api-access-2sfs5\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:49:53.779158 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.779138 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 14:49:53.779727 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.779704 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 14:49:53.877965 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.877931 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.878126 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.877970 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ed61594-c33d-419d-80fc-1a6f7b80d379-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.878126 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.878058 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-web-config\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.878126 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.878096 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.878258 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.878175 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.878258 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.878226 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ed61594-c33d-419d-80fc-1a6f7b80d379-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.878325 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.878259 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ed61594-c33d-419d-80fc-1a6f7b80d379-config-out\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.878325 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.878274 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.878325 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.878288 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.878433 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.878344 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed61594-c33d-419d-80fc-1a6f7b80d379-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.878433 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.878360 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ed61594-c33d-419d-80fc-1a6f7b80d379-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.878433 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.878382 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed61594-c33d-419d-80fc-1a6f7b80d379-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.878433 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.878401 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ed61594-c33d-419d-80fc-1a6f7b80d379-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.878433 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.878416 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.878433 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.878433 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed61594-c33d-419d-80fc-1a6f7b80d379-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.878645 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.878448 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.878645 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.878495 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-config\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.878645 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.878514 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfj7f\" (UniqueName: \"kubernetes.io/projected/6ed61594-c33d-419d-80fc-1a6f7b80d379-kube-api-access-jfj7f\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.979105 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.979065 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ed61594-c33d-419d-80fc-1a6f7b80d379-config-out\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.979105 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.979101 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.979315 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.979118 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.979315 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.979247 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed61594-c33d-419d-80fc-1a6f7b80d379-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.979315 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.979282 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ed61594-c33d-419d-80fc-1a6f7b80d379-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.979315 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.979308 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed61594-c33d-419d-80fc-1a6f7b80d379-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.979529 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.979340 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ed61594-c33d-419d-80fc-1a6f7b80d379-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.979529 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.979366 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.979529 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.979394 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed61594-c33d-419d-80fc-1a6f7b80d379-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.979529 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.979417 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.979529 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.979456 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-config\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.979529 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.979481 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jfj7f\" (UniqueName: \"kubernetes.io/projected/6ed61594-c33d-419d-80fc-1a6f7b80d379-kube-api-access-jfj7f\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.979529 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.979510 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.979529 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.979533 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ed61594-c33d-419d-80fc-1a6f7b80d379-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.979944 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.979589 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-web-config\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.980101 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.980012 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ed61594-c33d-419d-80fc-1a6f7b80d379-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.980598 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.980478 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed61594-c33d-419d-80fc-1a6f7b80d379-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.981445 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.980616 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ed61594-c33d-419d-80fc-1a6f7b80d379-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.981445 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.980801 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.981445 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.980816 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed61594-c33d-419d-80fc-1a6f7b80d379-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.981445 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.980902 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.981445 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.981279 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ed61594-c33d-419d-80fc-1a6f7b80d379-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.981735 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.981447 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ed61594-c33d-419d-80fc-1a6f7b80d379-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.983409 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.983003 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ed61594-c33d-419d-80fc-1a6f7b80d379-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.983409 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.983269 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ed61594-c33d-419d-80fc-1a6f7b80d379-config-out\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.983409 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.983334 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.983409 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.983376 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.983696 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.983446 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-web-config\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.983786 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.983762 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.984774 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.984748 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.984872 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.984835 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.985033 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.985015 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-config\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.985092 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.985043 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.985128 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.985111 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ed61594-c33d-419d-80fc-1a6f7b80d379-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.985162 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.985127 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ed61594-c33d-419d-80fc-1a6f7b80d379-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:53.988725 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:53.988706 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfj7f\" (UniqueName: \"kubernetes.io/projected/6ed61594-c33d-419d-80fc-1a6f7b80d379-kube-api-access-jfj7f\") pod \"prometheus-k8s-0\" (UID: \"6ed61594-c33d-419d-80fc-1a6f7b80d379\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:54.081449 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:54.081419 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:49:54.213067 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:54.213030 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 14:49:54.215984 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:49:54.215956 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ed61594_c33d_419d_80fc_1a6f7b80d379.slice/crio-80553c19a770c1f20403445ab0d5c42900d1ac1d653f6607befdfeb0fbc86f25 WatchSource:0}: Error finding container 80553c19a770c1f20403445ab0d5c42900d1ac1d653f6607befdfeb0fbc86f25: Status 404 returned error can't find the container with id 80553c19a770c1f20403445ab0d5c42900d1ac1d653f6607befdfeb0fbc86f25 Jun 03 14:49:54.715912 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:54.715875 2580 generic.go:358] "Generic (PLEG): container finished" podID="6ed61594-c33d-419d-80fc-1a6f7b80d379" containerID="5933eff913af4d56178c62c7a34e168e2b8ceb706e1886c4f7e57e78e373e5e9" exitCode=0 Jun 03 14:49:54.716277 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:54.715953 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ed61594-c33d-419d-80fc-1a6f7b80d379","Type":"ContainerDied","Data":"5933eff913af4d56178c62c7a34e168e2b8ceb706e1886c4f7e57e78e373e5e9"} Jun 03 14:49:54.716277 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:54.715983 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ed61594-c33d-419d-80fc-1a6f7b80d379","Type":"ContainerStarted","Data":"80553c19a770c1f20403445ab0d5c42900d1ac1d653f6607befdfeb0fbc86f25"} Jun 03 14:49:54.903728 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:54.903021 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c90ae5f7-0c62-4c23-852b-42094b5b57b1" path="/var/lib/kubelet/pods/c90ae5f7-0c62-4c23-852b-42094b5b57b1/volumes" Jun 03 14:49:55.722804 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:55.722770 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ed61594-c33d-419d-80fc-1a6f7b80d379","Type":"ContainerStarted","Data":"f593ec57d8d45851c60f1ca0acb3e60a7af58f4b49f08ec45a267b5dd484691b"} Jun 03 14:49:55.722804 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:55.722804 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ed61594-c33d-419d-80fc-1a6f7b80d379","Type":"ContainerStarted","Data":"bf7c60b990bdd5d73e035a321f6446704c19608d205f8cb0cc3b190cd828b4c5"} Jun 03 14:49:55.722804 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:55.722813 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ed61594-c33d-419d-80fc-1a6f7b80d379","Type":"ContainerStarted","Data":"e8e35255d827e32a8f61fea65a0d01be9237507d207eb9a27e5496439f704a2f"} Jun 03 14:49:55.723247 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:55.722822 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ed61594-c33d-419d-80fc-1a6f7b80d379","Type":"ContainerStarted","Data":"3d4f12807f5385edb8299dd54e5d2a1991ec99d6127f403080c090c26bca5ed3"} Jun 03 14:49:55.723247 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:55.722829 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ed61594-c33d-419d-80fc-1a6f7b80d379","Type":"ContainerStarted","Data":"2b5cdc77a68eb89ca70d38bde087ef95767ee5816507b1ff83454e57ef60e0bc"} Jun 03 14:49:55.723247 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:55.722837 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ed61594-c33d-419d-80fc-1a6f7b80d379","Type":"ContainerStarted","Data":"40f83981ce9b596306de394b0eb3bcccaaf9654827faedb211845c1f34a6fd7b"} Jun 03 14:49:55.748724 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:55.748644 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.748631348 podStartE2EDuration="2.748631348s" podCreationTimestamp="2026-06-03 14:49:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:49:55.747503631 +0000 UTC m=+279.410606095" watchObservedRunningTime="2026-06-03 14:49:55.748631348 +0000 UTC m=+279.411733810" Jun 03 14:49:57.306020 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:49:57.305975 2580 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-798tm" podUID="a3762e8b-89b7-46cf-bfff-d02b5ea63779" Jun 03 14:49:57.728313 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:57.728281 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-798tm" Jun 03 14:49:59.081939 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:49:59.081903 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:50:00.740038 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:50:00.740008 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls\") pod \"dns-default-798tm\" (UID: \"a3762e8b-89b7-46cf-bfff-d02b5ea63779\") " pod="openshift-dns/dns-default-798tm" Jun 03 14:50:00.742504 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:50:00.742472 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3762e8b-89b7-46cf-bfff-d02b5ea63779-metrics-tls\") pod \"dns-default-798tm\" (UID: \"a3762e8b-89b7-46cf-bfff-d02b5ea63779\") " pod="openshift-dns/dns-default-798tm" Jun 03 14:50:00.841165 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:50:00.841114 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert\") pod \"ingress-canary-njv2f\" (UID: \"7c67156d-cd08-4a11-b6f8-5430e5673f45\") " pod="openshift-ingress-canary/ingress-canary-njv2f" Jun 03 14:50:00.843692 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:50:00.843645 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c67156d-cd08-4a11-b6f8-5430e5673f45-cert\") pod \"ingress-canary-njv2f\" (UID: \"7c67156d-cd08-4a11-b6f8-5430e5673f45\") " pod="openshift-ingress-canary/ingress-canary-njv2f" Jun 03 14:50:01.032414 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:50:01.032333 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dkhrx\"" Jun 03 14:50:01.039733 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:50:01.039714 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-798tm" Jun 03 14:50:01.099873 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:50:01.099839 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ljvdn\"" Jun 03 14:50:01.107239 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:50:01.107206 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-njv2f" Jun 03 14:50:01.173570 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:50:01.173528 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-798tm"] Jun 03 14:50:01.249949 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:50:01.249919 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-njv2f"] Jun 03 14:50:01.252190 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:50:01.252165 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c67156d_cd08_4a11_b6f8_5430e5673f45.slice/crio-c9ca0a4b646361df6f54eecfd2679fe4bf32cf72010f8446627201898d9b6bad WatchSource:0}: Error finding container c9ca0a4b646361df6f54eecfd2679fe4bf32cf72010f8446627201898d9b6bad: Status 404 returned error can't find the container with id c9ca0a4b646361df6f54eecfd2679fe4bf32cf72010f8446627201898d9b6bad Jun 03 14:50:01.747036 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:50:01.746997 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-njv2f" event={"ID":"7c67156d-cd08-4a11-b6f8-5430e5673f45","Type":"ContainerStarted","Data":"c9ca0a4b646361df6f54eecfd2679fe4bf32cf72010f8446627201898d9b6bad"} Jun 03 14:50:01.748726 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:50:01.748680 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-798tm" event={"ID":"a3762e8b-89b7-46cf-bfff-d02b5ea63779","Type":"ContainerStarted","Data":"4dbcd3e71857d7cd74647aea93b1e3399a5258b12984374bf7367305e57de97e"} Jun 03 14:50:03.756744 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:50:03.756700 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-798tm" event={"ID":"a3762e8b-89b7-46cf-bfff-d02b5ea63779","Type":"ContainerStarted","Data":"c7de63c529abd8152aa508948b5e4b275a724c248e0451a573e859cebf6276f3"} Jun 03 14:50:03.756744 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:50:03.756744 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-798tm" event={"ID":"a3762e8b-89b7-46cf-bfff-d02b5ea63779","Type":"ContainerStarted","Data":"8178ebb9623b23ce8907e5928bf708cbd7d81edde75c8dc534ce13b36422fe21"} Jun 03 14:50:03.757231 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:50:03.756816 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-798tm" Jun 03 14:50:03.757960 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:50:03.757938 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-njv2f" event={"ID":"7c67156d-cd08-4a11-b6f8-5430e5673f45","Type":"ContainerStarted","Data":"2f14aec11010a99988918d07cda62a3991a1acae5df60e623d770cf1753a108c"} Jun 03 14:50:03.775259 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:50:03.775208 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-798tm" podStartSLOduration=252.025225405 podStartE2EDuration="4m13.775194693s" podCreationTimestamp="2026-06-03 14:45:50 +0000 UTC" firstStartedPulling="2026-06-03 14:50:01.186154663 +0000 UTC m=+284.849257111" lastFinishedPulling="2026-06-03 14:50:02.936123954 +0000 UTC m=+286.599226399" observedRunningTime="2026-06-03 14:50:03.773889611 +0000 UTC m=+287.436992076" watchObservedRunningTime="2026-06-03 14:50:03.775194693 +0000 UTC m=+287.438297135" Jun 03 14:50:03.788870 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:50:03.788808 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-njv2f" podStartSLOduration=252.104675091 podStartE2EDuration="4m13.788791631s" podCreationTimestamp="2026-06-03 14:45:50 +0000 UTC" firstStartedPulling="2026-06-03 14:50:01.25397843 +0000 UTC m=+284.917080871" lastFinishedPulling="2026-06-03 14:50:02.938094967 +0000 UTC m=+286.601197411" observedRunningTime="2026-06-03 14:50:03.787439172 +0000 UTC m=+287.450541636" watchObservedRunningTime="2026-06-03 14:50:03.788791631 +0000 UTC m=+287.451894096" Jun 03 14:50:13.763006 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:50:13.762971 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-798tm" Jun 03 14:50:16.786534 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:50:16.786508 2580 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 14:50:54.082596 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:50:54.082554 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:50:54.098522 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:50:54.098497 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:50:54.915711 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:50:54.915682 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:55:28.502192 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.502156 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28"] Jun 03 14:55:28.504411 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.504393 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28" Jun 03 14:55:28.506804 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.506781 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 14:55:28.507468 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.507290 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 14:55:28.507711 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.507620 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-j7tbk\"" Jun 03 14:55:28.507901 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.507886 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 14:55:28.507972 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.507923 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 14:55:28.517433 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.517410 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28"] Jun 03 14:55:28.566211 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.566172 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba-manifests\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-wmr28\" (UID: \"4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28" Jun 03 14:55:28.566211 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.566215 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxqzr\" (UniqueName: \"kubernetes.io/projected/4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba-kube-api-access-rxqzr\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-wmr28\" (UID: \"4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28" Jun 03 14:55:28.566438 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.566234 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-wmr28\" (UID: \"4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28" Jun 03 14:55:28.566438 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.566322 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba-tmp\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-wmr28\" (UID: \"4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28" Jun 03 14:55:28.566438 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.566353 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-wmr28\" (UID: \"4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28" Jun 03 14:55:28.667181 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.667146 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba-tmp\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-wmr28\" (UID: \"4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28" Jun 03 14:55:28.667342 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.667198 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-wmr28\" (UID: \"4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28" Jun 03 14:55:28.667342 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.667235 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba-manifests\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-wmr28\" (UID: \"4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28" Jun 03 14:55:28.667342 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.667260 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxqzr\" (UniqueName: \"kubernetes.io/projected/4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba-kube-api-access-rxqzr\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-wmr28\" (UID: \"4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28" Jun 03 14:55:28.667342 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.667286 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-wmr28\" (UID: \"4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28" Jun 03 14:55:28.667707 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.667679 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba-manifests\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-wmr28\" (UID: \"4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28" Jun 03 14:55:28.669719 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.669695 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba-tmp\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-wmr28\" (UID: \"4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28" Jun 03 14:55:28.669824 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.669750 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-wmr28\" (UID: \"4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28" Jun 03 14:55:28.669824 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.669792 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-wmr28\" (UID: \"4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28" Jun 03 14:55:28.674981 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.674961 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxqzr\" (UniqueName: \"kubernetes.io/projected/4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba-kube-api-access-rxqzr\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-wmr28\" (UID: \"4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28" Jun 03 14:55:28.814880 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.814784 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28" Jun 03 14:55:28.947433 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.947401 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28"] Jun 03 14:55:28.951016 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:55:28.950984 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f1c570f_b53a_4ce2_9ac6_8504e20bb4ba.slice/crio-b115cb37bacd0138e2ee428bf0086f3adef0b38453d52ffee7f1a27e1e62b181 WatchSource:0}: Error finding container b115cb37bacd0138e2ee428bf0086f3adef0b38453d52ffee7f1a27e1e62b181: Status 404 returned error can't find the container with id b115cb37bacd0138e2ee428bf0086f3adef0b38453d52ffee7f1a27e1e62b181 Jun 03 14:55:28.952518 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:28.952498 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 14:55:29.679215 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:29.679153 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28" event={"ID":"4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba","Type":"ContainerStarted","Data":"b115cb37bacd0138e2ee428bf0086f3adef0b38453d52ffee7f1a27e1e62b181"} Jun 03 14:55:32.692560 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:32.692518 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28" event={"ID":"4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba","Type":"ContainerStarted","Data":"197041729b1c641aa099e15b3f131ba9839c3ea28f58ab2e623e80f19192e74e"} Jun 03 14:55:33.696765 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:33.696649 2580 generic.go:358] "Generic (PLEG): container finished" podID="4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba" containerID="197041729b1c641aa099e15b3f131ba9839c3ea28f58ab2e623e80f19192e74e" exitCode=0 Jun 03 14:55:33.697128 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:33.696759 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28" event={"ID":"4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba","Type":"ContainerDied","Data":"197041729b1c641aa099e15b3f131ba9839c3ea28f58ab2e623e80f19192e74e"} Jun 03 14:55:34.702565 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:34.702527 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28" event={"ID":"4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba","Type":"ContainerStarted","Data":"904e6a922c0b91e03616dcd89eaf9614b243f02c1b3df97b8dfefb8d54f9c041"} Jun 03 14:55:34.703155 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:34.702787 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28" Jun 03 14:55:34.726265 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:34.726208 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28" podStartSLOduration=1.570817278 podStartE2EDuration="6.726191423s" podCreationTimestamp="2026-06-03 14:55:28 +0000 UTC" firstStartedPulling="2026-06-03 14:55:28.952674236 +0000 UTC m=+612.615776677" lastFinishedPulling="2026-06-03 14:55:34.108048381 +0000 UTC m=+617.771150822" observedRunningTime="2026-06-03 14:55:34.72414829 +0000 UTC m=+618.387250754" watchObservedRunningTime="2026-06-03 14:55:34.726191423 +0000 UTC m=+618.389293887" Jun 03 14:55:45.708710 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:45.708682 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-wmr28" Jun 03 14:55:48.463185 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:48.463153 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-fb689c99f-qknwb"] Jun 03 14:55:48.471964 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:48.471945 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-fb689c99f-qknwb" Jun 03 14:55:48.474997 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:48.474968 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 14:55:48.475154 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:48.475005 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 14:55:48.476288 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:48.476266 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8qbgr\"" Jun 03 14:55:48.478307 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:48.478283 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-fb689c99f-qknwb"] Jun 03 14:55:48.546465 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:48.546420 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj6pz\" (UniqueName: \"kubernetes.io/projected/dbeacfce-baab-47f2-b9d5-9249c28190dc-kube-api-access-jj6pz\") pod \"kube-auth-proxy-fb689c99f-qknwb\" (UID: \"dbeacfce-baab-47f2-b9d5-9249c28190dc\") " pod="openshift-ingress/kube-auth-proxy-fb689c99f-qknwb" Jun 03 14:55:48.546625 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:48.546533 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbeacfce-baab-47f2-b9d5-9249c28190dc-tls-certs\") pod \"kube-auth-proxy-fb689c99f-qknwb\" (UID: \"dbeacfce-baab-47f2-b9d5-9249c28190dc\") " pod="openshift-ingress/kube-auth-proxy-fb689c99f-qknwb" Jun 03 14:55:48.546625 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:48.546603 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dbeacfce-baab-47f2-b9d5-9249c28190dc-tmp\") pod \"kube-auth-proxy-fb689c99f-qknwb\" (UID: \"dbeacfce-baab-47f2-b9d5-9249c28190dc\") " pod="openshift-ingress/kube-auth-proxy-fb689c99f-qknwb" Jun 03 14:55:48.647008 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:48.646974 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbeacfce-baab-47f2-b9d5-9249c28190dc-tls-certs\") pod \"kube-auth-proxy-fb689c99f-qknwb\" (UID: \"dbeacfce-baab-47f2-b9d5-9249c28190dc\") " pod="openshift-ingress/kube-auth-proxy-fb689c99f-qknwb" Jun 03 14:55:48.647220 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:48.647019 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dbeacfce-baab-47f2-b9d5-9249c28190dc-tmp\") pod \"kube-auth-proxy-fb689c99f-qknwb\" (UID: \"dbeacfce-baab-47f2-b9d5-9249c28190dc\") " pod="openshift-ingress/kube-auth-proxy-fb689c99f-qknwb" Jun 03 14:55:48.647220 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:48.647056 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jj6pz\" (UniqueName: \"kubernetes.io/projected/dbeacfce-baab-47f2-b9d5-9249c28190dc-kube-api-access-jj6pz\") pod \"kube-auth-proxy-fb689c99f-qknwb\" (UID: \"dbeacfce-baab-47f2-b9d5-9249c28190dc\") " pod="openshift-ingress/kube-auth-proxy-fb689c99f-qknwb" Jun 03 14:55:48.649515 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:48.649489 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dbeacfce-baab-47f2-b9d5-9249c28190dc-tmp\") pod \"kube-auth-proxy-fb689c99f-qknwb\" (UID: \"dbeacfce-baab-47f2-b9d5-9249c28190dc\") " pod="openshift-ingress/kube-auth-proxy-fb689c99f-qknwb" Jun 03 14:55:48.649719 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:48.649702 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbeacfce-baab-47f2-b9d5-9249c28190dc-tls-certs\") pod \"kube-auth-proxy-fb689c99f-qknwb\" (UID: \"dbeacfce-baab-47f2-b9d5-9249c28190dc\") " pod="openshift-ingress/kube-auth-proxy-fb689c99f-qknwb" Jun 03 14:55:48.655375 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:48.655351 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj6pz\" (UniqueName: \"kubernetes.io/projected/dbeacfce-baab-47f2-b9d5-9249c28190dc-kube-api-access-jj6pz\") pod \"kube-auth-proxy-fb689c99f-qknwb\" (UID: \"dbeacfce-baab-47f2-b9d5-9249c28190dc\") " pod="openshift-ingress/kube-auth-proxy-fb689c99f-qknwb" Jun 03 14:55:48.783823 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:48.783746 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-fb689c99f-qknwb" Jun 03 14:55:48.931575 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:48.931366 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-fb689c99f-qknwb"] Jun 03 14:55:48.934965 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:55:48.934923 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbeacfce_baab_47f2_b9d5_9249c28190dc.slice/crio-de552c5edc8996697c9286af2b22dd54726a425ffde5b55fed99cfbdde9edc25 WatchSource:0}: Error finding container de552c5edc8996697c9286af2b22dd54726a425ffde5b55fed99cfbdde9edc25: Status 404 returned error can't find the container with id de552c5edc8996697c9286af2b22dd54726a425ffde5b55fed99cfbdde9edc25 Jun 03 14:55:49.750976 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:49.750914 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-fb689c99f-qknwb" event={"ID":"dbeacfce-baab-47f2-b9d5-9249c28190dc","Type":"ContainerStarted","Data":"de552c5edc8996697c9286af2b22dd54726a425ffde5b55fed99cfbdde9edc25"} Jun 03 14:55:51.760027 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:51.759992 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-fb689c99f-qknwb" event={"ID":"dbeacfce-baab-47f2-b9d5-9249c28190dc","Type":"ContainerStarted","Data":"18d7b45d050e96e7f614178be5fb28862ef60a1447bc9c69830dd8fe2d41f7e8"} Jun 03 14:55:51.778689 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:51.778627 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-fb689c99f-qknwb" podStartSLOduration=1.063679635 podStartE2EDuration="3.778613337s" podCreationTimestamp="2026-06-03 14:55:48 +0000 UTC" firstStartedPulling="2026-06-03 14:55:48.936926211 +0000 UTC m=+632.600028665" lastFinishedPulling="2026-06-03 14:55:51.651859922 +0000 UTC m=+635.314962367" observedRunningTime="2026-06-03 14:55:51.776463658 +0000 UTC m=+635.439566118" watchObservedRunningTime="2026-06-03 14:55:51.778613337 +0000 UTC m=+635.441715830" Jun 03 14:55:56.203249 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:56.203166 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c7547bc79-b4pz5"] Jun 03 14:55:56.206403 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:56.206387 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-b4pz5" Jun 03 14:55:56.209364 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:56.209340 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 14:55:56.210520 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:56.210498 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 14:55:56.210669 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:56.210634 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 14:55:56.210739 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:56.210680 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 14:55:56.210739 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:56.210637 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 14:55:56.210853 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:56.210800 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-282gt\"" Jun 03 14:55:56.225603 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:56.225572 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c7547bc79-b4pz5"] Jun 03 14:55:56.315816 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:56.315784 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/462cbe04-51a3-4867-9760-8d4cc9ce59ee-cert\") pod \"lws-controller-manager-5c7547bc79-b4pz5\" (UID: \"462cbe04-51a3-4867-9760-8d4cc9ce59ee\") " pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-b4pz5" Jun 03 14:55:56.315994 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:56.315827 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/462cbe04-51a3-4867-9760-8d4cc9ce59ee-manager-config\") pod \"lws-controller-manager-5c7547bc79-b4pz5\" (UID: \"462cbe04-51a3-4867-9760-8d4cc9ce59ee\") " pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-b4pz5" Jun 03 14:55:56.315994 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:56.315853 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/462cbe04-51a3-4867-9760-8d4cc9ce59ee-metrics-cert\") pod \"lws-controller-manager-5c7547bc79-b4pz5\" (UID: \"462cbe04-51a3-4867-9760-8d4cc9ce59ee\") " pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-b4pz5" Jun 03 14:55:56.315994 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:56.315875 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzhtl\" (UniqueName: \"kubernetes.io/projected/462cbe04-51a3-4867-9760-8d4cc9ce59ee-kube-api-access-gzhtl\") pod \"lws-controller-manager-5c7547bc79-b4pz5\" (UID: \"462cbe04-51a3-4867-9760-8d4cc9ce59ee\") " pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-b4pz5" Jun 03 14:55:56.417094 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:56.417058 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/462cbe04-51a3-4867-9760-8d4cc9ce59ee-cert\") pod \"lws-controller-manager-5c7547bc79-b4pz5\" (UID: \"462cbe04-51a3-4867-9760-8d4cc9ce59ee\") " pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-b4pz5" Jun 03 14:55:56.417274 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:56.417107 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/462cbe04-51a3-4867-9760-8d4cc9ce59ee-manager-config\") pod \"lws-controller-manager-5c7547bc79-b4pz5\" (UID: \"462cbe04-51a3-4867-9760-8d4cc9ce59ee\") " pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-b4pz5" Jun 03 14:55:56.417274 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:56.417130 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/462cbe04-51a3-4867-9760-8d4cc9ce59ee-metrics-cert\") pod \"lws-controller-manager-5c7547bc79-b4pz5\" (UID: \"462cbe04-51a3-4867-9760-8d4cc9ce59ee\") " pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-b4pz5" Jun 03 14:55:56.417274 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:56.417151 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzhtl\" (UniqueName: \"kubernetes.io/projected/462cbe04-51a3-4867-9760-8d4cc9ce59ee-kube-api-access-gzhtl\") pod \"lws-controller-manager-5c7547bc79-b4pz5\" (UID: \"462cbe04-51a3-4867-9760-8d4cc9ce59ee\") " pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-b4pz5" Jun 03 14:55:56.417837 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:56.417804 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/462cbe04-51a3-4867-9760-8d4cc9ce59ee-manager-config\") pod \"lws-controller-manager-5c7547bc79-b4pz5\" (UID: \"462cbe04-51a3-4867-9760-8d4cc9ce59ee\") " pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-b4pz5" Jun 03 14:55:56.419586 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:56.419564 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/462cbe04-51a3-4867-9760-8d4cc9ce59ee-cert\") pod \"lws-controller-manager-5c7547bc79-b4pz5\" (UID: \"462cbe04-51a3-4867-9760-8d4cc9ce59ee\") " pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-b4pz5" Jun 03 14:55:56.419586 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:56.419577 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/462cbe04-51a3-4867-9760-8d4cc9ce59ee-metrics-cert\") pod \"lws-controller-manager-5c7547bc79-b4pz5\" (UID: \"462cbe04-51a3-4867-9760-8d4cc9ce59ee\") " pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-b4pz5" Jun 03 14:55:56.428941 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:56.428914 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzhtl\" (UniqueName: \"kubernetes.io/projected/462cbe04-51a3-4867-9760-8d4cc9ce59ee-kube-api-access-gzhtl\") pod \"lws-controller-manager-5c7547bc79-b4pz5\" (UID: \"462cbe04-51a3-4867-9760-8d4cc9ce59ee\") " pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-b4pz5" Jun 03 14:55:56.516056 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:56.515974 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-b4pz5" Jun 03 14:55:56.657907 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:56.657866 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c7547bc79-b4pz5"] Jun 03 14:55:56.659126 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:55:56.659098 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod462cbe04_51a3_4867_9760_8d4cc9ce59ee.slice/crio-596b8feb124fc60473f76781bc8b2feaf160daa914c4ad2eee5383398eaebba1 WatchSource:0}: Error finding container 596b8feb124fc60473f76781bc8b2feaf160daa914c4ad2eee5383398eaebba1: Status 404 returned error can't find the container with id 596b8feb124fc60473f76781bc8b2feaf160daa914c4ad2eee5383398eaebba1 Jun 03 14:55:56.779366 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:55:56.779272 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-b4pz5" event={"ID":"462cbe04-51a3-4867-9760-8d4cc9ce59ee","Type":"ContainerStarted","Data":"596b8feb124fc60473f76781bc8b2feaf160daa914c4ad2eee5383398eaebba1"} Jun 03 14:56:03.805821 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:56:03.805779 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-b4pz5" event={"ID":"462cbe04-51a3-4867-9760-8d4cc9ce59ee","Type":"ContainerStarted","Data":"7080b173b6704d9c933f53c441f791f5475a2d69ae53b51dbcebd29d785af6b2"} Jun 03 14:56:03.806237 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:56:03.805862 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-b4pz5" Jun 03 14:56:03.823533 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:56:03.823484 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-b4pz5" podStartSLOduration=1.274763806 podStartE2EDuration="7.823469822s" podCreationTimestamp="2026-06-03 14:55:56 +0000 UTC" firstStartedPulling="2026-06-03 14:55:56.660960929 +0000 UTC m=+640.324063370" lastFinishedPulling="2026-06-03 14:56:03.209666926 +0000 UTC m=+646.872769386" observedRunningTime="2026-06-03 14:56:03.822516094 +0000 UTC m=+647.485618557" watchObservedRunningTime="2026-06-03 14:56:03.823469822 +0000 UTC m=+647.486572284" Jun 03 14:56:14.811314 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:56:14.811287 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-b4pz5" Jun 03 14:57:33.327000 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:57:33.326916 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-jvvms"] Jun 03 14:57:33.329310 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:57:33.329291 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-jvvms" Jun 03 14:57:33.332024 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:57:33.332005 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 14:57:33.333093 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:57:33.333070 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-cg8db\"" Jun 03 14:57:33.333195 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:57:33.333099 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 14:57:33.339722 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:57:33.339700 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-jvvms"] Jun 03 14:57:33.464846 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:57:33.464812 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v7lj\" (UniqueName: \"kubernetes.io/projected/3ad5551d-5945-40d0-bbe1-6b5a02944eba-kube-api-access-4v7lj\") pod \"authorino-operator-657f44b778-jvvms\" (UID: \"3ad5551d-5945-40d0-bbe1-6b5a02944eba\") " pod="kuadrant-system/authorino-operator-657f44b778-jvvms" Jun 03 14:57:33.566234 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:57:33.566193 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4v7lj\" (UniqueName: \"kubernetes.io/projected/3ad5551d-5945-40d0-bbe1-6b5a02944eba-kube-api-access-4v7lj\") pod \"authorino-operator-657f44b778-jvvms\" (UID: \"3ad5551d-5945-40d0-bbe1-6b5a02944eba\") " pod="kuadrant-system/authorino-operator-657f44b778-jvvms" Jun 03 14:57:33.574766 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:57:33.574742 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v7lj\" (UniqueName: \"kubernetes.io/projected/3ad5551d-5945-40d0-bbe1-6b5a02944eba-kube-api-access-4v7lj\") pod \"authorino-operator-657f44b778-jvvms\" (UID: \"3ad5551d-5945-40d0-bbe1-6b5a02944eba\") " pod="kuadrant-system/authorino-operator-657f44b778-jvvms" Jun 03 14:57:33.639668 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:57:33.639619 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-jvvms" Jun 03 14:57:33.766846 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:57:33.766823 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-jvvms"] Jun 03 14:57:33.769427 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:57:33.769398 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ad5551d_5945_40d0_bbe1_6b5a02944eba.slice/crio-47ce6776631b0659b694ac8d147e44662e0726833a1bb9b507590d90d563bdc5 WatchSource:0}: Error finding container 47ce6776631b0659b694ac8d147e44662e0726833a1bb9b507590d90d563bdc5: Status 404 returned error can't find the container with id 47ce6776631b0659b694ac8d147e44662e0726833a1bb9b507590d90d563bdc5 Jun 03 14:57:34.105918 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:57:34.105828 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-jvvms" event={"ID":"3ad5551d-5945-40d0-bbe1-6b5a02944eba","Type":"ContainerStarted","Data":"47ce6776631b0659b694ac8d147e44662e0726833a1bb9b507590d90d563bdc5"} Jun 03 14:57:37.119624 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:57:37.119576 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-jvvms" event={"ID":"3ad5551d-5945-40d0-bbe1-6b5a02944eba","Type":"ContainerStarted","Data":"36412a5fafcf219c8f1d406f1a485ab4daa30baa0d9a3e1f2c45097d38043743"} Jun 03 14:57:37.120062 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:57:37.119718 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-jvvms" Jun 03 14:57:37.137554 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:57:37.137507 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-jvvms" podStartSLOduration=1.456880215 podStartE2EDuration="4.13749217s" podCreationTimestamp="2026-06-03 14:57:33 +0000 UTC" firstStartedPulling="2026-06-03 14:57:33.771421929 +0000 UTC m=+737.434524386" lastFinishedPulling="2026-06-03 14:57:36.452033897 +0000 UTC m=+740.115136341" observedRunningTime="2026-06-03 14:57:37.135962512 +0000 UTC m=+740.799064985" watchObservedRunningTime="2026-06-03 14:57:37.13749217 +0000 UTC m=+740.800594634" Jun 03 14:57:48.125364 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:57:48.125325 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-jvvms" Jun 03 14:58:33.454816 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:33.454781 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-m8fsk"] Jun 03 14:58:33.457259 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:33.457232 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-m8fsk" Jun 03 14:58:33.459814 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:33.459793 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dcldh\"" Jun 03 14:58:33.459922 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:33.459821 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 14:58:33.467697 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:33.467675 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-m8fsk"] Jun 03 14:58:33.490434 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:33.490404 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-m8fsk"] Jun 03 14:58:33.591796 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:33.591761 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9dsn\" (UniqueName: \"kubernetes.io/projected/8a3cda8c-627a-4a04-a49a-a5dfbb1a99b2-kube-api-access-l9dsn\") pod \"limitador-limitador-78c99df468-m8fsk\" (UID: \"8a3cda8c-627a-4a04-a49a-a5dfbb1a99b2\") " pod="kuadrant-system/limitador-limitador-78c99df468-m8fsk" Jun 03 14:58:33.591958 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:33.591835 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8a3cda8c-627a-4a04-a49a-a5dfbb1a99b2-config-file\") pod \"limitador-limitador-78c99df468-m8fsk\" (UID: \"8a3cda8c-627a-4a04-a49a-a5dfbb1a99b2\") " pod="kuadrant-system/limitador-limitador-78c99df468-m8fsk" Jun 03 14:58:33.692542 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:33.692461 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l9dsn\" (UniqueName: \"kubernetes.io/projected/8a3cda8c-627a-4a04-a49a-a5dfbb1a99b2-kube-api-access-l9dsn\") pod \"limitador-limitador-78c99df468-m8fsk\" (UID: \"8a3cda8c-627a-4a04-a49a-a5dfbb1a99b2\") " pod="kuadrant-system/limitador-limitador-78c99df468-m8fsk" Jun 03 14:58:33.692743 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:33.692548 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8a3cda8c-627a-4a04-a49a-a5dfbb1a99b2-config-file\") pod \"limitador-limitador-78c99df468-m8fsk\" (UID: \"8a3cda8c-627a-4a04-a49a-a5dfbb1a99b2\") " pod="kuadrant-system/limitador-limitador-78c99df468-m8fsk" Jun 03 14:58:33.693120 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:33.693102 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8a3cda8c-627a-4a04-a49a-a5dfbb1a99b2-config-file\") pod \"limitador-limitador-78c99df468-m8fsk\" (UID: \"8a3cda8c-627a-4a04-a49a-a5dfbb1a99b2\") " pod="kuadrant-system/limitador-limitador-78c99df468-m8fsk" Jun 03 14:58:33.706719 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:33.706667 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9dsn\" (UniqueName: \"kubernetes.io/projected/8a3cda8c-627a-4a04-a49a-a5dfbb1a99b2-kube-api-access-l9dsn\") pod \"limitador-limitador-78c99df468-m8fsk\" (UID: \"8a3cda8c-627a-4a04-a49a-a5dfbb1a99b2\") " pod="kuadrant-system/limitador-limitador-78c99df468-m8fsk" Jun 03 14:58:33.767793 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:33.767757 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-m8fsk" Jun 03 14:58:33.847530 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:33.847499 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-6mwf7"] Jun 03 14:58:33.850988 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:33.850966 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-6mwf7" Jun 03 14:58:33.853841 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:33.853592 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7b9vv\"" Jun 03 14:58:33.855538 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:33.855343 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-6mwf7"] Jun 03 14:58:33.907569 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:33.907545 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-m8fsk"] Jun 03 14:58:33.910038 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:58:33.909994 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3cda8c_627a_4a04_a49a_a5dfbb1a99b2.slice/crio-a567d05c2ea53d3287f8ab6ee12192a71ff070c383e42a5c8acd4d2298b39e33 WatchSource:0}: Error finding container a567d05c2ea53d3287f8ab6ee12192a71ff070c383e42a5c8acd4d2298b39e33: Status 404 returned error can't find the container with id a567d05c2ea53d3287f8ab6ee12192a71ff070c383e42a5c8acd4d2298b39e33 Jun 03 14:58:33.994823 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:33.994732 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtpj4\" (UniqueName: \"kubernetes.io/projected/2ca47168-94ee-4a81-a272-70ff0c354223-kube-api-access-wtpj4\") pod \"authorino-f99f4b5cd-6mwf7\" (UID: \"2ca47168-94ee-4a81-a272-70ff0c354223\") " pod="kuadrant-system/authorino-f99f4b5cd-6mwf7" Jun 03 14:58:34.096002 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:34.095973 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtpj4\" (UniqueName: \"kubernetes.io/projected/2ca47168-94ee-4a81-a272-70ff0c354223-kube-api-access-wtpj4\") pod \"authorino-f99f4b5cd-6mwf7\" (UID: \"2ca47168-94ee-4a81-a272-70ff0c354223\") " pod="kuadrant-system/authorino-f99f4b5cd-6mwf7" Jun 03 14:58:34.104986 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:34.104959 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtpj4\" (UniqueName: \"kubernetes.io/projected/2ca47168-94ee-4a81-a272-70ff0c354223-kube-api-access-wtpj4\") pod \"authorino-f99f4b5cd-6mwf7\" (UID: \"2ca47168-94ee-4a81-a272-70ff0c354223\") " pod="kuadrant-system/authorino-f99f4b5cd-6mwf7" Jun 03 14:58:34.191348 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:34.191318 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-6mwf7" Jun 03 14:58:34.331601 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:34.331561 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-m8fsk" event={"ID":"8a3cda8c-627a-4a04-a49a-a5dfbb1a99b2","Type":"ContainerStarted","Data":"a567d05c2ea53d3287f8ab6ee12192a71ff070c383e42a5c8acd4d2298b39e33"} Jun 03 14:58:34.336485 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:34.335921 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-6mwf7"] Jun 03 14:58:34.340346 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:58:34.340313 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ca47168_94ee_4a81_a272_70ff0c354223.slice/crio-07173bfc417cc415623c037ab3f93b259ecbe66a7bf6cea7c28f6f81e3578baf WatchSource:0}: Error finding container 07173bfc417cc415623c037ab3f93b259ecbe66a7bf6cea7c28f6f81e3578baf: Status 404 returned error can't find the container with id 07173bfc417cc415623c037ab3f93b259ecbe66a7bf6cea7c28f6f81e3578baf Jun 03 14:58:35.337738 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:35.337678 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-6mwf7" event={"ID":"2ca47168-94ee-4a81-a272-70ff0c354223","Type":"ContainerStarted","Data":"07173bfc417cc415623c037ab3f93b259ecbe66a7bf6cea7c28f6f81e3578baf"} Jun 03 14:58:37.768634 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:37.768595 2580 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-6mwf7"] Jun 03 14:58:38.348985 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:38.348947 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-m8fsk" event={"ID":"8a3cda8c-627a-4a04-a49a-a5dfbb1a99b2","Type":"ContainerStarted","Data":"97d28d46c7a43adf1333b18d2742a55cd333a4e8dde47d443d249cc391e35fec"} Jun 03 14:58:38.349174 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:38.349056 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-m8fsk" Jun 03 14:58:38.350275 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:38.350250 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-6mwf7" event={"ID":"2ca47168-94ee-4a81-a272-70ff0c354223","Type":"ContainerStarted","Data":"1622560db929879fb7960afcbf618ecd31dfd9fb034825011401e7780fbe1794"} Jun 03 14:58:38.350393 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:38.350347 2580 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-6mwf7" podUID="2ca47168-94ee-4a81-a272-70ff0c354223" containerName="authorino" containerID="cri-o://1622560db929879fb7960afcbf618ecd31dfd9fb034825011401e7780fbe1794" gracePeriod=30 Jun 03 14:58:38.364271 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:38.364230 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-m8fsk" podStartSLOduration=1.156877966 podStartE2EDuration="5.36421695s" podCreationTimestamp="2026-06-03 14:58:33 +0000 UTC" firstStartedPulling="2026-06-03 14:58:33.911768335 +0000 UTC m=+797.574870780" lastFinishedPulling="2026-06-03 14:58:38.119107318 +0000 UTC m=+801.782209764" observedRunningTime="2026-06-03 14:58:38.363787799 +0000 UTC m=+802.026890289" watchObservedRunningTime="2026-06-03 14:58:38.36421695 +0000 UTC m=+802.027319453" Jun 03 14:58:38.377292 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:38.377252 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-6mwf7" podStartSLOduration=1.597422542 podStartE2EDuration="5.377241205s" podCreationTimestamp="2026-06-03 14:58:33 +0000 UTC" firstStartedPulling="2026-06-03 14:58:34.342376756 +0000 UTC m=+798.005479200" lastFinishedPulling="2026-06-03 14:58:38.122195423 +0000 UTC m=+801.785297863" observedRunningTime="2026-06-03 14:58:38.376195759 +0000 UTC m=+802.039298224" watchObservedRunningTime="2026-06-03 14:58:38.377241205 +0000 UTC m=+802.040343684" Jun 03 14:58:38.591705 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:38.591679 2580 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-6mwf7" Jun 03 14:58:38.742791 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:38.742699 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtpj4\" (UniqueName: \"kubernetes.io/projected/2ca47168-94ee-4a81-a272-70ff0c354223-kube-api-access-wtpj4\") pod \"2ca47168-94ee-4a81-a272-70ff0c354223\" (UID: \"2ca47168-94ee-4a81-a272-70ff0c354223\") " Jun 03 14:58:38.745013 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:38.744986 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ca47168-94ee-4a81-a272-70ff0c354223-kube-api-access-wtpj4" (OuterVolumeSpecName: "kube-api-access-wtpj4") pod "2ca47168-94ee-4a81-a272-70ff0c354223" (UID: "2ca47168-94ee-4a81-a272-70ff0c354223"). InnerVolumeSpecName "kube-api-access-wtpj4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:58:38.844124 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:38.844087 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtpj4\" (UniqueName: \"kubernetes.io/projected/2ca47168-94ee-4a81-a272-70ff0c354223-kube-api-access-wtpj4\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 14:58:39.355126 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:39.355092 2580 generic.go:358] "Generic (PLEG): container finished" podID="2ca47168-94ee-4a81-a272-70ff0c354223" containerID="1622560db929879fb7960afcbf618ecd31dfd9fb034825011401e7780fbe1794" exitCode=0 Jun 03 14:58:39.355294 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:39.355155 2580 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-6mwf7" Jun 03 14:58:39.355294 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:39.355182 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-6mwf7" event={"ID":"2ca47168-94ee-4a81-a272-70ff0c354223","Type":"ContainerDied","Data":"1622560db929879fb7960afcbf618ecd31dfd9fb034825011401e7780fbe1794"} Jun 03 14:58:39.355294 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:39.355221 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-6mwf7" event={"ID":"2ca47168-94ee-4a81-a272-70ff0c354223","Type":"ContainerDied","Data":"07173bfc417cc415623c037ab3f93b259ecbe66a7bf6cea7c28f6f81e3578baf"} Jun 03 14:58:39.355294 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:39.355237 2580 scope.go:117] "RemoveContainer" containerID="1622560db929879fb7960afcbf618ecd31dfd9fb034825011401e7780fbe1794" Jun 03 14:58:39.363355 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:39.363337 2580 scope.go:117] "RemoveContainer" containerID="1622560db929879fb7960afcbf618ecd31dfd9fb034825011401e7780fbe1794" Jun 03 14:58:39.363604 ip-10-0-134-32 kubenswrapper[2580]: E0603 14:58:39.363587 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1622560db929879fb7960afcbf618ecd31dfd9fb034825011401e7780fbe1794\": container with ID starting with 1622560db929879fb7960afcbf618ecd31dfd9fb034825011401e7780fbe1794 not found: ID does not exist" containerID="1622560db929879fb7960afcbf618ecd31dfd9fb034825011401e7780fbe1794" Jun 03 14:58:39.363694 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:39.363612 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1622560db929879fb7960afcbf618ecd31dfd9fb034825011401e7780fbe1794"} err="failed to get container status \"1622560db929879fb7960afcbf618ecd31dfd9fb034825011401e7780fbe1794\": rpc error: code = NotFound desc = could not find container \"1622560db929879fb7960afcbf618ecd31dfd9fb034825011401e7780fbe1794\": container with ID starting with 1622560db929879fb7960afcbf618ecd31dfd9fb034825011401e7780fbe1794 not found: ID does not exist" Jun 03 14:58:39.371530 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:39.371506 2580 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-6mwf7"] Jun 03 14:58:39.377524 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:39.377498 2580 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-6mwf7"] Jun 03 14:58:40.900385 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:40.900344 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ca47168-94ee-4a81-a272-70ff0c354223" path="/var/lib/kubelet/pods/2ca47168-94ee-4a81-a272-70ff0c354223/volumes" Jun 03 14:58:49.356307 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:58:49.356275 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-m8fsk" Jun 03 14:59:57.776640 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:57.776603 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-qc47c"] Jun 03 14:59:57.777111 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:57.776951 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ca47168-94ee-4a81-a272-70ff0c354223" containerName="authorino" Jun 03 14:59:57.777111 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:57.776963 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ca47168-94ee-4a81-a272-70ff0c354223" containerName="authorino" Jun 03 14:59:57.777111 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:57.777033 2580 memory_manager.go:356] "RemoveStaleState removing state" podUID="2ca47168-94ee-4a81-a272-70ff0c354223" containerName="authorino" Jun 03 14:59:57.778971 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:57.778950 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-qc47c" Jun 03 14:59:57.781443 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:57.781420 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7b9vv\"" Jun 03 14:59:57.786823 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:57.786799 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-qc47c"] Jun 03 14:59:57.824954 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:57.824930 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-278h6\" (UniqueName: \"kubernetes.io/projected/6a0fe2d7-8c25-424a-b870-6f42ffa515d8-kube-api-access-278h6\") pod \"authorino-8b475cf9f-qc47c\" (UID: \"6a0fe2d7-8c25-424a-b870-6f42ffa515d8\") " pod="kuadrant-system/authorino-8b475cf9f-qc47c" Jun 03 14:59:57.925429 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:57.925389 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-278h6\" (UniqueName: \"kubernetes.io/projected/6a0fe2d7-8c25-424a-b870-6f42ffa515d8-kube-api-access-278h6\") pod \"authorino-8b475cf9f-qc47c\" (UID: \"6a0fe2d7-8c25-424a-b870-6f42ffa515d8\") " pod="kuadrant-system/authorino-8b475cf9f-qc47c" Jun 03 14:59:57.935209 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:57.935174 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-278h6\" (UniqueName: \"kubernetes.io/projected/6a0fe2d7-8c25-424a-b870-6f42ffa515d8-kube-api-access-278h6\") pod \"authorino-8b475cf9f-qc47c\" (UID: \"6a0fe2d7-8c25-424a-b870-6f42ffa515d8\") " pod="kuadrant-system/authorino-8b475cf9f-qc47c" Jun 03 14:59:58.021279 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:58.021243 2580 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-qc47c"] Jun 03 14:59:58.021526 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:58.021511 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-qc47c" Jun 03 14:59:58.049209 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:58.049175 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d56c97bd6-dkkbj"] Jun 03 14:59:58.052153 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:58.052136 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d56c97bd6-dkkbj" Jun 03 14:59:58.061789 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:58.061737 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d56c97bd6-dkkbj"] Jun 03 14:59:58.127969 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:58.127937 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjn88\" (UniqueName: \"kubernetes.io/projected/0b3131a5-ede9-4409-8169-3a6383f317de-kube-api-access-xjn88\") pod \"authorino-6d56c97bd6-dkkbj\" (UID: \"0b3131a5-ede9-4409-8169-3a6383f317de\") " pod="kuadrant-system/authorino-6d56c97bd6-dkkbj" Jun 03 14:59:58.159921 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:58.159883 2580 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-qc47c"] Jun 03 14:59:58.163270 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:59:58.163242 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a0fe2d7_8c25_424a_b870_6f42ffa515d8.slice/crio-1b14fa470c3fbcdc8e9a3fdb2f0861e5f6a4d3efaed56f3d1eb00bced8cc9514 WatchSource:0}: Error finding container 1b14fa470c3fbcdc8e9a3fdb2f0861e5f6a4d3efaed56f3d1eb00bced8cc9514: Status 404 returned error can't find the container with id 1b14fa470c3fbcdc8e9a3fdb2f0861e5f6a4d3efaed56f3d1eb00bced8cc9514 Jun 03 14:59:58.228516 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:58.228471 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xjn88\" (UniqueName: \"kubernetes.io/projected/0b3131a5-ede9-4409-8169-3a6383f317de-kube-api-access-xjn88\") pod \"authorino-6d56c97bd6-dkkbj\" (UID: \"0b3131a5-ede9-4409-8169-3a6383f317de\") " pod="kuadrant-system/authorino-6d56c97bd6-dkkbj" Jun 03 14:59:58.236768 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:58.236744 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjn88\" (UniqueName: \"kubernetes.io/projected/0b3131a5-ede9-4409-8169-3a6383f317de-kube-api-access-xjn88\") pod \"authorino-6d56c97bd6-dkkbj\" (UID: \"0b3131a5-ede9-4409-8169-3a6383f317de\") " pod="kuadrant-system/authorino-6d56c97bd6-dkkbj" Jun 03 14:59:58.364040 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:58.363963 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d56c97bd6-dkkbj" Jun 03 14:59:58.494821 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:58.494794 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d56c97bd6-dkkbj"] Jun 03 14:59:58.497441 ip-10-0-134-32 kubenswrapper[2580]: W0603 14:59:58.497410 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b3131a5_ede9_4409_8169_3a6383f317de.slice/crio-d7a8fbefabf2df22ead29276bfbd9624a01f88a1ada166ab5ee02a44d13e0bc9 WatchSource:0}: Error finding container d7a8fbefabf2df22ead29276bfbd9624a01f88a1ada166ab5ee02a44d13e0bc9: Status 404 returned error can't find the container with id d7a8fbefabf2df22ead29276bfbd9624a01f88a1ada166ab5ee02a44d13e0bc9 Jun 03 14:59:58.611899 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:58.611864 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d56c97bd6-dkkbj" event={"ID":"0b3131a5-ede9-4409-8169-3a6383f317de","Type":"ContainerStarted","Data":"d7a8fbefabf2df22ead29276bfbd9624a01f88a1ada166ab5ee02a44d13e0bc9"} Jun 03 14:59:58.612814 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:58.612784 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-qc47c" event={"ID":"6a0fe2d7-8c25-424a-b870-6f42ffa515d8","Type":"ContainerStarted","Data":"1b14fa470c3fbcdc8e9a3fdb2f0861e5f6a4d3efaed56f3d1eb00bced8cc9514"} Jun 03 14:59:59.617385 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:59.617346 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d56c97bd6-dkkbj" event={"ID":"0b3131a5-ede9-4409-8169-3a6383f317de","Type":"ContainerStarted","Data":"58b601fffec02321e54130a7655524c71b0ad5b98cf08524ecb90f99f64876ba"} Jun 03 14:59:59.618486 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:59.618458 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-qc47c" event={"ID":"6a0fe2d7-8c25-424a-b870-6f42ffa515d8","Type":"ContainerStarted","Data":"223bf14792d596e2b4bab7224eb8145b2e69c6b76398b7601e077d13fc71de01"} Jun 03 14:59:59.618599 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:59.618510 2580 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-qc47c" podUID="6a0fe2d7-8c25-424a-b870-6f42ffa515d8" containerName="authorino" containerID="cri-o://223bf14792d596e2b4bab7224eb8145b2e69c6b76398b7601e077d13fc71de01" gracePeriod=30 Jun 03 14:59:59.631884 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:59.631834 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-6d56c97bd6-dkkbj" podStartSLOduration=1.308139088 podStartE2EDuration="1.631817579s" podCreationTimestamp="2026-06-03 14:59:58 +0000 UTC" firstStartedPulling="2026-06-03 14:59:58.498828005 +0000 UTC m=+882.161930446" lastFinishedPulling="2026-06-03 14:59:58.822506493 +0000 UTC m=+882.485608937" observedRunningTime="2026-06-03 14:59:59.631448261 +0000 UTC m=+883.294550725" watchObservedRunningTime="2026-06-03 14:59:59.631817579 +0000 UTC m=+883.294920042" Jun 03 14:59:59.647141 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:59.647092 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-qc47c" podStartSLOduration=2.219100462 podStartE2EDuration="2.647077951s" podCreationTimestamp="2026-06-03 14:59:57 +0000 UTC" firstStartedPulling="2026-06-03 14:59:58.164520565 +0000 UTC m=+881.827623006" lastFinishedPulling="2026-06-03 14:59:58.592498054 +0000 UTC m=+882.255600495" observedRunningTime="2026-06-03 14:59:59.645328897 +0000 UTC m=+883.308431361" watchObservedRunningTime="2026-06-03 14:59:59.647077951 +0000 UTC m=+883.310180414" Jun 03 14:59:59.863951 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:59.863928 2580 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-qc47c" Jun 03 14:59:59.942232 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:59.942203 2580 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-278h6\" (UniqueName: \"kubernetes.io/projected/6a0fe2d7-8c25-424a-b870-6f42ffa515d8-kube-api-access-278h6\") pod \"6a0fe2d7-8c25-424a-b870-6f42ffa515d8\" (UID: \"6a0fe2d7-8c25-424a-b870-6f42ffa515d8\") " Jun 03 14:59:59.944444 ip-10-0-134-32 kubenswrapper[2580]: I0603 14:59:59.944416 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a0fe2d7-8c25-424a-b870-6f42ffa515d8-kube-api-access-278h6" (OuterVolumeSpecName: "kube-api-access-278h6") pod "6a0fe2d7-8c25-424a-b870-6f42ffa515d8" (UID: "6a0fe2d7-8c25-424a-b870-6f42ffa515d8"). InnerVolumeSpecName "kube-api-access-278h6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:00:00.043358 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:00:00.043310 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-278h6\" (UniqueName: \"kubernetes.io/projected/6a0fe2d7-8c25-424a-b870-6f42ffa515d8-kube-api-access-278h6\") on node \"ip-10-0-134-32.ec2.internal\" DevicePath \"\"" Jun 03 15:00:00.623588 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:00:00.623550 2580 generic.go:358] "Generic (PLEG): container finished" podID="6a0fe2d7-8c25-424a-b870-6f42ffa515d8" containerID="223bf14792d596e2b4bab7224eb8145b2e69c6b76398b7601e077d13fc71de01" exitCode=0 Jun 03 15:00:00.624044 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:00:00.623600 2580 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-qc47c" Jun 03 15:00:00.624044 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:00:00.623635 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-qc47c" event={"ID":"6a0fe2d7-8c25-424a-b870-6f42ffa515d8","Type":"ContainerDied","Data":"223bf14792d596e2b4bab7224eb8145b2e69c6b76398b7601e077d13fc71de01"} Jun 03 15:00:00.624044 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:00:00.623697 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-qc47c" event={"ID":"6a0fe2d7-8c25-424a-b870-6f42ffa515d8","Type":"ContainerDied","Data":"1b14fa470c3fbcdc8e9a3fdb2f0861e5f6a4d3efaed56f3d1eb00bced8cc9514"} Jun 03 15:00:00.624044 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:00:00.623717 2580 scope.go:117] "RemoveContainer" containerID="223bf14792d596e2b4bab7224eb8145b2e69c6b76398b7601e077d13fc71de01" Jun 03 15:00:00.634384 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:00:00.634362 2580 scope.go:117] "RemoveContainer" containerID="223bf14792d596e2b4bab7224eb8145b2e69c6b76398b7601e077d13fc71de01" Jun 03 15:00:00.635200 ip-10-0-134-32 kubenswrapper[2580]: E0603 15:00:00.635176 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"223bf14792d596e2b4bab7224eb8145b2e69c6b76398b7601e077d13fc71de01\": container with ID starting with 223bf14792d596e2b4bab7224eb8145b2e69c6b76398b7601e077d13fc71de01 not found: ID does not exist" containerID="223bf14792d596e2b4bab7224eb8145b2e69c6b76398b7601e077d13fc71de01" Jun 03 15:00:00.635287 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:00:00.635208 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"223bf14792d596e2b4bab7224eb8145b2e69c6b76398b7601e077d13fc71de01"} err="failed to get container status \"223bf14792d596e2b4bab7224eb8145b2e69c6b76398b7601e077d13fc71de01\": rpc error: code = NotFound desc = could not find container \"223bf14792d596e2b4bab7224eb8145b2e69c6b76398b7601e077d13fc71de01\": container with ID starting with 223bf14792d596e2b4bab7224eb8145b2e69c6b76398b7601e077d13fc71de01 not found: ID does not exist" Jun 03 15:00:00.643576 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:00:00.643544 2580 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-qc47c"] Jun 03 15:00:00.645223 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:00:00.645203 2580 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-qc47c"] Jun 03 15:00:00.901146 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:00:00.901114 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a0fe2d7-8c25-424a-b870-6f42ffa515d8" path="/var/lib/kubelet/pods/6a0fe2d7-8c25-424a-b870-6f42ffa515d8/volumes" Jun 03 15:00:38.009005 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:00:38.008968 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-m8fsk"] Jun 03 15:01:33.619682 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:33.619625 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-m8fsk"] Jun 03 15:01:45.149687 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:45.149635 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-m8fsk"] Jun 03 15:01:54.819906 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:54.819872 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg"] Jun 03 15:01:54.820282 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:54.820239 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a0fe2d7-8c25-424a-b870-6f42ffa515d8" containerName="authorino" Jun 03 15:01:54.820282 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:54.820252 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a0fe2d7-8c25-424a-b870-6f42ffa515d8" containerName="authorino" Jun 03 15:01:54.820355 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:54.820330 2580 memory_manager.go:356] "RemoveStaleState removing state" podUID="6a0fe2d7-8c25-424a-b870-6f42ffa515d8" containerName="authorino" Jun 03 15:01:54.822959 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:54.822936 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" Jun 03 15:01:54.826839 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:54.826811 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gnjdk\"" Jun 03 15:01:54.827079 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:54.826814 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 15:01:54.827152 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:54.826813 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 03 15:01:54.827286 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:54.826916 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 15:01:54.837930 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:54.837904 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg"] Jun 03 15:01:54.914770 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:54.914736 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzbr9\" (UniqueName: \"kubernetes.io/projected/d69a21cc-eced-47f8-9d7d-b1a24e9862ec-kube-api-access-fzbr9\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg\" (UID: \"d69a21cc-eced-47f8-9d7d-b1a24e9862ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" Jun 03 15:01:54.914953 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:54.914804 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d69a21cc-eced-47f8-9d7d-b1a24e9862ec-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg\" (UID: \"d69a21cc-eced-47f8-9d7d-b1a24e9862ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" Jun 03 15:01:54.914953 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:54.914830 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d69a21cc-eced-47f8-9d7d-b1a24e9862ec-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg\" (UID: \"d69a21cc-eced-47f8-9d7d-b1a24e9862ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" Jun 03 15:01:54.914953 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:54.914869 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d69a21cc-eced-47f8-9d7d-b1a24e9862ec-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg\" (UID: \"d69a21cc-eced-47f8-9d7d-b1a24e9862ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" Jun 03 15:01:54.914953 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:54.914902 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d69a21cc-eced-47f8-9d7d-b1a24e9862ec-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg\" (UID: \"d69a21cc-eced-47f8-9d7d-b1a24e9862ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" Jun 03 15:01:54.914953 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:54.914923 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d69a21cc-eced-47f8-9d7d-b1a24e9862ec-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg\" (UID: \"d69a21cc-eced-47f8-9d7d-b1a24e9862ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" Jun 03 15:01:55.015845 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:55.015803 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fzbr9\" (UniqueName: \"kubernetes.io/projected/d69a21cc-eced-47f8-9d7d-b1a24e9862ec-kube-api-access-fzbr9\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg\" (UID: \"d69a21cc-eced-47f8-9d7d-b1a24e9862ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" Jun 03 15:01:55.016046 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:55.015895 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d69a21cc-eced-47f8-9d7d-b1a24e9862ec-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg\" (UID: \"d69a21cc-eced-47f8-9d7d-b1a24e9862ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" Jun 03 15:01:55.016046 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:55.015925 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d69a21cc-eced-47f8-9d7d-b1a24e9862ec-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg\" (UID: \"d69a21cc-eced-47f8-9d7d-b1a24e9862ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" Jun 03 15:01:55.016046 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:55.015968 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d69a21cc-eced-47f8-9d7d-b1a24e9862ec-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg\" (UID: \"d69a21cc-eced-47f8-9d7d-b1a24e9862ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" Jun 03 15:01:55.016046 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:55.015999 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d69a21cc-eced-47f8-9d7d-b1a24e9862ec-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg\" (UID: \"d69a21cc-eced-47f8-9d7d-b1a24e9862ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" Jun 03 15:01:55.016046 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:55.016020 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d69a21cc-eced-47f8-9d7d-b1a24e9862ec-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg\" (UID: \"d69a21cc-eced-47f8-9d7d-b1a24e9862ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" Jun 03 15:01:55.016696 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:55.016371 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d69a21cc-eced-47f8-9d7d-b1a24e9862ec-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg\" (UID: \"d69a21cc-eced-47f8-9d7d-b1a24e9862ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" Jun 03 15:01:55.016696 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:55.016492 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d69a21cc-eced-47f8-9d7d-b1a24e9862ec-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg\" (UID: \"d69a21cc-eced-47f8-9d7d-b1a24e9862ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" Jun 03 15:01:55.016696 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:55.016638 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d69a21cc-eced-47f8-9d7d-b1a24e9862ec-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg\" (UID: \"d69a21cc-eced-47f8-9d7d-b1a24e9862ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" Jun 03 15:01:55.023890 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:55.023860 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d69a21cc-eced-47f8-9d7d-b1a24e9862ec-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg\" (UID: \"d69a21cc-eced-47f8-9d7d-b1a24e9862ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" Jun 03 15:01:55.025359 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:55.025305 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzbr9\" (UniqueName: \"kubernetes.io/projected/d69a21cc-eced-47f8-9d7d-b1a24e9862ec-kube-api-access-fzbr9\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg\" (UID: \"d69a21cc-eced-47f8-9d7d-b1a24e9862ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" Jun 03 15:01:55.026729 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:55.026705 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d69a21cc-eced-47f8-9d7d-b1a24e9862ec-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg\" (UID: \"d69a21cc-eced-47f8-9d7d-b1a24e9862ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" Jun 03 15:01:55.137739 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:55.137701 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" Jun 03 15:01:55.275557 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:55.275533 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg"] Jun 03 15:01:55.278336 ip-10-0-134-32 kubenswrapper[2580]: W0603 15:01:55.278308 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd69a21cc_eced_47f8_9d7d_b1a24e9862ec.slice/crio-20f1f042f480c29a3c108a15cb1b1b349621913a505214dc7749f02ea6d62c64 WatchSource:0}: Error finding container 20f1f042f480c29a3c108a15cb1b1b349621913a505214dc7749f02ea6d62c64: Status 404 returned error can't find the container with id 20f1f042f480c29a3c108a15cb1b1b349621913a505214dc7749f02ea6d62c64 Jun 03 15:01:55.280302 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:55.280277 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:01:55.939565 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:55.939526 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-m8fsk"] Jun 03 15:01:56.031289 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:56.031255 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" event={"ID":"d69a21cc-eced-47f8-9d7d-b1a24e9862ec","Type":"ContainerStarted","Data":"20f1f042f480c29a3c108a15cb1b1b349621913a505214dc7749f02ea6d62c64"} Jun 03 15:01:59.044156 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:01:59.044118 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" event={"ID":"d69a21cc-eced-47f8-9d7d-b1a24e9862ec","Type":"ContainerStarted","Data":"bfd1d752d8927f89500458012c1a74565d444902960279eb3029f01f563a5118"} Jun 03 15:02:01.053899 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:01.053868 2580 generic.go:358] "Generic (PLEG): container finished" podID="d69a21cc-eced-47f8-9d7d-b1a24e9862ec" containerID="bfd1d752d8927f89500458012c1a74565d444902960279eb3029f01f563a5118" exitCode=0 Jun 03 15:02:01.054276 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:01.053928 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" event={"ID":"d69a21cc-eced-47f8-9d7d-b1a24e9862ec","Type":"ContainerDied","Data":"bfd1d752d8927f89500458012c1a74565d444902960279eb3029f01f563a5118"} Jun 03 15:02:03.953955 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:03.953916 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-m8fsk"] Jun 03 15:02:21.471354 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:21.471319 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr"] Jun 03 15:02:21.481572 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:21.481553 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" Jun 03 15:02:21.497643 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:21.497621 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 03 15:02:21.523019 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:21.522986 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr"] Jun 03 15:02:21.653318 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:21.653272 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr\" (UID: \"cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" Jun 03 15:02:21.653318 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:21.653318 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr\" (UID: \"cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" Jun 03 15:02:21.653546 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:21.653335 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr\" (UID: \"cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" Jun 03 15:02:21.653546 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:21.653408 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p782n\" (UniqueName: \"kubernetes.io/projected/cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e-kube-api-access-p782n\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr\" (UID: \"cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" Jun 03 15:02:21.653546 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:21.653458 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr\" (UID: \"cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" Jun 03 15:02:21.653546 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:21.653504 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr\" (UID: \"cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" Jun 03 15:02:21.754972 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:21.754875 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr\" (UID: \"cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" Jun 03 15:02:21.755120 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:21.754983 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr\" (UID: \"cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" Jun 03 15:02:21.755120 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:21.755017 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr\" (UID: \"cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" Jun 03 15:02:21.755120 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:21.755041 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr\" (UID: \"cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" Jun 03 15:02:21.755120 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:21.755088 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p782n\" (UniqueName: \"kubernetes.io/projected/cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e-kube-api-access-p782n\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr\" (UID: \"cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" Jun 03 15:02:21.755317 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:21.755125 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr\" (UID: \"cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" Jun 03 15:02:21.755402 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:21.755379 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr\" (UID: \"cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" Jun 03 15:02:21.755460 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:21.755417 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr\" (UID: \"cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" Jun 03 15:02:21.755514 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:21.755454 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr\" (UID: \"cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" Jun 03 15:02:21.757383 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:21.757353 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr\" (UID: \"cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" Jun 03 15:02:21.757673 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:21.757635 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr\" (UID: \"cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" Jun 03 15:02:21.773701 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:21.773677 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p782n\" (UniqueName: \"kubernetes.io/projected/cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e-kube-api-access-p782n\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr\" (UID: \"cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" Jun 03 15:02:21.791667 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:21.791620 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" Jun 03 15:02:21.937257 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:21.937221 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr"] Jun 03 15:02:21.940856 ip-10-0-134-32 kubenswrapper[2580]: W0603 15:02:21.940828 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc6c6f1a_c2c5_4233_b33f_3da879fd7d7e.slice/crio-8ad7b7c51bcdd74ac5c76a4b3d119ca5edbcbb9711248f47be6a9f1050066722 WatchSource:0}: Error finding container 8ad7b7c51bcdd74ac5c76a4b3d119ca5edbcbb9711248f47be6a9f1050066722: Status 404 returned error can't find the container with id 8ad7b7c51bcdd74ac5c76a4b3d119ca5edbcbb9711248f47be6a9f1050066722 Jun 03 15:02:22.126561 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:22.126524 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" event={"ID":"cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e","Type":"ContainerStarted","Data":"96d6880bdced960a1e0ae8a8bb3262df3d94cab0a56ac9ce60fcdaec7098cc1c"} Jun 03 15:02:22.126561 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:22.126557 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" event={"ID":"cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e","Type":"ContainerStarted","Data":"8ad7b7c51bcdd74ac5c76a4b3d119ca5edbcbb9711248f47be6a9f1050066722"} Jun 03 15:02:23.156457 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:23.156423 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-m8fsk"] Jun 03 15:02:25.140493 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:25.140460 2580 generic.go:358] "Generic (PLEG): container finished" podID="cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e" containerID="96d6880bdced960a1e0ae8a8bb3262df3d94cab0a56ac9ce60fcdaec7098cc1c" exitCode=0 Jun 03 15:02:25.140871 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:25.140545 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" event={"ID":"cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e","Type":"ContainerDied","Data":"96d6880bdced960a1e0ae8a8bb3262df3d94cab0a56ac9ce60fcdaec7098cc1c"} Jun 03 15:02:29.154229 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:29.154195 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" event={"ID":"d69a21cc-eced-47f8-9d7d-b1a24e9862ec","Type":"ContainerStarted","Data":"e56d7a51d92af0811c7a5781117df7290656ea275de16358d9677d1617ce1b64"} Jun 03 15:02:29.176204 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:29.176148 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" podStartSLOduration=1.9716194420000002 podStartE2EDuration="35.176134774s" podCreationTimestamp="2026-06-03 15:01:54 +0000 UTC" firstStartedPulling="2026-06-03 15:01:55.280467316 +0000 UTC m=+998.943569771" lastFinishedPulling="2026-06-03 15:02:28.484982659 +0000 UTC m=+1032.148085103" observedRunningTime="2026-06-03 15:02:29.175609882 +0000 UTC m=+1032.838712346" watchObservedRunningTime="2026-06-03 15:02:29.176134774 +0000 UTC m=+1032.839237236" Jun 03 15:02:35.138785 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:35.138745 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" Jun 03 15:02:35.139225 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:35.138797 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" Jun 03 15:02:35.151476 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:35.151444 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" Jun 03 15:02:35.186202 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:35.186167 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg" Jun 03 15:02:47.847573 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:47.847526 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-m8fsk"] Jun 03 15:02:50.232344 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:50.232308 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" event={"ID":"cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e","Type":"ContainerStarted","Data":"3f18af5f736621684c165e8181100f9d2d0437ac2e4085c81b278bcbad14cc60"} Jun 03 15:02:50.252941 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:50.252897 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" podStartSLOduration=5.087485373 podStartE2EDuration="29.252883303s" podCreationTimestamp="2026-06-03 15:02:21 +0000 UTC" firstStartedPulling="2026-06-03 15:02:25.141187315 +0000 UTC m=+1028.804289756" lastFinishedPulling="2026-06-03 15:02:49.306585245 +0000 UTC m=+1052.969687686" observedRunningTime="2026-06-03 15:02:50.252243733 +0000 UTC m=+1053.915346197" watchObservedRunningTime="2026-06-03 15:02:50.252883303 +0000 UTC m=+1053.915985760" Jun 03 15:02:51.792487 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:51.792448 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" Jun 03 15:02:51.792487 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:51.792495 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" Jun 03 15:02:51.805351 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:51.805323 2580 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" Jun 03 15:02:52.251361 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:02:52.251330 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr" Jun 03 15:09:03.887894 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:03.887820 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d56c97bd6-dkkbj_0b3131a5-ede9-4409-8169-3a6383f317de/authorino/0.log" Jun 03 15:09:09.696376 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:09.696344 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bd9f95c7d-wmr28_4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba/copy-manifests/0.log" Jun 03 15:09:09.709893 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:09.709868 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bd9f95c7d-wmr28_4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba/manager/0.log" Jun 03 15:09:11.318209 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:11.318176 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d56c97bd6-dkkbj_0b3131a5-ede9-4409-8169-3a6383f317de/authorino/0.log" Jun 03 15:09:11.436426 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:11.436392 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-jvvms_3ad5551d-5945-40d0-bbe1-6b5a02944eba/manager/0.log" Jun 03 15:09:12.053193 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:12.053159 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-m8fsk_8a3cda8c-627a-4a04-a49a-a5dfbb1a99b2/limitador/0.log" Jun 03 15:09:12.895775 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:12.895747 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fb689c99f-qknwb_dbeacfce-baab-47f2-b9d5-9249c28190dc/kube-auth-proxy/0.log" Jun 03 15:09:13.376630 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:13.376599 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5899b68489-rzt2z_10b236ab-1722-423e-b86d-9cb79540f191/router/0.log" Jun 03 15:09:13.984905 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:13.984875 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg_d69a21cc-eced-47f8-9d7d-b1a24e9862ec/storage-initializer/0.log" Jun 03 15:09:13.996515 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:13.996491 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-qqxpg_d69a21cc-eced-47f8-9d7d-b1a24e9862ec/main/0.log" Jun 03 15:09:14.229957 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:14.229936 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr_cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e/storage-initializer/0.log" Jun 03 15:09:14.239250 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:14.239178 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-rj8wr_cc6c6f1a-c2c5-4233-b33f-3da879fd7d7e/main/0.log" Jun 03 15:09:18.722020 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:18.721982 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9snz7/must-gather-nmdnt"] Jun 03 15:09:18.725318 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:18.725302 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9snz7/must-gather-nmdnt" Jun 03 15:09:18.727916 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:18.727895 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9snz7\"/\"kube-root-ca.crt\"" Jun 03 15:09:18.729030 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:18.729011 2580 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9snz7\"/\"openshift-service-ca.crt\"" Jun 03 15:09:18.729140 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:18.729015 2580 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9snz7\"/\"default-dockercfg-hzmpx\"" Jun 03 15:09:18.742707 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:18.742684 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9snz7/must-gather-nmdnt"] Jun 03 15:09:18.918550 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:18.918520 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl54t\" (UniqueName: \"kubernetes.io/projected/d15421cc-46f8-4d77-a8be-a3c17030f372-kube-api-access-rl54t\") pod \"must-gather-nmdnt\" (UID: \"d15421cc-46f8-4d77-a8be-a3c17030f372\") " pod="openshift-must-gather-9snz7/must-gather-nmdnt" Jun 03 15:09:18.918740 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:18.918614 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d15421cc-46f8-4d77-a8be-a3c17030f372-must-gather-output\") pod \"must-gather-nmdnt\" (UID: \"d15421cc-46f8-4d77-a8be-a3c17030f372\") " pod="openshift-must-gather-9snz7/must-gather-nmdnt" Jun 03 15:09:19.019980 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:19.019892 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d15421cc-46f8-4d77-a8be-a3c17030f372-must-gather-output\") pod \"must-gather-nmdnt\" (UID: \"d15421cc-46f8-4d77-a8be-a3c17030f372\") " pod="openshift-must-gather-9snz7/must-gather-nmdnt" Jun 03 15:09:19.019980 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:19.019979 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rl54t\" (UniqueName: \"kubernetes.io/projected/d15421cc-46f8-4d77-a8be-a3c17030f372-kube-api-access-rl54t\") pod \"must-gather-nmdnt\" (UID: \"d15421cc-46f8-4d77-a8be-a3c17030f372\") " pod="openshift-must-gather-9snz7/must-gather-nmdnt" Jun 03 15:09:19.020280 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:19.020257 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d15421cc-46f8-4d77-a8be-a3c17030f372-must-gather-output\") pod \"must-gather-nmdnt\" (UID: \"d15421cc-46f8-4d77-a8be-a3c17030f372\") " pod="openshift-must-gather-9snz7/must-gather-nmdnt" Jun 03 15:09:19.029558 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:19.029534 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl54t\" (UniqueName: \"kubernetes.io/projected/d15421cc-46f8-4d77-a8be-a3c17030f372-kube-api-access-rl54t\") pod \"must-gather-nmdnt\" (UID: \"d15421cc-46f8-4d77-a8be-a3c17030f372\") " pod="openshift-must-gather-9snz7/must-gather-nmdnt" Jun 03 15:09:19.033840 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:19.033820 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9snz7/must-gather-nmdnt" Jun 03 15:09:19.181254 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:19.181227 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9snz7/must-gather-nmdnt"] Jun 03 15:09:19.183189 ip-10-0-134-32 kubenswrapper[2580]: W0603 15:09:19.183158 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd15421cc_46f8_4d77_a8be_a3c17030f372.slice/crio-c3b564f5deb015f2d2b862d069eb8edd52b96a3c6f5e315e62bf744c168993a5 WatchSource:0}: Error finding container c3b564f5deb015f2d2b862d069eb8edd52b96a3c6f5e315e62bf744c168993a5: Status 404 returned error can't find the container with id c3b564f5deb015f2d2b862d069eb8edd52b96a3c6f5e315e62bf744c168993a5 Jun 03 15:09:19.185252 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:19.185235 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:09:19.562405 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:19.562369 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9snz7/must-gather-nmdnt" event={"ID":"d15421cc-46f8-4d77-a8be-a3c17030f372","Type":"ContainerStarted","Data":"c3b564f5deb015f2d2b862d069eb8edd52b96a3c6f5e315e62bf744c168993a5"} Jun 03 15:09:20.567292 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:20.567248 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9snz7/must-gather-nmdnt" event={"ID":"d15421cc-46f8-4d77-a8be-a3c17030f372","Type":"ContainerStarted","Data":"ce05f19e5df2434959deb93d50bb456aa53ce55a790cf317535fd20f2a6df9f4"} Jun 03 15:09:20.567292 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:20.567291 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9snz7/must-gather-nmdnt" event={"ID":"d15421cc-46f8-4d77-a8be-a3c17030f372","Type":"ContainerStarted","Data":"521c9b8e16f9ccb3de84d848f3f6a133fd136b03c83bc3bbbb0cda2faac90004"} Jun 03 15:09:20.584351 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:20.584292 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-9snz7/must-gather-nmdnt" podStartSLOduration=1.690016914 podStartE2EDuration="2.584277175s" podCreationTimestamp="2026-06-03 15:09:18 +0000 UTC" firstStartedPulling="2026-06-03 15:09:19.185367467 +0000 UTC m=+1442.848469908" lastFinishedPulling="2026-06-03 15:09:20.079627728 +0000 UTC m=+1443.742730169" observedRunningTime="2026-06-03 15:09:20.582394522 +0000 UTC m=+1444.245496987" watchObservedRunningTime="2026-06-03 15:09:20.584277175 +0000 UTC m=+1444.247379638" Jun 03 15:09:21.917419 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:21.917390 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4k4qb_db01432f-994f-414e-83ab-34ec0ca5fb26/global-pull-secret-syncer/0.log" Jun 03 15:09:22.158194 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:22.158138 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xmqx7_dca64948-d4ce-43d4-bbd4-b651db08a776/konnectivity-agent/0.log" Jun 03 15:09:22.217239 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:22.217153 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-32.ec2.internal_9bbfdd57113509939e81d22cb0c12ade/haproxy/0.log" Jun 03 15:09:26.373897 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:26.373866 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d56c97bd6-dkkbj_0b3131a5-ede9-4409-8169-3a6383f317de/authorino/0.log" Jun 03 15:09:26.407063 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:26.406881 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-jvvms_3ad5551d-5945-40d0-bbe1-6b5a02944eba/manager/0.log" Jun 03 15:09:26.595763 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:26.595733 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-m8fsk_8a3cda8c-627a-4a04-a49a-a5dfbb1a99b2/limitador/0.log" Jun 03 15:09:28.191502 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:28.191463 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-74fbff5879-5qm8g_4551f145-77cf-4717-a050-d2793d2e9b1c/metrics-server/0.log" Jun 03 15:09:28.316568 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:28.315750 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6vlhb_29c1895a-9866-4d8b-b066-5e9c6f9447ca/node-exporter/0.log" Jun 03 15:09:28.347677 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:28.346712 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6vlhb_29c1895a-9866-4d8b-b066-5e9c6f9447ca/kube-rbac-proxy/0.log" Jun 03 15:09:28.370793 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:28.370751 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6vlhb_29c1895a-9866-4d8b-b066-5e9c6f9447ca/init-textfile/0.log" Jun 03 15:09:28.675929 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:28.675874 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6ed61594-c33d-419d-80fc-1a6f7b80d379/prometheus/0.log" Jun 03 15:09:28.703484 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:28.703451 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6ed61594-c33d-419d-80fc-1a6f7b80d379/config-reloader/0.log" Jun 03 15:09:28.729118 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:28.729047 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6ed61594-c33d-419d-80fc-1a6f7b80d379/thanos-sidecar/0.log" Jun 03 15:09:28.753676 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:28.752349 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6ed61594-c33d-419d-80fc-1a6f7b80d379/kube-rbac-proxy-web/0.log" Jun 03 15:09:28.777303 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:28.777273 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6ed61594-c33d-419d-80fc-1a6f7b80d379/kube-rbac-proxy/0.log" Jun 03 15:09:28.806551 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:28.806528 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6ed61594-c33d-419d-80fc-1a6f7b80d379/kube-rbac-proxy-thanos/0.log" Jun 03 15:09:28.841945 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:28.841918 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6ed61594-c33d-419d-80fc-1a6f7b80d379/init-config-reloader/0.log" Jun 03 15:09:28.880671 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:28.880617 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-k8tb9_0092d9e0-ef4c-48d4-a574-be4a63f7db96/prometheus-operator/0.log" Jun 03 15:09:28.908788 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:28.908747 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-k8tb9_0092d9e0-ef4c-48d4-a574-be4a63f7db96/kube-rbac-proxy/0.log" Jun 03 15:09:28.928854 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:28.928823 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-9zl62_f2f14a8e-ea5b-4066-ba46-6d00ac8af806/prometheus-operator-admission-webhook/0.log" Jun 03 15:09:28.968793 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:28.968765 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c4b4bb8d5-ctxd2_e53c3fc4-ed40-4c67-8956-f1df8517c984/telemeter-client/0.log" Jun 03 15:09:28.992738 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:28.992673 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c4b4bb8d5-ctxd2_e53c3fc4-ed40-4c67-8956-f1df8517c984/reload/0.log" Jun 03 15:09:29.014045 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:29.014016 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c4b4bb8d5-ctxd2_e53c3fc4-ed40-4c67-8956-f1df8517c984/kube-rbac-proxy/0.log" Jun 03 15:09:31.400279 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:31.400232 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-s5d6z_b9ed5c6c-623c-44fb-8c83-859e820789d4/download-server/0.log" Jun 03 15:09:31.517100 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:31.517059 2580 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9snz7/perf-node-gather-daemonset-rj8dc"] Jun 03 15:09:31.524527 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:31.524492 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-rj8dc" Jun 03 15:09:31.534374 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:31.534319 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9snz7/perf-node-gather-daemonset-rj8dc"] Jun 03 15:09:31.653898 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:31.653818 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df1ce264-76a5-43c2-a4e5-1f0776e9572d-lib-modules\") pod \"perf-node-gather-daemonset-rj8dc\" (UID: \"df1ce264-76a5-43c2-a4e5-1f0776e9572d\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-rj8dc" Jun 03 15:09:31.653898 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:31.653869 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntgnq\" (UniqueName: \"kubernetes.io/projected/df1ce264-76a5-43c2-a4e5-1f0776e9572d-kube-api-access-ntgnq\") pod \"perf-node-gather-daemonset-rj8dc\" (UID: \"df1ce264-76a5-43c2-a4e5-1f0776e9572d\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-rj8dc" Jun 03 15:09:31.654081 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:31.653945 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/df1ce264-76a5-43c2-a4e5-1f0776e9572d-proc\") pod \"perf-node-gather-daemonset-rj8dc\" (UID: \"df1ce264-76a5-43c2-a4e5-1f0776e9572d\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-rj8dc" Jun 03 15:09:31.654081 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:31.653970 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/df1ce264-76a5-43c2-a4e5-1f0776e9572d-podres\") pod \"perf-node-gather-daemonset-rj8dc\" (UID: \"df1ce264-76a5-43c2-a4e5-1f0776e9572d\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-rj8dc" Jun 03 15:09:31.654081 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:31.653996 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df1ce264-76a5-43c2-a4e5-1f0776e9572d-sys\") pod \"perf-node-gather-daemonset-rj8dc\" (UID: \"df1ce264-76a5-43c2-a4e5-1f0776e9572d\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-rj8dc" Jun 03 15:09:31.755396 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:31.755352 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df1ce264-76a5-43c2-a4e5-1f0776e9572d-lib-modules\") pod \"perf-node-gather-daemonset-rj8dc\" (UID: \"df1ce264-76a5-43c2-a4e5-1f0776e9572d\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-rj8dc" Jun 03 15:09:31.755594 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:31.755415 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ntgnq\" (UniqueName: \"kubernetes.io/projected/df1ce264-76a5-43c2-a4e5-1f0776e9572d-kube-api-access-ntgnq\") pod \"perf-node-gather-daemonset-rj8dc\" (UID: \"df1ce264-76a5-43c2-a4e5-1f0776e9572d\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-rj8dc" Jun 03 15:09:31.755594 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:31.755474 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/df1ce264-76a5-43c2-a4e5-1f0776e9572d-proc\") pod \"perf-node-gather-daemonset-rj8dc\" (UID: \"df1ce264-76a5-43c2-a4e5-1f0776e9572d\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-rj8dc" Jun 03 15:09:31.755594 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:31.755507 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/df1ce264-76a5-43c2-a4e5-1f0776e9572d-podres\") pod \"perf-node-gather-daemonset-rj8dc\" (UID: \"df1ce264-76a5-43c2-a4e5-1f0776e9572d\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-rj8dc" Jun 03 15:09:31.755594 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:31.755528 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df1ce264-76a5-43c2-a4e5-1f0776e9572d-lib-modules\") pod \"perf-node-gather-daemonset-rj8dc\" (UID: \"df1ce264-76a5-43c2-a4e5-1f0776e9572d\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-rj8dc" Jun 03 15:09:31.755594 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:31.755553 2580 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df1ce264-76a5-43c2-a4e5-1f0776e9572d-sys\") pod \"perf-node-gather-daemonset-rj8dc\" (UID: \"df1ce264-76a5-43c2-a4e5-1f0776e9572d\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-rj8dc" Jun 03 15:09:31.755815 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:31.755613 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/df1ce264-76a5-43c2-a4e5-1f0776e9572d-podres\") pod \"perf-node-gather-daemonset-rj8dc\" (UID: \"df1ce264-76a5-43c2-a4e5-1f0776e9572d\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-rj8dc" Jun 03 15:09:31.755815 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:31.755628 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/df1ce264-76a5-43c2-a4e5-1f0776e9572d-proc\") pod \"perf-node-gather-daemonset-rj8dc\" (UID: \"df1ce264-76a5-43c2-a4e5-1f0776e9572d\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-rj8dc" Jun 03 15:09:31.755815 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:31.755643 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df1ce264-76a5-43c2-a4e5-1f0776e9572d-sys\") pod \"perf-node-gather-daemonset-rj8dc\" (UID: \"df1ce264-76a5-43c2-a4e5-1f0776e9572d\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-rj8dc" Jun 03 15:09:31.765459 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:31.765428 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntgnq\" (UniqueName: \"kubernetes.io/projected/df1ce264-76a5-43c2-a4e5-1f0776e9572d-kube-api-access-ntgnq\") pod \"perf-node-gather-daemonset-rj8dc\" (UID: \"df1ce264-76a5-43c2-a4e5-1f0776e9572d\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-rj8dc" Jun 03 15:09:31.840283 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:31.840244 2580 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-rj8dc" Jun 03 15:09:32.010769 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:32.010168 2580 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9snz7/perf-node-gather-daemonset-rj8dc"] Jun 03 15:09:32.012710 ip-10-0-134-32 kubenswrapper[2580]: W0603 15:09:32.012675 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddf1ce264_76a5_43c2_a4e5_1f0776e9572d.slice/crio-8e1685778baf37b3622ae0a4a8270e4516db113ae26b0ee842996cb6cd24d28c WatchSource:0}: Error finding container 8e1685778baf37b3622ae0a4a8270e4516db113ae26b0ee842996cb6cd24d28c: Status 404 returned error can't find the container with id 8e1685778baf37b3622ae0a4a8270e4516db113ae26b0ee842996cb6cd24d28c Jun 03 15:09:32.618297 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:32.618268 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-rj8dc" event={"ID":"df1ce264-76a5-43c2-a4e5-1f0776e9572d","Type":"ContainerStarted","Data":"d12a97b93f12b774bdf31d2c126d7e0904df4851d2767748f0c48035693a0546"} Jun 03 15:09:32.618297 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:32.618303 2580 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-rj8dc" event={"ID":"df1ce264-76a5-43c2-a4e5-1f0776e9572d","Type":"ContainerStarted","Data":"8e1685778baf37b3622ae0a4a8270e4516db113ae26b0ee842996cb6cd24d28c"} Jun 03 15:09:32.618805 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:32.618344 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-rj8dc" Jun 03 15:09:32.637086 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:32.637025 2580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-rj8dc" podStartSLOduration=1.6370055799999998 podStartE2EDuration="1.63700558s" podCreationTimestamp="2026-06-03 15:09:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:09:32.636385472 +0000 UTC m=+1456.299487940" watchObservedRunningTime="2026-06-03 15:09:32.63700558 +0000 UTC m=+1456.300108046" Jun 03 15:09:32.958574 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:32.958540 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-798tm_a3762e8b-89b7-46cf-bfff-d02b5ea63779/dns/0.log" Jun 03 15:09:32.988274 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:32.988247 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-798tm_a3762e8b-89b7-46cf-bfff-d02b5ea63779/kube-rbac-proxy/0.log" Jun 03 15:09:33.162228 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:33.162200 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-knjfc_c8bacdf4-c8e3-4a93-8a3b-b57db3791c86/dns-node-resolver/0.log" Jun 03 15:09:33.800132 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:33.800101 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rvlxf_c16b05d8-a603-4e5e-a431-7dfe6e86ca0b/node-ca/0.log" Jun 03 15:09:34.868423 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:34.868391 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fb689c99f-qknwb_dbeacfce-baab-47f2-b9d5-9249c28190dc/kube-auth-proxy/0.log" Jun 03 15:09:35.025088 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:35.025061 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5899b68489-rzt2z_10b236ab-1722-423e-b86d-9cb79540f191/router/0.log" Jun 03 15:09:35.737063 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:35.737031 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-njv2f_7c67156d-cd08-4a11-b6f8-5430e5673f45/serve-healthcheck-canary/0.log" Jun 03 15:09:36.399689 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:36.399637 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mjfls_4e3bcb75-7227-4d8b-bba1-097048c0861d/kube-rbac-proxy/0.log" Jun 03 15:09:36.431282 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:36.431259 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mjfls_4e3bcb75-7227-4d8b-bba1-097048c0861d/exporter/0.log" Jun 03 15:09:36.469975 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:36.469946 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mjfls_4e3bcb75-7227-4d8b-bba1-097048c0861d/extractor/0.log" Jun 03 15:09:38.633097 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:38.633071 2580 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-rj8dc" Jun 03 15:09:39.157773 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:39.157736 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bd9f95c7d-wmr28_4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba/manager/0.log" Jun 03 15:09:39.176179 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:39.176152 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bd9f95c7d-wmr28_4f1c570f-b53a-4ce2-9ac6-8504e20bb4ba/copy-manifests/0.log" Jun 03 15:09:40.934064 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:40.934038 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5c7547bc79-b4pz5_462cbe04-51a3-4867-9760-8d4cc9ce59ee/manager/0.log" Jun 03 15:09:45.762680 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:45.762629 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-l89fz_a202206a-0f64-4e17-bbeb-7e2591cf589e/migrator/0.log" Jun 03 15:09:45.793926 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:45.793893 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-l89fz_a202206a-0f64-4e17-bbeb-7e2591cf589e/graceful-termination/0.log" Jun 03 15:09:46.214113 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:46.214079 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-t5289_767e75c0-64a1-4662-a1cf-d24409a9c302/kube-storage-version-migrator-operator/1.log" Jun 03 15:09:46.214968 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:46.214946 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-t5289_767e75c0-64a1-4662-a1cf-d24409a9c302/kube-storage-version-migrator-operator/0.log" Jun 03 15:09:47.749420 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:47.749395 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qp7fh_6864f29b-0e87-45fa-9de3-35e89474c9ca/kube-multus-additional-cni-plugins/0.log" Jun 03 15:09:47.786344 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:47.786316 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qp7fh_6864f29b-0e87-45fa-9de3-35e89474c9ca/egress-router-binary-copy/0.log" Jun 03 15:09:47.811853 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:47.811823 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qp7fh_6864f29b-0e87-45fa-9de3-35e89474c9ca/cni-plugins/0.log" Jun 03 15:09:47.839200 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:47.839175 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qp7fh_6864f29b-0e87-45fa-9de3-35e89474c9ca/bond-cni-plugin/0.log" Jun 03 15:09:47.863827 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:47.863801 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qp7fh_6864f29b-0e87-45fa-9de3-35e89474c9ca/routeoverride-cni/0.log" Jun 03 15:09:47.889013 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:47.888990 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qp7fh_6864f29b-0e87-45fa-9de3-35e89474c9ca/whereabouts-cni-bincopy/0.log" Jun 03 15:09:47.915419 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:47.915390 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qp7fh_6864f29b-0e87-45fa-9de3-35e89474c9ca/whereabouts-cni/0.log" Jun 03 15:09:48.061091 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:48.060941 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wt9nf_6fcad51b-5916-4694-87a8-bf3ac3cf21cf/kube-multus/0.log" Jun 03 15:09:48.214820 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:48.214790 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qlx8q_bef4ffc0-2d1c-4742-abdd-1ba23bea3574/network-metrics-daemon/0.log" Jun 03 15:09:48.246355 ip-10-0-134-32 kubenswrapper[2580]: I0603 15:09:48.246324 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qlx8q_bef4ffc0-2d1c-4742-abdd-1ba23bea3574/kube-rbac-proxy/0.log"