Jun 03 03:20:24.703282 ip-10-0-141-253 systemd[1]: Starting Kubernetes Kubelet... Jun 03 03:20:25.158419 ip-10-0-141-253 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 03:20:25.158419 ip-10-0-141-253 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 03:20:25.158419 ip-10-0-141-253 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 03:20:25.158419 ip-10-0-141-253 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 03:20:25.158419 ip-10-0-141-253 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 03:20:25.160029 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.159923 2558 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 03:20:25.164113 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164098 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 03:20:25.164113 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164114 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 03:20:25.164175 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164119 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 03:20:25.164175 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164123 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 03:20:25.164175 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164126 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 03:20:25.164175 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164130 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 03:20:25.164175 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164133 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 03:20:25.164175 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164140 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 03:20:25.164175 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164143 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 03:20:25.164175 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164147 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 03:20:25.164175 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164151 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 03:20:25.164175 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164155 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 03:20:25.164175 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164158 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 03:20:25.164175 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164161 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 03:20:25.164175 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164164 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 03:20:25.164175 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164167 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 03:20:25.164175 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164169 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 03:20:25.164175 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164172 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 03 03:20:25.164175 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164174 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 03:20:25.164175 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164177 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 03:20:25.164175 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164180 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 03:20:25.164175 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164183 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 03:20:25.164648 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164186 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 03:20:25.164648 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164189 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 03:20:25.164648 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164192 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 03:20:25.164648 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164194 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 03:20:25.164648 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164197 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 03:20:25.164648 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164199 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 03:20:25.164648 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164202 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 03:20:25.164648 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164205 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 03:20:25.164648 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164209 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 03:20:25.164648 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164212 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 03:20:25.164648 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164215 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 03:20:25.164648 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164218 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 03:20:25.164648 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164221 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 03:20:25.164648 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164224 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 03:20:25.164648 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164227 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 03:20:25.164648 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164236 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 03:20:25.164648 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164239 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 03:20:25.164648 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164242 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 03:20:25.164648 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164250 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 03:20:25.165124 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164253 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 03:20:25.165124 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164256 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 03:20:25.165124 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164259 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 03:20:25.165124 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164261 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 03:20:25.165124 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164265 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 03:20:25.165124 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164267 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 03:20:25.165124 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164270 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 03:20:25.165124 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164273 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 03:20:25.165124 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164275 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 03:20:25.165124 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164278 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 03:20:25.165124 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164280 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 03:20:25.165124 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164283 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 03:20:25.165124 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164285 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 03:20:25.165124 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164288 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 03:20:25.165124 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164291 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 03:20:25.165124 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164294 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 03:20:25.165124 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164297 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 03:20:25.165124 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164299 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 03:20:25.165124 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164302 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 03:20:25.165620 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164305 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 03:20:25.165620 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164307 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 03:20:25.165620 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164310 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 03:20:25.165620 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164313 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 03:20:25.165620 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164316 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 03:20:25.165620 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164318 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 03:20:25.165620 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164321 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 03:20:25.165620 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164323 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 03:20:25.165620 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164326 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 03:20:25.165620 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164328 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 03:20:25.165620 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164331 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 03:20:25.165620 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164334 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 03:20:25.165620 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164336 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 03:20:25.165620 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164346 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 03:20:25.165620 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164349 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 03:20:25.165620 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164351 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 03:20:25.165620 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164355 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 03:20:25.165620 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164357 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 03:20:25.165620 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164360 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 03:20:25.165620 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164363 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 03:20:25.166112 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164365 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 03:20:25.166112 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164370 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 03:20:25.166112 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164373 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 03:20:25.166112 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164375 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 03:20:25.166112 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164378 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 03:20:25.166112 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164381 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 03:20:25.166112 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164797 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 03:20:25.166112 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164803 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 03:20:25.166112 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164806 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 03:20:25.166112 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164809 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 03:20:25.166112 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164812 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 03:20:25.166112 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164814 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 03:20:25.166112 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164817 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 03:20:25.166112 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164820 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 03:20:25.166112 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164822 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 03:20:25.166112 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164825 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 03:20:25.166112 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164830 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 03:20:25.166112 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164833 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 03:20:25.166112 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164836 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 03:20:25.166572 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164839 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 03:20:25.166572 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164842 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 03:20:25.166572 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164845 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 03:20:25.166572 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164848 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 03:20:25.166572 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164851 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 03:20:25.166572 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164854 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 03:20:25.166572 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164868 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 03:20:25.166572 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164872 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 03:20:25.166572 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164875 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 03:20:25.166572 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164878 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 03:20:25.166572 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164881 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 03:20:25.166572 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164883 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 03:20:25.166572 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164886 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 03:20:25.166572 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164889 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 03:20:25.166572 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164891 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 03:20:25.166572 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164894 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 03:20:25.166572 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164896 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 03:20:25.166572 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164899 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 03:20:25.166572 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164901 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 03:20:25.166572 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164903 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 03:20:25.167107 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164908 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 03:20:25.167107 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164911 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 03:20:25.167107 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164913 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 03:20:25.167107 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164916 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 03:20:25.167107 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164919 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 03:20:25.167107 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164922 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 03:20:25.167107 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164925 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 03:20:25.167107 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164927 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 03:20:25.167107 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164930 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 03:20:25.167107 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164933 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 03:20:25.167107 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164935 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 03:20:25.167107 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164938 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 03:20:25.167107 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164940 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 03:20:25.167107 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164943 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 03:20:25.167107 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164946 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 03:20:25.167107 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164948 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 03:20:25.167107 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164951 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 03:20:25.167107 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164953 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 03:20:25.167107 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164956 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 03:20:25.167107 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164964 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 03:20:25.167622 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164967 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 03:20:25.167622 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164969 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 03:20:25.167622 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164972 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 03:20:25.167622 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164974 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 03:20:25.167622 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164977 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 03:20:25.167622 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164980 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 03:20:25.167622 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164983 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 03:20:25.167622 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.164986 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 03:20:25.167622 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165001 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 03:20:25.167622 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165005 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 03:20:25.167622 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165008 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 03:20:25.167622 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165010 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 03:20:25.167622 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165014 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 03:20:25.167622 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165017 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 03:20:25.167622 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165020 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 03:20:25.167622 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165022 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 03:20:25.167622 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165025 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 03 03:20:25.167622 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165028 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 03:20:25.167622 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165031 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 03:20:25.168370 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165033 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 03:20:25.168370 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165036 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 03:20:25.168370 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165039 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 03:20:25.168370 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165041 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 03:20:25.168370 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165044 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 03:20:25.168370 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165046 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 03:20:25.168370 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165049 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 03:20:25.168370 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165051 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 03:20:25.168370 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165054 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 03:20:25.168370 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165056 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 03:20:25.168370 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165059 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 03:20:25.168370 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165061 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 03:20:25.168370 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165064 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 03:20:25.168370 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165073 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 03:20:25.168370 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165147 2558 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 03:20:25.168370 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165155 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 03:20:25.168370 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165168 2558 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 03:20:25.168370 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165173 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 03:20:25.168370 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165177 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 03:20:25.168370 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165180 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 03:20:25.168370 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165185 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 03:20:25.168975 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165189 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 03:20:25.168975 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165192 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 03:20:25.168975 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165195 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 03:20:25.168975 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165199 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 03:20:25.168975 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165203 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 03:20:25.168975 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165206 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 03:20:25.168975 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165209 2558 flags.go:64] FLAG: --cgroup-root="" Jun 03 03:20:25.168975 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165212 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 03:20:25.168975 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165215 2558 flags.go:64] FLAG: --client-ca-file="" Jun 03 03:20:25.168975 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165218 2558 flags.go:64] FLAG: --cloud-config="" Jun 03 03:20:25.168975 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165221 2558 flags.go:64] FLAG: --cloud-provider="external" Jun 03 03:20:25.168975 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165224 2558 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 03:20:25.168975 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165230 2558 flags.go:64] FLAG: --cluster-domain="" Jun 03 03:20:25.168975 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165233 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 03:20:25.168975 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165236 2558 flags.go:64] FLAG: --config-dir="" Jun 03 03:20:25.168975 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165239 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 03:20:25.168975 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165242 2558 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 03:20:25.168975 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165246 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 03:20:25.168975 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165249 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 03:20:25.168975 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165252 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 03:20:25.168975 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165255 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 03:20:25.168975 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165258 2558 flags.go:64] FLAG: --contention-profiling="false" Jun 03 03:20:25.168975 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165261 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 03:20:25.168975 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165264 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 03:20:25.169575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165267 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 03:20:25.169575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165276 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 03:20:25.169575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165280 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 03:20:25.169575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165283 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 03:20:25.169575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165286 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 03:20:25.169575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165289 2558 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 03:20:25.169575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165292 2558 flags.go:64] FLAG: --enable-server="true" Jun 03 03:20:25.169575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165295 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 03:20:25.169575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165302 2558 flags.go:64] FLAG: --event-burst="100" Jun 03 03:20:25.169575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165305 2558 flags.go:64] FLAG: --event-qps="50" Jun 03 03:20:25.169575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165308 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 03:20:25.169575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165311 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 03:20:25.169575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165315 2558 flags.go:64] FLAG: --eviction-hard="" Jun 03 03:20:25.169575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165319 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 03:20:25.169575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165322 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 03:20:25.169575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165325 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 03:20:25.169575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165328 2558 flags.go:64] FLAG: --eviction-soft="" Jun 03 03:20:25.169575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165331 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 03:20:25.169575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165334 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 03:20:25.169575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165337 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 03:20:25.169575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165339 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 03:20:25.169575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165342 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 03:20:25.169575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165345 2558 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 03:20:25.169575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165348 2558 flags.go:64] FLAG: --feature-gates="" Jun 03 03:20:25.169575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165352 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 03:20:25.170340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165355 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 03:20:25.170340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165358 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 03:20:25.170340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165361 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 03:20:25.170340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165364 2558 flags.go:64] FLAG: --healthz-port="10248" Jun 03 03:20:25.170340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165367 2558 flags.go:64] FLAG: --help="false" Jun 03 03:20:25.170340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165370 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-141-253.ec2.internal" Jun 03 03:20:25.170340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165373 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 03:20:25.170340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165376 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 03:20:25.170340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165379 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 03:20:25.170340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165393 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 03:20:25.170340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165397 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 03:20:25.170340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165400 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 03:20:25.170340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165402 2558 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 03:20:25.170340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165405 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 03:20:25.170340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165408 2558 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 03:20:25.170340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165411 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 03:20:25.170340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165414 2558 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 03:20:25.170340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165417 2558 flags.go:64] FLAG: --kube-reserved="" Jun 03 03:20:25.170340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165420 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 03:20:25.170340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165423 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 03:20:25.170340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165427 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 03:20:25.170340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165429 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 03:20:25.170340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165432 2558 flags.go:64] FLAG: --lock-file="" Jun 03 03:20:25.170340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165435 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 03:20:25.171047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165438 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 03:20:25.171047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165441 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 03:20:25.171047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165446 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 03:20:25.171047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165449 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 03:20:25.171047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165452 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 03:20:25.171047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165454 2558 flags.go:64] FLAG: --logging-format="text" Jun 03 03:20:25.171047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165457 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 03:20:25.171047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165461 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 03:20:25.171047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165463 2558 flags.go:64] FLAG: --manifest-url="" Jun 03 03:20:25.171047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165466 2558 flags.go:64] FLAG: --manifest-url-header="" Jun 03 03:20:25.171047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165471 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 03:20:25.171047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165474 2558 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 03:20:25.171047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165478 2558 flags.go:64] FLAG: --max-pods="110" Jun 03 03:20:25.171047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165481 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 03:20:25.171047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165484 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 03:20:25.171047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165487 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 03:20:25.171047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165490 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 03:20:25.171047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165493 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 03:20:25.171047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165501 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 03:20:25.171047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165504 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 03:20:25.171047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165512 2558 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 03:20:25.171047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165515 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 03:20:25.171047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165518 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 03:20:25.171047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165521 2558 flags.go:64] FLAG: --pod-cidr="" Jun 03 03:20:25.171739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165524 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 03:20:25.171739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165530 2558 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 03:20:25.171739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165533 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 03:20:25.171739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165536 2558 flags.go:64] FLAG: --pods-per-core="0" Jun 03 03:20:25.171739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165544 2558 flags.go:64] FLAG: --port="10250" Jun 03 03:20:25.171739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165547 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 03:20:25.171739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165550 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06d321b4d08767c17" Jun 03 03:20:25.171739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165553 2558 flags.go:64] FLAG: --qos-reserved="" Jun 03 03:20:25.171739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165556 2558 flags.go:64] FLAG: --read-only-port="10255" Jun 03 03:20:25.171739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165559 2558 flags.go:64] FLAG: --register-node="true" Jun 03 03:20:25.171739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165562 2558 flags.go:64] FLAG: --register-schedulable="true" Jun 03 03:20:25.171739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165565 2558 flags.go:64] FLAG: --register-with-taints="" Jun 03 03:20:25.171739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165572 2558 flags.go:64] FLAG: --registry-burst="10" Jun 03 03:20:25.171739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165575 2558 flags.go:64] FLAG: --registry-qps="5" Jun 03 03:20:25.171739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165578 2558 flags.go:64] FLAG: --reserved-cpus="" Jun 03 03:20:25.171739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165581 2558 flags.go:64] FLAG: --reserved-memory="" Jun 03 03:20:25.171739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165584 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 03:20:25.171739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165587 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 03:20:25.171739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165590 2558 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 03:20:25.171739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165593 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 03:20:25.171739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165596 2558 flags.go:64] FLAG: --runonce="false" Jun 03 03:20:25.171739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165599 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 03:20:25.171739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165602 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 03:20:25.171739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165604 2558 flags.go:64] FLAG: --seccomp-default="false" Jun 03 03:20:25.171739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165607 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 03:20:25.172389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165610 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 03:20:25.172389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165613 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 03:20:25.172389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165623 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 03:20:25.172389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165627 2558 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 03:20:25.172389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165631 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 03:20:25.172389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165634 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 03:20:25.172389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165637 2558 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 03:20:25.172389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165640 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 03:20:25.172389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165643 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 03:20:25.172389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165645 2558 flags.go:64] FLAG: --system-cgroups="" Jun 03 03:20:25.172389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165649 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 03:20:25.172389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165656 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 03:20:25.172389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165659 2558 flags.go:64] FLAG: --tls-cert-file="" Jun 03 03:20:25.172389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165662 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 03:20:25.172389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165668 2558 flags.go:64] FLAG: --tls-min-version="" Jun 03 03:20:25.172389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165670 2558 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 03:20:25.172389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165673 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 03:20:25.172389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165676 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 03:20:25.172389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165679 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 03:20:25.172389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165682 2558 flags.go:64] FLAG: --v="2" Jun 03 03:20:25.172389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165686 2558 flags.go:64] FLAG: --version="false" Jun 03 03:20:25.172389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165690 2558 flags.go:64] FLAG: --vmodule="" Jun 03 03:20:25.172389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165694 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 03:20:25.172389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.165698 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 03:20:25.172389 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165799 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 03:20:25.173014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165802 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 03:20:25.173014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165806 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 03:20:25.173014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165808 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 03:20:25.173014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165811 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 03:20:25.173014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165814 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 03:20:25.173014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165816 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 03:20:25.173014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165819 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 03:20:25.173014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165821 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 03:20:25.173014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165824 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 03:20:25.173014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165827 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 03:20:25.173014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165830 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 03:20:25.173014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165833 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 03:20:25.173014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165835 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 03:20:25.173014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165838 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 03:20:25.173014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165841 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 03:20:25.173014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165843 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 03:20:25.173014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165846 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 03:20:25.173014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165848 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 03:20:25.173014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165852 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 03:20:25.173014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165855 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 03:20:25.173529 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165858 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 03:20:25.173529 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165860 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 03:20:25.173529 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165863 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 03:20:25.173529 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165865 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 03:20:25.173529 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165868 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 03:20:25.173529 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165870 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 03:20:25.173529 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165873 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 03:20:25.173529 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165876 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 03:20:25.173529 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165878 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 03:20:25.173529 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165881 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 03:20:25.173529 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165883 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 03:20:25.173529 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165886 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 03:20:25.173529 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165888 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 03:20:25.173529 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165891 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 03:20:25.173529 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165893 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 03:20:25.173529 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165896 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 03:20:25.173529 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165898 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 03:20:25.173529 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165901 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 03:20:25.173529 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165903 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 03:20:25.174004 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165906 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 03 03:20:25.174004 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165909 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 03:20:25.174004 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165912 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 03:20:25.174004 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165915 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 03:20:25.174004 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165918 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 03:20:25.174004 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165921 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 03:20:25.174004 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165925 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 03:20:25.174004 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165929 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 03:20:25.174004 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165931 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 03:20:25.174004 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165934 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 03:20:25.174004 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165937 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 03:20:25.174004 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165941 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 03:20:25.174004 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165944 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 03:20:25.174004 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165946 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 03:20:25.174004 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165949 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 03:20:25.174004 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165952 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 03:20:25.174004 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165955 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 03:20:25.174004 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165957 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 03:20:25.174004 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165962 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 03:20:25.174505 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165965 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 03:20:25.174505 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165968 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 03:20:25.174505 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165971 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 03:20:25.174505 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165974 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 03:20:25.174505 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165977 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 03:20:25.174505 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165980 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 03:20:25.174505 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165983 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 03:20:25.174505 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.165986 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 03:20:25.174505 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.166003 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 03:20:25.174505 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.166006 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 03:20:25.174505 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.166008 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 03:20:25.174505 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.166011 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 03:20:25.174505 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.166014 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 03:20:25.174505 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.166017 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 03:20:25.174505 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.166021 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 03:20:25.174505 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.166024 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 03:20:25.174505 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.166027 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 03:20:25.174505 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.166029 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 03:20:25.174505 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.166032 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 03:20:25.174505 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.166035 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 03:20:25.175014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.166038 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 03:20:25.175014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.166040 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 03:20:25.175014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.166042 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 03:20:25.175014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.166045 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 03:20:25.175014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.166050 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 03:20:25.175014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.166053 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 03:20:25.175014 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.166055 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 03:20:25.175014 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.166872 2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 03:20:25.176565 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.176546 2558 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 03:20:25.176607 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.176566 2558 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 03:20:25.176641 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176613 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 03:20:25.176641 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176618 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 03:20:25.176641 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176621 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 03:20:25.176641 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176625 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 03:20:25.176641 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176628 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 03:20:25.176641 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176632 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 03:20:25.176641 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176637 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 03:20:25.176641 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176640 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 03:20:25.176641 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176643 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 03:20:25.176862 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176646 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 03:20:25.176862 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176650 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 03:20:25.176862 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176652 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 03:20:25.176862 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176655 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 03:20:25.176862 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176659 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 03:20:25.176862 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176661 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 03:20:25.176862 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176665 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 03:20:25.176862 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176667 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 03:20:25.176862 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176670 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 03:20:25.176862 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176672 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 03:20:25.176862 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176675 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 03:20:25.176862 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176678 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 03:20:25.176862 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176681 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 03:20:25.176862 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176683 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 03:20:25.176862 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176686 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 03:20:25.176862 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176688 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 03:20:25.176862 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176691 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 03:20:25.176862 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176693 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 03:20:25.176862 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176696 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 03:20:25.176862 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176698 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 03:20:25.177381 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176701 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 03:20:25.177381 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176704 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 03:20:25.177381 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176707 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 03:20:25.177381 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176710 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 03:20:25.177381 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176712 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 03:20:25.177381 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176715 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 03:20:25.177381 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176717 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 03:20:25.177381 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176720 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 03:20:25.177381 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176722 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 03:20:25.177381 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176725 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 03:20:25.177381 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176728 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 03:20:25.177381 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176730 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 03:20:25.177381 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176733 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 03:20:25.177381 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176737 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 03:20:25.177381 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176740 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 03:20:25.177381 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176743 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 03:20:25.177381 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176746 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 03:20:25.177381 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176748 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 03:20:25.177381 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176751 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 03:20:25.177381 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176754 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 03:20:25.177875 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176756 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 03:20:25.177875 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176759 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 03 03:20:25.177875 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176761 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 03:20:25.177875 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176764 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 03:20:25.177875 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176767 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 03:20:25.177875 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176770 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 03:20:25.177875 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176773 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 03:20:25.177875 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176775 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 03:20:25.177875 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176778 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 03:20:25.177875 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176781 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 03:20:25.177875 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176783 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 03:20:25.177875 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176786 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 03:20:25.177875 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176788 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 03:20:25.177875 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176791 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 03:20:25.177875 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176793 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 03:20:25.177875 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176796 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 03:20:25.177875 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176798 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 03:20:25.177875 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176801 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 03:20:25.177875 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176803 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 03:20:25.177875 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176806 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 03:20:25.178389 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176809 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 03:20:25.178389 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176812 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 03:20:25.178389 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176814 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 03:20:25.178389 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176817 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 03:20:25.178389 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176819 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 03:20:25.178389 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176822 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 03:20:25.178389 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176825 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 03:20:25.178389 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176828 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 03:20:25.178389 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176831 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 03:20:25.178389 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176834 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 03:20:25.178389 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176836 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 03:20:25.178389 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176840 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 03:20:25.178389 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176843 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 03:20:25.178389 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176845 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 03:20:25.178389 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176848 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 03:20:25.178389 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176850 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 03:20:25.178389 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176853 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 03:20:25.178802 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.176858 2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 03:20:25.178802 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176971 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 03:20:25.178802 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176976 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 03:20:25.178802 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176980 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 03:20:25.178802 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176983 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 03:20:25.178802 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.176985 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 03:20:25.178802 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177005 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 03:20:25.178802 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177010 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 03:20:25.178802 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177014 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 03:20:25.178802 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177017 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 03:20:25.178802 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177020 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 03:20:25.178802 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177023 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 03:20:25.178802 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177025 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 03:20:25.178802 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177028 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 03:20:25.178802 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177031 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 03:20:25.178802 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177033 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 03:20:25.179228 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177036 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 03:20:25.179228 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177039 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 03:20:25.179228 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177042 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 03:20:25.179228 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177044 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 03:20:25.179228 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177047 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 03:20:25.179228 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177050 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 03:20:25.179228 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177053 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 03:20:25.179228 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177057 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 03:20:25.179228 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177059 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 03:20:25.179228 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177062 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 03:20:25.179228 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177065 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 03:20:25.179228 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177067 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 03:20:25.179228 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177070 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 03:20:25.179228 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177072 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 03:20:25.179228 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177075 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 03:20:25.179228 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177077 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 03:20:25.179228 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177080 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 03:20:25.179228 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177082 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 03:20:25.179228 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177085 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 03:20:25.179228 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177087 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 03:20:25.179751 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177090 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 03:20:25.179751 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177093 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 03:20:25.179751 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177095 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 03:20:25.179751 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177098 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 03:20:25.179751 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177100 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 03:20:25.179751 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177103 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 03 03:20:25.179751 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177105 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 03:20:25.179751 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177108 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 03:20:25.179751 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177111 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 03:20:25.179751 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177113 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 03:20:25.179751 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177116 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 03:20:25.179751 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177118 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 03:20:25.179751 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177121 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 03:20:25.179751 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177123 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 03:20:25.179751 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177126 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 03:20:25.179751 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177128 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 03:20:25.179751 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177131 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 03:20:25.179751 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177134 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 03:20:25.179751 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177137 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 03:20:25.179751 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177139 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 03:20:25.180260 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177143 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 03:20:25.180260 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177145 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 03:20:25.180260 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177148 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 03:20:25.180260 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177150 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 03:20:25.180260 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177153 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 03:20:25.180260 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177156 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 03:20:25.180260 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177158 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 03:20:25.180260 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177162 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 03:20:25.180260 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177166 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 03:20:25.180260 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177169 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 03:20:25.180260 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177172 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 03:20:25.180260 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177175 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 03:20:25.180260 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177177 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 03:20:25.180260 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177180 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 03:20:25.180260 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177182 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 03:20:25.180260 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177185 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 03:20:25.180260 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177187 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 03:20:25.180260 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177190 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 03:20:25.180260 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177192 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 03:20:25.180260 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177195 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 03:20:25.180742 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177198 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 03:20:25.180742 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177200 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 03:20:25.180742 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177203 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 03:20:25.180742 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177205 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 03:20:25.180742 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177208 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 03:20:25.180742 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177210 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 03:20:25.180742 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177212 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 03:20:25.180742 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177215 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 03:20:25.180742 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177217 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 03:20:25.180742 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177221 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 03:20:25.180742 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:25.177225 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 03:20:25.180742 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.177230 2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 03:20:25.180742 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.177923 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 03:20:25.181469 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.181455 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 03:20:25.182478 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.182465 2558 server.go:1019] "Starting client certificate rotation" Jun 03 03:20:25.182584 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.182566 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 03:20:25.182642 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.182616 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 03:20:25.206341 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.206320 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 03:20:25.210164 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.210144 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 03:20:25.225179 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.225155 2558 log.go:25] "Validated CRI v1 runtime API" Jun 03 03:20:25.231047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.231032 2558 log.go:25] "Validated CRI v1 image API" Jun 03 03:20:25.232228 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.232215 2558 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 03:20:25.235244 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.235226 2558 fs.go:135] Filesystem UUIDs: map[0db93a5e-dcb8-4719-8519-2e81eb2bf7d2:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 aefee08b-b285-42f7-a929-4290e57ca6cf:/dev/nvme0n1p4] Jun 03 03:20:25.235293 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.235245 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 03:20:25.239763 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.239402 2558 manager.go:217] Machine: {Timestamp:2026-06-03 03:20:25.238873135 +0000 UTC m=+0.410782996 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101989 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c475fbab26c11b6e75c2d9ba42b44 SystemUUID:ec2c475f-bab2-6c11-b6e7-5c2d9ba42b44 BootID:16afe992-122e-4b6f-90f1-9435202f9a0f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1a:5d:49:92:53 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1a:5d:49:92:53 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:82:b5:ec:c1:93 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 03:20:25.239847 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.239800 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 03:20:25.239894 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.239880 2558 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 03:20:25.241957 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.241940 2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 03:20:25.242630 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.242607 2558 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 03:20:25.242780 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.242634 2558 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-253.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 03:20:25.242831 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.242789 2558 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 03:20:25.242831 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.242798 2558 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 03:20:25.242831 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.242805 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 03:20:25.243642 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.243631 2558 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 03:20:25.245140 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.245093 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 03 03:20:25.245226 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.245201 2558 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 03:20:25.247638 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.247626 2558 kubelet.go:491] "Attempting to sync node with API server" Jun 03 03:20:25.247638 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.247640 2558 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 03:20:25.247741 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.247652 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 03:20:25.247741 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.247661 2558 kubelet.go:397] "Adding apiserver pod source" Jun 03 03:20:25.247741 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.247672 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 03:20:25.248779 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.248767 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 03:20:25.248824 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.248786 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 03:20:25.252255 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.252240 2558 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 03:20:25.254050 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.254037 2558 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 03:20:25.256152 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.256133 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 03:20:25.256199 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.256165 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 03:20:25.256199 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.256179 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 03:20:25.256199 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.256190 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 03:20:25.256277 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.256209 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 03:20:25.256277 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.256220 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 03:20:25.256277 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.256232 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 03:20:25.256277 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.256243 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 03:20:25.256277 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.256256 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 03:20:25.256277 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.256268 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 03:20:25.256434 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.256292 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 03:20:25.256434 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.256305 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 03:20:25.257686 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.257676 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 03:20:25.257686 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.257685 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 03:20:25.260289 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:25.260266 2558 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 03:20:25.260411 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.260397 2558 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 03:20:25.260515 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:25.260497 2558 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 03:20:25.261165 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.261151 2558 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 03:20:25.261223 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.261191 2558 server.go:1295] "Started kubelet" Jun 03 03:20:25.261324 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.261278 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 03:20:25.262707 ip-10-0-141-253 systemd[1]: Started Kubernetes Kubelet. Jun 03 03:20:25.263142 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.262942 2558 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 03:20:25.263142 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.263050 2558 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 03:20:25.263321 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.263164 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d7gqt" Jun 03 03:20:25.264899 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.264181 2558 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 03:20:25.265810 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.265797 2558 server.go:317] "Adding debug handlers to kubelet server" Jun 03 03:20:25.269081 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.269063 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 03:20:25.269081 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.269077 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 03:20:25.269213 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.269060 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d7gqt" Jun 03 03:20:25.269327 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.269311 2558 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 03:20:25.269327 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.269327 2558 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 03:20:25.269452 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.269422 2558 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 03:20:25.269501 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.269484 2558 reconstruct.go:97] "Volume reconstruction finished" Jun 03 03:20:25.269501 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.269491 2558 reconciler.go:26] "Reconciler: start to sync state" Jun 03 03:20:25.271096 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:25.271075 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-253.ec2.internal\" not found" Jun 03 03:20:25.271249 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.271232 2558 factory.go:55] Registering systemd factory Jun 03 03:20:25.271338 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.271325 2558 factory.go:223] Registration of the systemd container factory successfully Jun 03 03:20:25.273307 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.273285 2558 factory.go:153] Registering CRI-O factory Jun 03 03:20:25.273307 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.273306 2558 factory.go:223] Registration of the crio container factory successfully Jun 03 03:20:25.273432 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.273357 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 03:20:25.273432 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.273394 2558 factory.go:103] Registering Raw factory Jun 03 03:20:25.273432 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.273410 2558 manager.go:1196] Started watching for new ooms in manager Jun 03 03:20:25.273788 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.273761 2558 manager.go:319] Starting recovery of all containers Jun 03 03:20:25.275575 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:25.275550 2558 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 03:20:25.281224 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.281049 2558 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 03:20:25.283434 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:25.283412 2558 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-253.ec2.internal\" not found" node="ip-10-0-141-253.ec2.internal" Jun 03 03:20:25.285880 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.285863 2558 manager.go:324] Recovery completed Jun 03 03:20:25.289809 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.289797 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 03:20:25.291802 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.291787 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientMemory" Jun 03 03:20:25.291862 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.291814 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 03:20:25.291862 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.291824 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientPID" Jun 03 03:20:25.292368 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.292350 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 03:20:25.292431 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.292369 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 03:20:25.292431 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.292392 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 03 03:20:25.294715 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.294703 2558 policy_none.go:49] "None policy: Start" Jun 03 03:20:25.294770 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.294720 2558 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 03:20:25.294770 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.294734 2558 state_mem.go:35] "Initializing new in-memory state store" Jun 03 03:20:25.333573 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.333554 2558 manager.go:341] "Starting Device Plugin manager" Jun 03 03:20:25.333682 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:25.333594 2558 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 03:20:25.333682 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.333608 2558 server.go:85] "Starting device plugin registration server" Jun 03 03:20:25.333872 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.333858 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 03:20:25.333934 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.333873 2558 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 03:20:25.333984 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.333959 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 03:20:25.334062 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.334056 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 03:20:25.334114 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.334066 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 03:20:25.334672 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:25.334644 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 03:20:25.334739 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:25.334687 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-253.ec2.internal\" not found" Jun 03 03:20:25.364006 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.363970 2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 03:20:25.365215 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.365201 2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 03:20:25.365305 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.365230 2558 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 03:20:25.365305 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.365250 2558 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 03:20:25.365305 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.365261 2558 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 03:20:25.365305 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:25.365302 2558 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 03:20:25.368268 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.368244 2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 03:20:25.434385 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.434327 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 03:20:25.435159 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.435143 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientMemory" Jun 03 03:20:25.435242 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.435171 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 03:20:25.435242 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.435182 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientPID" Jun 03 03:20:25.435242 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.435206 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-253.ec2.internal" Jun 03 03:20:25.443504 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.443489 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-253.ec2.internal" Jun 03 03:20:25.443546 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:25.443510 2558 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-253.ec2.internal\": node \"ip-10-0-141-253.ec2.internal\" not found" Jun 03 03:20:25.466048 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.466027 2558 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-253.ec2.internal"] Jun 03 03:20:25.466122 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.466087 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 03:20:25.467319 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.467303 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientMemory" Jun 03 03:20:25.467401 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.467338 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 03:20:25.467401 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.467353 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientPID" Jun 03 03:20:25.468600 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.468584 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 03:20:25.468751 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.468736 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal" Jun 03 03:20:25.468797 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.468766 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 03:20:25.469242 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.469227 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientMemory" Jun 03 03:20:25.469332 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.469249 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 03:20:25.469332 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.469260 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientPID" Jun 03 03:20:25.469332 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.469270 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientMemory" Jun 03 03:20:25.469332 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.469287 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 03:20:25.469332 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.469296 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientPID" Jun 03 03:20:25.469532 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:25.469459 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-253.ec2.internal\" not found" Jun 03 03:20:25.470456 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.470439 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7622d28d87bea8853b695a9482dc52b8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal\" (UID: \"7622d28d87bea8853b695a9482dc52b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal" Jun 03 03:20:25.470456 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.470452 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-253.ec2.internal" Jun 03 03:20:25.470546 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.470475 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 03:20:25.470546 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.470470 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7622d28d87bea8853b695a9482dc52b8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal\" (UID: \"7622d28d87bea8853b695a9482dc52b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal" Jun 03 03:20:25.470546 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.470533 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51754ad4b56dbdc3429426f262ad029e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-253.ec2.internal\" (UID: \"51754ad4b56dbdc3429426f262ad029e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-253.ec2.internal" Jun 03 03:20:25.471134 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.471116 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientMemory" Jun 03 03:20:25.471217 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.471146 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 03:20:25.471217 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.471162 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientPID" Jun 03 03:20:25.492513 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:25.492496 2558 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-253.ec2.internal\" not found" node="ip-10-0-141-253.ec2.internal" Jun 03 03:20:25.496793 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:25.496777 2558 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-253.ec2.internal\" not found" node="ip-10-0-141-253.ec2.internal" Jun 03 03:20:25.570304 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:25.570270 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-253.ec2.internal\" not found" Jun 03 03:20:25.571436 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.571412 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7622d28d87bea8853b695a9482dc52b8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal\" (UID: \"7622d28d87bea8853b695a9482dc52b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal" Jun 03 03:20:25.571532 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.571444 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7622d28d87bea8853b695a9482dc52b8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal\" (UID: \"7622d28d87bea8853b695a9482dc52b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal" Jun 03 03:20:25.571532 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.571457 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7622d28d87bea8853b695a9482dc52b8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal\" (UID: \"7622d28d87bea8853b695a9482dc52b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal" Jun 03 03:20:25.571532 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.571501 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7622d28d87bea8853b695a9482dc52b8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal\" (UID: \"7622d28d87bea8853b695a9482dc52b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal" Jun 03 03:20:25.571532 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.571506 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51754ad4b56dbdc3429426f262ad029e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-253.ec2.internal\" (UID: \"51754ad4b56dbdc3429426f262ad029e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-253.ec2.internal" Jun 03 03:20:25.571660 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.571554 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51754ad4b56dbdc3429426f262ad029e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-253.ec2.internal\" (UID: \"51754ad4b56dbdc3429426f262ad029e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-253.ec2.internal" Jun 03 03:20:25.670855 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:25.670808 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-253.ec2.internal\" not found" Jun 03 03:20:25.771492 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:25.771419 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-253.ec2.internal\" not found" Jun 03 03:20:25.794666 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.794646 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal" Jun 03 03:20:25.800275 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:25.800258 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-253.ec2.internal" Jun 03 03:20:25.872078 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:25.872040 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-253.ec2.internal\" not found" Jun 03 03:20:25.972494 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:25.972455 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-253.ec2.internal\" not found" Jun 03 03:20:26.072953 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:26.072869 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-253.ec2.internal\" not found" Jun 03 03:20:26.173427 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:26.173400 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-253.ec2.internal\" not found" Jun 03 03:20:26.182686 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:26.182664 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 03:20:26.182895 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:26.182874 2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 03:20:26.182953 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:26.182893 2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 03:20:26.269205 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:26.269174 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 03:20:26.271887 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:26.271853 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 03:15:25 +0000 UTC" deadline="2028-03-12 01:44:35.77236294 +0000 UTC" Jun 03 03:20:26.271887 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:26.271878 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15550h24m9.500486979s" Jun 03 03:20:26.274062 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:26.274041 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-253.ec2.internal\" not found" Jun 03 03:20:26.277798 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:26.277778 2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 03:20:26.280176 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:26.280154 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7622d28d87bea8853b695a9482dc52b8.slice/crio-b84eea3f2e08daae01d6073d116cd8ea02375c654ab7a29e6c06b154b95e8dde WatchSource:0}: Error finding container b84eea3f2e08daae01d6073d116cd8ea02375c654ab7a29e6c06b154b95e8dde: Status 404 returned error can't find the container with id b84eea3f2e08daae01d6073d116cd8ea02375c654ab7a29e6c06b154b95e8dde Jun 03 03:20:26.280429 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:26.280413 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51754ad4b56dbdc3429426f262ad029e.slice/crio-48c3f22daec181b426ba8355dfa7dd4015a21b760e15845b253a8f5ffbe5d1e0 WatchSource:0}: Error finding container 48c3f22daec181b426ba8355dfa7dd4015a21b760e15845b253a8f5ffbe5d1e0: Status 404 returned error can't find the container with id 48c3f22daec181b426ba8355dfa7dd4015a21b760e15845b253a8f5ffbe5d1e0 Jun 03 03:20:26.284134 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:26.284111 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 03:20:26.298030 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:26.298008 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-q4n8k" Jun 03 03:20:26.309218 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:26.309203 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-q4n8k" Jun 03 03:20:26.368371 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:26.368289 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal" event={"ID":"7622d28d87bea8853b695a9482dc52b8","Type":"ContainerStarted","Data":"b84eea3f2e08daae01d6073d116cd8ea02375c654ab7a29e6c06b154b95e8dde"} Jun 03 03:20:26.369244 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:26.369223 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-253.ec2.internal" event={"ID":"51754ad4b56dbdc3429426f262ad029e","Type":"ContainerStarted","Data":"48c3f22daec181b426ba8355dfa7dd4015a21b760e15845b253a8f5ffbe5d1e0"} Jun 03 03:20:26.374457 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:26.374430 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-253.ec2.internal\" not found" Jun 03 03:20:26.474892 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:26.474866 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-253.ec2.internal\" not found" Jun 03 03:20:26.575294 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:26.575266 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-253.ec2.internal\" not found" Jun 03 03:20:26.607100 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:26.607079 2558 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 03:20:26.669796 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:26.669766 2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal" Jun 03 03:20:26.679929 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:26.679904 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 03:20:26.681594 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:26.681578 2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-253.ec2.internal" Jun 03 03:20:26.687130 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:26.687116 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 03:20:26.813525 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:26.811575 2558 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 03:20:27.129180 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.129153 2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 03:20:27.248341 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.248309 2558 apiserver.go:52] "Watching apiserver" Jun 03 03:20:27.253198 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.253174 2558 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 03:20:27.255074 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.255040 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-4fv96","kube-system/kube-apiserver-proxy-ip-10-0-141-253.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx","openshift-dns/node-resolver-nbf8p","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal","openshift-multus/multus-additional-cni-plugins-pdxhs","openshift-multus/multus-t6wx4","openshift-network-diagnostics/network-check-target-gqszd","openshift-network-operator/iptables-alerter-g4kxc","kube-system/konnectivity-agent-7rz6d","openshift-cluster-node-tuning-operator/tuned-hhvsb","openshift-image-registry/node-ca-wrjnf","openshift-multus/network-metrics-daemon-rp75f"] Jun 03 03:20:27.256433 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.256413 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.257449 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.257427 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" Jun 03 03:20:27.258593 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.258568 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nbf8p" Jun 03 03:20:27.259161 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.259133 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 03:20:27.259161 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.259131 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 03:20:27.259301 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.259170 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 03:20:27.259301 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.259187 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 03:20:27.259488 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.259469 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8nl7n\"" Jun 03 03:20:27.259783 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.259769 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.259848 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.259790 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-j2tz8\"" Jun 03 03:20:27.259971 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.259952 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 03:20:27.260040 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.259956 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 03:20:27.260413 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.260084 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 03:20:27.260483 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.260473 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 03:20:27.260539 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.260505 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 03:20:27.261153 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.260960 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.261153 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.261066 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dcch9\"" Jun 03 03:20:27.261966 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.261837 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 03:20:27.261966 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.261853 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 03:20:27.261966 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.261932 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q5ttq\"" Jun 03 03:20:27.263556 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.263121 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-62jq7\"" Jun 03 03:20:27.263556 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.263134 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 03:20:27.263556 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.263152 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:27.263556 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:27.263213 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqszd" podUID="3de6cab3-243e-4cc5-91c5-458eec3e5180" Jun 03 03:20:27.263556 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.263301 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 03:20:27.263556 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.263332 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 03:20:27.263556 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.263409 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 03:20:27.264551 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.264349 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 03:20:27.264551 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.264502 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 03:20:27.264701 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.264580 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g4kxc" Jun 03 03:20:27.264701 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.264690 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7rz6d" Jun 03 03:20:27.267462 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.267122 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.267462 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.267426 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 03:20:27.267600 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.267571 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 03:20:27.268124 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.267901 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xqwwh\"" Jun 03 03:20:27.268124 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.267943 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xwlvx\"" Jun 03 03:20:27.268124 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.267978 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 03:20:27.268124 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.268033 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 03:20:27.268124 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.267949 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 03:20:27.269114 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.269092 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cldvj\"" Jun 03 03:20:27.269114 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.269105 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wrjnf" Jun 03 03:20:27.269257 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.269098 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 03:20:27.269962 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.269942 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 03:20:27.270425 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.270410 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:27.270501 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:27.270469 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rp75f" podUID="55469fc3-4142-42c5-8420-af3316559074" Jun 03 03:20:27.270918 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.270900 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c9hnt\"" Jun 03 03:20:27.271024 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.270930 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 03:20:27.271024 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.270961 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 03:20:27.271216 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.271200 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 03:20:27.278152 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278127 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/31f50417-f5ba-4dc1-b5e8-8445d17652ed-device-dir\") pod \"aws-ebs-csi-driver-node-wp9fx\" (UID: \"31f50417-f5ba-4dc1-b5e8-8445d17652ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" Jun 03 03:20:27.278229 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278158 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vmp2\" (UniqueName: \"kubernetes.io/projected/55469fc3-4142-42c5-8420-af3316559074-kube-api-access-2vmp2\") pod \"network-metrics-daemon-rp75f\" (UID: \"55469fc3-4142-42c5-8420-af3316559074\") " pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:27.278229 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278186 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b49ee6d0-1785-4901-9e01-29a2b91214cd-cni-binary-copy\") pod \"multus-additional-cni-plugins-pdxhs\" (UID: \"b49ee6d0-1785-4901-9e01-29a2b91214cd\") " pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.278229 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278211 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-systemd-units\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.278381 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278229 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-etc-sysconfig\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.278381 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278251 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-etc-sysctl-d\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.278381 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278273 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-host\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.278381 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278297 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kzdl\" (UniqueName: \"kubernetes.io/projected/31f50417-f5ba-4dc1-b5e8-8445d17652ed-kube-api-access-8kzdl\") pod \"aws-ebs-csi-driver-node-wp9fx\" (UID: \"31f50417-f5ba-4dc1-b5e8-8445d17652ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" Jun 03 03:20:27.278381 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278343 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/087a08d4-5cd4-40dc-ac07-07a516cb3602-multus-daemon-config\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.278615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278378 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-host-kubelet\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.278615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278406 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-etc-openvswitch\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.278615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278432 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/31f50417-f5ba-4dc1-b5e8-8445d17652ed-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wp9fx\" (UID: \"31f50417-f5ba-4dc1-b5e8-8445d17652ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" Jun 03 03:20:27.278615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278456 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh5tw\" (UniqueName: \"kubernetes.io/projected/ea8e1018-9d63-4b7a-b241-4b9f6d563906-kube-api-access-lh5tw\") pod \"node-resolver-nbf8p\" (UID: \"ea8e1018-9d63-4b7a-b241-4b9f6d563906\") " pod="openshift-dns/node-resolver-nbf8p" Jun 03 03:20:27.278615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278482 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-host-run-k8s-cni-cncf-io\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.278615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278507 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-hostroot\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.278615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278530 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d70d6dc6-b06b-4651-88d9-d08322361734-ovn-node-metrics-cert\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.278615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278555 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d70d6dc6-b06b-4651-88d9-d08322361734-ovnkube-script-lib\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.278615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278581 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b49ee6d0-1785-4901-9e01-29a2b91214cd-system-cni-dir\") pod \"multus-additional-cni-plugins-pdxhs\" (UID: \"b49ee6d0-1785-4901-9e01-29a2b91214cd\") " pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.278615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278606 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-host-var-lib-cni-multus\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.279068 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278629 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-multus-conf-dir\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.279068 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278668 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-host-run-multus-certs\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.279068 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278693 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-etc-kubernetes\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.279068 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278718 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-var-lib-openvswitch\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.279068 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278759 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8af70d99-31a6-49ef-91bb-735be0eb8536-serviceca\") pod \"node-ca-wrjnf\" (UID: \"8af70d99-31a6-49ef-91bb-735be0eb8536\") " pod="openshift-image-registry/node-ca-wrjnf" Jun 03 03:20:27.279068 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278798 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shwp6\" (UniqueName: \"kubernetes.io/projected/d70d6dc6-b06b-4651-88d9-d08322361734-kube-api-access-shwp6\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.279068 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278827 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-etc-kubernetes\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.279068 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278851 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-lib-modules\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.279068 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278875 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mbfr\" (UniqueName: \"kubernetes.io/projected/3de6cab3-243e-4cc5-91c5-458eec3e5180-kube-api-access-4mbfr\") pod \"network-check-target-gqszd\" (UID: \"3de6cab3-243e-4cc5-91c5-458eec3e5180\") " pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:27.279068 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278898 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-os-release\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.279068 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.278930 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-host-run-netns\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.279068 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279002 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/31f50417-f5ba-4dc1-b5e8-8445d17652ed-sys-fs\") pod \"aws-ebs-csi-driver-node-wp9fx\" (UID: \"31f50417-f5ba-4dc1-b5e8-8445d17652ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" Jun 03 03:20:27.279068 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279046 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4whrt\" (UniqueName: \"kubernetes.io/projected/b49ee6d0-1785-4901-9e01-29a2b91214cd-kube-api-access-4whrt\") pod \"multus-additional-cni-plugins-pdxhs\" (UID: \"b49ee6d0-1785-4901-9e01-29a2b91214cd\") " pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.279615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279078 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-host-slash\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.279615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279119 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-run-ovn\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.279615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279140 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-node-log\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.279615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279160 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-log-socket\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.279615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279192 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.279615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279221 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-sys\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.279615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279249 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs\") pod \"network-metrics-daemon-rp75f\" (UID: \"55469fc3-4142-42c5-8420-af3316559074\") " pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:27.279615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279294 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-host-run-ovn-kubernetes\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.279615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279325 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-etc-systemd\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.279615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279352 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4vr6\" (UniqueName: \"kubernetes.io/projected/8af70d99-31a6-49ef-91bb-735be0eb8536-kube-api-access-f4vr6\") pod \"node-ca-wrjnf\" (UID: \"8af70d99-31a6-49ef-91bb-735be0eb8536\") " pod="openshift-image-registry/node-ca-wrjnf" Jun 03 03:20:27.279615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279373 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b49ee6d0-1785-4901-9e01-29a2b91214cd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pdxhs\" (UID: \"b49ee6d0-1785-4901-9e01-29a2b91214cd\") " pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.279615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279396 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-system-cni-dir\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.279615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279418 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-cnibin\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.279615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279435 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-host-run-netns\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.279615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279450 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b836c825-35f6-4fc3-8b10-e098282ab5d3-agent-certs\") pod \"konnectivity-agent-7rz6d\" (UID: \"b836c825-35f6-4fc3-8b10-e098282ab5d3\") " pod="kube-system/konnectivity-agent-7rz6d" Jun 03 03:20:27.279615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279464 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-tmp\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.280179 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279489 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/31f50417-f5ba-4dc1-b5e8-8445d17652ed-registration-dir\") pod \"aws-ebs-csi-driver-node-wp9fx\" (UID: \"31f50417-f5ba-4dc1-b5e8-8445d17652ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" Jun 03 03:20:27.280179 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279535 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b49ee6d0-1785-4901-9e01-29a2b91214cd-cnibin\") pod \"multus-additional-cni-plugins-pdxhs\" (UID: \"b49ee6d0-1785-4901-9e01-29a2b91214cd\") " pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.280179 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279555 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-etc-modprobe-d\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.280179 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279583 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-var-lib-kubelet\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.280179 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279615 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/31f50417-f5ba-4dc1-b5e8-8445d17652ed-socket-dir\") pod \"aws-ebs-csi-driver-node-wp9fx\" (UID: \"31f50417-f5ba-4dc1-b5e8-8445d17652ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" Jun 03 03:20:27.280179 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279641 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b49ee6d0-1785-4901-9e01-29a2b91214cd-os-release\") pod \"multus-additional-cni-plugins-pdxhs\" (UID: \"b49ee6d0-1785-4901-9e01-29a2b91214cd\") " pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.280179 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279681 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3c9be03-6ef9-4159-a698-95c653bddcf4-iptables-alerter-script\") pod \"iptables-alerter-g4kxc\" (UID: \"f3c9be03-6ef9-4159-a698-95c653bddcf4\") " pod="openshift-network-operator/iptables-alerter-g4kxc" Jun 03 03:20:27.280179 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279728 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-host-cni-netd\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.280179 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279759 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea8e1018-9d63-4b7a-b241-4b9f6d563906-hosts-file\") pod \"node-resolver-nbf8p\" (UID: \"ea8e1018-9d63-4b7a-b241-4b9f6d563906\") " pod="openshift-dns/node-resolver-nbf8p" Jun 03 03:20:27.280179 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279790 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-host-var-lib-kubelet\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.280179 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279819 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzdcx\" (UniqueName: \"kubernetes.io/projected/087a08d4-5cd4-40dc-ac07-07a516cb3602-kube-api-access-fzdcx\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.280179 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279849 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-etc-sysctl-conf\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.280179 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279873 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-run\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.280179 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279895 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-etc-tuned\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.280179 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279918 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55bwx\" (UniqueName: \"kubernetes.io/projected/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-kube-api-access-55bwx\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.280179 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279941 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b49ee6d0-1785-4901-9e01-29a2b91214cd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pdxhs\" (UID: \"b49ee6d0-1785-4901-9e01-29a2b91214cd\") " pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.280733 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.279966 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3c9be03-6ef9-4159-a698-95c653bddcf4-host-slash\") pod \"iptables-alerter-g4kxc\" (UID: \"f3c9be03-6ef9-4159-a698-95c653bddcf4\") " pod="openshift-network-operator/iptables-alerter-g4kxc" Jun 03 03:20:27.280733 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.280008 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/087a08d4-5cd4-40dc-ac07-07a516cb3602-cni-binary-copy\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.280733 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.280034 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-run-systemd\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.280733 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.280061 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8af70d99-31a6-49ef-91bb-735be0eb8536-host\") pod \"node-ca-wrjnf\" (UID: \"8af70d99-31a6-49ef-91bb-735be0eb8536\") " pod="openshift-image-registry/node-ca-wrjnf" Jun 03 03:20:27.280733 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.280082 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b49ee6d0-1785-4901-9e01-29a2b91214cd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pdxhs\" (UID: \"b49ee6d0-1785-4901-9e01-29a2b91214cd\") " pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.280733 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.280109 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-multus-cni-dir\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.280733 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.280123 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-run-openvswitch\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.280733 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.280140 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/31f50417-f5ba-4dc1-b5e8-8445d17652ed-etc-selinux\") pod \"aws-ebs-csi-driver-node-wp9fx\" (UID: \"31f50417-f5ba-4dc1-b5e8-8445d17652ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" Jun 03 03:20:27.280733 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.280155 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-host-var-lib-cni-bin\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.280733 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.280197 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d70d6dc6-b06b-4651-88d9-d08322361734-ovnkube-config\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.280733 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.280215 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d70d6dc6-b06b-4651-88d9-d08322361734-env-overrides\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.280733 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.280229 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b836c825-35f6-4fc3-8b10-e098282ab5d3-konnectivity-ca\") pod \"konnectivity-agent-7rz6d\" (UID: \"b836c825-35f6-4fc3-8b10-e098282ab5d3\") " pod="kube-system/konnectivity-agent-7rz6d" Jun 03 03:20:27.280733 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.280245 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea8e1018-9d63-4b7a-b241-4b9f6d563906-tmp-dir\") pod \"node-resolver-nbf8p\" (UID: \"ea8e1018-9d63-4b7a-b241-4b9f6d563906\") " pod="openshift-dns/node-resolver-nbf8p" Jun 03 03:20:27.280733 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.280310 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mhd4\" (UniqueName: \"kubernetes.io/projected/f3c9be03-6ef9-4159-a698-95c653bddcf4-kube-api-access-2mhd4\") pod \"iptables-alerter-g4kxc\" (UID: \"f3c9be03-6ef9-4159-a698-95c653bddcf4\") " pod="openshift-network-operator/iptables-alerter-g4kxc" Jun 03 03:20:27.280733 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.280344 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-multus-socket-dir-parent\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.280733 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.280370 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-host-cni-bin\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.310249 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.310214 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 03:15:26 +0000 UTC" deadline="2028-03-04 07:45:38.755561006 +0000 UTC" Jun 03 03:20:27.310249 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.310249 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15364h25m11.445316147s" Jun 03 03:20:27.370634 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.370600 2558 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 03:20:27.381169 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381089 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-etc-sysctl-conf\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.381169 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381131 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-run\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.381169 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381154 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-etc-tuned\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.381411 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381177 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55bwx\" (UniqueName: \"kubernetes.io/projected/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-kube-api-access-55bwx\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.381411 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381201 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b49ee6d0-1785-4901-9e01-29a2b91214cd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pdxhs\" (UID: \"b49ee6d0-1785-4901-9e01-29a2b91214cd\") " pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.381411 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381224 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3c9be03-6ef9-4159-a698-95c653bddcf4-host-slash\") pod \"iptables-alerter-g4kxc\" (UID: \"f3c9be03-6ef9-4159-a698-95c653bddcf4\") " pod="openshift-network-operator/iptables-alerter-g4kxc" Jun 03 03:20:27.381411 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381229 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-run\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.381411 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381246 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/087a08d4-5cd4-40dc-ac07-07a516cb3602-cni-binary-copy\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.381411 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381286 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-run-systemd\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.381411 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381307 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3c9be03-6ef9-4159-a698-95c653bddcf4-host-slash\") pod \"iptables-alerter-g4kxc\" (UID: \"f3c9be03-6ef9-4159-a698-95c653bddcf4\") " pod="openshift-network-operator/iptables-alerter-g4kxc" Jun 03 03:20:27.381411 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381312 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8af70d99-31a6-49ef-91bb-735be0eb8536-host\") pod \"node-ca-wrjnf\" (UID: \"8af70d99-31a6-49ef-91bb-735be0eb8536\") " pod="openshift-image-registry/node-ca-wrjnf" Jun 03 03:20:27.381411 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381340 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b49ee6d0-1785-4901-9e01-29a2b91214cd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pdxhs\" (UID: \"b49ee6d0-1785-4901-9e01-29a2b91214cd\") " pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.381411 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381347 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-run-systemd\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.381411 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381309 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-etc-sysctl-conf\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.381411 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381366 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-multus-cni-dir\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.381411 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381390 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-run-openvswitch\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.381411 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381412 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/31f50417-f5ba-4dc1-b5e8-8445d17652ed-etc-selinux\") pod \"aws-ebs-csi-driver-node-wp9fx\" (UID: \"31f50417-f5ba-4dc1-b5e8-8445d17652ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" Jun 03 03:20:27.381411 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381414 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-multus-cni-dir\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.382123 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381436 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-host-var-lib-cni-bin\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.382123 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381455 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-run-openvswitch\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.382123 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381459 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d70d6dc6-b06b-4651-88d9-d08322361734-ovnkube-config\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.382123 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381354 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8af70d99-31a6-49ef-91bb-735be0eb8536-host\") pod \"node-ca-wrjnf\" (UID: \"8af70d99-31a6-49ef-91bb-735be0eb8536\") " pod="openshift-image-registry/node-ca-wrjnf" Jun 03 03:20:27.382123 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381484 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d70d6dc6-b06b-4651-88d9-d08322361734-env-overrides\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.382123 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381498 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b49ee6d0-1785-4901-9e01-29a2b91214cd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pdxhs\" (UID: \"b49ee6d0-1785-4901-9e01-29a2b91214cd\") " pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.382123 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381516 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-host-var-lib-cni-bin\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.382123 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381508 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b836c825-35f6-4fc3-8b10-e098282ab5d3-konnectivity-ca\") pod \"konnectivity-agent-7rz6d\" (UID: \"b836c825-35f6-4fc3-8b10-e098282ab5d3\") " pod="kube-system/konnectivity-agent-7rz6d" Jun 03 03:20:27.382123 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381565 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea8e1018-9d63-4b7a-b241-4b9f6d563906-tmp-dir\") pod \"node-resolver-nbf8p\" (UID: \"ea8e1018-9d63-4b7a-b241-4b9f6d563906\") " pod="openshift-dns/node-resolver-nbf8p" Jun 03 03:20:27.382123 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381573 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/31f50417-f5ba-4dc1-b5e8-8445d17652ed-etc-selinux\") pod \"aws-ebs-csi-driver-node-wp9fx\" (UID: \"31f50417-f5ba-4dc1-b5e8-8445d17652ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" Jun 03 03:20:27.382123 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381564 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 03:20:27.382123 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381596 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2mhd4\" (UniqueName: \"kubernetes.io/projected/f3c9be03-6ef9-4159-a698-95c653bddcf4-kube-api-access-2mhd4\") pod \"iptables-alerter-g4kxc\" (UID: \"f3c9be03-6ef9-4159-a698-95c653bddcf4\") " pod="openshift-network-operator/iptables-alerter-g4kxc" Jun 03 03:20:27.382123 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381671 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-multus-socket-dir-parent\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.382123 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381697 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-host-cni-bin\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.382123 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381723 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/31f50417-f5ba-4dc1-b5e8-8445d17652ed-device-dir\") pod \"aws-ebs-csi-driver-node-wp9fx\" (UID: \"31f50417-f5ba-4dc1-b5e8-8445d17652ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" Jun 03 03:20:27.382123 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381748 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vmp2\" (UniqueName: \"kubernetes.io/projected/55469fc3-4142-42c5-8420-af3316559074-kube-api-access-2vmp2\") pod \"network-metrics-daemon-rp75f\" (UID: \"55469fc3-4142-42c5-8420-af3316559074\") " pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:27.382123 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381777 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b49ee6d0-1785-4901-9e01-29a2b91214cd-cni-binary-copy\") pod \"multus-additional-cni-plugins-pdxhs\" (UID: \"b49ee6d0-1785-4901-9e01-29a2b91214cd\") " pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.382123 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381804 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-systemd-units\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.383011 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381833 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-etc-sysconfig\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.383011 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381858 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-etc-sysctl-d\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.383011 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381885 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-host\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.383011 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381893 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea8e1018-9d63-4b7a-b241-4b9f6d563906-tmp-dir\") pod \"node-resolver-nbf8p\" (UID: \"ea8e1018-9d63-4b7a-b241-4b9f6d563906\") " pod="openshift-dns/node-resolver-nbf8p" Jun 03 03:20:27.383011 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381911 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8kzdl\" (UniqueName: \"kubernetes.io/projected/31f50417-f5ba-4dc1-b5e8-8445d17652ed-kube-api-access-8kzdl\") pod \"aws-ebs-csi-driver-node-wp9fx\" (UID: \"31f50417-f5ba-4dc1-b5e8-8445d17652ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" Jun 03 03:20:27.383011 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381747 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b49ee6d0-1785-4901-9e01-29a2b91214cd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pdxhs\" (UID: \"b49ee6d0-1785-4901-9e01-29a2b91214cd\") " pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.383011 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381937 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/087a08d4-5cd4-40dc-ac07-07a516cb3602-multus-daemon-config\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.383011 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.381965 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-host-kubelet\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.383011 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382007 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-etc-openvswitch\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.383011 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382036 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/31f50417-f5ba-4dc1-b5e8-8445d17652ed-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wp9fx\" (UID: \"31f50417-f5ba-4dc1-b5e8-8445d17652ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" Jun 03 03:20:27.383011 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382037 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d70d6dc6-b06b-4651-88d9-d08322361734-env-overrides\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.383011 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382062 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lh5tw\" (UniqueName: \"kubernetes.io/projected/ea8e1018-9d63-4b7a-b241-4b9f6d563906-kube-api-access-lh5tw\") pod \"node-resolver-nbf8p\" (UID: \"ea8e1018-9d63-4b7a-b241-4b9f6d563906\") " pod="openshift-dns/node-resolver-nbf8p" Jun 03 03:20:27.383011 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382099 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d70d6dc6-b06b-4651-88d9-d08322361734-ovnkube-config\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.383011 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382160 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-host\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.383011 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382219 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-multus-socket-dir-parent\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.383011 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382267 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-host-cni-bin\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.383011 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382270 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/087a08d4-5cd4-40dc-ac07-07a516cb3602-cni-binary-copy\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.383779 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382342 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/31f50417-f5ba-4dc1-b5e8-8445d17652ed-device-dir\") pod \"aws-ebs-csi-driver-node-wp9fx\" (UID: \"31f50417-f5ba-4dc1-b5e8-8445d17652ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" Jun 03 03:20:27.383779 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382413 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-host-kubelet\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.383779 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382479 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-etc-openvswitch\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.383779 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382544 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/31f50417-f5ba-4dc1-b5e8-8445d17652ed-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wp9fx\" (UID: \"31f50417-f5ba-4dc1-b5e8-8445d17652ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" Jun 03 03:20:27.383779 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382545 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-systemd-units\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.383779 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382557 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b836c825-35f6-4fc3-8b10-e098282ab5d3-konnectivity-ca\") pod \"konnectivity-agent-7rz6d\" (UID: \"b836c825-35f6-4fc3-8b10-e098282ab5d3\") " pod="kube-system/konnectivity-agent-7rz6d" Jun 03 03:20:27.383779 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382595 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-host-run-k8s-cni-cncf-io\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.383779 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382600 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-etc-sysconfig\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.383779 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382604 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b49ee6d0-1785-4901-9e01-29a2b91214cd-cni-binary-copy\") pod \"multus-additional-cni-plugins-pdxhs\" (UID: \"b49ee6d0-1785-4901-9e01-29a2b91214cd\") " pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.383779 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382618 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-hostroot\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.383779 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382640 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-host-run-k8s-cni-cncf-io\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.383779 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382642 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d70d6dc6-b06b-4651-88d9-d08322361734-ovn-node-metrics-cert\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.383779 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382657 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-etc-sysctl-d\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.383779 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382665 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-hostroot\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.383779 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382675 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d70d6dc6-b06b-4651-88d9-d08322361734-ovnkube-script-lib\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.383779 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382702 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b49ee6d0-1785-4901-9e01-29a2b91214cd-system-cni-dir\") pod \"multus-additional-cni-plugins-pdxhs\" (UID: \"b49ee6d0-1785-4901-9e01-29a2b91214cd\") " pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.383779 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382729 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-host-var-lib-cni-multus\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.383779 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382755 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-multus-conf-dir\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.384595 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382783 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-host-run-multus-certs\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.384595 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382827 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-etc-kubernetes\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.384595 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382839 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-host-var-lib-cni-multus\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.384595 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382852 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-var-lib-openvswitch\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.384595 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382858 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/087a08d4-5cd4-40dc-ac07-07a516cb3602-multus-daemon-config\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.384595 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382877 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8af70d99-31a6-49ef-91bb-735be0eb8536-serviceca\") pod \"node-ca-wrjnf\" (UID: \"8af70d99-31a6-49ef-91bb-735be0eb8536\") " pod="openshift-image-registry/node-ca-wrjnf" Jun 03 03:20:27.384595 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382885 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-host-run-multus-certs\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.384595 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382904 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-shwp6\" (UniqueName: \"kubernetes.io/projected/d70d6dc6-b06b-4651-88d9-d08322361734-kube-api-access-shwp6\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.384595 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382919 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-multus-conf-dir\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.384595 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382920 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-etc-kubernetes\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.384595 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382930 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-etc-kubernetes\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.384595 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382795 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b49ee6d0-1785-4901-9e01-29a2b91214cd-system-cni-dir\") pod \"multus-additional-cni-plugins-pdxhs\" (UID: \"b49ee6d0-1785-4901-9e01-29a2b91214cd\") " pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.384595 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382943 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-var-lib-openvswitch\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.384595 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.382956 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-lib-modules\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.384595 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383031 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-etc-kubernetes\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.384595 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383050 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4mbfr\" (UniqueName: \"kubernetes.io/projected/3de6cab3-243e-4cc5-91c5-458eec3e5180-kube-api-access-4mbfr\") pod \"network-check-target-gqszd\" (UID: \"3de6cab3-243e-4cc5-91c5-458eec3e5180\") " pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:27.384595 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383076 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-os-release\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.384595 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383099 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-host-run-netns\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.385415 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383126 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-lib-modules\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.385415 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383130 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/31f50417-f5ba-4dc1-b5e8-8445d17652ed-sys-fs\") pod \"aws-ebs-csi-driver-node-wp9fx\" (UID: \"31f50417-f5ba-4dc1-b5e8-8445d17652ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" Jun 03 03:20:27.385415 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383185 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4whrt\" (UniqueName: \"kubernetes.io/projected/b49ee6d0-1785-4901-9e01-29a2b91214cd-kube-api-access-4whrt\") pod \"multus-additional-cni-plugins-pdxhs\" (UID: \"b49ee6d0-1785-4901-9e01-29a2b91214cd\") " pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.385415 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383185 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/31f50417-f5ba-4dc1-b5e8-8445d17652ed-sys-fs\") pod \"aws-ebs-csi-driver-node-wp9fx\" (UID: \"31f50417-f5ba-4dc1-b5e8-8445d17652ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" Jun 03 03:20:27.385415 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383225 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-host-slash\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.385415 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383252 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-run-ovn\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.385415 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383270 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-host-run-netns\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.385415 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383279 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-node-log\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.385415 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383313 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-log-socket\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.385415 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383316 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-node-log\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.385415 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383348 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8af70d99-31a6-49ef-91bb-735be0eb8536-serviceca\") pod \"node-ca-wrjnf\" (UID: \"8af70d99-31a6-49ef-91bb-735be0eb8536\") " pod="openshift-image-registry/node-ca-wrjnf" Jun 03 03:20:27.385415 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383364 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-log-socket\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.385415 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383224 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-os-release\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.385415 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383418 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-host-slash\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.385415 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383410 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-run-ovn\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.385415 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383488 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.385415 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383523 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-sys\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.385415 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383549 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs\") pod \"network-metrics-daemon-rp75f\" (UID: \"55469fc3-4142-42c5-8420-af3316559074\") " pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:27.386195 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383550 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.386195 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383574 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-host-run-ovn-kubernetes\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.386195 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383583 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-sys\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.386195 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383599 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-etc-systemd\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.386195 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383628 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f4vr6\" (UniqueName: \"kubernetes.io/projected/8af70d99-31a6-49ef-91bb-735be0eb8536-kube-api-access-f4vr6\") pod \"node-ca-wrjnf\" (UID: \"8af70d99-31a6-49ef-91bb-735be0eb8536\") " pod="openshift-image-registry/node-ca-wrjnf" Jun 03 03:20:27.386195 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383632 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-host-run-ovn-kubernetes\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.386195 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:27.383641 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:27.386195 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383655 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b49ee6d0-1785-4901-9e01-29a2b91214cd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pdxhs\" (UID: \"b49ee6d0-1785-4901-9e01-29a2b91214cd\") " pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.386195 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383679 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-etc-systemd\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.386195 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383681 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-system-cni-dir\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.386195 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383729 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-system-cni-dir\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.386195 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:27.383743 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs podName:55469fc3-4142-42c5-8420-af3316559074 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:27.883694313 +0000 UTC m=+3.055604180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs") pod "network-metrics-daemon-rp75f" (UID: "55469fc3-4142-42c5-8420-af3316559074") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:27.386195 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383859 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d70d6dc6-b06b-4651-88d9-d08322361734-ovnkube-script-lib\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.386195 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383875 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-cnibin\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.386195 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383905 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-host-run-netns\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.386195 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383930 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b836c825-35f6-4fc3-8b10-e098282ab5d3-agent-certs\") pod \"konnectivity-agent-7rz6d\" (UID: \"b836c825-35f6-4fc3-8b10-e098282ab5d3\") " pod="kube-system/konnectivity-agent-7rz6d" Jun 03 03:20:27.386195 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383957 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-tmp\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.386860 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383970 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-cnibin\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.386860 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.383981 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/31f50417-f5ba-4dc1-b5e8-8445d17652ed-registration-dir\") pod \"aws-ebs-csi-driver-node-wp9fx\" (UID: \"31f50417-f5ba-4dc1-b5e8-8445d17652ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" Jun 03 03:20:27.386860 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.384025 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b49ee6d0-1785-4901-9e01-29a2b91214cd-cnibin\") pod \"multus-additional-cni-plugins-pdxhs\" (UID: \"b49ee6d0-1785-4901-9e01-29a2b91214cd\") " pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.386860 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.384052 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-etc-modprobe-d\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.386860 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.384077 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-var-lib-kubelet\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.386860 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.384104 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/31f50417-f5ba-4dc1-b5e8-8445d17652ed-socket-dir\") pod \"aws-ebs-csi-driver-node-wp9fx\" (UID: \"31f50417-f5ba-4dc1-b5e8-8445d17652ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" Jun 03 03:20:27.386860 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.384128 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b49ee6d0-1785-4901-9e01-29a2b91214cd-os-release\") pod \"multus-additional-cni-plugins-pdxhs\" (UID: \"b49ee6d0-1785-4901-9e01-29a2b91214cd\") " pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.386860 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.384152 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3c9be03-6ef9-4159-a698-95c653bddcf4-iptables-alerter-script\") pod \"iptables-alerter-g4kxc\" (UID: \"f3c9be03-6ef9-4159-a698-95c653bddcf4\") " pod="openshift-network-operator/iptables-alerter-g4kxc" Jun 03 03:20:27.386860 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.384178 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-host-cni-netd\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.386860 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.384182 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b49ee6d0-1785-4901-9e01-29a2b91214cd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pdxhs\" (UID: \"b49ee6d0-1785-4901-9e01-29a2b91214cd\") " pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.386860 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.384201 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea8e1018-9d63-4b7a-b241-4b9f6d563906-hosts-file\") pod \"node-resolver-nbf8p\" (UID: \"ea8e1018-9d63-4b7a-b241-4b9f6d563906\") " pod="openshift-dns/node-resolver-nbf8p" Jun 03 03:20:27.386860 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.384227 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-host-var-lib-kubelet\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.386860 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.384251 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fzdcx\" (UniqueName: \"kubernetes.io/projected/087a08d4-5cd4-40dc-ac07-07a516cb3602-kube-api-access-fzdcx\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.386860 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.384281 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-var-lib-kubelet\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.386860 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.384596 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/31f50417-f5ba-4dc1-b5e8-8445d17652ed-socket-dir\") pod \"aws-ebs-csi-driver-node-wp9fx\" (UID: \"31f50417-f5ba-4dc1-b5e8-8445d17652ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" Jun 03 03:20:27.386860 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.384671 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b49ee6d0-1785-4901-9e01-29a2b91214cd-os-release\") pod \"multus-additional-cni-plugins-pdxhs\" (UID: \"b49ee6d0-1785-4901-9e01-29a2b91214cd\") " pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.386860 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.385224 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3c9be03-6ef9-4159-a698-95c653bddcf4-iptables-alerter-script\") pod \"iptables-alerter-g4kxc\" (UID: \"f3c9be03-6ef9-4159-a698-95c653bddcf4\") " pod="openshift-network-operator/iptables-alerter-g4kxc" Jun 03 03:20:27.387630 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.385262 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-host-run-netns\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.387630 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.385337 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/087a08d4-5cd4-40dc-ac07-07a516cb3602-host-var-lib-kubelet\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.387630 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.385291 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d70d6dc6-b06b-4651-88d9-d08322361734-host-cni-netd\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.387630 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.385352 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea8e1018-9d63-4b7a-b241-4b9f6d563906-hosts-file\") pod \"node-resolver-nbf8p\" (UID: \"ea8e1018-9d63-4b7a-b241-4b9f6d563906\") " pod="openshift-dns/node-resolver-nbf8p" Jun 03 03:20:27.387630 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.385386 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b49ee6d0-1785-4901-9e01-29a2b91214cd-cnibin\") pod \"multus-additional-cni-plugins-pdxhs\" (UID: \"b49ee6d0-1785-4901-9e01-29a2b91214cd\") " pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.387630 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.385435 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/31f50417-f5ba-4dc1-b5e8-8445d17652ed-registration-dir\") pod \"aws-ebs-csi-driver-node-wp9fx\" (UID: \"31f50417-f5ba-4dc1-b5e8-8445d17652ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" Jun 03 03:20:27.387630 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.385441 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-etc-modprobe-d\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.387630 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.386016 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-etc-tuned\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.387630 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.386580 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-tmp\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.387630 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.386756 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d70d6dc6-b06b-4651-88d9-d08322361734-ovn-node-metrics-cert\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.387630 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.387167 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b836c825-35f6-4fc3-8b10-e098282ab5d3-agent-certs\") pod \"konnectivity-agent-7rz6d\" (UID: \"b836c825-35f6-4fc3-8b10-e098282ab5d3\") " pod="kube-system/konnectivity-agent-7rz6d" Jun 03 03:20:27.389009 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.388971 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55bwx\" (UniqueName: \"kubernetes.io/projected/4fa26aa9-3388-4e0c-8ef1-1428b81bf785-kube-api-access-55bwx\") pod \"tuned-hhvsb\" (UID: \"4fa26aa9-3388-4e0c-8ef1-1428b81bf785\") " pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.390313 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.390289 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kzdl\" (UniqueName: \"kubernetes.io/projected/31f50417-f5ba-4dc1-b5e8-8445d17652ed-kube-api-access-8kzdl\") pod \"aws-ebs-csi-driver-node-wp9fx\" (UID: \"31f50417-f5ba-4dc1-b5e8-8445d17652ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" Jun 03 03:20:27.390872 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.390848 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mhd4\" (UniqueName: \"kubernetes.io/projected/f3c9be03-6ef9-4159-a698-95c653bddcf4-kube-api-access-2mhd4\") pod \"iptables-alerter-g4kxc\" (UID: \"f3c9be03-6ef9-4159-a698-95c653bddcf4\") " pod="openshift-network-operator/iptables-alerter-g4kxc" Jun 03 03:20:27.390872 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.390863 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shwp6\" (UniqueName: \"kubernetes.io/projected/d70d6dc6-b06b-4651-88d9-d08322361734-kube-api-access-shwp6\") pod \"ovnkube-node-4fv96\" (UID: \"d70d6dc6-b06b-4651-88d9-d08322361734\") " pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.391226 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.391205 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh5tw\" (UniqueName: \"kubernetes.io/projected/ea8e1018-9d63-4b7a-b241-4b9f6d563906-kube-api-access-lh5tw\") pod \"node-resolver-nbf8p\" (UID: \"ea8e1018-9d63-4b7a-b241-4b9f6d563906\") " pod="openshift-dns/node-resolver-nbf8p" Jun 03 03:20:27.391226 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.391217 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vmp2\" (UniqueName: \"kubernetes.io/projected/55469fc3-4142-42c5-8420-af3316559074-kube-api-access-2vmp2\") pod \"network-metrics-daemon-rp75f\" (UID: \"55469fc3-4142-42c5-8420-af3316559074\") " pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:27.392159 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:27.392139 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 03:20:27.392159 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:27.392159 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 03:20:27.392306 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:27.392169 2558 projected.go:194] Error preparing data for projected volume kube-api-access-4mbfr for pod openshift-network-diagnostics/network-check-target-gqszd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:27.392306 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:27.392221 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3de6cab3-243e-4cc5-91c5-458eec3e5180-kube-api-access-4mbfr podName:3de6cab3-243e-4cc5-91c5-458eec3e5180 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:27.892206145 +0000 UTC m=+3.064115998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4mbfr" (UniqueName: "kubernetes.io/projected/3de6cab3-243e-4cc5-91c5-458eec3e5180-kube-api-access-4mbfr") pod "network-check-target-gqszd" (UID: "3de6cab3-243e-4cc5-91c5-458eec3e5180") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:27.394322 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.394300 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4vr6\" (UniqueName: \"kubernetes.io/projected/8af70d99-31a6-49ef-91bb-735be0eb8536-kube-api-access-f4vr6\") pod \"node-ca-wrjnf\" (UID: \"8af70d99-31a6-49ef-91bb-735be0eb8536\") " pod="openshift-image-registry/node-ca-wrjnf" Jun 03 03:20:27.395140 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.395117 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4whrt\" (UniqueName: \"kubernetes.io/projected/b49ee6d0-1785-4901-9e01-29a2b91214cd-kube-api-access-4whrt\") pod \"multus-additional-cni-plugins-pdxhs\" (UID: \"b49ee6d0-1785-4901-9e01-29a2b91214cd\") " pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.395373 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.395350 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzdcx\" (UniqueName: \"kubernetes.io/projected/087a08d4-5cd4-40dc-ac07-07a516cb3602-kube-api-access-fzdcx\") pod \"multus-t6wx4\" (UID: \"087a08d4-5cd4-40dc-ac07-07a516cb3602\") " pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.569758 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.569719 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t6wx4" Jun 03 03:20:27.577537 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.577514 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" Jun 03 03:20:27.586102 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.586070 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nbf8p" Jun 03 03:20:27.591683 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.591660 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pdxhs" Jun 03 03:20:27.597544 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.597524 2558 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 03:20:27.597642 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.597607 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:27.605367 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.605339 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g4kxc" Jun 03 03:20:27.612339 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.612319 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7rz6d" Jun 03 03:20:27.618920 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.618902 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" Jun 03 03:20:27.625463 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.625449 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wrjnf" Jun 03 03:20:27.888434 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.888399 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs\") pod \"network-metrics-daemon-rp75f\" (UID: \"55469fc3-4142-42c5-8420-af3316559074\") " pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:27.888583 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:27.888517 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:27.888583 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:27.888570 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs podName:55469fc3-4142-42c5-8420-af3316559074 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:28.88855412 +0000 UTC m=+4.060463969 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs") pod "network-metrics-daemon-rp75f" (UID: "55469fc3-4142-42c5-8420-af3316559074") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:27.909194 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:27.909167 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd70d6dc6_b06b_4651_88d9_d08322361734.slice/crio-6d0cca34aa5783d49c119cb8ee351fd3fe5702897acf5296f2c421dfd863b5e1 WatchSource:0}: Error finding container 6d0cca34aa5783d49c119cb8ee351fd3fe5702897acf5296f2c421dfd863b5e1: Status 404 returned error can't find the container with id 6d0cca34aa5783d49c119cb8ee351fd3fe5702897acf5296f2c421dfd863b5e1 Jun 03 03:20:27.910323 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:27.910278 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fa26aa9_3388_4e0c_8ef1_1428b81bf785.slice/crio-80a2400ba81dd160fd36b915f21fbeb0ab8185746479f858bd44bfd5b2aa2a75 WatchSource:0}: Error finding container 80a2400ba81dd160fd36b915f21fbeb0ab8185746479f858bd44bfd5b2aa2a75: Status 404 returned error can't find the container with id 80a2400ba81dd160fd36b915f21fbeb0ab8185746479f858bd44bfd5b2aa2a75 Jun 03 03:20:27.911092 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:27.911067 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb836c825_35f6_4fc3_8b10_e098282ab5d3.slice/crio-0bb315a54436bdc7e5b2083d2554871b8c3cbbbb5d61ee838773061c9fd515e8 WatchSource:0}: Error finding container 0bb315a54436bdc7e5b2083d2554871b8c3cbbbb5d61ee838773061c9fd515e8: Status 404 returned error can't find the container with id 0bb315a54436bdc7e5b2083d2554871b8c3cbbbb5d61ee838773061c9fd515e8 Jun 03 03:20:27.911750 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:27.911702 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8af70d99_31a6_49ef_91bb_735be0eb8536.slice/crio-316aaf840208aee2b70c601efc2eb29ec3c6dba0395ad80f77ae41265e01bc34 WatchSource:0}: Error finding container 316aaf840208aee2b70c601efc2eb29ec3c6dba0395ad80f77ae41265e01bc34: Status 404 returned error can't find the container with id 316aaf840208aee2b70c601efc2eb29ec3c6dba0395ad80f77ae41265e01bc34 Jun 03 03:20:27.914425 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:27.914380 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea8e1018_9d63_4b7a_b241_4b9f6d563906.slice/crio-ed163240e4346a73a944e7385cfe2227a93d53b60fa4951cc007c6556f4c1a74 WatchSource:0}: Error finding container ed163240e4346a73a944e7385cfe2227a93d53b60fa4951cc007c6556f4c1a74: Status 404 returned error can't find the container with id ed163240e4346a73a944e7385cfe2227a93d53b60fa4951cc007c6556f4c1a74 Jun 03 03:20:27.915319 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:27.915298 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3c9be03_6ef9_4159_a698_95c653bddcf4.slice/crio-1a052167d1caf628efb65839e925676cabb241270e0c915ab13fa9278d13af5b WatchSource:0}: Error finding container 1a052167d1caf628efb65839e925676cabb241270e0c915ab13fa9278d13af5b: Status 404 returned error can't find the container with id 1a052167d1caf628efb65839e925676cabb241270e0c915ab13fa9278d13af5b Jun 03 03:20:27.916319 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:27.916238 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31f50417_f5ba_4dc1_b5e8_8445d17652ed.slice/crio-5cd198acbdb458cc4d6431ccf227b830d4e06f4b8a9100c455faa02df5c4a764 WatchSource:0}: Error finding container 5cd198acbdb458cc4d6431ccf227b830d4e06f4b8a9100c455faa02df5c4a764: Status 404 returned error can't find the container with id 5cd198acbdb458cc4d6431ccf227b830d4e06f4b8a9100c455faa02df5c4a764 Jun 03 03:20:27.916875 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:27.916853 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod087a08d4_5cd4_40dc_ac07_07a516cb3602.slice/crio-d28a4a2273515a87cdbbdee512d0bc98040f0b75faa2b8ec065992b4f822ee48 WatchSource:0}: Error finding container d28a4a2273515a87cdbbdee512d0bc98040f0b75faa2b8ec065992b4f822ee48: Status 404 returned error can't find the container with id d28a4a2273515a87cdbbdee512d0bc98040f0b75faa2b8ec065992b4f822ee48 Jun 03 03:20:27.918758 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:20:27.918513 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb49ee6d0_1785_4901_9e01_29a2b91214cd.slice/crio-f38db6d0e6ee644129a9dfc27c5773940c1d3af05831bdbf1b3674e7cb5b12f1 WatchSource:0}: Error finding container f38db6d0e6ee644129a9dfc27c5773940c1d3af05831bdbf1b3674e7cb5b12f1: Status 404 returned error can't find the container with id f38db6d0e6ee644129a9dfc27c5773940c1d3af05831bdbf1b3674e7cb5b12f1 Jun 03 03:20:27.989170 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:27.988899 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4mbfr\" (UniqueName: \"kubernetes.io/projected/3de6cab3-243e-4cc5-91c5-458eec3e5180-kube-api-access-4mbfr\") pod \"network-check-target-gqszd\" (UID: \"3de6cab3-243e-4cc5-91c5-458eec3e5180\") " pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:27.989246 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:27.989083 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 03:20:27.989246 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:27.989232 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 03:20:27.989246 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:27.989246 2558 projected.go:194] Error preparing data for projected volume kube-api-access-4mbfr for pod openshift-network-diagnostics/network-check-target-gqszd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:27.989346 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:27.989293 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3de6cab3-243e-4cc5-91c5-458eec3e5180-kube-api-access-4mbfr podName:3de6cab3-243e-4cc5-91c5-458eec3e5180 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:28.989278684 +0000 UTC m=+4.161188533 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4mbfr" (UniqueName: "kubernetes.io/projected/3de6cab3-243e-4cc5-91c5-458eec3e5180-kube-api-access-4mbfr") pod "network-check-target-gqszd" (UID: "3de6cab3-243e-4cc5-91c5-458eec3e5180") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:28.311382 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:28.311339 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 03:15:26 +0000 UTC" deadline="2028-03-17 14:34:30.184724248 +0000 UTC" Jun 03 03:20:28.311382 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:28.311379 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15683h14m1.873349042s" Jun 03 03:20:28.365947 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:28.365916 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:28.366146 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:28.366076 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rp75f" podUID="55469fc3-4142-42c5-8420-af3316559074" Jun 03 03:20:28.366529 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:28.366507 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:28.366614 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:28.366601 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqszd" podUID="3de6cab3-243e-4cc5-91c5-458eec3e5180" Jun 03 03:20:28.378206 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:28.378170 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g4kxc" event={"ID":"f3c9be03-6ef9-4159-a698-95c653bddcf4","Type":"ContainerStarted","Data":"1a052167d1caf628efb65839e925676cabb241270e0c915ab13fa9278d13af5b"} Jun 03 03:20:28.384336 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:28.384307 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-253.ec2.internal" event={"ID":"51754ad4b56dbdc3429426f262ad029e","Type":"ContainerStarted","Data":"f1bcafa49fbf1e59dd6a7215e515036918ed5d5b2e1f7f3c26ba680c09012c85"} Jun 03 03:20:28.389770 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:28.389743 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pdxhs" event={"ID":"b49ee6d0-1785-4901-9e01-29a2b91214cd","Type":"ContainerStarted","Data":"f38db6d0e6ee644129a9dfc27c5773940c1d3af05831bdbf1b3674e7cb5b12f1"} Jun 03 03:20:28.391347 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:28.391284 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" event={"ID":"31f50417-f5ba-4dc1-b5e8-8445d17652ed","Type":"ContainerStarted","Data":"5cd198acbdb458cc4d6431ccf227b830d4e06f4b8a9100c455faa02df5c4a764"} Jun 03 03:20:28.393697 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:28.393674 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nbf8p" event={"ID":"ea8e1018-9d63-4b7a-b241-4b9f6d563906","Type":"ContainerStarted","Data":"ed163240e4346a73a944e7385cfe2227a93d53b60fa4951cc007c6556f4c1a74"} Jun 03 03:20:28.396587 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:28.395616 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wrjnf" event={"ID":"8af70d99-31a6-49ef-91bb-735be0eb8536","Type":"ContainerStarted","Data":"316aaf840208aee2b70c601efc2eb29ec3c6dba0395ad80f77ae41265e01bc34"} Jun 03 03:20:28.396702 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:28.396631 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-253.ec2.internal" podStartSLOduration=2.396616923 podStartE2EDuration="2.396616923s" podCreationTimestamp="2026-06-03 03:20:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:20:28.396551935 +0000 UTC m=+3.568461808" watchObservedRunningTime="2026-06-03 03:20:28.396616923 +0000 UTC m=+3.568526835" Jun 03 03:20:28.398189 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:28.398141 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7rz6d" event={"ID":"b836c825-35f6-4fc3-8b10-e098282ab5d3","Type":"ContainerStarted","Data":"0bb315a54436bdc7e5b2083d2554871b8c3cbbbb5d61ee838773061c9fd515e8"} Jun 03 03:20:28.400784 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:28.400747 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" event={"ID":"4fa26aa9-3388-4e0c-8ef1-1428b81bf785","Type":"ContainerStarted","Data":"80a2400ba81dd160fd36b915f21fbeb0ab8185746479f858bd44bfd5b2aa2a75"} Jun 03 03:20:28.404420 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:28.403410 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" event={"ID":"d70d6dc6-b06b-4651-88d9-d08322361734","Type":"ContainerStarted","Data":"6d0cca34aa5783d49c119cb8ee351fd3fe5702897acf5296f2c421dfd863b5e1"} Jun 03 03:20:28.406033 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:28.406010 2558 generic.go:358] "Generic (PLEG): container finished" podID="7622d28d87bea8853b695a9482dc52b8" containerID="409c381cfa196844d48e9048b733035fa7ac2b22720dba108d42acb3c7ea15e2" exitCode=0 Jun 03 03:20:28.406127 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:28.406073 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal" event={"ID":"7622d28d87bea8853b695a9482dc52b8","Type":"ContainerDied","Data":"409c381cfa196844d48e9048b733035fa7ac2b22720dba108d42acb3c7ea15e2"} Jun 03 03:20:28.407872 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:28.407851 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t6wx4" event={"ID":"087a08d4-5cd4-40dc-ac07-07a516cb3602","Type":"ContainerStarted","Data":"d28a4a2273515a87cdbbdee512d0bc98040f0b75faa2b8ec065992b4f822ee48"} Jun 03 03:20:28.895326 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:28.895291 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs\") pod \"network-metrics-daemon-rp75f\" (UID: \"55469fc3-4142-42c5-8420-af3316559074\") " pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:28.895506 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:28.895439 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:28.895506 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:28.895502 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs podName:55469fc3-4142-42c5-8420-af3316559074 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:30.895483101 +0000 UTC m=+6.067392952 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs") pod "network-metrics-daemon-rp75f" (UID: "55469fc3-4142-42c5-8420-af3316559074") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:28.996552 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:28.995925 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4mbfr\" (UniqueName: \"kubernetes.io/projected/3de6cab3-243e-4cc5-91c5-458eec3e5180-kube-api-access-4mbfr\") pod \"network-check-target-gqszd\" (UID: \"3de6cab3-243e-4cc5-91c5-458eec3e5180\") " pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:28.996552 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:28.996142 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 03:20:28.996552 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:28.996163 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 03:20:28.996552 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:28.996176 2558 projected.go:194] Error preparing data for projected volume kube-api-access-4mbfr for pod openshift-network-diagnostics/network-check-target-gqszd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:28.996552 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:28.996238 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3de6cab3-243e-4cc5-91c5-458eec3e5180-kube-api-access-4mbfr podName:3de6cab3-243e-4cc5-91c5-458eec3e5180 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:30.99621889 +0000 UTC m=+6.168128756 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4mbfr" (UniqueName: "kubernetes.io/projected/3de6cab3-243e-4cc5-91c5-458eec3e5180-kube-api-access-4mbfr") pod "network-check-target-gqszd" (UID: "3de6cab3-243e-4cc5-91c5-458eec3e5180") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:29.414116 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:29.414080 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal" event={"ID":"7622d28d87bea8853b695a9482dc52b8","Type":"ContainerStarted","Data":"5bc8f4bef3e407c5ed680e577aa05f66979be2124d0ef1aea118f3c7c1925f0f"} Jun 03 03:20:30.365872 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:30.365837 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:30.366133 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:30.365978 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rp75f" podUID="55469fc3-4142-42c5-8420-af3316559074" Jun 03 03:20:30.366458 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:30.366437 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:30.366570 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:30.366535 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqszd" podUID="3de6cab3-243e-4cc5-91c5-458eec3e5180" Jun 03 03:20:30.910858 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:30.910155 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs\") pod \"network-metrics-daemon-rp75f\" (UID: \"55469fc3-4142-42c5-8420-af3316559074\") " pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:30.910858 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:30.910394 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:30.910858 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:30.910462 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs podName:55469fc3-4142-42c5-8420-af3316559074 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:34.910442919 +0000 UTC m=+10.082352772 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs") pod "network-metrics-daemon-rp75f" (UID: "55469fc3-4142-42c5-8420-af3316559074") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:31.011908 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:31.011226 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4mbfr\" (UniqueName: \"kubernetes.io/projected/3de6cab3-243e-4cc5-91c5-458eec3e5180-kube-api-access-4mbfr\") pod \"network-check-target-gqszd\" (UID: \"3de6cab3-243e-4cc5-91c5-458eec3e5180\") " pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:31.011908 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:31.011425 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 03:20:31.011908 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:31.011444 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 03:20:31.011908 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:31.011457 2558 projected.go:194] Error preparing data for projected volume kube-api-access-4mbfr for pod openshift-network-diagnostics/network-check-target-gqszd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:31.011908 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:31.011515 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3de6cab3-243e-4cc5-91c5-458eec3e5180-kube-api-access-4mbfr podName:3de6cab3-243e-4cc5-91c5-458eec3e5180 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:35.011495514 +0000 UTC m=+10.183405386 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4mbfr" (UniqueName: "kubernetes.io/projected/3de6cab3-243e-4cc5-91c5-458eec3e5180-kube-api-access-4mbfr") pod "network-check-target-gqszd" (UID: "3de6cab3-243e-4cc5-91c5-458eec3e5180") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:32.365811 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:32.365777 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:32.366292 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:32.365913 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqszd" podUID="3de6cab3-243e-4cc5-91c5-458eec3e5180" Jun 03 03:20:32.366366 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:32.366328 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:32.366494 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:32.366432 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rp75f" podUID="55469fc3-4142-42c5-8420-af3316559074" Jun 03 03:20:34.366046 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:34.365968 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:34.366520 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:34.365968 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:34.366520 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:34.366120 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqszd" podUID="3de6cab3-243e-4cc5-91c5-458eec3e5180" Jun 03 03:20:34.366520 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:34.366197 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rp75f" podUID="55469fc3-4142-42c5-8420-af3316559074" Jun 03 03:20:34.943173 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:34.943115 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs\") pod \"network-metrics-daemon-rp75f\" (UID: \"55469fc3-4142-42c5-8420-af3316559074\") " pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:34.943357 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:34.943268 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:34.943357 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:34.943332 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs podName:55469fc3-4142-42c5-8420-af3316559074 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:42.943312943 +0000 UTC m=+18.115222803 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs") pod "network-metrics-daemon-rp75f" (UID: "55469fc3-4142-42c5-8420-af3316559074") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:35.044530 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:35.044491 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4mbfr\" (UniqueName: \"kubernetes.io/projected/3de6cab3-243e-4cc5-91c5-458eec3e5180-kube-api-access-4mbfr\") pod \"network-check-target-gqszd\" (UID: \"3de6cab3-243e-4cc5-91c5-458eec3e5180\") " pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:35.044702 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:35.044681 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 03:20:35.044778 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:35.044712 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 03:20:35.044778 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:35.044725 2558 projected.go:194] Error preparing data for projected volume kube-api-access-4mbfr for pod openshift-network-diagnostics/network-check-target-gqszd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:35.044877 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:35.044796 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3de6cab3-243e-4cc5-91c5-458eec3e5180-kube-api-access-4mbfr podName:3de6cab3-243e-4cc5-91c5-458eec3e5180 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:43.044774838 +0000 UTC m=+18.216684706 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4mbfr" (UniqueName: "kubernetes.io/projected/3de6cab3-243e-4cc5-91c5-458eec3e5180-kube-api-access-4mbfr") pod "network-check-target-gqszd" (UID: "3de6cab3-243e-4cc5-91c5-458eec3e5180") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:36.366373 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:36.366341 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:36.366913 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:36.366339 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:36.366913 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:36.366478 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rp75f" podUID="55469fc3-4142-42c5-8420-af3316559074" Jun 03 03:20:36.366913 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:36.366531 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqszd" podUID="3de6cab3-243e-4cc5-91c5-458eec3e5180" Jun 03 03:20:38.366314 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:38.366221 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:38.366314 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:38.366246 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:38.366793 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:38.366365 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rp75f" podUID="55469fc3-4142-42c5-8420-af3316559074" Jun 03 03:20:38.366793 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:38.366442 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqszd" podUID="3de6cab3-243e-4cc5-91c5-458eec3e5180" Jun 03 03:20:40.366160 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:40.366126 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:40.366634 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:40.366126 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:40.366634 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:40.366245 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rp75f" podUID="55469fc3-4142-42c5-8420-af3316559074" Jun 03 03:20:40.366634 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:40.366296 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqszd" podUID="3de6cab3-243e-4cc5-91c5-458eec3e5180" Jun 03 03:20:42.366414 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:42.366374 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:42.366835 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:42.366513 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rp75f" podUID="55469fc3-4142-42c5-8420-af3316559074" Jun 03 03:20:42.366835 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:42.366548 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:42.366835 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:42.366597 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqszd" podUID="3de6cab3-243e-4cc5-91c5-458eec3e5180" Jun 03 03:20:43.002686 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:43.002649 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs\") pod \"network-metrics-daemon-rp75f\" (UID: \"55469fc3-4142-42c5-8420-af3316559074\") " pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:43.002866 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:43.002776 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:43.002866 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:43.002855 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs podName:55469fc3-4142-42c5-8420-af3316559074 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:59.002834647 +0000 UTC m=+34.174744511 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs") pod "network-metrics-daemon-rp75f" (UID: "55469fc3-4142-42c5-8420-af3316559074") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:43.103393 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:43.103347 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4mbfr\" (UniqueName: \"kubernetes.io/projected/3de6cab3-243e-4cc5-91c5-458eec3e5180-kube-api-access-4mbfr\") pod \"network-check-target-gqszd\" (UID: \"3de6cab3-243e-4cc5-91c5-458eec3e5180\") " pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:43.103568 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:43.103520 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 03:20:43.103568 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:43.103541 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 03:20:43.103568 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:43.103552 2558 projected.go:194] Error preparing data for projected volume kube-api-access-4mbfr for pod openshift-network-diagnostics/network-check-target-gqszd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:43.103688 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:43.103612 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3de6cab3-243e-4cc5-91c5-458eec3e5180-kube-api-access-4mbfr podName:3de6cab3-243e-4cc5-91c5-458eec3e5180 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:59.103594532 +0000 UTC m=+34.275504402 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4mbfr" (UniqueName: "kubernetes.io/projected/3de6cab3-243e-4cc5-91c5-458eec3e5180-kube-api-access-4mbfr") pod "network-check-target-gqszd" (UID: "3de6cab3-243e-4cc5-91c5-458eec3e5180") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:44.366379 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:44.366346 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:44.366846 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:44.366432 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:44.366846 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:44.366581 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rp75f" podUID="55469fc3-4142-42c5-8420-af3316559074" Jun 03 03:20:44.366846 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:44.366704 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqszd" podUID="3de6cab3-243e-4cc5-91c5-458eec3e5180" Jun 03 03:20:46.365678 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:46.365511 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:46.366132 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:46.365510 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:46.366132 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:46.365749 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rp75f" podUID="55469fc3-4142-42c5-8420-af3316559074" Jun 03 03:20:46.366132 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:46.365813 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqszd" podUID="3de6cab3-243e-4cc5-91c5-458eec3e5180" Jun 03 03:20:46.445643 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:46.445620 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pdxhs" event={"ID":"b49ee6d0-1785-4901-9e01-29a2b91214cd","Type":"ContainerStarted","Data":"34c74d2d3a21eb43ff36f928866baefada04aacb64677f252d665142042a1d08"} Jun 03 03:20:46.447018 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:46.446977 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" event={"ID":"31f50417-f5ba-4dc1-b5e8-8445d17652ed","Type":"ContainerStarted","Data":"a178f03fd0680b8978603b67c8cc10944d4b55796a6a5c8b366f201b13f09ec8"} Jun 03 03:20:46.448328 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:46.448304 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nbf8p" event={"ID":"ea8e1018-9d63-4b7a-b241-4b9f6d563906","Type":"ContainerStarted","Data":"9562f10f22ce2c60e6136dda12ce6a69d96742b744eae40910f737d532e770b9"} Jun 03 03:20:46.449397 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:46.449377 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wrjnf" event={"ID":"8af70d99-31a6-49ef-91bb-735be0eb8536","Type":"ContainerStarted","Data":"2f1b1ea43a6f7b189d41287acd6c134a6ee75cc85c61ff86ee6291a47460e724"} Jun 03 03:20:46.450518 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:46.450487 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7rz6d" event={"ID":"b836c825-35f6-4fc3-8b10-e098282ab5d3","Type":"ContainerStarted","Data":"fb87deba97dfbf85d3b22e8741185c6cf6a5acee98d886b70c8453420f16c44e"} Jun 03 03:20:46.452124 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:46.452102 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" event={"ID":"4fa26aa9-3388-4e0c-8ef1-1428b81bf785","Type":"ContainerStarted","Data":"991b4ea5edf8b26adef528b3ce8a72f35107e4d1d7961c3272405d044e5250d3"} Jun 03 03:20:46.453664 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:46.453640 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" event={"ID":"d70d6dc6-b06b-4651-88d9-d08322361734","Type":"ContainerStarted","Data":"73873ac2f1ab2685327511eec99ee62b4ce0f3733aac4bdbb0e2e340981189c2"} Jun 03 03:20:46.453745 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:46.453672 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" event={"ID":"d70d6dc6-b06b-4651-88d9-d08322361734","Type":"ContainerStarted","Data":"77fd9e60c65820c085f6194eb50b42e41420198bdeb6541ad6b3449fc061b58c"} Jun 03 03:20:46.455047 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:46.455015 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t6wx4" event={"ID":"087a08d4-5cd4-40dc-ac07-07a516cb3602","Type":"ContainerStarted","Data":"f7c598406f5b34d576c54f8ef6ce92fbdc8dca07d68daaf854e12cac1c501e0e"} Jun 03 03:20:46.464259 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:46.464197 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal" podStartSLOduration=20.464160576 podStartE2EDuration="20.464160576s" podCreationTimestamp="2026-06-03 03:20:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:20:29.432188389 +0000 UTC m=+4.604098261" watchObservedRunningTime="2026-06-03 03:20:46.464160576 +0000 UTC m=+21.636070450" Jun 03 03:20:46.477549 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:46.477505 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-nbf8p" podStartSLOduration=3.32073706 podStartE2EDuration="21.477490303s" podCreationTimestamp="2026-06-03 03:20:25 +0000 UTC" firstStartedPulling="2026-06-03 03:20:27.916088532 +0000 UTC m=+3.087998395" lastFinishedPulling="2026-06-03 03:20:46.072841774 +0000 UTC m=+21.244751638" observedRunningTime="2026-06-03 03:20:46.47745577 +0000 UTC m=+21.649365641" watchObservedRunningTime="2026-06-03 03:20:46.477490303 +0000 UTC m=+21.649400174" Jun 03 03:20:46.494850 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:46.493386 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-t6wx4" podStartSLOduration=3.334174827 podStartE2EDuration="21.493368732s" podCreationTimestamp="2026-06-03 03:20:25 +0000 UTC" firstStartedPulling="2026-06-03 03:20:27.919502295 +0000 UTC m=+3.091412144" lastFinishedPulling="2026-06-03 03:20:46.078696186 +0000 UTC m=+21.250606049" observedRunningTime="2026-06-03 03:20:46.492005854 +0000 UTC m=+21.663915734" watchObservedRunningTime="2026-06-03 03:20:46.493368732 +0000 UTC m=+21.665278604" Jun 03 03:20:46.507741 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:46.507702 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7rz6d" podStartSLOduration=8.128625252 podStartE2EDuration="21.50768956s" podCreationTimestamp="2026-06-03 03:20:25 +0000 UTC" firstStartedPulling="2026-06-03 03:20:27.913005389 +0000 UTC m=+3.084915251" lastFinishedPulling="2026-06-03 03:20:41.292069702 +0000 UTC m=+16.463979559" observedRunningTime="2026-06-03 03:20:46.507232931 +0000 UTC m=+21.679142803" watchObservedRunningTime="2026-06-03 03:20:46.50768956 +0000 UTC m=+21.679599477" Jun 03 03:20:46.521631 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:46.521591 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hhvsb" podStartSLOduration=3.358831332 podStartE2EDuration="21.52157731s" podCreationTimestamp="2026-06-03 03:20:25 +0000 UTC" firstStartedPulling="2026-06-03 03:20:27.913040497 +0000 UTC m=+3.084950345" lastFinishedPulling="2026-06-03 03:20:46.075786456 +0000 UTC m=+21.247696323" observedRunningTime="2026-06-03 03:20:46.521495195 +0000 UTC m=+21.693405090" watchObservedRunningTime="2026-06-03 03:20:46.52157731 +0000 UTC m=+21.693487181" Jun 03 03:20:47.457937 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:47.457757 2558 generic.go:358] "Generic (PLEG): container finished" podID="b49ee6d0-1785-4901-9e01-29a2b91214cd" containerID="34c74d2d3a21eb43ff36f928866baefada04aacb64677f252d665142042a1d08" exitCode=0 Jun 03 03:20:47.458532 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:47.457840 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pdxhs" event={"ID":"b49ee6d0-1785-4901-9e01-29a2b91214cd","Type":"ContainerDied","Data":"34c74d2d3a21eb43ff36f928866baefada04aacb64677f252d665142042a1d08"} Jun 03 03:20:47.460588 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:47.460568 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/ovn-acl-logging/0.log" Jun 03 03:20:47.460890 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:47.460868 2558 generic.go:358] "Generic (PLEG): container finished" podID="d70d6dc6-b06b-4651-88d9-d08322361734" containerID="73873ac2f1ab2685327511eec99ee62b4ce0f3733aac4bdbb0e2e340981189c2" exitCode=1 Jun 03 03:20:47.460987 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:47.460961 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" event={"ID":"d70d6dc6-b06b-4651-88d9-d08322361734","Type":"ContainerDied","Data":"73873ac2f1ab2685327511eec99ee62b4ce0f3733aac4bdbb0e2e340981189c2"} Jun 03 03:20:47.461051 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:47.460986 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" event={"ID":"d70d6dc6-b06b-4651-88d9-d08322361734","Type":"ContainerStarted","Data":"ea9e9f6d85915411796116e1aff1199a5c5dbc7fd07b558bfd8a3a9afdcca168"} Jun 03 03:20:47.461051 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:47.461016 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" event={"ID":"d70d6dc6-b06b-4651-88d9-d08322361734","Type":"ContainerStarted","Data":"441f0fce789c0999021d011ff259abb6c4b58b2e940f65ba311cf203171b1395"} Jun 03 03:20:47.461051 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:47.461032 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" event={"ID":"d70d6dc6-b06b-4651-88d9-d08322361734","Type":"ContainerStarted","Data":"4dc2cc1f315696013908c96a61400a0b5ba0cdc5d10879e5f02afa73730adbb1"} Jun 03 03:20:47.461051 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:47.461041 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" event={"ID":"d70d6dc6-b06b-4651-88d9-d08322361734","Type":"ContainerStarted","Data":"2f050cf83047d71f7ef55845027e92365ab13feff5984ef4c8049ee7a8093976"} Jun 03 03:20:47.477273 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:47.477233 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wrjnf" podStartSLOduration=4.353001508 podStartE2EDuration="22.477221233s" podCreationTimestamp="2026-06-03 03:20:25 +0000 UTC" firstStartedPulling="2026-06-03 03:20:27.913536965 +0000 UTC m=+3.085446814" lastFinishedPulling="2026-06-03 03:20:46.037756689 +0000 UTC m=+21.209666539" observedRunningTime="2026-06-03 03:20:46.538344494 +0000 UTC m=+21.710254364" watchObservedRunningTime="2026-06-03 03:20:47.477221233 +0000 UTC m=+22.649131104" Jun 03 03:20:47.596486 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:47.596461 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 03:20:48.352516 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:48.352406 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T03:20:47.596480453Z","UUID":"6cebe5da-aee8-4a86-95ba-6a049a8cf645","Handler":null,"Name":"","Endpoint":""} Jun 03 03:20:48.354925 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:48.354881 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 03:20:48.355082 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:48.354934 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 03:20:48.366387 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:48.366361 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:48.366549 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:48.366361 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:48.366549 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:48.366504 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rp75f" podUID="55469fc3-4142-42c5-8420-af3316559074" Jun 03 03:20:48.366628 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:48.366553 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqszd" podUID="3de6cab3-243e-4cc5-91c5-458eec3e5180" Jun 03 03:20:48.464163 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:48.464124 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g4kxc" event={"ID":"f3c9be03-6ef9-4159-a698-95c653bddcf4","Type":"ContainerStarted","Data":"a7e392784bedfcc6ac7ebde6b944b1db7e1e6ef69406adbca1be640bce694647"} Jun 03 03:20:48.466008 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:48.465960 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" event={"ID":"31f50417-f5ba-4dc1-b5e8-8445d17652ed","Type":"ContainerStarted","Data":"f70bf48578de608c9945e5c78d40dad0fc73a5daeac991d73ce30ec567829a93"} Jun 03 03:20:48.477234 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:48.477192 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-g4kxc" podStartSLOduration=5.431042764 podStartE2EDuration="23.477179099s" podCreationTimestamp="2026-06-03 03:20:25 +0000 UTC" firstStartedPulling="2026-06-03 03:20:27.917025842 +0000 UTC m=+3.088935695" lastFinishedPulling="2026-06-03 03:20:45.963162168 +0000 UTC m=+21.135072030" observedRunningTime="2026-06-03 03:20:48.477160163 +0000 UTC m=+23.649070034" watchObservedRunningTime="2026-06-03 03:20:48.477179099 +0000 UTC m=+23.649088972" Jun 03 03:20:49.471429 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:49.471234 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/ovn-acl-logging/0.log" Jun 03 03:20:49.471928 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:49.471831 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" event={"ID":"d70d6dc6-b06b-4651-88d9-d08322361734","Type":"ContainerStarted","Data":"d5cf910d30a0c37c80929d6dea58f334d068a056d96889f5a06f8c71bdb2fcad"} Jun 03 03:20:49.473778 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:49.473752 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" event={"ID":"31f50417-f5ba-4dc1-b5e8-8445d17652ed","Type":"ContainerStarted","Data":"35e665460c87b3164d3cd96f7bb5c7fe9a5c82bd5d1a8894a4132651c89ed8fa"} Jun 03 03:20:49.490223 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:49.490181 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wp9fx" podStartSLOduration=3.598219952 podStartE2EDuration="24.490167905s" podCreationTimestamp="2026-06-03 03:20:25 +0000 UTC" firstStartedPulling="2026-06-03 03:20:27.918727006 +0000 UTC m=+3.090636870" lastFinishedPulling="2026-06-03 03:20:48.810674969 +0000 UTC m=+23.982584823" observedRunningTime="2026-06-03 03:20:49.490098842 +0000 UTC m=+24.662008714" watchObservedRunningTime="2026-06-03 03:20:49.490167905 +0000 UTC m=+24.662077776" Jun 03 03:20:50.366354 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:50.366318 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:50.366554 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:50.366318 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:50.366554 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:50.366454 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqszd" podUID="3de6cab3-243e-4cc5-91c5-458eec3e5180" Jun 03 03:20:50.366554 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:50.366510 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rp75f" podUID="55469fc3-4142-42c5-8420-af3316559074" Jun 03 03:20:50.428485 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:50.428452 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7rz6d" Jun 03 03:20:50.429124 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:50.429099 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7rz6d" Jun 03 03:20:52.365714 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:52.365534 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:52.366515 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:52.365534 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:52.366515 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:52.365777 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqszd" podUID="3de6cab3-243e-4cc5-91c5-458eec3e5180" Jun 03 03:20:52.366515 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:52.365878 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rp75f" podUID="55469fc3-4142-42c5-8420-af3316559074" Jun 03 03:20:52.481282 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:52.481250 2558 generic.go:358] "Generic (PLEG): container finished" podID="b49ee6d0-1785-4901-9e01-29a2b91214cd" containerID="32a2fac33dc0d4632752817623486a431a2adb8e93832b25a1d17421881ca9df" exitCode=0 Jun 03 03:20:52.481459 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:52.481339 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pdxhs" event={"ID":"b49ee6d0-1785-4901-9e01-29a2b91214cd","Type":"ContainerDied","Data":"32a2fac33dc0d4632752817623486a431a2adb8e93832b25a1d17421881ca9df"} Jun 03 03:20:52.484301 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:52.484282 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/ovn-acl-logging/0.log" Jun 03 03:20:52.484663 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:52.484638 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" event={"ID":"d70d6dc6-b06b-4651-88d9-d08322361734","Type":"ContainerStarted","Data":"f2ae3a83187acf817526ca34071773b48073285803dde636ddd1d470f17be325"} Jun 03 03:20:52.484937 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:52.484917 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:52.485031 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:52.484946 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:52.485031 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:52.484959 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:52.485145 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:52.485074 2558 scope.go:117] "RemoveContainer" containerID="73873ac2f1ab2685327511eec99ee62b4ce0f3733aac4bdbb0e2e340981189c2" Jun 03 03:20:52.500885 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:52.500866 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:52.501029 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:52.501015 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:20:53.489545 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:53.489474 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/ovn-acl-logging/0.log" Jun 03 03:20:53.489899 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:53.489786 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" event={"ID":"d70d6dc6-b06b-4651-88d9-d08322361734","Type":"ContainerStarted","Data":"64b891ac4df5b8cd8d1cc5bed6496e7db06ff994ed63fa403cb45e29c903383f"} Jun 03 03:20:53.491446 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:53.491420 2558 generic.go:358] "Generic (PLEG): container finished" podID="b49ee6d0-1785-4901-9e01-29a2b91214cd" containerID="7e9a7575411c43bc87ed4b2e4ae1cb9aed6a87ec137838c0176500df62b21ad2" exitCode=0 Jun 03 03:20:53.491570 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:53.491459 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pdxhs" event={"ID":"b49ee6d0-1785-4901-9e01-29a2b91214cd","Type":"ContainerDied","Data":"7e9a7575411c43bc87ed4b2e4ae1cb9aed6a87ec137838c0176500df62b21ad2"} Jun 03 03:20:53.513740 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:53.513552 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" podStartSLOduration=10.293958926 podStartE2EDuration="28.513541705s" podCreationTimestamp="2026-06-03 03:20:25 +0000 UTC" firstStartedPulling="2026-06-03 03:20:27.910821666 +0000 UTC m=+3.082731528" lastFinishedPulling="2026-06-03 03:20:46.130404438 +0000 UTC m=+21.302314307" observedRunningTime="2026-06-03 03:20:53.512156018 +0000 UTC m=+28.684065889" watchObservedRunningTime="2026-06-03 03:20:53.513541705 +0000 UTC m=+28.685451575" Jun 03 03:20:53.536723 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:53.536686 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gqszd"] Jun 03 03:20:53.536907 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:53.536888 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:53.537051 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:53.537009 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqszd" podUID="3de6cab3-243e-4cc5-91c5-458eec3e5180" Jun 03 03:20:53.537272 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:53.537248 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rp75f"] Jun 03 03:20:53.537389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:53.537374 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:53.537487 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:53.537468 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rp75f" podUID="55469fc3-4142-42c5-8420-af3316559074" Jun 03 03:20:53.969890 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:53.969849 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7rz6d" Jun 03 03:20:53.970061 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:53.970047 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 03:20:53.970653 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:53.970631 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7rz6d" Jun 03 03:20:54.495144 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:54.495100 2558 generic.go:358] "Generic (PLEG): container finished" podID="b49ee6d0-1785-4901-9e01-29a2b91214cd" containerID="8d7081148a53eb7163e161d8288a5a841b6e5703adad334bc4fa05127baf1741" exitCode=0 Jun 03 03:20:54.495837 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:54.495799 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pdxhs" event={"ID":"b49ee6d0-1785-4901-9e01-29a2b91214cd","Type":"ContainerDied","Data":"8d7081148a53eb7163e161d8288a5a841b6e5703adad334bc4fa05127baf1741"} Jun 03 03:20:55.366452 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:55.366369 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:55.366604 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:55.366520 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqszd" podUID="3de6cab3-243e-4cc5-91c5-458eec3e5180" Jun 03 03:20:55.366654 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:55.366624 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:55.366757 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:55.366738 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rp75f" podUID="55469fc3-4142-42c5-8420-af3316559074" Jun 03 03:20:57.365517 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:57.365484 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:57.366306 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:57.365622 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rp75f" podUID="55469fc3-4142-42c5-8420-af3316559074" Jun 03 03:20:57.366306 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:57.365728 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:57.366306 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:57.365825 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqszd" podUID="3de6cab3-243e-4cc5-91c5-458eec3e5180" Jun 03 03:20:59.024707 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.024667 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs\") pod \"network-metrics-daemon-rp75f\" (UID: \"55469fc3-4142-42c5-8420-af3316559074\") " pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:59.025265 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:59.024800 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:59.025265 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:59.024867 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs podName:55469fc3-4142-42c5-8420-af3316559074 nodeName:}" failed. No retries permitted until 2026-06-03 03:21:31.024850403 +0000 UTC m=+66.196760258 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs") pod "network-metrics-daemon-rp75f" (UID: "55469fc3-4142-42c5-8420-af3316559074") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:59.125922 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.125877 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4mbfr\" (UniqueName: \"kubernetes.io/projected/3de6cab3-243e-4cc5-91c5-458eec3e5180-kube-api-access-4mbfr\") pod \"network-check-target-gqszd\" (UID: \"3de6cab3-243e-4cc5-91c5-458eec3e5180\") " pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:59.126113 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:59.126079 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 03:20:59.126113 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:59.126106 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 03:20:59.126230 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:59.126122 2558 projected.go:194] Error preparing data for projected volume kube-api-access-4mbfr for pod openshift-network-diagnostics/network-check-target-gqszd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:59.126230 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:59.126185 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3de6cab3-243e-4cc5-91c5-458eec3e5180-kube-api-access-4mbfr podName:3de6cab3-243e-4cc5-91c5-458eec3e5180 nodeName:}" failed. No retries permitted until 2026-06-03 03:21:31.126166649 +0000 UTC m=+66.298076503 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4mbfr" (UniqueName: "kubernetes.io/projected/3de6cab3-243e-4cc5-91c5-458eec3e5180-kube-api-access-4mbfr") pod "network-check-target-gqszd" (UID: "3de6cab3-243e-4cc5-91c5-458eec3e5180") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:59.157767 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.157739 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeReady" Jun 03 03:20:59.157905 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.157858 2558 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 03:20:59.196487 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.196447 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-v2qx2"] Jun 03 03:20:59.228604 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.228576 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qzwsf"] Jun 03 03:20:59.228786 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.228751 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v2qx2" Jun 03 03:20:59.231044 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.231017 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 03:20:59.231044 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.231033 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kzhg4\"" Jun 03 03:20:59.231354 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.231324 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 03:20:59.244606 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.244530 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v2qx2"] Jun 03 03:20:59.244710 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.244639 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qzwsf"] Jun 03 03:20:59.244710 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.244656 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qzwsf" Jun 03 03:20:59.246816 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.246797 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7jxzs\"" Jun 03 03:20:59.246903 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.246830 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 03:20:59.246903 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.246830 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 03:20:59.247106 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.246796 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 03:20:59.327110 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.327025 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgn6p\" (UniqueName: \"kubernetes.io/projected/a2546001-186b-47fb-a1e3-059132eabef5-kube-api-access-tgn6p\") pod \"dns-default-v2qx2\" (UID: \"a2546001-186b-47fb-a1e3-059132eabef5\") " pod="openshift-dns/dns-default-v2qx2" Jun 03 03:20:59.327110 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.327070 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2546001-186b-47fb-a1e3-059132eabef5-tmp-dir\") pod \"dns-default-v2qx2\" (UID: \"a2546001-186b-47fb-a1e3-059132eabef5\") " pod="openshift-dns/dns-default-v2qx2" Jun 03 03:20:59.327328 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.327124 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2546001-186b-47fb-a1e3-059132eabef5-config-volume\") pod \"dns-default-v2qx2\" (UID: \"a2546001-186b-47fb-a1e3-059132eabef5\") " pod="openshift-dns/dns-default-v2qx2" Jun 03 03:20:59.327328 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.327152 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96gwb\" (UniqueName: \"kubernetes.io/projected/07bbf7cb-60c5-4184-a023-5a4bef630b32-kube-api-access-96gwb\") pod \"ingress-canary-qzwsf\" (UID: \"07bbf7cb-60c5-4184-a023-5a4bef630b32\") " pod="openshift-ingress-canary/ingress-canary-qzwsf" Jun 03 03:20:59.327328 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.327275 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert\") pod \"ingress-canary-qzwsf\" (UID: \"07bbf7cb-60c5-4184-a023-5a4bef630b32\") " pod="openshift-ingress-canary/ingress-canary-qzwsf" Jun 03 03:20:59.327489 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.327332 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls\") pod \"dns-default-v2qx2\" (UID: \"a2546001-186b-47fb-a1e3-059132eabef5\") " pod="openshift-dns/dns-default-v2qx2" Jun 03 03:20:59.366466 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.366429 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:20:59.366630 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.366480 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:20:59.369575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.369378 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 03:20:59.369575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.369402 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 03:20:59.369575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.369438 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qcjrn\"" Jun 03 03:20:59.369827 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.369738 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bwf2t\"" Jun 03 03:20:59.369827 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.369777 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 03:20:59.428389 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.428350 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls\") pod \"dns-default-v2qx2\" (UID: \"a2546001-186b-47fb-a1e3-059132eabef5\") " pod="openshift-dns/dns-default-v2qx2" Jun 03 03:20:59.428532 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.428429 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tgn6p\" (UniqueName: \"kubernetes.io/projected/a2546001-186b-47fb-a1e3-059132eabef5-kube-api-access-tgn6p\") pod \"dns-default-v2qx2\" (UID: \"a2546001-186b-47fb-a1e3-059132eabef5\") " pod="openshift-dns/dns-default-v2qx2" Jun 03 03:20:59.428532 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.428457 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2546001-186b-47fb-a1e3-059132eabef5-tmp-dir\") pod \"dns-default-v2qx2\" (UID: \"a2546001-186b-47fb-a1e3-059132eabef5\") " pod="openshift-dns/dns-default-v2qx2" Jun 03 03:20:59.428532 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.428478 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2546001-186b-47fb-a1e3-059132eabef5-config-volume\") pod \"dns-default-v2qx2\" (UID: \"a2546001-186b-47fb-a1e3-059132eabef5\") " pod="openshift-dns/dns-default-v2qx2" Jun 03 03:20:59.428676 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:59.428517 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 03:20:59.431591 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.428853 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-96gwb\" (UniqueName: \"kubernetes.io/projected/07bbf7cb-60c5-4184-a023-5a4bef630b32-kube-api-access-96gwb\") pod \"ingress-canary-qzwsf\" (UID: \"07bbf7cb-60c5-4184-a023-5a4bef630b32\") " pod="openshift-ingress-canary/ingress-canary-qzwsf" Jun 03 03:20:59.431591 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:59.428917 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls podName:a2546001-186b-47fb-a1e3-059132eabef5 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:59.928891802 +0000 UTC m=+35.100801700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls") pod "dns-default-v2qx2" (UID: "a2546001-186b-47fb-a1e3-059132eabef5") : secret "dns-default-metrics-tls" not found Jun 03 03:20:59.431591 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.428961 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert\") pod \"ingress-canary-qzwsf\" (UID: \"07bbf7cb-60c5-4184-a023-5a4bef630b32\") " pod="openshift-ingress-canary/ingress-canary-qzwsf" Jun 03 03:20:59.431591 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:59.429111 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 03:20:59.431591 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:59.429272 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert podName:07bbf7cb-60c5-4184-a023-5a4bef630b32 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:59.929257664 +0000 UTC m=+35.101167514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert") pod "ingress-canary-qzwsf" (UID: "07bbf7cb-60c5-4184-a023-5a4bef630b32") : secret "canary-serving-cert" not found Jun 03 03:20:59.431591 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.429275 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2546001-186b-47fb-a1e3-059132eabef5-tmp-dir\") pod \"dns-default-v2qx2\" (UID: \"a2546001-186b-47fb-a1e3-059132eabef5\") " pod="openshift-dns/dns-default-v2qx2" Jun 03 03:20:59.431591 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.429664 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2546001-186b-47fb-a1e3-059132eabef5-config-volume\") pod \"dns-default-v2qx2\" (UID: \"a2546001-186b-47fb-a1e3-059132eabef5\") " pod="openshift-dns/dns-default-v2qx2" Jun 03 03:20:59.438696 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.438671 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgn6p\" (UniqueName: \"kubernetes.io/projected/a2546001-186b-47fb-a1e3-059132eabef5-kube-api-access-tgn6p\") pod \"dns-default-v2qx2\" (UID: \"a2546001-186b-47fb-a1e3-059132eabef5\") " pod="openshift-dns/dns-default-v2qx2" Jun 03 03:20:59.438810 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.438758 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96gwb\" (UniqueName: \"kubernetes.io/projected/07bbf7cb-60c5-4184-a023-5a4bef630b32-kube-api-access-96gwb\") pod \"ingress-canary-qzwsf\" (UID: \"07bbf7cb-60c5-4184-a023-5a4bef630b32\") " pod="openshift-ingress-canary/ingress-canary-qzwsf" Jun 03 03:20:59.933270 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.933230 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert\") pod \"ingress-canary-qzwsf\" (UID: \"07bbf7cb-60c5-4184-a023-5a4bef630b32\") " pod="openshift-ingress-canary/ingress-canary-qzwsf" Jun 03 03:20:59.933456 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:20:59.933285 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls\") pod \"dns-default-v2qx2\" (UID: \"a2546001-186b-47fb-a1e3-059132eabef5\") " pod="openshift-dns/dns-default-v2qx2" Jun 03 03:20:59.933456 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:59.933403 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 03:20:59.933548 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:59.933484 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert podName:07bbf7cb-60c5-4184-a023-5a4bef630b32 nodeName:}" failed. No retries permitted until 2026-06-03 03:21:00.933462794 +0000 UTC m=+36.105372659 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert") pod "ingress-canary-qzwsf" (UID: "07bbf7cb-60c5-4184-a023-5a4bef630b32") : secret "canary-serving-cert" not found Jun 03 03:20:59.933548 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:59.933408 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 03:20:59.933616 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:20:59.933576 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls podName:a2546001-186b-47fb-a1e3-059132eabef5 nodeName:}" failed. No retries permitted until 2026-06-03 03:21:00.933561632 +0000 UTC m=+36.105471500 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls") pod "dns-default-v2qx2" (UID: "a2546001-186b-47fb-a1e3-059132eabef5") : secret "dns-default-metrics-tls" not found Jun 03 03:21:00.941511 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:00.941476 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert\") pod \"ingress-canary-qzwsf\" (UID: \"07bbf7cb-60c5-4184-a023-5a4bef630b32\") " pod="openshift-ingress-canary/ingress-canary-qzwsf" Jun 03 03:21:00.941511 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:00.941516 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls\") pod \"dns-default-v2qx2\" (UID: \"a2546001-186b-47fb-a1e3-059132eabef5\") " pod="openshift-dns/dns-default-v2qx2" Jun 03 03:21:00.941912 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:21:00.941619 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 03:21:00.941912 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:21:00.941623 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 03:21:00.941912 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:21:00.941670 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls podName:a2546001-186b-47fb-a1e3-059132eabef5 nodeName:}" failed. No retries permitted until 2026-06-03 03:21:02.941657049 +0000 UTC m=+38.113566898 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls") pod "dns-default-v2qx2" (UID: "a2546001-186b-47fb-a1e3-059132eabef5") : secret "dns-default-metrics-tls" not found Jun 03 03:21:00.941912 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:21:00.941684 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert podName:07bbf7cb-60c5-4184-a023-5a4bef630b32 nodeName:}" failed. No retries permitted until 2026-06-03 03:21:02.94167715 +0000 UTC m=+38.113586999 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert") pod "ingress-canary-qzwsf" (UID: "07bbf7cb-60c5-4184-a023-5a4bef630b32") : secret "canary-serving-cert" not found Jun 03 03:21:01.509429 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:01.509392 2558 generic.go:358] "Generic (PLEG): container finished" podID="b49ee6d0-1785-4901-9e01-29a2b91214cd" containerID="c3cdd7b6bc1044c9bcd9468a3ea4d49d17307c7d631d143f7fb3195d5401b9bb" exitCode=0 Jun 03 03:21:01.509595 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:01.509441 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pdxhs" event={"ID":"b49ee6d0-1785-4901-9e01-29a2b91214cd","Type":"ContainerDied","Data":"c3cdd7b6bc1044c9bcd9468a3ea4d49d17307c7d631d143f7fb3195d5401b9bb"} Jun 03 03:21:02.513649 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:02.513616 2558 generic.go:358] "Generic (PLEG): container finished" podID="b49ee6d0-1785-4901-9e01-29a2b91214cd" containerID="aa9ca710e09a63ba1438d28ca5daf3ae0d5aac6c20af7604dd578f37591c42f7" exitCode=0 Jun 03 03:21:02.514088 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:02.513683 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pdxhs" event={"ID":"b49ee6d0-1785-4901-9e01-29a2b91214cd","Type":"ContainerDied","Data":"aa9ca710e09a63ba1438d28ca5daf3ae0d5aac6c20af7604dd578f37591c42f7"} Jun 03 03:21:02.955256 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:02.955151 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert\") pod \"ingress-canary-qzwsf\" (UID: \"07bbf7cb-60c5-4184-a023-5a4bef630b32\") " pod="openshift-ingress-canary/ingress-canary-qzwsf" Jun 03 03:21:02.955256 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:02.955215 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls\") pod \"dns-default-v2qx2\" (UID: \"a2546001-186b-47fb-a1e3-059132eabef5\") " pod="openshift-dns/dns-default-v2qx2" Jun 03 03:21:02.955511 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:21:02.955317 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 03:21:02.955511 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:21:02.955392 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert podName:07bbf7cb-60c5-4184-a023-5a4bef630b32 nodeName:}" failed. No retries permitted until 2026-06-03 03:21:06.95537502 +0000 UTC m=+42.127284869 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert") pod "ingress-canary-qzwsf" (UID: "07bbf7cb-60c5-4184-a023-5a4bef630b32") : secret "canary-serving-cert" not found Jun 03 03:21:02.955511 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:21:02.955325 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 03:21:02.955511 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:21:02.955477 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls podName:a2546001-186b-47fb-a1e3-059132eabef5 nodeName:}" failed. No retries permitted until 2026-06-03 03:21:06.955458722 +0000 UTC m=+42.127368583 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls") pod "dns-default-v2qx2" (UID: "a2546001-186b-47fb-a1e3-059132eabef5") : secret "dns-default-metrics-tls" not found Jun 03 03:21:03.521629 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:03.521591 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pdxhs" event={"ID":"b49ee6d0-1785-4901-9e01-29a2b91214cd","Type":"ContainerStarted","Data":"f14069e8d7fe276100dc562515a86c44de671f1e7ef21b68e1b6de44e1955990"} Jun 03 03:21:03.542235 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:03.542185 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pdxhs" podStartSLOduration=5.981277978 podStartE2EDuration="38.542170144s" podCreationTimestamp="2026-06-03 03:20:25 +0000 UTC" firstStartedPulling="2026-06-03 03:20:27.920236407 +0000 UTC m=+3.092146256" lastFinishedPulling="2026-06-03 03:21:00.48112857 +0000 UTC m=+35.653038422" observedRunningTime="2026-06-03 03:21:03.541654457 +0000 UTC m=+38.713564340" watchObservedRunningTime="2026-06-03 03:21:03.542170144 +0000 UTC m=+38.714080015" Jun 03 03:21:06.984420 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:06.984378 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert\") pod \"ingress-canary-qzwsf\" (UID: \"07bbf7cb-60c5-4184-a023-5a4bef630b32\") " pod="openshift-ingress-canary/ingress-canary-qzwsf" Jun 03 03:21:06.984420 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:06.984421 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls\") pod \"dns-default-v2qx2\" (UID: \"a2546001-186b-47fb-a1e3-059132eabef5\") " pod="openshift-dns/dns-default-v2qx2" Jun 03 03:21:06.984870 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:21:06.984532 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 03:21:06.984870 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:21:06.984532 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 03:21:06.984870 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:21:06.984585 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls podName:a2546001-186b-47fb-a1e3-059132eabef5 nodeName:}" failed. No retries permitted until 2026-06-03 03:21:14.984571108 +0000 UTC m=+50.156480974 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls") pod "dns-default-v2qx2" (UID: "a2546001-186b-47fb-a1e3-059132eabef5") : secret "dns-default-metrics-tls" not found Jun 03 03:21:06.984870 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:21:06.984599 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert podName:07bbf7cb-60c5-4184-a023-5a4bef630b32 nodeName:}" failed. No retries permitted until 2026-06-03 03:21:14.984593102 +0000 UTC m=+50.156502951 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert") pod "ingress-canary-qzwsf" (UID: "07bbf7cb-60c5-4184-a023-5a4bef630b32") : secret "canary-serving-cert" not found Jun 03 03:21:15.038894 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:15.038861 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert\") pod \"ingress-canary-qzwsf\" (UID: \"07bbf7cb-60c5-4184-a023-5a4bef630b32\") " pod="openshift-ingress-canary/ingress-canary-qzwsf" Jun 03 03:21:15.038894 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:15.038897 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls\") pod \"dns-default-v2qx2\" (UID: \"a2546001-186b-47fb-a1e3-059132eabef5\") " pod="openshift-dns/dns-default-v2qx2" Jun 03 03:21:15.039418 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:21:15.039031 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 03:21:15.039418 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:21:15.039050 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 03:21:15.039418 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:21:15.039084 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls podName:a2546001-186b-47fb-a1e3-059132eabef5 nodeName:}" failed. No retries permitted until 2026-06-03 03:21:31.039068532 +0000 UTC m=+66.210978382 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls") pod "dns-default-v2qx2" (UID: "a2546001-186b-47fb-a1e3-059132eabef5") : secret "dns-default-metrics-tls" not found Jun 03 03:21:15.039418 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:21:15.039115 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert podName:07bbf7cb-60c5-4184-a023-5a4bef630b32 nodeName:}" failed. No retries permitted until 2026-06-03 03:21:31.039100751 +0000 UTC m=+66.211010600 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert") pod "ingress-canary-qzwsf" (UID: "07bbf7cb-60c5-4184-a023-5a4bef630b32") : secret "canary-serving-cert" not found Jun 03 03:21:24.506086 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:24.506055 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4fv96" Jun 03 03:21:31.049901 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:31.049865 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert\") pod \"ingress-canary-qzwsf\" (UID: \"07bbf7cb-60c5-4184-a023-5a4bef630b32\") " pod="openshift-ingress-canary/ingress-canary-qzwsf" Jun 03 03:21:31.049901 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:31.049905 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls\") pod \"dns-default-v2qx2\" (UID: \"a2546001-186b-47fb-a1e3-059132eabef5\") " pod="openshift-dns/dns-default-v2qx2" Jun 03 03:21:31.050365 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:31.049947 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs\") pod \"network-metrics-daemon-rp75f\" (UID: \"55469fc3-4142-42c5-8420-af3316559074\") " pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:21:31.050365 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:21:31.050029 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 03:21:31.050365 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:21:31.050068 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 03:21:31.050365 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:21:31.050086 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert podName:07bbf7cb-60c5-4184-a023-5a4bef630b32 nodeName:}" failed. No retries permitted until 2026-06-03 03:22:03.050070606 +0000 UTC m=+98.221980476 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert") pod "ingress-canary-qzwsf" (UID: "07bbf7cb-60c5-4184-a023-5a4bef630b32") : secret "canary-serving-cert" not found Jun 03 03:21:31.050365 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:21:31.050127 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls podName:a2546001-186b-47fb-a1e3-059132eabef5 nodeName:}" failed. No retries permitted until 2026-06-03 03:22:03.050113656 +0000 UTC m=+98.222023506 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls") pod "dns-default-v2qx2" (UID: "a2546001-186b-47fb-a1e3-059132eabef5") : secret "dns-default-metrics-tls" not found Jun 03 03:21:31.052162 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:31.052147 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 03:21:31.060154 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:21:31.060137 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 03:21:31.060263 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:21:31.060176 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs podName:55469fc3-4142-42c5-8420-af3316559074 nodeName:}" failed. No retries permitted until 2026-06-03 03:22:35.060164736 +0000 UTC m=+130.232074590 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs") pod "network-metrics-daemon-rp75f" (UID: "55469fc3-4142-42c5-8420-af3316559074") : secret "metrics-daemon-secret" not found Jun 03 03:21:31.150581 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:31.150517 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4mbfr\" (UniqueName: \"kubernetes.io/projected/3de6cab3-243e-4cc5-91c5-458eec3e5180-kube-api-access-4mbfr\") pod \"network-check-target-gqszd\" (UID: \"3de6cab3-243e-4cc5-91c5-458eec3e5180\") " pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:21:31.152501 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:31.152486 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 03:21:31.163311 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:31.163292 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 03:21:31.175378 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:31.175358 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mbfr\" (UniqueName: \"kubernetes.io/projected/3de6cab3-243e-4cc5-91c5-458eec3e5180-kube-api-access-4mbfr\") pod \"network-check-target-gqszd\" (UID: \"3de6cab3-243e-4cc5-91c5-458eec3e5180\") " pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:21:31.185344 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:31.185326 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qcjrn\"" Jun 03 03:21:31.193868 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:31.193853 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:21:31.342890 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:31.342833 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gqszd"] Jun 03 03:21:31.345871 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:21:31.345843 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3de6cab3_243e_4cc5_91c5_458eec3e5180.slice/crio-cda1e6f3b5f0be9a95dc47e232ef8680b8a57bfb81b5fbed0bdb263713ed3caa WatchSource:0}: Error finding container cda1e6f3b5f0be9a95dc47e232ef8680b8a57bfb81b5fbed0bdb263713ed3caa: Status 404 returned error can't find the container with id cda1e6f3b5f0be9a95dc47e232ef8680b8a57bfb81b5fbed0bdb263713ed3caa Jun 03 03:21:31.573270 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:31.573236 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gqszd" event={"ID":"3de6cab3-243e-4cc5-91c5-458eec3e5180","Type":"ContainerStarted","Data":"cda1e6f3b5f0be9a95dc47e232ef8680b8a57bfb81b5fbed0bdb263713ed3caa"} Jun 03 03:21:36.584088 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:36.584057 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gqszd" event={"ID":"3de6cab3-243e-4cc5-91c5-458eec3e5180","Type":"ContainerStarted","Data":"ee54136e71cd3cd50bea33935d9c857eaf1473862822e063225af8daaff2e12d"} Jun 03 03:21:36.584464 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:36.584178 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:21:36.597551 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:21:36.597511 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gqszd" podStartSLOduration=67.136131886 podStartE2EDuration="1m11.597498882s" podCreationTimestamp="2026-06-03 03:20:25 +0000 UTC" firstStartedPulling="2026-06-03 03:21:31.347647865 +0000 UTC m=+66.519557728" lastFinishedPulling="2026-06-03 03:21:35.809014871 +0000 UTC m=+70.980924724" observedRunningTime="2026-06-03 03:21:36.596877654 +0000 UTC m=+71.768787526" watchObservedRunningTime="2026-06-03 03:21:36.597498882 +0000 UTC m=+71.769408753" Jun 03 03:22:03.070624 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:03.070578 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert\") pod \"ingress-canary-qzwsf\" (UID: \"07bbf7cb-60c5-4184-a023-5a4bef630b32\") " pod="openshift-ingress-canary/ingress-canary-qzwsf" Jun 03 03:22:03.070624 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:03.070629 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls\") pod \"dns-default-v2qx2\" (UID: \"a2546001-186b-47fb-a1e3-059132eabef5\") " pod="openshift-dns/dns-default-v2qx2" Jun 03 03:22:03.071231 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:22:03.070724 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 03:22:03.071231 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:22:03.070789 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 03:22:03.071231 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:22:03.070798 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert podName:07bbf7cb-60c5-4184-a023-5a4bef630b32 nodeName:}" failed. No retries permitted until 2026-06-03 03:23:07.070783147 +0000 UTC m=+162.242692996 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert") pod "ingress-canary-qzwsf" (UID: "07bbf7cb-60c5-4184-a023-5a4bef630b32") : secret "canary-serving-cert" not found Jun 03 03:22:03.071231 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:22:03.070850 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls podName:a2546001-186b-47fb-a1e3-059132eabef5 nodeName:}" failed. No retries permitted until 2026-06-03 03:23:07.070834063 +0000 UTC m=+162.242743914 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls") pod "dns-default-v2qx2" (UID: "a2546001-186b-47fb-a1e3-059132eabef5") : secret "dns-default-metrics-tls" not found Jun 03 03:22:07.588028 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:07.587981 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gqszd" Jun 03 03:22:35.069604 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:35.069549 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs\") pod \"network-metrics-daemon-rp75f\" (UID: \"55469fc3-4142-42c5-8420-af3316559074\") " pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:22:35.070162 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:22:35.069675 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 03:22:35.070162 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:22:35.069733 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs podName:55469fc3-4142-42c5-8420-af3316559074 nodeName:}" failed. No retries permitted until 2026-06-03 03:24:37.069717428 +0000 UTC m=+252.241627277 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs") pod "network-metrics-daemon-rp75f" (UID: "55469fc3-4142-42c5-8420-af3316559074") : secret "metrics-daemon-secret" not found Jun 03 03:22:37.907224 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:37.907194 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-g27np"] Jun 03 03:22:37.910009 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:37.909974 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-g27np" Jun 03 03:22:37.910513 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:37.910493 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-tq7jg"] Jun 03 03:22:37.912061 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:37.912042 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 03 03:22:37.912829 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:37.912812 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 03 03:22:37.912902 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:37.912872 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-dkt2q\"" Jun 03 03:22:37.913104 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:37.913089 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" Jun 03 03:22:37.914867 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:37.914852 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 03 03:22:37.915058 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:37.915037 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 03 03:22:37.915058 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:37.915042 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 03 03:22:37.915190 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:37.915072 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-d69tf\"" Jun 03 03:22:37.915624 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:37.915606 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 03 03:22:37.917662 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:37.917204 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-g27np"] Jun 03 03:22:37.920772 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:37.920752 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 03 03:22:37.923896 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:37.923876 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-tq7jg"] Jun 03 03:22:37.987622 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:37.987595 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f53d812-13d2-4aae-9673-a8b3c90386e9-serving-cert\") pod \"console-operator-86d7c6cc77-tq7jg\" (UID: \"3f53d812-13d2-4aae-9673-a8b3c90386e9\") " pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" Jun 03 03:22:37.987729 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:37.987625 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbkjs\" (UniqueName: \"kubernetes.io/projected/0175a2dd-1bca-4635-b4bd-bdaa20a4de6f-kube-api-access-hbkjs\") pod \"volume-data-source-validator-7598fd5bd-g27np\" (UID: \"0175a2dd-1bca-4635-b4bd-bdaa20a4de6f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-g27np" Jun 03 03:22:37.987729 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:37.987662 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvnjw\" (UniqueName: \"kubernetes.io/projected/3f53d812-13d2-4aae-9673-a8b3c90386e9-kube-api-access-hvnjw\") pod \"console-operator-86d7c6cc77-tq7jg\" (UID: \"3f53d812-13d2-4aae-9673-a8b3c90386e9\") " pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" Jun 03 03:22:37.987729 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:37.987702 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f53d812-13d2-4aae-9673-a8b3c90386e9-config\") pod \"console-operator-86d7c6cc77-tq7jg\" (UID: \"3f53d812-13d2-4aae-9673-a8b3c90386e9\") " pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" Jun 03 03:22:37.987841 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:37.987735 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f53d812-13d2-4aae-9673-a8b3c90386e9-trusted-ca\") pod \"console-operator-86d7c6cc77-tq7jg\" (UID: \"3f53d812-13d2-4aae-9673-a8b3c90386e9\") " pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" Jun 03 03:22:38.010070 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.010049 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-q2g2j"] Jun 03 03:22:38.012735 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.012718 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mg788"] Jun 03 03:22:38.012868 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.012854 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-q2g2j" Jun 03 03:22:38.014878 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.014864 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 03 03:22:38.015156 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.015137 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 03 03:22:38.015263 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.015216 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 03:22:38.015263 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.015218 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-746645b9b9-vw7dh"] Jun 03 03:22:38.015383 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.015328 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mg788" Jun 03 03:22:38.015692 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.015522 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 03:22:38.016017 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.015981 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-vq9fc\"" Jun 03 03:22:38.017713 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.017689 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mlprd\"" Jun 03 03:22:38.018093 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.018073 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 03 03:22:38.018377 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.018358 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 03 03:22:38.018443 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.018408 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 03 03:22:38.018813 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.018795 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 03 03:22:38.020837 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.020820 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:38.022829 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.022810 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 03 03:22:38.022969 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.022946 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 03:22:38.022969 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.022964 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 03 03:22:38.023131 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.023027 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-crcll\"" Jun 03 03:22:38.023131 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.023032 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 03 03:22:38.023376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.023359 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 03:22:38.023447 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.023434 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 03 03:22:38.023492 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.023435 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 03 03:22:38.027167 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.027150 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mg788"] Jun 03 03:22:38.028222 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.028122 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-746645b9b9-vw7dh"] Jun 03 03:22:38.029159 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.029136 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-q2g2j"] Jun 03 03:22:38.088888 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.088871 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a2d2c179-f717-45c3-8e52-94168d354ff9-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-mg788\" (UID: \"a2d2c179-f717-45c3-8e52-94168d354ff9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mg788" Jun 03 03:22:38.088983 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.088899 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hvnjw\" (UniqueName: \"kubernetes.io/projected/3f53d812-13d2-4aae-9673-a8b3c90386e9-kube-api-access-hvnjw\") pod \"console-operator-86d7c6cc77-tq7jg\" (UID: \"3f53d812-13d2-4aae-9673-a8b3c90386e9\") " pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" Jun 03 03:22:38.088983 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.088925 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c54da6ba-c2e2-40c7-92ad-cf73160ad5ee-snapshots\") pod \"insights-operator-788bf58df5-q2g2j\" (UID: \"c54da6ba-c2e2-40c7-92ad-cf73160ad5ee\") " pod="openshift-insights/insights-operator-788bf58df5-q2g2j" Jun 03 03:22:38.088983 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.088942 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/663f11c6-a48b-4193-8a3d-9feea74d8b0c-stats-auth\") pod \"router-default-746645b9b9-vw7dh\" (UID: \"663f11c6-a48b-4193-8a3d-9feea74d8b0c\") " pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:38.089104 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.089053 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f53d812-13d2-4aae-9673-a8b3c90386e9-config\") pod \"console-operator-86d7c6cc77-tq7jg\" (UID: \"3f53d812-13d2-4aae-9673-a8b3c90386e9\") " pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" Jun 03 03:22:38.089104 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.089073 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c54da6ba-c2e2-40c7-92ad-cf73160ad5ee-service-ca-bundle\") pod \"insights-operator-788bf58df5-q2g2j\" (UID: \"c54da6ba-c2e2-40c7-92ad-cf73160ad5ee\") " pod="openshift-insights/insights-operator-788bf58df5-q2g2j" Jun 03 03:22:38.089166 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.089117 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f53d812-13d2-4aae-9673-a8b3c90386e9-trusted-ca\") pod \"console-operator-86d7c6cc77-tq7jg\" (UID: \"3f53d812-13d2-4aae-9673-a8b3c90386e9\") " pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" Jun 03 03:22:38.089198 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.089162 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a2d2c179-f717-45c3-8e52-94168d354ff9-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-mg788\" (UID: \"a2d2c179-f717-45c3-8e52-94168d354ff9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mg788" Jun 03 03:22:38.089198 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.089183 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/663f11c6-a48b-4193-8a3d-9feea74d8b0c-metrics-certs\") pod \"router-default-746645b9b9-vw7dh\" (UID: \"663f11c6-a48b-4193-8a3d-9feea74d8b0c\") " pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:38.089274 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.089205 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkmgl\" (UniqueName: \"kubernetes.io/projected/a2d2c179-f717-45c3-8e52-94168d354ff9-kube-api-access-wkmgl\") pod \"kube-storage-version-migrator-operator-96ddc787c-mg788\" (UID: \"a2d2c179-f717-45c3-8e52-94168d354ff9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mg788" Jun 03 03:22:38.089274 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.089224 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c54da6ba-c2e2-40c7-92ad-cf73160ad5ee-serving-cert\") pod \"insights-operator-788bf58df5-q2g2j\" (UID: \"c54da6ba-c2e2-40c7-92ad-cf73160ad5ee\") " pod="openshift-insights/insights-operator-788bf58df5-q2g2j" Jun 03 03:22:38.089274 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.089254 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ktzb\" (UniqueName: \"kubernetes.io/projected/c54da6ba-c2e2-40c7-92ad-cf73160ad5ee-kube-api-access-7ktzb\") pod \"insights-operator-788bf58df5-q2g2j\" (UID: \"c54da6ba-c2e2-40c7-92ad-cf73160ad5ee\") " pod="openshift-insights/insights-operator-788bf58df5-q2g2j" Jun 03 03:22:38.089381 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.089358 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f53d812-13d2-4aae-9673-a8b3c90386e9-serving-cert\") pod \"console-operator-86d7c6cc77-tq7jg\" (UID: \"3f53d812-13d2-4aae-9673-a8b3c90386e9\") " pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" Jun 03 03:22:38.089381 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.089377 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hbkjs\" (UniqueName: \"kubernetes.io/projected/0175a2dd-1bca-4635-b4bd-bdaa20a4de6f-kube-api-access-hbkjs\") pod \"volume-data-source-validator-7598fd5bd-g27np\" (UID: \"0175a2dd-1bca-4635-b4bd-bdaa20a4de6f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-g27np" Jun 03 03:22:38.089470 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.089397 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/663f11c6-a48b-4193-8a3d-9feea74d8b0c-service-ca-bundle\") pod \"router-default-746645b9b9-vw7dh\" (UID: \"663f11c6-a48b-4193-8a3d-9feea74d8b0c\") " pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:38.089470 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.089419 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c54da6ba-c2e2-40c7-92ad-cf73160ad5ee-tmp\") pod \"insights-operator-788bf58df5-q2g2j\" (UID: \"c54da6ba-c2e2-40c7-92ad-cf73160ad5ee\") " pod="openshift-insights/insights-operator-788bf58df5-q2g2j" Jun 03 03:22:38.089470 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.089444 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c54da6ba-c2e2-40c7-92ad-cf73160ad5ee-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-q2g2j\" (UID: \"c54da6ba-c2e2-40c7-92ad-cf73160ad5ee\") " pod="openshift-insights/insights-operator-788bf58df5-q2g2j" Jun 03 03:22:38.089605 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.089478 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/663f11c6-a48b-4193-8a3d-9feea74d8b0c-default-certificate\") pod \"router-default-746645b9b9-vw7dh\" (UID: \"663f11c6-a48b-4193-8a3d-9feea74d8b0c\") " pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:38.089605 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.089501 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22pch\" (UniqueName: \"kubernetes.io/projected/663f11c6-a48b-4193-8a3d-9feea74d8b0c-kube-api-access-22pch\") pod \"router-default-746645b9b9-vw7dh\" (UID: \"663f11c6-a48b-4193-8a3d-9feea74d8b0c\") " pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:38.089687 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.089601 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f53d812-13d2-4aae-9673-a8b3c90386e9-config\") pod \"console-operator-86d7c6cc77-tq7jg\" (UID: \"3f53d812-13d2-4aae-9673-a8b3c90386e9\") " pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" Jun 03 03:22:38.089837 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.089812 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f53d812-13d2-4aae-9673-a8b3c90386e9-trusted-ca\") pod \"console-operator-86d7c6cc77-tq7jg\" (UID: \"3f53d812-13d2-4aae-9673-a8b3c90386e9\") " pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" Jun 03 03:22:38.091547 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.091531 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f53d812-13d2-4aae-9673-a8b3c90386e9-serving-cert\") pod \"console-operator-86d7c6cc77-tq7jg\" (UID: \"3f53d812-13d2-4aae-9673-a8b3c90386e9\") " pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" Jun 03 03:22:38.095830 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.095808 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvnjw\" (UniqueName: \"kubernetes.io/projected/3f53d812-13d2-4aae-9673-a8b3c90386e9-kube-api-access-hvnjw\") pod \"console-operator-86d7c6cc77-tq7jg\" (UID: \"3f53d812-13d2-4aae-9673-a8b3c90386e9\") " pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" Jun 03 03:22:38.096224 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.096208 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbkjs\" (UniqueName: \"kubernetes.io/projected/0175a2dd-1bca-4635-b4bd-bdaa20a4de6f-kube-api-access-hbkjs\") pod \"volume-data-source-validator-7598fd5bd-g27np\" (UID: \"0175a2dd-1bca-4635-b4bd-bdaa20a4de6f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-g27np" Jun 03 03:22:38.190207 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.190148 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c54da6ba-c2e2-40c7-92ad-cf73160ad5ee-snapshots\") pod \"insights-operator-788bf58df5-q2g2j\" (UID: \"c54da6ba-c2e2-40c7-92ad-cf73160ad5ee\") " pod="openshift-insights/insights-operator-788bf58df5-q2g2j" Jun 03 03:22:38.190207 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.190183 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/663f11c6-a48b-4193-8a3d-9feea74d8b0c-stats-auth\") pod \"router-default-746645b9b9-vw7dh\" (UID: \"663f11c6-a48b-4193-8a3d-9feea74d8b0c\") " pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:38.190207 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.190201 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c54da6ba-c2e2-40c7-92ad-cf73160ad5ee-service-ca-bundle\") pod \"insights-operator-788bf58df5-q2g2j\" (UID: \"c54da6ba-c2e2-40c7-92ad-cf73160ad5ee\") " pod="openshift-insights/insights-operator-788bf58df5-q2g2j" Jun 03 03:22:38.190394 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.190339 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a2d2c179-f717-45c3-8e52-94168d354ff9-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-mg788\" (UID: \"a2d2c179-f717-45c3-8e52-94168d354ff9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mg788" Jun 03 03:22:38.190394 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.190377 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/663f11c6-a48b-4193-8a3d-9feea74d8b0c-metrics-certs\") pod \"router-default-746645b9b9-vw7dh\" (UID: \"663f11c6-a48b-4193-8a3d-9feea74d8b0c\") " pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:38.190493 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.190413 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wkmgl\" (UniqueName: \"kubernetes.io/projected/a2d2c179-f717-45c3-8e52-94168d354ff9-kube-api-access-wkmgl\") pod \"kube-storage-version-migrator-operator-96ddc787c-mg788\" (UID: \"a2d2c179-f717-45c3-8e52-94168d354ff9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mg788" Jun 03 03:22:38.190493 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.190442 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c54da6ba-c2e2-40c7-92ad-cf73160ad5ee-serving-cert\") pod \"insights-operator-788bf58df5-q2g2j\" (UID: \"c54da6ba-c2e2-40c7-92ad-cf73160ad5ee\") " pod="openshift-insights/insights-operator-788bf58df5-q2g2j" Jun 03 03:22:38.190493 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.190468 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ktzb\" (UniqueName: \"kubernetes.io/projected/c54da6ba-c2e2-40c7-92ad-cf73160ad5ee-kube-api-access-7ktzb\") pod \"insights-operator-788bf58df5-q2g2j\" (UID: \"c54da6ba-c2e2-40c7-92ad-cf73160ad5ee\") " pod="openshift-insights/insights-operator-788bf58df5-q2g2j" Jun 03 03:22:38.190640 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.190526 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/663f11c6-a48b-4193-8a3d-9feea74d8b0c-service-ca-bundle\") pod \"router-default-746645b9b9-vw7dh\" (UID: \"663f11c6-a48b-4193-8a3d-9feea74d8b0c\") " pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:38.190640 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.190560 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c54da6ba-c2e2-40c7-92ad-cf73160ad5ee-tmp\") pod \"insights-operator-788bf58df5-q2g2j\" (UID: \"c54da6ba-c2e2-40c7-92ad-cf73160ad5ee\") " pod="openshift-insights/insights-operator-788bf58df5-q2g2j" Jun 03 03:22:38.190640 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:22:38.190568 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 03:22:38.190640 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.190588 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c54da6ba-c2e2-40c7-92ad-cf73160ad5ee-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-q2g2j\" (UID: \"c54da6ba-c2e2-40c7-92ad-cf73160ad5ee\") " pod="openshift-insights/insights-operator-788bf58df5-q2g2j" Jun 03 03:22:38.190640 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.190614 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/663f11c6-a48b-4193-8a3d-9feea74d8b0c-default-certificate\") pod \"router-default-746645b9b9-vw7dh\" (UID: \"663f11c6-a48b-4193-8a3d-9feea74d8b0c\") " pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:38.190640 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:22:38.190638 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/663f11c6-a48b-4193-8a3d-9feea74d8b0c-metrics-certs podName:663f11c6-a48b-4193-8a3d-9feea74d8b0c nodeName:}" failed. No retries permitted until 2026-06-03 03:22:38.69061923 +0000 UTC m=+133.862529102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/663f11c6-a48b-4193-8a3d-9feea74d8b0c-metrics-certs") pod "router-default-746645b9b9-vw7dh" (UID: "663f11c6-a48b-4193-8a3d-9feea74d8b0c") : secret "router-metrics-certs-default" not found Jun 03 03:22:38.190945 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.190685 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-22pch\" (UniqueName: \"kubernetes.io/projected/663f11c6-a48b-4193-8a3d-9feea74d8b0c-kube-api-access-22pch\") pod \"router-default-746645b9b9-vw7dh\" (UID: \"663f11c6-a48b-4193-8a3d-9feea74d8b0c\") " pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:38.190945 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.190718 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c54da6ba-c2e2-40c7-92ad-cf73160ad5ee-service-ca-bundle\") pod \"insights-operator-788bf58df5-q2g2j\" (UID: \"c54da6ba-c2e2-40c7-92ad-cf73160ad5ee\") " pod="openshift-insights/insights-operator-788bf58df5-q2g2j" Jun 03 03:22:38.190945 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.190728 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a2d2c179-f717-45c3-8e52-94168d354ff9-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-mg788\" (UID: \"a2d2c179-f717-45c3-8e52-94168d354ff9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mg788" Jun 03 03:22:38.190945 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.190745 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c54da6ba-c2e2-40c7-92ad-cf73160ad5ee-snapshots\") pod \"insights-operator-788bf58df5-q2g2j\" (UID: \"c54da6ba-c2e2-40c7-92ad-cf73160ad5ee\") " pod="openshift-insights/insights-operator-788bf58df5-q2g2j" Jun 03 03:22:38.190945 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:22:38.190771 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/663f11c6-a48b-4193-8a3d-9feea74d8b0c-service-ca-bundle podName:663f11c6-a48b-4193-8a3d-9feea74d8b0c nodeName:}" failed. No retries permitted until 2026-06-03 03:22:38.690752388 +0000 UTC m=+133.862662240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/663f11c6-a48b-4193-8a3d-9feea74d8b0c-service-ca-bundle") pod "router-default-746645b9b9-vw7dh" (UID: "663f11c6-a48b-4193-8a3d-9feea74d8b0c") : configmap references non-existent config key: service-ca.crt Jun 03 03:22:38.190945 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.190891 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a2d2c179-f717-45c3-8e52-94168d354ff9-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-mg788\" (UID: \"a2d2c179-f717-45c3-8e52-94168d354ff9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mg788" Jun 03 03:22:38.191289 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.191026 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c54da6ba-c2e2-40c7-92ad-cf73160ad5ee-tmp\") pod \"insights-operator-788bf58df5-q2g2j\" (UID: \"c54da6ba-c2e2-40c7-92ad-cf73160ad5ee\") " pod="openshift-insights/insights-operator-788bf58df5-q2g2j" Jun 03 03:22:38.191728 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.191701 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c54da6ba-c2e2-40c7-92ad-cf73160ad5ee-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-q2g2j\" (UID: \"c54da6ba-c2e2-40c7-92ad-cf73160ad5ee\") " pod="openshift-insights/insights-operator-788bf58df5-q2g2j" Jun 03 03:22:38.192577 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.192552 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c54da6ba-c2e2-40c7-92ad-cf73160ad5ee-serving-cert\") pod \"insights-operator-788bf58df5-q2g2j\" (UID: \"c54da6ba-c2e2-40c7-92ad-cf73160ad5ee\") " pod="openshift-insights/insights-operator-788bf58df5-q2g2j" Jun 03 03:22:38.192808 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.192790 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a2d2c179-f717-45c3-8e52-94168d354ff9-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-mg788\" (UID: \"a2d2c179-f717-45c3-8e52-94168d354ff9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mg788" Jun 03 03:22:38.192904 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.192885 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/663f11c6-a48b-4193-8a3d-9feea74d8b0c-default-certificate\") pod \"router-default-746645b9b9-vw7dh\" (UID: \"663f11c6-a48b-4193-8a3d-9feea74d8b0c\") " pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:38.193194 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.193179 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/663f11c6-a48b-4193-8a3d-9feea74d8b0c-stats-auth\") pod \"router-default-746645b9b9-vw7dh\" (UID: \"663f11c6-a48b-4193-8a3d-9feea74d8b0c\") " pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:38.198445 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.198422 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkmgl\" (UniqueName: \"kubernetes.io/projected/a2d2c179-f717-45c3-8e52-94168d354ff9-kube-api-access-wkmgl\") pod \"kube-storage-version-migrator-operator-96ddc787c-mg788\" (UID: \"a2d2c179-f717-45c3-8e52-94168d354ff9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mg788" Jun 03 03:22:38.198893 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.198872 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22pch\" (UniqueName: \"kubernetes.io/projected/663f11c6-a48b-4193-8a3d-9feea74d8b0c-kube-api-access-22pch\") pod \"router-default-746645b9b9-vw7dh\" (UID: \"663f11c6-a48b-4193-8a3d-9feea74d8b0c\") " pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:38.198936 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.198920 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ktzb\" (UniqueName: \"kubernetes.io/projected/c54da6ba-c2e2-40c7-92ad-cf73160ad5ee-kube-api-access-7ktzb\") pod \"insights-operator-788bf58df5-q2g2j\" (UID: \"c54da6ba-c2e2-40c7-92ad-cf73160ad5ee\") " pod="openshift-insights/insights-operator-788bf58df5-q2g2j" Jun 03 03:22:38.220654 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.220634 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-g27np" Jun 03 03:22:38.226244 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.226221 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" Jun 03 03:22:38.325408 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.325378 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-q2g2j" Jun 03 03:22:38.332449 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.332424 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mg788" Jun 03 03:22:38.342421 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.342400 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-g27np"] Jun 03 03:22:38.346874 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:22:38.346848 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0175a2dd_1bca_4635_b4bd_bdaa20a4de6f.slice/crio-dd07f8cd2b5378495d734abb16eec3bedc24910769161c38bd8d028dd9b69db8 WatchSource:0}: Error finding container dd07f8cd2b5378495d734abb16eec3bedc24910769161c38bd8d028dd9b69db8: Status 404 returned error can't find the container with id dd07f8cd2b5378495d734abb16eec3bedc24910769161c38bd8d028dd9b69db8 Jun 03 03:22:38.361570 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.361536 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-tq7jg"] Jun 03 03:22:38.367632 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:22:38.367598 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f53d812_13d2_4aae_9673_a8b3c90386e9.slice/crio-80ce6a2931c9faab4d046ddc33241be347a8e905ffade4e4a7f18b8d36fdd276 WatchSource:0}: Error finding container 80ce6a2931c9faab4d046ddc33241be347a8e905ffade4e4a7f18b8d36fdd276: Status 404 returned error can't find the container with id 80ce6a2931c9faab4d046ddc33241be347a8e905ffade4e4a7f18b8d36fdd276 Jun 03 03:22:38.454089 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.454022 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-q2g2j"] Jun 03 03:22:38.457951 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:22:38.457926 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc54da6ba_c2e2_40c7_92ad_cf73160ad5ee.slice/crio-e40597fc4b4b198221fb9add560c37c8743c7aa8d5f565cb63db39e14147bf12 WatchSource:0}: Error finding container e40597fc4b4b198221fb9add560c37c8743c7aa8d5f565cb63db39e14147bf12: Status 404 returned error can't find the container with id e40597fc4b4b198221fb9add560c37c8743c7aa8d5f565cb63db39e14147bf12 Jun 03 03:22:38.468250 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.468229 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mg788"] Jun 03 03:22:38.471289 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:22:38.471265 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2d2c179_f717_45c3_8e52_94168d354ff9.slice/crio-ac779a7421b27a8c364809339fdf27037f146949418a0952295de9b8e0727073 WatchSource:0}: Error finding container ac779a7421b27a8c364809339fdf27037f146949418a0952295de9b8e0727073: Status 404 returned error can't find the container with id ac779a7421b27a8c364809339fdf27037f146949418a0952295de9b8e0727073 Jun 03 03:22:38.694818 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.694787 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/663f11c6-a48b-4193-8a3d-9feea74d8b0c-metrics-certs\") pod \"router-default-746645b9b9-vw7dh\" (UID: \"663f11c6-a48b-4193-8a3d-9feea74d8b0c\") " pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:38.694949 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.694837 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/663f11c6-a48b-4193-8a3d-9feea74d8b0c-service-ca-bundle\") pod \"router-default-746645b9b9-vw7dh\" (UID: \"663f11c6-a48b-4193-8a3d-9feea74d8b0c\") " pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:38.694949 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:22:38.694933 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 03:22:38.695046 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:22:38.695017 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/663f11c6-a48b-4193-8a3d-9feea74d8b0c-service-ca-bundle podName:663f11c6-a48b-4193-8a3d-9feea74d8b0c nodeName:}" failed. No retries permitted until 2026-06-03 03:22:39.69494801 +0000 UTC m=+134.866857873 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/663f11c6-a48b-4193-8a3d-9feea74d8b0c-service-ca-bundle") pod "router-default-746645b9b9-vw7dh" (UID: "663f11c6-a48b-4193-8a3d-9feea74d8b0c") : configmap references non-existent config key: service-ca.crt Jun 03 03:22:38.695092 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:22:38.695060 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/663f11c6-a48b-4193-8a3d-9feea74d8b0c-metrics-certs podName:663f11c6-a48b-4193-8a3d-9feea74d8b0c nodeName:}" failed. No retries permitted until 2026-06-03 03:22:39.695047918 +0000 UTC m=+134.866957767 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/663f11c6-a48b-4193-8a3d-9feea74d8b0c-metrics-certs") pod "router-default-746645b9b9-vw7dh" (UID: "663f11c6-a48b-4193-8a3d-9feea74d8b0c") : secret "router-metrics-certs-default" not found Jun 03 03:22:38.697830 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.697807 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" event={"ID":"3f53d812-13d2-4aae-9673-a8b3c90386e9","Type":"ContainerStarted","Data":"80ce6a2931c9faab4d046ddc33241be347a8e905ffade4e4a7f18b8d36fdd276"} Jun 03 03:22:38.698682 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.698652 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-g27np" event={"ID":"0175a2dd-1bca-4635-b4bd-bdaa20a4de6f","Type":"ContainerStarted","Data":"dd07f8cd2b5378495d734abb16eec3bedc24910769161c38bd8d028dd9b69db8"} Jun 03 03:22:38.699683 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.699658 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mg788" event={"ID":"a2d2c179-f717-45c3-8e52-94168d354ff9","Type":"ContainerStarted","Data":"ac779a7421b27a8c364809339fdf27037f146949418a0952295de9b8e0727073"} Jun 03 03:22:38.700583 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:38.700564 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-q2g2j" event={"ID":"c54da6ba-c2e2-40c7-92ad-cf73160ad5ee","Type":"ContainerStarted","Data":"e40597fc4b4b198221fb9add560c37c8743c7aa8d5f565cb63db39e14147bf12"} Jun 03 03:22:39.702693 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:39.702606 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/663f11c6-a48b-4193-8a3d-9feea74d8b0c-metrics-certs\") pod \"router-default-746645b9b9-vw7dh\" (UID: \"663f11c6-a48b-4193-8a3d-9feea74d8b0c\") " pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:39.708063 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:39.703580 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/663f11c6-a48b-4193-8a3d-9feea74d8b0c-service-ca-bundle\") pod \"router-default-746645b9b9-vw7dh\" (UID: \"663f11c6-a48b-4193-8a3d-9feea74d8b0c\") " pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:39.708063 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:22:39.707671 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 03:22:39.708063 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:22:39.707756 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/663f11c6-a48b-4193-8a3d-9feea74d8b0c-metrics-certs podName:663f11c6-a48b-4193-8a3d-9feea74d8b0c nodeName:}" failed. No retries permitted until 2026-06-03 03:22:41.707735344 +0000 UTC m=+136.879645207 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/663f11c6-a48b-4193-8a3d-9feea74d8b0c-metrics-certs") pod "router-default-746645b9b9-vw7dh" (UID: "663f11c6-a48b-4193-8a3d-9feea74d8b0c") : secret "router-metrics-certs-default" not found Jun 03 03:22:39.712828 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:22:39.708426 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/663f11c6-a48b-4193-8a3d-9feea74d8b0c-service-ca-bundle podName:663f11c6-a48b-4193-8a3d-9feea74d8b0c nodeName:}" failed. No retries permitted until 2026-06-03 03:22:41.708401184 +0000 UTC m=+136.880311047 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/663f11c6-a48b-4193-8a3d-9feea74d8b0c-service-ca-bundle") pod "router-default-746645b9b9-vw7dh" (UID: "663f11c6-a48b-4193-8a3d-9feea74d8b0c") : configmap references non-existent config key: service-ca.crt Jun 03 03:22:40.710750 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:40.710717 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-g27np" event={"ID":"0175a2dd-1bca-4635-b4bd-bdaa20a4de6f","Type":"ContainerStarted","Data":"efcbee0d9bcdc8f7f7e7961f7f33bc6e9ddf2619f5cd492e4a8c59bf615f49e8"} Jun 03 03:22:40.725191 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:40.724734 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-g27np" podStartSLOduration=2.013677896 podStartE2EDuration="3.724717289s" podCreationTimestamp="2026-06-03 03:22:37 +0000 UTC" firstStartedPulling="2026-06-03 03:22:38.34916102 +0000 UTC m=+133.521070871" lastFinishedPulling="2026-06-03 03:22:40.060200408 +0000 UTC m=+135.232110264" observedRunningTime="2026-06-03 03:22:40.72432125 +0000 UTC m=+135.896231123" watchObservedRunningTime="2026-06-03 03:22:40.724717289 +0000 UTC m=+135.896627160" Jun 03 03:22:41.721795 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:41.721771 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/663f11c6-a48b-4193-8a3d-9feea74d8b0c-metrics-certs\") pod \"router-default-746645b9b9-vw7dh\" (UID: \"663f11c6-a48b-4193-8a3d-9feea74d8b0c\") " pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:41.722077 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:41.721817 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/663f11c6-a48b-4193-8a3d-9feea74d8b0c-service-ca-bundle\") pod \"router-default-746645b9b9-vw7dh\" (UID: \"663f11c6-a48b-4193-8a3d-9feea74d8b0c\") " pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:41.722077 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:22:41.721918 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 03:22:41.722077 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:22:41.721942 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/663f11c6-a48b-4193-8a3d-9feea74d8b0c-service-ca-bundle podName:663f11c6-a48b-4193-8a3d-9feea74d8b0c nodeName:}" failed. No retries permitted until 2026-06-03 03:22:45.721929245 +0000 UTC m=+140.893839094 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/663f11c6-a48b-4193-8a3d-9feea74d8b0c-service-ca-bundle") pod "router-default-746645b9b9-vw7dh" (UID: "663f11c6-a48b-4193-8a3d-9feea74d8b0c") : configmap references non-existent config key: service-ca.crt Jun 03 03:22:41.722077 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:22:41.721967 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/663f11c6-a48b-4193-8a3d-9feea74d8b0c-metrics-certs podName:663f11c6-a48b-4193-8a3d-9feea74d8b0c nodeName:}" failed. No retries permitted until 2026-06-03 03:22:45.721954237 +0000 UTC m=+140.893864086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/663f11c6-a48b-4193-8a3d-9feea74d8b0c-metrics-certs") pod "router-default-746645b9b9-vw7dh" (UID: "663f11c6-a48b-4193-8a3d-9feea74d8b0c") : secret "router-metrics-certs-default" not found Jun 03 03:22:42.717520 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:42.717483 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mg788" event={"ID":"a2d2c179-f717-45c3-8e52-94168d354ff9","Type":"ContainerStarted","Data":"9f6a674991f2057c76718569b1304d88259bf40c05bc90821b5c308a73cd7675"} Jun 03 03:22:42.719151 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:42.719057 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-q2g2j" event={"ID":"c54da6ba-c2e2-40c7-92ad-cf73160ad5ee","Type":"ContainerStarted","Data":"9537ee3774913723c4a62bce879175e1fde5163ca3b046dc7ad0bd851fa30c1a"} Jun 03 03:22:42.720664 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:42.720646 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-tq7jg_3f53d812-13d2-4aae-9673-a8b3c90386e9/console-operator/0.log" Jun 03 03:22:42.720789 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:42.720679 2558 generic.go:358] "Generic (PLEG): container finished" podID="3f53d812-13d2-4aae-9673-a8b3c90386e9" containerID="0d6adc344b26172f8e56158c0e6a7db21cf0b63e5e42ba731337da6b0e10510c" exitCode=255 Jun 03 03:22:42.720789 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:42.720723 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" event={"ID":"3f53d812-13d2-4aae-9673-a8b3c90386e9","Type":"ContainerDied","Data":"0d6adc344b26172f8e56158c0e6a7db21cf0b63e5e42ba731337da6b0e10510c"} Jun 03 03:22:42.720903 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:42.720888 2558 scope.go:117] "RemoveContainer" containerID="0d6adc344b26172f8e56158c0e6a7db21cf0b63e5e42ba731337da6b0e10510c" Jun 03 03:22:42.731619 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:42.731576 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mg788" podStartSLOduration=2.511374036 podStartE2EDuration="5.731562288s" podCreationTimestamp="2026-06-03 03:22:37 +0000 UTC" firstStartedPulling="2026-06-03 03:22:38.472939503 +0000 UTC m=+133.644849351" lastFinishedPulling="2026-06-03 03:22:41.693127755 +0000 UTC m=+136.865037603" observedRunningTime="2026-06-03 03:22:42.730886503 +0000 UTC m=+137.902796376" watchObservedRunningTime="2026-06-03 03:22:42.731562288 +0000 UTC m=+137.903472158" Jun 03 03:22:42.745259 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:42.745214 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-q2g2j" podStartSLOduration=2.509646068 podStartE2EDuration="5.74519824s" podCreationTimestamp="2026-06-03 03:22:37 +0000 UTC" firstStartedPulling="2026-06-03 03:22:38.459910428 +0000 UTC m=+133.631820277" lastFinishedPulling="2026-06-03 03:22:41.695462594 +0000 UTC m=+136.867372449" observedRunningTime="2026-06-03 03:22:42.744291775 +0000 UTC m=+137.916201647" watchObservedRunningTime="2026-06-03 03:22:42.74519824 +0000 UTC m=+137.917108316" Jun 03 03:22:43.101006 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:43.100959 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-zgrzg"] Jun 03 03:22:43.103658 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:43.103634 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-zgrzg" Jun 03 03:22:43.105584 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:43.105565 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 03 03:22:43.105762 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:43.105744 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 03 03:22:43.105850 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:43.105816 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-nwl4j\"" Jun 03 03:22:43.111186 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:43.111146 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-zgrzg"] Jun 03 03:22:43.234775 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:43.234753 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7ng8\" (UniqueName: \"kubernetes.io/projected/34261552-be96-4a42-828e-f5ed06ccafe5-kube-api-access-t7ng8\") pod \"migrator-96c6f749-zgrzg\" (UID: \"34261552-be96-4a42-828e-f5ed06ccafe5\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-zgrzg" Jun 03 03:22:43.335234 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:43.335193 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7ng8\" (UniqueName: \"kubernetes.io/projected/34261552-be96-4a42-828e-f5ed06ccafe5-kube-api-access-t7ng8\") pod \"migrator-96c6f749-zgrzg\" (UID: \"34261552-be96-4a42-828e-f5ed06ccafe5\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-zgrzg" Jun 03 03:22:43.342350 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:43.342325 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7ng8\" (UniqueName: \"kubernetes.io/projected/34261552-be96-4a42-828e-f5ed06ccafe5-kube-api-access-t7ng8\") pod \"migrator-96c6f749-zgrzg\" (UID: \"34261552-be96-4a42-828e-f5ed06ccafe5\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-zgrzg" Jun 03 03:22:43.412328 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:43.412278 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-zgrzg" Jun 03 03:22:43.525180 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:43.525099 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-zgrzg"] Jun 03 03:22:43.528260 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:22:43.528235 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34261552_be96_4a42_828e_f5ed06ccafe5.slice/crio-51306df743a1e2ea5dd231765b021a7c64a21b9c9b56534c7a749628bae60b76 WatchSource:0}: Error finding container 51306df743a1e2ea5dd231765b021a7c64a21b9c9b56534c7a749628bae60b76: Status 404 returned error can't find the container with id 51306df743a1e2ea5dd231765b021a7c64a21b9c9b56534c7a749628bae60b76 Jun 03 03:22:43.724453 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:43.724382 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-zgrzg" event={"ID":"34261552-be96-4a42-828e-f5ed06ccafe5","Type":"ContainerStarted","Data":"51306df743a1e2ea5dd231765b021a7c64a21b9c9b56534c7a749628bae60b76"} Jun 03 03:22:43.725584 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:43.725568 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-tq7jg_3f53d812-13d2-4aae-9673-a8b3c90386e9/console-operator/1.log" Jun 03 03:22:43.725932 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:43.725918 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-tq7jg_3f53d812-13d2-4aae-9673-a8b3c90386e9/console-operator/0.log" Jun 03 03:22:43.726006 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:43.725953 2558 generic.go:358] "Generic (PLEG): container finished" podID="3f53d812-13d2-4aae-9673-a8b3c90386e9" containerID="9f56fa92c17b1765399fafdacd163dd9e0b2d9b4f2b8d24c83ebd7e761e593ef" exitCode=255 Jun 03 03:22:43.726055 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:43.726034 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" event={"ID":"3f53d812-13d2-4aae-9673-a8b3c90386e9","Type":"ContainerDied","Data":"9f56fa92c17b1765399fafdacd163dd9e0b2d9b4f2b8d24c83ebd7e761e593ef"} Jun 03 03:22:43.726095 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:43.726077 2558 scope.go:117] "RemoveContainer" containerID="0d6adc344b26172f8e56158c0e6a7db21cf0b63e5e42ba731337da6b0e10510c" Jun 03 03:22:43.726278 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:43.726265 2558 scope.go:117] "RemoveContainer" containerID="9f56fa92c17b1765399fafdacd163dd9e0b2d9b4f2b8d24c83ebd7e761e593ef" Jun 03 03:22:43.726460 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:22:43.726441 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-tq7jg_openshift-console-operator(3f53d812-13d2-4aae-9673-a8b3c90386e9)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" podUID="3f53d812-13d2-4aae-9673-a8b3c90386e9" Jun 03 03:22:44.732259 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:44.732229 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-zgrzg" event={"ID":"34261552-be96-4a42-828e-f5ed06ccafe5","Type":"ContainerStarted","Data":"38c05f5a7a51dea10c97a95c7f17578a86c6130b80220090484b14f080a62db8"} Jun 03 03:22:44.732573 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:44.732264 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-zgrzg" event={"ID":"34261552-be96-4a42-828e-f5ed06ccafe5","Type":"ContainerStarted","Data":"a6cda29594172705e0f77e337096be500b9f7a53a06c92b243841fe26f23c6de"} Jun 03 03:22:44.733480 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:44.733464 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-tq7jg_3f53d812-13d2-4aae-9673-a8b3c90386e9/console-operator/1.log" Jun 03 03:22:44.733752 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:44.733737 2558 scope.go:117] "RemoveContainer" containerID="9f56fa92c17b1765399fafdacd163dd9e0b2d9b4f2b8d24c83ebd7e761e593ef" Jun 03 03:22:44.733920 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:22:44.733902 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-tq7jg_openshift-console-operator(3f53d812-13d2-4aae-9673-a8b3c90386e9)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" podUID="3f53d812-13d2-4aae-9673-a8b3c90386e9" Jun 03 03:22:44.747795 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:44.747755 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-zgrzg" podStartSLOduration=0.692278867 podStartE2EDuration="1.747745251s" podCreationTimestamp="2026-06-03 03:22:43 +0000 UTC" firstStartedPulling="2026-06-03 03:22:43.530067688 +0000 UTC m=+138.701977536" lastFinishedPulling="2026-06-03 03:22:44.585534068 +0000 UTC m=+139.757443920" observedRunningTime="2026-06-03 03:22:44.746873154 +0000 UTC m=+139.918783019" watchObservedRunningTime="2026-06-03 03:22:44.747745251 +0000 UTC m=+139.919655155" Jun 03 03:22:44.983212 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:44.983146 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nbf8p_ea8e1018-9d63-4b7a-b241-4b9f6d563906/dns-node-resolver/0.log" Jun 03 03:22:45.753613 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:45.753578 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/663f11c6-a48b-4193-8a3d-9feea74d8b0c-metrics-certs\") pod \"router-default-746645b9b9-vw7dh\" (UID: \"663f11c6-a48b-4193-8a3d-9feea74d8b0c\") " pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:45.754031 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:45.753635 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/663f11c6-a48b-4193-8a3d-9feea74d8b0c-service-ca-bundle\") pod \"router-default-746645b9b9-vw7dh\" (UID: \"663f11c6-a48b-4193-8a3d-9feea74d8b0c\") " pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:45.754031 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:22:45.753678 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 03:22:45.754031 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:22:45.753745 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/663f11c6-a48b-4193-8a3d-9feea74d8b0c-metrics-certs podName:663f11c6-a48b-4193-8a3d-9feea74d8b0c nodeName:}" failed. No retries permitted until 2026-06-03 03:22:53.753727774 +0000 UTC m=+148.925637640 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/663f11c6-a48b-4193-8a3d-9feea74d8b0c-metrics-certs") pod "router-default-746645b9b9-vw7dh" (UID: "663f11c6-a48b-4193-8a3d-9feea74d8b0c") : secret "router-metrics-certs-default" not found Jun 03 03:22:45.754031 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:22:45.753759 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/663f11c6-a48b-4193-8a3d-9feea74d8b0c-service-ca-bundle podName:663f11c6-a48b-4193-8a3d-9feea74d8b0c nodeName:}" failed. No retries permitted until 2026-06-03 03:22:53.753753402 +0000 UTC m=+148.925663251 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/663f11c6-a48b-4193-8a3d-9feea74d8b0c-service-ca-bundle") pod "router-default-746645b9b9-vw7dh" (UID: "663f11c6-a48b-4193-8a3d-9feea74d8b0c") : configmap references non-existent config key: service-ca.crt Jun 03 03:22:45.983173 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:45.983145 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wrjnf_8af70d99-31a6-49ef-91bb-735be0eb8536/node-ca/0.log" Jun 03 03:22:48.226939 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:48.226908 2558 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" Jun 03 03:22:48.226939 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:48.226942 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" Jun 03 03:22:48.227359 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:48.227289 2558 scope.go:117] "RemoveContainer" containerID="9f56fa92c17b1765399fafdacd163dd9e0b2d9b4f2b8d24c83ebd7e761e593ef" Jun 03 03:22:48.227454 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:22:48.227436 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-tq7jg_openshift-console-operator(3f53d812-13d2-4aae-9673-a8b3c90386e9)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" podUID="3f53d812-13d2-4aae-9673-a8b3c90386e9" Jun 03 03:22:53.807315 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:53.807288 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/663f11c6-a48b-4193-8a3d-9feea74d8b0c-metrics-certs\") pod \"router-default-746645b9b9-vw7dh\" (UID: \"663f11c6-a48b-4193-8a3d-9feea74d8b0c\") " pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:53.807691 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:53.807334 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/663f11c6-a48b-4193-8a3d-9feea74d8b0c-service-ca-bundle\") pod \"router-default-746645b9b9-vw7dh\" (UID: \"663f11c6-a48b-4193-8a3d-9feea74d8b0c\") " pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:53.807980 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:53.807962 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/663f11c6-a48b-4193-8a3d-9feea74d8b0c-service-ca-bundle\") pod \"router-default-746645b9b9-vw7dh\" (UID: \"663f11c6-a48b-4193-8a3d-9feea74d8b0c\") " pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:53.809706 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:53.809684 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/663f11c6-a48b-4193-8a3d-9feea74d8b0c-metrics-certs\") pod \"router-default-746645b9b9-vw7dh\" (UID: \"663f11c6-a48b-4193-8a3d-9feea74d8b0c\") " pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:53.936750 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:53.936722 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:54.058565 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:54.058497 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-746645b9b9-vw7dh"] Jun 03 03:22:54.061428 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:22:54.061395 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod663f11c6_a48b_4193_8a3d_9feea74d8b0c.slice/crio-cf730044597634d9b78c55a3a228bfab98a033587674f04f36fded19b625f3e3 WatchSource:0}: Error finding container cf730044597634d9b78c55a3a228bfab98a033587674f04f36fded19b625f3e3: Status 404 returned error can't find the container with id cf730044597634d9b78c55a3a228bfab98a033587674f04f36fded19b625f3e3 Jun 03 03:22:54.761855 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:54.761820 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-746645b9b9-vw7dh" event={"ID":"663f11c6-a48b-4193-8a3d-9feea74d8b0c","Type":"ContainerStarted","Data":"cb30780016dd531104ab1be75b5e8b5ae4b3dd66a5b4c904c5c0ccb7d9ec98c3"} Jun 03 03:22:54.761855 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:54.761856 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-746645b9b9-vw7dh" event={"ID":"663f11c6-a48b-4193-8a3d-9feea74d8b0c","Type":"ContainerStarted","Data":"cf730044597634d9b78c55a3a228bfab98a033587674f04f36fded19b625f3e3"} Jun 03 03:22:54.777683 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:54.777645 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-746645b9b9-vw7dh" podStartSLOduration=17.777631796 podStartE2EDuration="17.777631796s" podCreationTimestamp="2026-06-03 03:22:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:22:54.776819867 +0000 UTC m=+149.948729741" watchObservedRunningTime="2026-06-03 03:22:54.777631796 +0000 UTC m=+149.949541667" Jun 03 03:22:54.937791 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:54.937766 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:54.940068 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:54.940050 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:55.764585 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:55.764554 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:22:55.765724 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:22:55.765703 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-746645b9b9-vw7dh" Jun 03 03:23:00.366716 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:00.366688 2558 scope.go:117] "RemoveContainer" containerID="9f56fa92c17b1765399fafdacd163dd9e0b2d9b4f2b8d24c83ebd7e761e593ef" Jun 03 03:23:00.778505 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:00.778478 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-tq7jg_3f53d812-13d2-4aae-9673-a8b3c90386e9/console-operator/1.log" Jun 03 03:23:00.778649 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:00.778533 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" event={"ID":"3f53d812-13d2-4aae-9673-a8b3c90386e9","Type":"ContainerStarted","Data":"355e835834969ac93194e98740e9fba028dec13af3d22236fa0a08fe5c84ee5d"} Jun 03 03:23:00.778869 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:00.778846 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" Jun 03 03:23:00.793169 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:00.793111 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" podStartSLOduration=20.465501113 podStartE2EDuration="23.793096769s" podCreationTimestamp="2026-06-03 03:22:37 +0000 UTC" firstStartedPulling="2026-06-03 03:22:38.370496209 +0000 UTC m=+133.542406063" lastFinishedPulling="2026-06-03 03:22:41.698091871 +0000 UTC m=+136.870001719" observedRunningTime="2026-06-03 03:23:00.792355897 +0000 UTC m=+155.964265768" watchObservedRunningTime="2026-06-03 03:23:00.793096769 +0000 UTC m=+155.965006641" Jun 03 03:23:00.977813 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:00.977795 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-tq7jg" Jun 03 03:23:02.240320 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:23:02.240277 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-v2qx2" podUID="a2546001-186b-47fb-a1e3-059132eabef5" Jun 03 03:23:02.254600 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:23:02.254564 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-qzwsf" podUID="07bbf7cb-60c5-4184-a023-5a4bef630b32" Jun 03 03:23:02.378281 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:23:02.378222 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rp75f" podUID="55469fc3-4142-42c5-8420-af3316559074" Jun 03 03:23:02.783424 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:02.783392 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v2qx2" Jun 03 03:23:02.783424 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:02.783392 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qzwsf" Jun 03 03:23:07.085416 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.085383 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-k2qsz"] Jun 03 03:23:07.088638 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.088623 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-k2qsz" Jun 03 03:23:07.094128 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.094103 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 03:23:07.094269 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.094243 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-q68s8\"" Jun 03 03:23:07.095046 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.095021 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 03:23:07.101863 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.101837 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert\") pod \"ingress-canary-qzwsf\" (UID: \"07bbf7cb-60c5-4184-a023-5a4bef630b32\") " pod="openshift-ingress-canary/ingress-canary-qzwsf" Jun 03 03:23:07.101985 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.101885 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls\") pod \"dns-default-v2qx2\" (UID: \"a2546001-186b-47fb-a1e3-059132eabef5\") " pod="openshift-dns/dns-default-v2qx2" Jun 03 03:23:07.104356 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.104335 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2546001-186b-47fb-a1e3-059132eabef5-metrics-tls\") pod \"dns-default-v2qx2\" (UID: \"a2546001-186b-47fb-a1e3-059132eabef5\") " pod="openshift-dns/dns-default-v2qx2" Jun 03 03:23:07.104435 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.104364 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07bbf7cb-60c5-4184-a023-5a4bef630b32-cert\") pod \"ingress-canary-qzwsf\" (UID: \"07bbf7cb-60c5-4184-a023-5a4bef630b32\") " pod="openshift-ingress-canary/ingress-canary-qzwsf" Jun 03 03:23:07.107178 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.107158 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-k2qsz"] Jun 03 03:23:07.115378 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.115356 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-496p5"] Jun 03 03:23:07.118326 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.118313 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-496p5" Jun 03 03:23:07.120667 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.120643 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-vfk7w\"" Jun 03 03:23:07.120773 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.120757 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 03 03:23:07.125490 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.125455 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rqfr8"] Jun 03 03:23:07.128649 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.128627 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rqfr8" Jun 03 03:23:07.132482 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.132461 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 03:23:07.134858 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.134821 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 03:23:07.134979 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.134828 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mwlqd\"" Jun 03 03:23:07.136645 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.136624 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-496p5"] Jun 03 03:23:07.154919 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.154897 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rqfr8"] Jun 03 03:23:07.180784 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.180762 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d5cd555fc-hsjb5"] Jun 03 03:23:07.183522 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.183508 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.185559 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.185532 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 03:23:07.185660 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.185573 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 03:23:07.185660 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.185644 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-96wwc\"" Jun 03 03:23:07.185791 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.185669 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 03:23:07.189829 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.189811 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 03:23:07.194242 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.194225 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d5cd555fc-hsjb5"] Jun 03 03:23:07.202771 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.202753 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbcfj\" (UniqueName: \"kubernetes.io/projected/11ee73ec-0499-4f10-8e48-62e7280059e6-kube-api-access-rbcfj\") pod \"downloads-c65b8dc4b-k2qsz\" (UID: \"11ee73ec-0499-4f10-8e48-62e7280059e6\") " pod="openshift-console/downloads-c65b8dc4b-k2qsz" Jun 03 03:23:07.286286 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.286267 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kzhg4\"" Jun 03 03:23:07.286439 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.286428 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7jxzs\"" Jun 03 03:23:07.295184 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.295171 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v2qx2" Jun 03 03:23:07.295269 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.295254 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qzwsf" Jun 03 03:23:07.303308 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.303284 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6a6e7d5-d65b-47fc-9ecc-48acf9195f73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rqfr8\" (UID: \"c6a6e7d5-d65b-47fc-9ecc-48acf9195f73\") " pod="openshift-insights/insights-runtime-extractor-rqfr8" Jun 03 03:23:07.303412 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.303316 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6fe97911-57a8-4e31-ade8-c2ff46c7319f-registry-certificates\") pod \"image-registry-5d5cd555fc-hsjb5\" (UID: \"6fe97911-57a8-4e31-ade8-c2ff46c7319f\") " pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.303412 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.303338 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0ba294b4-6b4a-461e-a770-34568283b965-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-496p5\" (UID: \"0ba294b4-6b4a-461e-a770-34568283b965\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-496p5" Jun 03 03:23:07.303412 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.303371 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6a6e7d5-d65b-47fc-9ecc-48acf9195f73-data-volume\") pod \"insights-runtime-extractor-rqfr8\" (UID: \"c6a6e7d5-d65b-47fc-9ecc-48acf9195f73\") " pod="openshift-insights/insights-runtime-extractor-rqfr8" Jun 03 03:23:07.303629 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.303414 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4pzp\" (UniqueName: \"kubernetes.io/projected/6fe97911-57a8-4e31-ade8-c2ff46c7319f-kube-api-access-t4pzp\") pod \"image-registry-5d5cd555fc-hsjb5\" (UID: \"6fe97911-57a8-4e31-ade8-c2ff46c7319f\") " pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.303629 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.303478 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rbcfj\" (UniqueName: \"kubernetes.io/projected/11ee73ec-0499-4f10-8e48-62e7280059e6-kube-api-access-rbcfj\") pod \"downloads-c65b8dc4b-k2qsz\" (UID: \"11ee73ec-0499-4f10-8e48-62e7280059e6\") " pod="openshift-console/downloads-c65b8dc4b-k2qsz" Jun 03 03:23:07.303629 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.303517 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fe97911-57a8-4e31-ade8-c2ff46c7319f-registry-tls\") pod \"image-registry-5d5cd555fc-hsjb5\" (UID: \"6fe97911-57a8-4e31-ade8-c2ff46c7319f\") " pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.303629 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.303537 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6fe97911-57a8-4e31-ade8-c2ff46c7319f-bound-sa-token\") pod \"image-registry-5d5cd555fc-hsjb5\" (UID: \"6fe97911-57a8-4e31-ade8-c2ff46c7319f\") " pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.303629 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.303567 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6fe97911-57a8-4e31-ade8-c2ff46c7319f-ca-trust-extracted\") pod \"image-registry-5d5cd555fc-hsjb5\" (UID: \"6fe97911-57a8-4e31-ade8-c2ff46c7319f\") " pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.303908 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.303650 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6fe97911-57a8-4e31-ade8-c2ff46c7319f-image-registry-private-configuration\") pod \"image-registry-5d5cd555fc-hsjb5\" (UID: \"6fe97911-57a8-4e31-ade8-c2ff46c7319f\") " pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.303908 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.303675 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft8bg\" (UniqueName: \"kubernetes.io/projected/c6a6e7d5-d65b-47fc-9ecc-48acf9195f73-kube-api-access-ft8bg\") pod \"insights-runtime-extractor-rqfr8\" (UID: \"c6a6e7d5-d65b-47fc-9ecc-48acf9195f73\") " pod="openshift-insights/insights-runtime-extractor-rqfr8" Jun 03 03:23:07.303908 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.303699 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6a6e7d5-d65b-47fc-9ecc-48acf9195f73-crio-socket\") pod \"insights-runtime-extractor-rqfr8\" (UID: \"c6a6e7d5-d65b-47fc-9ecc-48acf9195f73\") " pod="openshift-insights/insights-runtime-extractor-rqfr8" Jun 03 03:23:07.303908 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.303719 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6fe97911-57a8-4e31-ade8-c2ff46c7319f-installation-pull-secrets\") pod \"image-registry-5d5cd555fc-hsjb5\" (UID: \"6fe97911-57a8-4e31-ade8-c2ff46c7319f\") " pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.303908 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.303761 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6a6e7d5-d65b-47fc-9ecc-48acf9195f73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rqfr8\" (UID: \"c6a6e7d5-d65b-47fc-9ecc-48acf9195f73\") " pod="openshift-insights/insights-runtime-extractor-rqfr8" Jun 03 03:23:07.303908 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.303782 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6fe97911-57a8-4e31-ade8-c2ff46c7319f-trusted-ca\") pod \"image-registry-5d5cd555fc-hsjb5\" (UID: \"6fe97911-57a8-4e31-ade8-c2ff46c7319f\") " pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.312312 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.312283 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbcfj\" (UniqueName: \"kubernetes.io/projected/11ee73ec-0499-4f10-8e48-62e7280059e6-kube-api-access-rbcfj\") pod \"downloads-c65b8dc4b-k2qsz\" (UID: \"11ee73ec-0499-4f10-8e48-62e7280059e6\") " pod="openshift-console/downloads-c65b8dc4b-k2qsz" Jun 03 03:23:07.397149 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.397124 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-k2qsz" Jun 03 03:23:07.404895 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.404803 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fe97911-57a8-4e31-ade8-c2ff46c7319f-registry-tls\") pod \"image-registry-5d5cd555fc-hsjb5\" (UID: \"6fe97911-57a8-4e31-ade8-c2ff46c7319f\") " pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.404895 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.404837 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6fe97911-57a8-4e31-ade8-c2ff46c7319f-bound-sa-token\") pod \"image-registry-5d5cd555fc-hsjb5\" (UID: \"6fe97911-57a8-4e31-ade8-c2ff46c7319f\") " pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.404895 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.404858 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6fe97911-57a8-4e31-ade8-c2ff46c7319f-ca-trust-extracted\") pod \"image-registry-5d5cd555fc-hsjb5\" (UID: \"6fe97911-57a8-4e31-ade8-c2ff46c7319f\") " pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.405233 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.404904 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6fe97911-57a8-4e31-ade8-c2ff46c7319f-image-registry-private-configuration\") pod \"image-registry-5d5cd555fc-hsjb5\" (UID: \"6fe97911-57a8-4e31-ade8-c2ff46c7319f\") " pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.405233 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.404932 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ft8bg\" (UniqueName: \"kubernetes.io/projected/c6a6e7d5-d65b-47fc-9ecc-48acf9195f73-kube-api-access-ft8bg\") pod \"insights-runtime-extractor-rqfr8\" (UID: \"c6a6e7d5-d65b-47fc-9ecc-48acf9195f73\") " pod="openshift-insights/insights-runtime-extractor-rqfr8" Jun 03 03:23:07.405233 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.404959 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6a6e7d5-d65b-47fc-9ecc-48acf9195f73-crio-socket\") pod \"insights-runtime-extractor-rqfr8\" (UID: \"c6a6e7d5-d65b-47fc-9ecc-48acf9195f73\") " pod="openshift-insights/insights-runtime-extractor-rqfr8" Jun 03 03:23:07.405233 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.404985 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6fe97911-57a8-4e31-ade8-c2ff46c7319f-installation-pull-secrets\") pod \"image-registry-5d5cd555fc-hsjb5\" (UID: \"6fe97911-57a8-4e31-ade8-c2ff46c7319f\") " pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.405233 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.405041 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6a6e7d5-d65b-47fc-9ecc-48acf9195f73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rqfr8\" (UID: \"c6a6e7d5-d65b-47fc-9ecc-48acf9195f73\") " pod="openshift-insights/insights-runtime-extractor-rqfr8" Jun 03 03:23:07.405233 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.405063 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6fe97911-57a8-4e31-ade8-c2ff46c7319f-trusted-ca\") pod \"image-registry-5d5cd555fc-hsjb5\" (UID: \"6fe97911-57a8-4e31-ade8-c2ff46c7319f\") " pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.405233 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.405094 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6a6e7d5-d65b-47fc-9ecc-48acf9195f73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rqfr8\" (UID: \"c6a6e7d5-d65b-47fc-9ecc-48acf9195f73\") " pod="openshift-insights/insights-runtime-extractor-rqfr8" Jun 03 03:23:07.405233 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.405123 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6fe97911-57a8-4e31-ade8-c2ff46c7319f-registry-certificates\") pod \"image-registry-5d5cd555fc-hsjb5\" (UID: \"6fe97911-57a8-4e31-ade8-c2ff46c7319f\") " pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.405233 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.405150 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0ba294b4-6b4a-461e-a770-34568283b965-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-496p5\" (UID: \"0ba294b4-6b4a-461e-a770-34568283b965\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-496p5" Jun 03 03:23:07.405233 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.405184 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6a6e7d5-d65b-47fc-9ecc-48acf9195f73-data-volume\") pod \"insights-runtime-extractor-rqfr8\" (UID: \"c6a6e7d5-d65b-47fc-9ecc-48acf9195f73\") " pod="openshift-insights/insights-runtime-extractor-rqfr8" Jun 03 03:23:07.405233 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.405213 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t4pzp\" (UniqueName: \"kubernetes.io/projected/6fe97911-57a8-4e31-ade8-c2ff46c7319f-kube-api-access-t4pzp\") pod \"image-registry-5d5cd555fc-hsjb5\" (UID: \"6fe97911-57a8-4e31-ade8-c2ff46c7319f\") " pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.406139 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.406050 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6a6e7d5-d65b-47fc-9ecc-48acf9195f73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rqfr8\" (UID: \"c6a6e7d5-d65b-47fc-9ecc-48acf9195f73\") " pod="openshift-insights/insights-runtime-extractor-rqfr8" Jun 03 03:23:07.408091 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.406610 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6fe97911-57a8-4e31-ade8-c2ff46c7319f-registry-certificates\") pod \"image-registry-5d5cd555fc-hsjb5\" (UID: \"6fe97911-57a8-4e31-ade8-c2ff46c7319f\") " pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.408091 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.407280 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6a6e7d5-d65b-47fc-9ecc-48acf9195f73-crio-socket\") pod \"insights-runtime-extractor-rqfr8\" (UID: \"c6a6e7d5-d65b-47fc-9ecc-48acf9195f73\") " pod="openshift-insights/insights-runtime-extractor-rqfr8" Jun 03 03:23:07.408091 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.408079 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6a6e7d5-d65b-47fc-9ecc-48acf9195f73-data-volume\") pod \"insights-runtime-extractor-rqfr8\" (UID: \"c6a6e7d5-d65b-47fc-9ecc-48acf9195f73\") " pod="openshift-insights/insights-runtime-extractor-rqfr8" Jun 03 03:23:07.408616 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.408572 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6fe97911-57a8-4e31-ade8-c2ff46c7319f-ca-trust-extracted\") pod \"image-registry-5d5cd555fc-hsjb5\" (UID: \"6fe97911-57a8-4e31-ade8-c2ff46c7319f\") " pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.409076 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.409030 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6fe97911-57a8-4e31-ade8-c2ff46c7319f-installation-pull-secrets\") pod \"image-registry-5d5cd555fc-hsjb5\" (UID: \"6fe97911-57a8-4e31-ade8-c2ff46c7319f\") " pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.409622 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.409238 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6fe97911-57a8-4e31-ade8-c2ff46c7319f-trusted-ca\") pod \"image-registry-5d5cd555fc-hsjb5\" (UID: \"6fe97911-57a8-4e31-ade8-c2ff46c7319f\") " pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.409622 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.409518 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fe97911-57a8-4e31-ade8-c2ff46c7319f-registry-tls\") pod \"image-registry-5d5cd555fc-hsjb5\" (UID: \"6fe97911-57a8-4e31-ade8-c2ff46c7319f\") " pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.409622 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.409579 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6fe97911-57a8-4e31-ade8-c2ff46c7319f-image-registry-private-configuration\") pod \"image-registry-5d5cd555fc-hsjb5\" (UID: \"6fe97911-57a8-4e31-ade8-c2ff46c7319f\") " pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.410435 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.410411 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6a6e7d5-d65b-47fc-9ecc-48acf9195f73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rqfr8\" (UID: \"c6a6e7d5-d65b-47fc-9ecc-48acf9195f73\") " pod="openshift-insights/insights-runtime-extractor-rqfr8" Jun 03 03:23:07.411388 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.411257 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0ba294b4-6b4a-461e-a770-34568283b965-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-496p5\" (UID: \"0ba294b4-6b4a-461e-a770-34568283b965\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-496p5" Jun 03 03:23:07.419355 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.419335 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6fe97911-57a8-4e31-ade8-c2ff46c7319f-bound-sa-token\") pod \"image-registry-5d5cd555fc-hsjb5\" (UID: \"6fe97911-57a8-4e31-ade8-c2ff46c7319f\") " pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.422895 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.422864 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft8bg\" (UniqueName: \"kubernetes.io/projected/c6a6e7d5-d65b-47fc-9ecc-48acf9195f73-kube-api-access-ft8bg\") pod \"insights-runtime-extractor-rqfr8\" (UID: \"c6a6e7d5-d65b-47fc-9ecc-48acf9195f73\") " pod="openshift-insights/insights-runtime-extractor-rqfr8" Jun 03 03:23:07.423131 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.423114 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4pzp\" (UniqueName: \"kubernetes.io/projected/6fe97911-57a8-4e31-ade8-c2ff46c7319f-kube-api-access-t4pzp\") pod \"image-registry-5d5cd555fc-hsjb5\" (UID: \"6fe97911-57a8-4e31-ade8-c2ff46c7319f\") " pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.427844 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.427824 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-496p5" Jun 03 03:23:07.432423 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.432398 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qzwsf"] Jun 03 03:23:07.436899 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:23:07.436876 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07bbf7cb_60c5_4184_a023_5a4bef630b32.slice/crio-b47040ed82f6956fd2c40375983b8ef95ba1a5ebdf26bf52a26f91229dc32a93 WatchSource:0}: Error finding container b47040ed82f6956fd2c40375983b8ef95ba1a5ebdf26bf52a26f91229dc32a93: Status 404 returned error can't find the container with id b47040ed82f6956fd2c40375983b8ef95ba1a5ebdf26bf52a26f91229dc32a93 Jun 03 03:23:07.438625 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.438608 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rqfr8" Jun 03 03:23:07.449881 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.449836 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v2qx2"] Jun 03 03:23:07.491800 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.491759 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.567053 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.565905 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-k2qsz"] Jun 03 03:23:07.571016 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:23:07.570932 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11ee73ec_0499_4f10_8e48_62e7280059e6.slice/crio-86fcc465ef9693df8ef9c979194adb068094bdd995bc179c7f60aed9a469aeb1 WatchSource:0}: Error finding container 86fcc465ef9693df8ef9c979194adb068094bdd995bc179c7f60aed9a469aeb1: Status 404 returned error can't find the container with id 86fcc465ef9693df8ef9c979194adb068094bdd995bc179c7f60aed9a469aeb1 Jun 03 03:23:07.595306 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.595230 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-496p5"] Jun 03 03:23:07.599981 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:23:07.599955 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba294b4_6b4a_461e_a770_34568283b965.slice/crio-00b1619403ef6873131a621b3d4ce1900864a116a649f8de85c7d38d736a02ba WatchSource:0}: Error finding container 00b1619403ef6873131a621b3d4ce1900864a116a649f8de85c7d38d736a02ba: Status 404 returned error can't find the container with id 00b1619403ef6873131a621b3d4ce1900864a116a649f8de85c7d38d736a02ba Jun 03 03:23:07.616587 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.616533 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rqfr8"] Jun 03 03:23:07.618912 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:23:07.618888 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6a6e7d5_d65b_47fc_9ecc_48acf9195f73.slice/crio-67c0535988f6add93df46da956056a7afb6c854b325f9b7d789af80afce79b8a WatchSource:0}: Error finding container 67c0535988f6add93df46da956056a7afb6c854b325f9b7d789af80afce79b8a: Status 404 returned error can't find the container with id 67c0535988f6add93df46da956056a7afb6c854b325f9b7d789af80afce79b8a Jun 03 03:23:07.646031 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.645915 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d5cd555fc-hsjb5"] Jun 03 03:23:07.648981 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:23:07.648957 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fe97911_57a8_4e31_ade8_c2ff46c7319f.slice/crio-e45e7b825017440d474b781588d0f1e20be924f8348295434f598929f22954c3 WatchSource:0}: Error finding container e45e7b825017440d474b781588d0f1e20be924f8348295434f598929f22954c3: Status 404 returned error can't find the container with id e45e7b825017440d474b781588d0f1e20be924f8348295434f598929f22954c3 Jun 03 03:23:07.798519 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.798488 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" event={"ID":"6fe97911-57a8-4e31-ade8-c2ff46c7319f","Type":"ContainerStarted","Data":"9a9b99f77c320ec8b6186a6832c5e1f957d3228a1eaef1ab6ac4f35f7070e87a"} Jun 03 03:23:07.798519 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.798524 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" event={"ID":"6fe97911-57a8-4e31-ade8-c2ff46c7319f","Type":"ContainerStarted","Data":"e45e7b825017440d474b781588d0f1e20be924f8348295434f598929f22954c3"} Jun 03 03:23:07.798696 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.798585 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:07.799795 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.799774 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rqfr8" event={"ID":"c6a6e7d5-d65b-47fc-9ecc-48acf9195f73","Type":"ContainerStarted","Data":"180438c9ad97b52f48224fc143cc6f10241a0e61b0c31fb6244b0058ac3cdc38"} Jun 03 03:23:07.799911 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.799798 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rqfr8" event={"ID":"c6a6e7d5-d65b-47fc-9ecc-48acf9195f73","Type":"ContainerStarted","Data":"67c0535988f6add93df46da956056a7afb6c854b325f9b7d789af80afce79b8a"} Jun 03 03:23:07.800816 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.800792 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-k2qsz" event={"ID":"11ee73ec-0499-4f10-8e48-62e7280059e6","Type":"ContainerStarted","Data":"86fcc465ef9693df8ef9c979194adb068094bdd995bc179c7f60aed9a469aeb1"} Jun 03 03:23:07.801861 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.801842 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v2qx2" event={"ID":"a2546001-186b-47fb-a1e3-059132eabef5","Type":"ContainerStarted","Data":"70be06ccf738b2cfb9e48d86cb6d4f59a99dc0769553260cfc7a3cacf05cc5d5"} Jun 03 03:23:07.802884 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.802866 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qzwsf" event={"ID":"07bbf7cb-60c5-4184-a023-5a4bef630b32","Type":"ContainerStarted","Data":"b47040ed82f6956fd2c40375983b8ef95ba1a5ebdf26bf52a26f91229dc32a93"} Jun 03 03:23:07.803869 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.803850 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-496p5" event={"ID":"0ba294b4-6b4a-461e-a770-34568283b965","Type":"ContainerStarted","Data":"00b1619403ef6873131a621b3d4ce1900864a116a649f8de85c7d38d736a02ba"} Jun 03 03:23:07.815781 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:07.815744 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" podStartSLOduration=0.81573309 podStartE2EDuration="815.73309ms" podCreationTimestamp="2026-06-03 03:23:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:23:07.814430491 +0000 UTC m=+162.986340362" watchObservedRunningTime="2026-06-03 03:23:07.81573309 +0000 UTC m=+162.987642957" Jun 03 03:23:08.808634 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:08.808592 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rqfr8" event={"ID":"c6a6e7d5-d65b-47fc-9ecc-48acf9195f73","Type":"ContainerStarted","Data":"9d0e6f65a7bb5c9678918fc669c4664c8f9e7f6a4e0355be6f5d8a66e586e8cd"} Jun 03 03:23:10.817885 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:10.817809 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-496p5" event={"ID":"0ba294b4-6b4a-461e-a770-34568283b965","Type":"ContainerStarted","Data":"f64313e8868fa24cb4aa1abe5082b6f8dcd9218aa91cd7c5a4fd0f786410d889"} Jun 03 03:23:10.818737 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:10.818707 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-496p5" Jun 03 03:23:10.823934 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:10.822574 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rqfr8" event={"ID":"c6a6e7d5-d65b-47fc-9ecc-48acf9195f73","Type":"ContainerStarted","Data":"5f3d9bfa6b53bdfc234fa7b0775a91057f06bb9369096d7403e34bd421eb7c17"} Jun 03 03:23:10.825034 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:10.825012 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v2qx2" event={"ID":"a2546001-186b-47fb-a1e3-059132eabef5","Type":"ContainerStarted","Data":"6b0507a4a01802e28ce30c70ee7727dfdb35323f137171abe64e2cbc3ddccffe"} Jun 03 03:23:10.825210 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:10.825041 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v2qx2" event={"ID":"a2546001-186b-47fb-a1e3-059132eabef5","Type":"ContainerStarted","Data":"a51d0cf519adb1c93abbb9ddf11c0e92d05b25d8f4c41ac2f08c7b281edba0b6"} Jun 03 03:23:10.825430 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:10.825399 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-v2qx2" Jun 03 03:23:10.825864 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:10.825761 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-496p5" Jun 03 03:23:10.827052 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:10.827022 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qzwsf" event={"ID":"07bbf7cb-60c5-4184-a023-5a4bef630b32","Type":"ContainerStarted","Data":"6cb1c7fc29c51849192528fd9edac5eaec6bf750a614b5e195625804de7a6388"} Jun 03 03:23:10.834698 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:10.834620 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-496p5" podStartSLOduration=0.877087402 podStartE2EDuration="3.834605263s" podCreationTimestamp="2026-06-03 03:23:07 +0000 UTC" firstStartedPulling="2026-06-03 03:23:07.602147951 +0000 UTC m=+162.774057804" lastFinishedPulling="2026-06-03 03:23:10.559665815 +0000 UTC m=+165.731575665" observedRunningTime="2026-06-03 03:23:10.833887132 +0000 UTC m=+166.005797004" watchObservedRunningTime="2026-06-03 03:23:10.834605263 +0000 UTC m=+166.006515135" Jun 03 03:23:10.850006 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:10.849943 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rqfr8" podStartSLOduration=0.90854768 podStartE2EDuration="3.849929011s" podCreationTimestamp="2026-06-03 03:23:07 +0000 UTC" firstStartedPulling="2026-06-03 03:23:07.67501068 +0000 UTC m=+162.846920542" lastFinishedPulling="2026-06-03 03:23:10.616392007 +0000 UTC m=+165.788301873" observedRunningTime="2026-06-03 03:23:10.849250595 +0000 UTC m=+166.021160466" watchObservedRunningTime="2026-06-03 03:23:10.849929011 +0000 UTC m=+166.021838886" Jun 03 03:23:10.885082 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:10.885034 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-v2qx2" podStartSLOduration=128.78653727 podStartE2EDuration="2m11.88502071s" podCreationTimestamp="2026-06-03 03:20:59 +0000 UTC" firstStartedPulling="2026-06-03 03:23:07.460785496 +0000 UTC m=+162.632695359" lastFinishedPulling="2026-06-03 03:23:10.559268938 +0000 UTC m=+165.731178799" observedRunningTime="2026-06-03 03:23:10.883630877 +0000 UTC m=+166.055540750" watchObservedRunningTime="2026-06-03 03:23:10.88502071 +0000 UTC m=+166.056930582" Jun 03 03:23:10.897040 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:10.896976 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qzwsf" podStartSLOduration=128.776508696 podStartE2EDuration="2m11.896959909s" podCreationTimestamp="2026-06-03 03:20:59 +0000 UTC" firstStartedPulling="2026-06-03 03:23:07.438731228 +0000 UTC m=+162.610641078" lastFinishedPulling="2026-06-03 03:23:10.559182438 +0000 UTC m=+165.731092291" observedRunningTime="2026-06-03 03:23:10.896100522 +0000 UTC m=+166.068010395" watchObservedRunningTime="2026-06-03 03:23:10.896959909 +0000 UTC m=+166.068869791" Jun 03 03:23:17.365735 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.365645 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:23:17.742830 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.742757 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7mtdh"] Jun 03 03:23:17.747570 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.747548 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.757181 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.757157 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 03:23:17.757308 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.757278 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q9xxj\"" Jun 03 03:23:17.757780 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.757764 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 03:23:17.758605 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.758585 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 03:23:17.759083 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.759049 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 03:23:17.759368 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.759348 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 03:23:17.760439 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.760423 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 03:23:17.786340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.786317 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9rql\" (UniqueName: \"kubernetes.io/projected/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-kube-api-access-n9rql\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.786456 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.786351 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-node-exporter-accelerators-collector-config\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.786456 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.786374 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-metrics-client-ca\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.786456 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.786426 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-node-exporter-tls\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.786562 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.786501 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-root\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.786592 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.786569 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-sys\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.786636 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.786605 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-node-exporter-textfile\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.786636 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.786625 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-node-exporter-wtmp\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.786706 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.786642 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.887771 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.887742 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-sys\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.887949 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.887803 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-node-exporter-textfile\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.887949 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.887833 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-node-exporter-wtmp\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.887949 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.887851 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-sys\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.887949 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.887857 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.887949 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.887925 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n9rql\" (UniqueName: \"kubernetes.io/projected/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-kube-api-access-n9rql\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.888254 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.887958 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-node-exporter-accelerators-collector-config\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.888254 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.887986 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-metrics-client-ca\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.888254 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.888065 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-node-exporter-wtmp\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.888254 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.888107 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-node-exporter-tls\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.888254 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.888142 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-root\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.888254 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.888186 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-root\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.888254 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.888227 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-node-exporter-textfile\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.888599 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:23:17.888268 2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 03:23:17.888599 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:23:17.888322 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-node-exporter-tls podName:d4b1bdd0-3ff3-400d-8572-c72324b24d8a nodeName:}" failed. No retries permitted until 2026-06-03 03:23:18.38830777 +0000 UTC m=+173.560217623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-node-exporter-tls") pod "node-exporter-7mtdh" (UID: "d4b1bdd0-3ff3-400d-8572-c72324b24d8a") : secret "node-exporter-tls" not found Jun 03 03:23:17.888704 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.888619 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-metrics-client-ca\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.888704 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.888635 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-node-exporter-accelerators-collector-config\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.890926 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.890905 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:17.896065 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:17.896020 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9rql\" (UniqueName: \"kubernetes.io/projected/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-kube-api-access-n9rql\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:18.393559 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.393525 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-node-exporter-tls\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:18.396125 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.396095 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d4b1bdd0-3ff3-400d-8572-c72324b24d8a-node-exporter-tls\") pod \"node-exporter-7mtdh\" (UID: \"d4b1bdd0-3ff3-400d-8572-c72324b24d8a\") " pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:18.658451 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.658367 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7mtdh" Jun 03 03:23:18.809652 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.809617 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 03:23:18.817161 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.817135 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:18.819871 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.819333 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 03:23:18.819871 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.819467 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 03:23:18.819871 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.819548 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4qqf8\"" Jun 03 03:23:18.819871 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.819565 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 03:23:18.819871 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.819467 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 03:23:18.819871 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.819331 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 03:23:18.819871 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.819784 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 03:23:18.820325 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.819915 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 03:23:18.820325 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.819980 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 03:23:18.820325 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.820199 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 03:23:18.824625 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.824574 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 03:23:18.897877 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.897853 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:18.898029 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.897888 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:18.898029 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.897950 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:18.898029 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.898011 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d7633780-55a5-4aa4-9ac1-450b56dfc51d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:18.898168 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.898043 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-config-volume\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:18.898168 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.898068 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:18.898168 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.898093 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4svth\" (UniqueName: \"kubernetes.io/projected/d7633780-55a5-4aa4-9ac1-450b56dfc51d-kube-api-access-4svth\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:18.898168 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.898162 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d7633780-55a5-4aa4-9ac1-450b56dfc51d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:18.898331 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.898200 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d7633780-55a5-4aa4-9ac1-450b56dfc51d-config-out\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:18.898331 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.898222 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:18.898331 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.898270 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7633780-55a5-4aa4-9ac1-450b56dfc51d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:18.898331 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.898299 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7633780-55a5-4aa4-9ac1-450b56dfc51d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:18.898528 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.898330 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-web-config\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:18.999556 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.999492 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4svth\" (UniqueName: \"kubernetes.io/projected/d7633780-55a5-4aa4-9ac1-450b56dfc51d-kube-api-access-4svth\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:18.999556 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.999528 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d7633780-55a5-4aa4-9ac1-450b56dfc51d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:18.999729 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.999566 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d7633780-55a5-4aa4-9ac1-450b56dfc51d-config-out\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:18.999729 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.999588 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:18.999729 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.999612 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7633780-55a5-4aa4-9ac1-450b56dfc51d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:18.999729 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.999635 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7633780-55a5-4aa4-9ac1-450b56dfc51d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:18.999729 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.999663 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-web-config\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:18.999964 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.999730 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:18.999964 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.999757 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:18.999964 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:18.999795 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:19.000174 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:19.000152 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d7633780-55a5-4aa4-9ac1-450b56dfc51d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:19.000232 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:19.000204 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-config-volume\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:19.000288 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:19.000232 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:19.000524 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:19.000497 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d7633780-55a5-4aa4-9ac1-450b56dfc51d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:19.000966 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:19.000916 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7633780-55a5-4aa4-9ac1-450b56dfc51d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:19.001808 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:19.001763 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7633780-55a5-4aa4-9ac1-450b56dfc51d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:19.002792 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:19.002742 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d7633780-55a5-4aa4-9ac1-450b56dfc51d-config-out\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:19.003391 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:19.002929 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:19.003391 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:19.003337 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-config-volume\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:19.003548 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:19.003492 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-web-config\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:19.004083 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:19.004059 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d7633780-55a5-4aa4-9ac1-450b56dfc51d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:19.004267 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:19.004237 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:19.004736 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:19.004715 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:19.005210 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:19.005183 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:19.005955 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:19.005921 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:19.006779 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:19.006757 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4svth\" (UniqueName: \"kubernetes.io/projected/d7633780-55a5-4aa4-9ac1-450b56dfc51d-kube-api-access-4svth\") pod \"alertmanager-main-0\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:19.129713 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:19.129683 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:23:20.832145 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:20.832118 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-v2qx2" Jun 03 03:23:22.048817 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.048777 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m"] Jun 03 03:23:22.053595 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.053573 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:23:22.057112 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.056818 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ppzpj\"" Jun 03 03:23:22.057112 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.056896 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 03 03:23:22.057112 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.056927 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 03 03:23:22.057328 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.057127 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 03:23:22.057328 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.057229 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 03 03:23:22.057772 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.057662 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cf4pas2om3p4u\"" Jun 03 03:23:22.059250 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.059219 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m"] Jun 03 03:23:22.127320 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.127289 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvczh\" (UniqueName: \"kubernetes.io/projected/9ee77936-416a-42cc-ae9d-679fad90febb-kube-api-access-dvczh\") pod \"metrics-server-7cd4b46c8f-tjh5m\" (UID: \"9ee77936-416a-42cc-ae9d-679fad90febb\") " pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:23:22.127449 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.127342 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9ee77936-416a-42cc-ae9d-679fad90febb-secret-metrics-server-tls\") pod \"metrics-server-7cd4b46c8f-tjh5m\" (UID: \"9ee77936-416a-42cc-ae9d-679fad90febb\") " pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:23:22.127449 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.127416 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9ee77936-416a-42cc-ae9d-679fad90febb-secret-metrics-server-client-certs\") pod \"metrics-server-7cd4b46c8f-tjh5m\" (UID: \"9ee77936-416a-42cc-ae9d-679fad90febb\") " pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:23:22.127558 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.127450 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9ee77936-416a-42cc-ae9d-679fad90febb-audit-log\") pod \"metrics-server-7cd4b46c8f-tjh5m\" (UID: \"9ee77936-416a-42cc-ae9d-679fad90febb\") " pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:23:22.127558 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.127521 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ee77936-416a-42cc-ae9d-679fad90febb-client-ca-bundle\") pod \"metrics-server-7cd4b46c8f-tjh5m\" (UID: \"9ee77936-416a-42cc-ae9d-679fad90febb\") " pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:23:22.127655 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.127555 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ee77936-416a-42cc-ae9d-679fad90febb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cd4b46c8f-tjh5m\" (UID: \"9ee77936-416a-42cc-ae9d-679fad90febb\") " pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:23:22.127655 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.127598 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9ee77936-416a-42cc-ae9d-679fad90febb-metrics-server-audit-profiles\") pod \"metrics-server-7cd4b46c8f-tjh5m\" (UID: \"9ee77936-416a-42cc-ae9d-679fad90febb\") " pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:23:22.228453 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.228420 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dvczh\" (UniqueName: \"kubernetes.io/projected/9ee77936-416a-42cc-ae9d-679fad90febb-kube-api-access-dvczh\") pod \"metrics-server-7cd4b46c8f-tjh5m\" (UID: \"9ee77936-416a-42cc-ae9d-679fad90febb\") " pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:23:22.228591 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.228465 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9ee77936-416a-42cc-ae9d-679fad90febb-secret-metrics-server-tls\") pod \"metrics-server-7cd4b46c8f-tjh5m\" (UID: \"9ee77936-416a-42cc-ae9d-679fad90febb\") " pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:23:22.228591 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.228488 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9ee77936-416a-42cc-ae9d-679fad90febb-secret-metrics-server-client-certs\") pod \"metrics-server-7cd4b46c8f-tjh5m\" (UID: \"9ee77936-416a-42cc-ae9d-679fad90febb\") " pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:23:22.228591 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.228538 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9ee77936-416a-42cc-ae9d-679fad90febb-audit-log\") pod \"metrics-server-7cd4b46c8f-tjh5m\" (UID: \"9ee77936-416a-42cc-ae9d-679fad90febb\") " pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:23:22.228591 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.228579 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ee77936-416a-42cc-ae9d-679fad90febb-client-ca-bundle\") pod \"metrics-server-7cd4b46c8f-tjh5m\" (UID: \"9ee77936-416a-42cc-ae9d-679fad90febb\") " pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:23:22.228807 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.228608 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ee77936-416a-42cc-ae9d-679fad90febb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cd4b46c8f-tjh5m\" (UID: \"9ee77936-416a-42cc-ae9d-679fad90febb\") " pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:23:22.228807 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.228644 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9ee77936-416a-42cc-ae9d-679fad90febb-metrics-server-audit-profiles\") pod \"metrics-server-7cd4b46c8f-tjh5m\" (UID: \"9ee77936-416a-42cc-ae9d-679fad90febb\") " pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:23:22.229316 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.229255 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9ee77936-416a-42cc-ae9d-679fad90febb-audit-log\") pod \"metrics-server-7cd4b46c8f-tjh5m\" (UID: \"9ee77936-416a-42cc-ae9d-679fad90febb\") " pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:23:22.229976 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.229472 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ee77936-416a-42cc-ae9d-679fad90febb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cd4b46c8f-tjh5m\" (UID: \"9ee77936-416a-42cc-ae9d-679fad90febb\") " pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:23:22.230446 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.230411 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9ee77936-416a-42cc-ae9d-679fad90febb-metrics-server-audit-profiles\") pod \"metrics-server-7cd4b46c8f-tjh5m\" (UID: \"9ee77936-416a-42cc-ae9d-679fad90febb\") " pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:23:22.235548 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.235495 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ee77936-416a-42cc-ae9d-679fad90febb-client-ca-bundle\") pod \"metrics-server-7cd4b46c8f-tjh5m\" (UID: \"9ee77936-416a-42cc-ae9d-679fad90febb\") " pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:23:22.235548 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.235516 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9ee77936-416a-42cc-ae9d-679fad90febb-secret-metrics-server-tls\") pod \"metrics-server-7cd4b46c8f-tjh5m\" (UID: \"9ee77936-416a-42cc-ae9d-679fad90febb\") " pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:23:22.235715 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.235677 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9ee77936-416a-42cc-ae9d-679fad90febb-secret-metrics-server-client-certs\") pod \"metrics-server-7cd4b46c8f-tjh5m\" (UID: \"9ee77936-416a-42cc-ae9d-679fad90febb\") " pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:23:22.236654 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.236629 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvczh\" (UniqueName: \"kubernetes.io/projected/9ee77936-416a-42cc-ae9d-679fad90febb-kube-api-access-dvczh\") pod \"metrics-server-7cd4b46c8f-tjh5m\" (UID: \"9ee77936-416a-42cc-ae9d-679fad90febb\") " pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:23:22.365927 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.365837 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:23:22.707110 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.707010 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-79598bccf6-bvlf5"] Jun 03 03:23:22.711873 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.711849 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:22.714248 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.714219 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 03:23:22.714375 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.714252 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9rp5v\"" Jun 03 03:23:22.715124 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.715102 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 03:23:22.715313 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.715295 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 03:23:22.715942 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.715785 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 03:23:22.716312 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.716287 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 03:23:22.718472 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.718345 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79598bccf6-bvlf5"] Jun 03 03:23:22.720203 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.720181 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 03:23:22.833748 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.833713 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-console-oauth-config\") pod \"console-79598bccf6-bvlf5\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:22.833748 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.833753 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-oauth-serving-cert\") pod \"console-79598bccf6-bvlf5\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:22.834005 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.833789 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-service-ca\") pod \"console-79598bccf6-bvlf5\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:22.834005 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.833822 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-trusted-ca-bundle\") pod \"console-79598bccf6-bvlf5\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:22.834005 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.833878 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-console-config\") pod \"console-79598bccf6-bvlf5\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:22.834005 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.833896 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-console-serving-cert\") pod \"console-79598bccf6-bvlf5\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:22.834005 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.833922 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6hcj\" (UniqueName: \"kubernetes.io/projected/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-kube-api-access-g6hcj\") pod \"console-79598bccf6-bvlf5\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:22.935507 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.935474 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-console-config\") pod \"console-79598bccf6-bvlf5\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:22.935507 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.935512 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-console-serving-cert\") pod \"console-79598bccf6-bvlf5\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:22.935758 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.935541 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g6hcj\" (UniqueName: \"kubernetes.io/projected/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-kube-api-access-g6hcj\") pod \"console-79598bccf6-bvlf5\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:22.935758 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.935598 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-console-oauth-config\") pod \"console-79598bccf6-bvlf5\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:22.935758 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.935629 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-oauth-serving-cert\") pod \"console-79598bccf6-bvlf5\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:22.935758 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.935657 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-service-ca\") pod \"console-79598bccf6-bvlf5\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:22.935758 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.935695 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-trusted-ca-bundle\") pod \"console-79598bccf6-bvlf5\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:22.936361 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.936328 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-console-config\") pod \"console-79598bccf6-bvlf5\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:22.936666 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.936633 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-service-ca\") pod \"console-79598bccf6-bvlf5\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:22.936776 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.936716 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-trusted-ca-bundle\") pod \"console-79598bccf6-bvlf5\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:22.936776 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.936741 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-oauth-serving-cert\") pod \"console-79598bccf6-bvlf5\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:22.938564 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.938541 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-console-oauth-config\") pod \"console-79598bccf6-bvlf5\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:22.938713 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.938689 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-console-serving-cert\") pod \"console-79598bccf6-bvlf5\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:22.952807 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:22.952785 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6hcj\" (UniqueName: \"kubernetes.io/projected/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-kube-api-access-g6hcj\") pod \"console-79598bccf6-bvlf5\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:23.023839 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.023794 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:23.898497 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.898468 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 03:23:23.903643 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.903622 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:23.906190 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.906168 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 03:23:23.906359 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.906335 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 03:23:23.906359 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.906353 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 03:23:23.906525 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.906395 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 03:23:23.906679 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.906658 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 03:23:23.906679 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.906672 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-pgdub699k7mb\"" Jun 03 03:23:23.906860 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.906710 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 03:23:23.907030 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.906986 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 03:23:23.907030 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.907019 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 03:23:23.907322 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.907265 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-75pp2\"" Jun 03 03:23:23.907408 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.907393 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 03:23:23.907472 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.907414 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 03:23:23.907472 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.907394 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 03:23:23.909638 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.909618 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 03:23:23.916248 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.916226 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 03:23:23.945475 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.945452 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0956636f-a168-4e48-ab68-418c66f35b52-config-out\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:23.945570 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.945491 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:23.945570 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.945517 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:23.945570 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.945560 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:23.945701 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.945605 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:23.945701 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.945649 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-config\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:23.945701 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.945673 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgtr8\" (UniqueName: \"kubernetes.io/projected/0956636f-a168-4e48-ab68-418c66f35b52-kube-api-access-cgtr8\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:23.945815 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.945709 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:23.945815 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.945755 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0956636f-a168-4e48-ab68-418c66f35b52-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:23.945815 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.945793 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:23.945926 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.945823 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0956636f-a168-4e48-ab68-418c66f35b52-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:23.945926 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.945853 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:23.945926 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.945878 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:23.946057 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.945924 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:23.946057 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.945964 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:23.946057 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.946019 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:23.946168 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.946078 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-web-config\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:23.946168 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:23.946125 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.046926 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.046894 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.047148 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.046940 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.047148 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.046978 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.047148 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.047055 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-web-config\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.047148 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.047108 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.047148 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.047136 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0956636f-a168-4e48-ab68-418c66f35b52-config-out\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.047397 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.047155 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.047397 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.047176 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.047397 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.047204 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.047397 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.047233 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.047397 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.047282 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-config\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.047397 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.047345 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cgtr8\" (UniqueName: \"kubernetes.io/projected/0956636f-a168-4e48-ab68-418c66f35b52-kube-api-access-cgtr8\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.047397 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.047372 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.047724 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.047409 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0956636f-a168-4e48-ab68-418c66f35b52-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.047724 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.047438 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.047724 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.047463 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0956636f-a168-4e48-ab68-418c66f35b52-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.047724 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.047492 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.047724 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.047519 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.047966 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.047809 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.048096 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.048021 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.048096 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.048021 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.048457 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.048381 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0956636f-a168-4e48-ab68-418c66f35b52-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.049779 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.049737 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.051546 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.050877 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.051546 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.051406 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-web-config\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.052554 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.051710 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.052554 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.051818 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.052554 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.052169 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.052851 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.052828 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0956636f-a168-4e48-ab68-418c66f35b52-config-out\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.053184 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.053150 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-config\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.053722 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.053683 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.053940 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.053917 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.054306 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.054262 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.054589 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.054557 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.054678 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.054626 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0956636f-a168-4e48-ab68-418c66f35b52-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.056507 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.056483 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgtr8\" (UniqueName: \"kubernetes.io/projected/0956636f-a168-4e48-ab68-418c66f35b52-kube-api-access-cgtr8\") pod \"prometheus-k8s-0\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.215832 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:24.215754 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:24.995411 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:23:24.995211 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4b1bdd0_3ff3_400d_8572_c72324b24d8a.slice/crio-0144ef6faa35a243298534e29e78b9992033e31fe51fa0e8e3d6e68d7f6e0866 WatchSource:0}: Error finding container 0144ef6faa35a243298534e29e78b9992033e31fe51fa0e8e3d6e68d7f6e0866: Status 404 returned error can't find the container with id 0144ef6faa35a243298534e29e78b9992033e31fe51fa0e8e3d6e68d7f6e0866 Jun 03 03:23:25.158510 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:25.158488 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 03:23:25.173232 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:23:25.173207 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7633780_55a5_4aa4_9ac1_450b56dfc51d.slice/crio-f6536dfb5b6770c61bc43b71b64b66d2c3e9914de557b9d335f2c5c4cb67d89b WatchSource:0}: Error finding container f6536dfb5b6770c61bc43b71b64b66d2c3e9914de557b9d335f2c5c4cb67d89b: Status 404 returned error can't find the container with id f6536dfb5b6770c61bc43b71b64b66d2c3e9914de557b9d335f2c5c4cb67d89b Jun 03 03:23:25.389828 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:25.389571 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m"] Jun 03 03:23:25.392680 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:25.392650 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79598bccf6-bvlf5"] Jun 03 03:23:25.393617 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:23:25.393588 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ee77936_416a_42cc_ae9d_679fad90febb.slice/crio-483a506d9bf56f87a1c541e3698b20e1c4300d4e37a106880767ec4f549cbf10 WatchSource:0}: Error finding container 483a506d9bf56f87a1c541e3698b20e1c4300d4e37a106880767ec4f549cbf10: Status 404 returned error can't find the container with id 483a506d9bf56f87a1c541e3698b20e1c4300d4e37a106880767ec4f549cbf10 Jun 03 03:23:25.399722 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:23:25.397360 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf88814b5_a21e_4c3a_890f_c21a5fac5ba9.slice/crio-6410b6ff6d1c62160974aad49e1f20cdc662b3207eb2e0b51181d410ca674e57 WatchSource:0}: Error finding container 6410b6ff6d1c62160974aad49e1f20cdc662b3207eb2e0b51181d410ca674e57: Status 404 returned error can't find the container with id 6410b6ff6d1c62160974aad49e1f20cdc662b3207eb2e0b51181d410ca674e57 Jun 03 03:23:25.399722 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:25.399668 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 03:23:25.404524 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:23:25.404499 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0956636f_a168_4e48_ab68_418c66f35b52.slice/crio-409e6f4a727891c2bfdb7bea8f23f2cfbc7384bffece8dee6608f28eac263a8c WatchSource:0}: Error finding container 409e6f4a727891c2bfdb7bea8f23f2cfbc7384bffece8dee6608f28eac263a8c: Status 404 returned error can't find the container with id 409e6f4a727891c2bfdb7bea8f23f2cfbc7384bffece8dee6608f28eac263a8c Jun 03 03:23:25.874396 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:25.874321 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" event={"ID":"9ee77936-416a-42cc-ae9d-679fad90febb","Type":"ContainerStarted","Data":"483a506d9bf56f87a1c541e3698b20e1c4300d4e37a106880767ec4f549cbf10"} Jun 03 03:23:25.876954 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:25.876892 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7mtdh" event={"ID":"d4b1bdd0-3ff3-400d-8572-c72324b24d8a","Type":"ContainerStarted","Data":"0144ef6faa35a243298534e29e78b9992033e31fe51fa0e8e3d6e68d7f6e0866"} Jun 03 03:23:25.881520 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:25.881425 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-k2qsz" event={"ID":"11ee73ec-0499-4f10-8e48-62e7280059e6","Type":"ContainerStarted","Data":"e3a2d2b463c850cb4ba5211806ce05192671165e86e431953e7390a0e229f607"} Jun 03 03:23:25.882138 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:25.882107 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-k2qsz" Jun 03 03:23:25.883416 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:25.883393 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79598bccf6-bvlf5" event={"ID":"f88814b5-a21e-4c3a-890f-c21a5fac5ba9","Type":"ContainerStarted","Data":"6410b6ff6d1c62160974aad49e1f20cdc662b3207eb2e0b51181d410ca674e57"} Jun 03 03:23:25.885731 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:25.885707 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7633780-55a5-4aa4-9ac1-450b56dfc51d","Type":"ContainerStarted","Data":"f6536dfb5b6770c61bc43b71b64b66d2c3e9914de557b9d335f2c5c4cb67d89b"} Jun 03 03:23:25.887697 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:25.887675 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-k2qsz" Jun 03 03:23:25.888332 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:25.888286 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0956636f-a168-4e48-ab68-418c66f35b52","Type":"ContainerStarted","Data":"409e6f4a727891c2bfdb7bea8f23f2cfbc7384bffece8dee6608f28eac263a8c"} Jun 03 03:23:25.899958 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:25.898433 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-k2qsz" podStartSLOduration=1.3740683009999999 podStartE2EDuration="18.898417474s" podCreationTimestamp="2026-06-03 03:23:07 +0000 UTC" firstStartedPulling="2026-06-03 03:23:07.573423043 +0000 UTC m=+162.745332899" lastFinishedPulling="2026-06-03 03:23:25.09777221 +0000 UTC m=+180.269682072" observedRunningTime="2026-06-03 03:23:25.897705611 +0000 UTC m=+181.069615484" watchObservedRunningTime="2026-06-03 03:23:25.898417474 +0000 UTC m=+181.070327349" Jun 03 03:23:28.815138 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:28.815109 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d5cd555fc-hsjb5" Jun 03 03:23:30.907266 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:30.907226 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" event={"ID":"9ee77936-416a-42cc-ae9d-679fad90febb","Type":"ContainerStarted","Data":"d548cc23b030143d13ee696904afa9c55d8dc7ec6da56c8548ed3ef58388a86e"} Jun 03 03:23:30.908983 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:30.908952 2558 generic.go:358] "Generic (PLEG): container finished" podID="d4b1bdd0-3ff3-400d-8572-c72324b24d8a" containerID="998cc94852aa301f5af9b1eb1015f42d1f0a8aabb259549a724aac6ab0e16adb" exitCode=0 Jun 03 03:23:30.909129 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:30.909031 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7mtdh" event={"ID":"d4b1bdd0-3ff3-400d-8572-c72324b24d8a","Type":"ContainerDied","Data":"998cc94852aa301f5af9b1eb1015f42d1f0a8aabb259549a724aac6ab0e16adb"} Jun 03 03:23:30.912212 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:30.911963 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79598bccf6-bvlf5" event={"ID":"f88814b5-a21e-4c3a-890f-c21a5fac5ba9","Type":"ContainerStarted","Data":"ccc88d490d695d77e2042755c22d01277ae12f3841f3502a7b9454ee76c22c19"} Jun 03 03:23:30.913678 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:30.913658 2558 generic.go:358] "Generic (PLEG): container finished" podID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerID="15861267f977051a88ab22a3f838000f0edd21b223a4492c4b41bc3946602cae" exitCode=0 Jun 03 03:23:30.913781 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:30.913752 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7633780-55a5-4aa4-9ac1-450b56dfc51d","Type":"ContainerDied","Data":"15861267f977051a88ab22a3f838000f0edd21b223a4492c4b41bc3946602cae"} Jun 03 03:23:30.915943 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:30.915183 2558 generic.go:358] "Generic (PLEG): container finished" podID="0956636f-a168-4e48-ab68-418c66f35b52" containerID="b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91" exitCode=0 Jun 03 03:23:30.915943 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:30.915246 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0956636f-a168-4e48-ab68-418c66f35b52","Type":"ContainerDied","Data":"b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91"} Jun 03 03:23:30.923832 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:30.923785 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" podStartSLOduration=4.478058578 podStartE2EDuration="8.923770723s" podCreationTimestamp="2026-06-03 03:23:22 +0000 UTC" firstStartedPulling="2026-06-03 03:23:25.396381349 +0000 UTC m=+180.568291200" lastFinishedPulling="2026-06-03 03:23:29.842093485 +0000 UTC m=+185.014003345" observedRunningTime="2026-06-03 03:23:30.922211056 +0000 UTC m=+186.094120937" watchObservedRunningTime="2026-06-03 03:23:30.923770723 +0000 UTC m=+186.095680594" Jun 03 03:23:30.959451 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:30.959381 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-79598bccf6-bvlf5" podStartSLOduration=4.5112852409999995 podStartE2EDuration="8.959364606s" podCreationTimestamp="2026-06-03 03:23:22 +0000 UTC" firstStartedPulling="2026-06-03 03:23:25.401391838 +0000 UTC m=+180.573301699" lastFinishedPulling="2026-06-03 03:23:29.849471213 +0000 UTC m=+185.021381064" observedRunningTime="2026-06-03 03:23:30.958465425 +0000 UTC m=+186.130375307" watchObservedRunningTime="2026-06-03 03:23:30.959364606 +0000 UTC m=+186.131274483" Jun 03 03:23:31.923125 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:31.923080 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7mtdh" event={"ID":"d4b1bdd0-3ff3-400d-8572-c72324b24d8a","Type":"ContainerStarted","Data":"1f7cfd5e5fe38b75f83933538bc4764d62357a9817776b2ee5b11e4cb46c2a95"} Jun 03 03:23:31.923125 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:31.923122 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7mtdh" event={"ID":"d4b1bdd0-3ff3-400d-8572-c72324b24d8a","Type":"ContainerStarted","Data":"72fc536ed7ae70e167097c3d9a73ecae01b6d71fe37cbea51a33cf0cf248bf15"} Jun 03 03:23:31.941469 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:31.941419 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7mtdh" podStartSLOduration=10.099863301 podStartE2EDuration="14.941403976s" podCreationTimestamp="2026-06-03 03:23:17 +0000 UTC" firstStartedPulling="2026-06-03 03:23:24.99823029 +0000 UTC m=+180.170140154" lastFinishedPulling="2026-06-03 03:23:29.839770974 +0000 UTC m=+185.011680829" observedRunningTime="2026-06-03 03:23:31.940051372 +0000 UTC m=+187.111961244" watchObservedRunningTime="2026-06-03 03:23:31.941403976 +0000 UTC m=+187.113313847" Jun 03 03:23:33.024274 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:33.024220 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:33.024695 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:33.024288 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:33.029777 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:33.029752 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:33.938315 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:33.938264 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:23:34.938818 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:34.938793 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7633780-55a5-4aa4-9ac1-450b56dfc51d","Type":"ContainerStarted","Data":"112d3b99642d833dc4475477cf90cdcfa9317e0885854bec9c93eeb7020a3fdd"} Jun 03 03:23:34.939193 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:34.938829 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7633780-55a5-4aa4-9ac1-450b56dfc51d","Type":"ContainerStarted","Data":"07a0e080e3c8e6247c2728bab8ee809f64531624f21ac324264418397b3e40a0"} Jun 03 03:23:34.939193 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:34.938845 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7633780-55a5-4aa4-9ac1-450b56dfc51d","Type":"ContainerStarted","Data":"9997841a8e789b8d5408d87e223cdabaa14687b21b1981030a06dc3a78c9bb1c"} Jun 03 03:23:34.941702 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:34.941675 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0956636f-a168-4e48-ab68-418c66f35b52","Type":"ContainerStarted","Data":"e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba"} Jun 03 03:23:35.952889 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:35.952848 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7633780-55a5-4aa4-9ac1-450b56dfc51d","Type":"ContainerStarted","Data":"7655522f6f8a4f6991a210567461c3e1ee14c00fd5312dafb62f1804a5b81a05"} Jun 03 03:23:35.952889 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:35.952893 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7633780-55a5-4aa4-9ac1-450b56dfc51d","Type":"ContainerStarted","Data":"1bbc07964f9361fab57534cc26b33a7aa7d74acb90624767877aeedb3f3d06da"} Jun 03 03:23:35.954809 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:35.954777 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0956636f-a168-4e48-ab68-418c66f35b52","Type":"ContainerStarted","Data":"dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e"} Jun 03 03:23:36.961231 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:36.961193 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7633780-55a5-4aa4-9ac1-450b56dfc51d","Type":"ContainerStarted","Data":"5f223e88615bb77b6253cea1a48b2312c21160a388df47e0425180de336b42c8"} Jun 03 03:23:36.987364 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:36.987318 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=7.840387163 podStartE2EDuration="18.987300953s" podCreationTimestamp="2026-06-03 03:23:18 +0000 UTC" firstStartedPulling="2026-06-03 03:23:25.175535823 +0000 UTC m=+180.347445672" lastFinishedPulling="2026-06-03 03:23:36.322449608 +0000 UTC m=+191.494359462" observedRunningTime="2026-06-03 03:23:36.985315321 +0000 UTC m=+192.157225194" watchObservedRunningTime="2026-06-03 03:23:36.987300953 +0000 UTC m=+192.159210824" Jun 03 03:23:37.966496 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:37.966399 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0956636f-a168-4e48-ab68-418c66f35b52","Type":"ContainerStarted","Data":"297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf"} Jun 03 03:23:37.966496 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:37.966447 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0956636f-a168-4e48-ab68-418c66f35b52","Type":"ContainerStarted","Data":"3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac"} Jun 03 03:23:38.972371 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:38.972333 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0956636f-a168-4e48-ab68-418c66f35b52","Type":"ContainerStarted","Data":"c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3"} Jun 03 03:23:38.972371 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:38.972374 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0956636f-a168-4e48-ab68-418c66f35b52","Type":"ContainerStarted","Data":"2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa"} Jun 03 03:23:39.001111 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:39.001069 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.706325777 podStartE2EDuration="16.001054392s" podCreationTimestamp="2026-06-03 03:23:23 +0000 UTC" firstStartedPulling="2026-06-03 03:23:25.407031829 +0000 UTC m=+180.578941693" lastFinishedPulling="2026-06-03 03:23:37.701760456 +0000 UTC m=+192.873670308" observedRunningTime="2026-06-03 03:23:38.999129498 +0000 UTC m=+194.171039379" watchObservedRunningTime="2026-06-03 03:23:39.001054392 +0000 UTC m=+194.172964274" Jun 03 03:23:39.216058 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:39.216031 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:23:42.366227 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:42.366192 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:23:42.366227 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:42.366232 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:23:53.018183 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:53.018150 2558 generic.go:358] "Generic (PLEG): container finished" podID="c54da6ba-c2e2-40c7-92ad-cf73160ad5ee" containerID="9537ee3774913723c4a62bce879175e1fde5163ca3b046dc7ad0bd851fa30c1a" exitCode=0 Jun 03 03:23:53.018590 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:53.018229 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-q2g2j" event={"ID":"c54da6ba-c2e2-40c7-92ad-cf73160ad5ee","Type":"ContainerDied","Data":"9537ee3774913723c4a62bce879175e1fde5163ca3b046dc7ad0bd851fa30c1a"} Jun 03 03:23:53.018590 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:53.018558 2558 scope.go:117] "RemoveContainer" containerID="9537ee3774913723c4a62bce879175e1fde5163ca3b046dc7ad0bd851fa30c1a" Jun 03 03:23:53.874811 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:53.874783 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-746645b9b9-vw7dh_663f11c6-a48b-4193-8a3d-9feea74d8b0c/router/0.log" Jun 03 03:23:53.891613 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:53.891585 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qzwsf_07bbf7cb-60c5-4184-a023-5a4bef630b32/serve-healthcheck-canary/0.log" Jun 03 03:23:54.023239 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:23:54.023207 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-q2g2j" event={"ID":"c54da6ba-c2e2-40c7-92ad-cf73160ad5ee","Type":"ContainerStarted","Data":"787980f28607f495989686f5d11c94b3cc0d83e47532b66238d4d70cb1e31904"} Jun 03 03:24:02.371084 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:02.371053 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:24:02.374855 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:02.374834 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7cd4b46c8f-tjh5m" Jun 03 03:24:18.094948 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:18.094913 2558 generic.go:358] "Generic (PLEG): container finished" podID="a2d2c179-f717-45c3-8e52-94168d354ff9" containerID="9f6a674991f2057c76718569b1304d88259bf40c05bc90821b5c308a73cd7675" exitCode=0 Jun 03 03:24:18.095440 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:18.094987 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mg788" event={"ID":"a2d2c179-f717-45c3-8e52-94168d354ff9","Type":"ContainerDied","Data":"9f6a674991f2057c76718569b1304d88259bf40c05bc90821b5c308a73cd7675"} Jun 03 03:24:18.095440 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:18.095418 2558 scope.go:117] "RemoveContainer" containerID="9f6a674991f2057c76718569b1304d88259bf40c05bc90821b5c308a73cd7675" Jun 03 03:24:19.099918 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:19.099874 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-mg788" event={"ID":"a2d2c179-f717-45c3-8e52-94168d354ff9","Type":"ContainerStarted","Data":"394ea927ddf3af382c4da09336d42215c512773960b20267deb1419ddba84e1d"} Jun 03 03:24:24.216959 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:24.216920 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:24.232118 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:24.232089 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:25.132127 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:25.132097 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:37.077432 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:37.077386 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs\") pod \"network-metrics-daemon-rp75f\" (UID: \"55469fc3-4142-42c5-8420-af3316559074\") " pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:24:37.079749 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:37.079729 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55469fc3-4142-42c5-8420-af3316559074-metrics-certs\") pod \"network-metrics-daemon-rp75f\" (UID: \"55469fc3-4142-42c5-8420-af3316559074\") " pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:24:37.168402 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:37.168370 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bwf2t\"" Jun 03 03:24:37.176980 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:37.176959 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rp75f" Jun 03 03:24:37.309901 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:37.309876 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rp75f"] Jun 03 03:24:37.311987 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:24:37.311957 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55469fc3_4142_42c5_8420_af3316559074.slice/crio-791b641f791d70fa9e8b504dc976aaa9bb86dcf8d28f3897fe185869741b143e WatchSource:0}: Error finding container 791b641f791d70fa9e8b504dc976aaa9bb86dcf8d28f3897fe185869741b143e: Status 404 returned error can't find the container with id 791b641f791d70fa9e8b504dc976aaa9bb86dcf8d28f3897fe185869741b143e Jun 03 03:24:37.946163 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:37.946121 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 03:24:37.947009 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:37.946735 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="alertmanager" containerID="cri-o://9997841a8e789b8d5408d87e223cdabaa14687b21b1981030a06dc3a78c9bb1c" gracePeriod=120 Jun 03 03:24:37.947009 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:37.946802 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="kube-rbac-proxy-web" containerID="cri-o://112d3b99642d833dc4475477cf90cdcfa9317e0885854bec9c93eeb7020a3fdd" gracePeriod=120 Jun 03 03:24:37.947009 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:37.946835 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="kube-rbac-proxy" containerID="cri-o://1bbc07964f9361fab57534cc26b33a7aa7d74acb90624767877aeedb3f3d06da" gracePeriod=120 Jun 03 03:24:37.947009 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:37.946897 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="kube-rbac-proxy-metric" containerID="cri-o://7655522f6f8a4f6991a210567461c3e1ee14c00fd5312dafb62f1804a5b81a05" gracePeriod=120 Jun 03 03:24:37.947009 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:37.946930 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="config-reloader" containerID="cri-o://07a0e080e3c8e6247c2728bab8ee809f64531624f21ac324264418397b3e40a0" gracePeriod=120 Jun 03 03:24:37.947009 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:37.946923 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="prom-label-proxy" containerID="cri-o://5f223e88615bb77b6253cea1a48b2312c21160a388df47e0425180de336b42c8" gracePeriod=120 Jun 03 03:24:38.159040 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:38.159005 2558 generic.go:358] "Generic (PLEG): container finished" podID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerID="5f223e88615bb77b6253cea1a48b2312c21160a388df47e0425180de336b42c8" exitCode=0 Jun 03 03:24:38.159040 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:38.159028 2558 generic.go:358] "Generic (PLEG): container finished" podID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerID="1bbc07964f9361fab57534cc26b33a7aa7d74acb90624767877aeedb3f3d06da" exitCode=0 Jun 03 03:24:38.159040 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:38.159039 2558 generic.go:358] "Generic (PLEG): container finished" podID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerID="07a0e080e3c8e6247c2728bab8ee809f64531624f21ac324264418397b3e40a0" exitCode=0 Jun 03 03:24:38.159040 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:38.159045 2558 generic.go:358] "Generic (PLEG): container finished" podID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerID="9997841a8e789b8d5408d87e223cdabaa14687b21b1981030a06dc3a78c9bb1c" exitCode=0 Jun 03 03:24:38.159558 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:38.159020 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7633780-55a5-4aa4-9ac1-450b56dfc51d","Type":"ContainerDied","Data":"5f223e88615bb77b6253cea1a48b2312c21160a388df47e0425180de336b42c8"} Jun 03 03:24:38.159558 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:38.159125 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7633780-55a5-4aa4-9ac1-450b56dfc51d","Type":"ContainerDied","Data":"1bbc07964f9361fab57534cc26b33a7aa7d74acb90624767877aeedb3f3d06da"} Jun 03 03:24:38.159558 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:38.159135 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7633780-55a5-4aa4-9ac1-450b56dfc51d","Type":"ContainerDied","Data":"07a0e080e3c8e6247c2728bab8ee809f64531624f21ac324264418397b3e40a0"} Jun 03 03:24:38.159558 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:38.159145 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7633780-55a5-4aa4-9ac1-450b56dfc51d","Type":"ContainerDied","Data":"9997841a8e789b8d5408d87e223cdabaa14687b21b1981030a06dc3a78c9bb1c"} Jun 03 03:24:38.160292 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:38.160274 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rp75f" event={"ID":"55469fc3-4142-42c5-8420-af3316559074","Type":"ContainerStarted","Data":"791b641f791d70fa9e8b504dc976aaa9bb86dcf8d28f3897fe185869741b143e"} Jun 03 03:24:39.166089 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.166053 2558 generic.go:358] "Generic (PLEG): container finished" podID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerID="7655522f6f8a4f6991a210567461c3e1ee14c00fd5312dafb62f1804a5b81a05" exitCode=0 Jun 03 03:24:39.166089 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.166085 2558 generic.go:358] "Generic (PLEG): container finished" podID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerID="112d3b99642d833dc4475477cf90cdcfa9317e0885854bec9c93eeb7020a3fdd" exitCode=0 Jun 03 03:24:39.166570 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.166108 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7633780-55a5-4aa4-9ac1-450b56dfc51d","Type":"ContainerDied","Data":"7655522f6f8a4f6991a210567461c3e1ee14c00fd5312dafb62f1804a5b81a05"} Jun 03 03:24:39.166570 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.166143 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7633780-55a5-4aa4-9ac1-450b56dfc51d","Type":"ContainerDied","Data":"112d3b99642d833dc4475477cf90cdcfa9317e0885854bec9c93eeb7020a3fdd"} Jun 03 03:24:39.167702 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.167680 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rp75f" event={"ID":"55469fc3-4142-42c5-8420-af3316559074","Type":"ContainerStarted","Data":"158bead187ffac01179f0ead750784f7789b410fb135ae2782535fe89cb1aa97"} Jun 03 03:24:39.167702 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.167704 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rp75f" event={"ID":"55469fc3-4142-42c5-8420-af3316559074","Type":"ContainerStarted","Data":"be497d1ce12f4074f1e5df63c0ba87641884019d17704530c01631031d59fad7"} Jun 03 03:24:39.183287 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.183223 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rp75f" podStartSLOduration=253.09133382 podStartE2EDuration="4m14.183209139s" podCreationTimestamp="2026-06-03 03:20:25 +0000 UTC" firstStartedPulling="2026-06-03 03:24:37.314075037 +0000 UTC m=+252.485984887" lastFinishedPulling="2026-06-03 03:24:38.405950356 +0000 UTC m=+253.577860206" observedRunningTime="2026-06-03 03:24:39.182125348 +0000 UTC m=+254.354035220" watchObservedRunningTime="2026-06-03 03:24:39.183209139 +0000 UTC m=+254.355119039" Jun 03 03:24:39.199012 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.198975 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:39.295133 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.295097 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d7633780-55a5-4aa4-9ac1-450b56dfc51d-alertmanager-main-db\") pod \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " Jun 03 03:24:39.295328 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.295138 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7633780-55a5-4aa4-9ac1-450b56dfc51d-alertmanager-trusted-ca-bundle\") pod \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " Jun 03 03:24:39.295328 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.295182 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7633780-55a5-4aa4-9ac1-450b56dfc51d-metrics-client-ca\") pod \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " Jun 03 03:24:39.295328 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.295219 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-secret-alertmanager-kube-rbac-proxy\") pod \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " Jun 03 03:24:39.295328 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.295243 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-cluster-tls-config\") pod \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " Jun 03 03:24:39.295328 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.295300 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d7633780-55a5-4aa4-9ac1-450b56dfc51d-config-out\") pod \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " Jun 03 03:24:39.295584 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.295348 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-web-config\") pod \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " Jun 03 03:24:39.295584 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.295378 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d7633780-55a5-4aa4-9ac1-450b56dfc51d-tls-assets\") pod \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " Jun 03 03:24:39.295584 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.295410 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " Jun 03 03:24:39.295584 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.295437 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-secret-alertmanager-kube-rbac-proxy-web\") pod \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " Jun 03 03:24:39.295584 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.295465 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4svth\" (UniqueName: \"kubernetes.io/projected/d7633780-55a5-4aa4-9ac1-450b56dfc51d-kube-api-access-4svth\") pod \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " Jun 03 03:24:39.295584 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.295479 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7633780-55a5-4aa4-9ac1-450b56dfc51d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d7633780-55a5-4aa4-9ac1-450b56dfc51d" (UID: "d7633780-55a5-4aa4-9ac1-450b56dfc51d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:24:39.295584 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.295511 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-secret-alertmanager-main-tls\") pod \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " Jun 03 03:24:39.295584 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.295542 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-config-volume\") pod \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\" (UID: \"d7633780-55a5-4aa4-9ac1-450b56dfc51d\") " Jun 03 03:24:39.295584 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.295575 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7633780-55a5-4aa4-9ac1-450b56dfc51d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d7633780-55a5-4aa4-9ac1-450b56dfc51d" (UID: "d7633780-55a5-4aa4-9ac1-450b56dfc51d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:24:39.296042 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.295588 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7633780-55a5-4aa4-9ac1-450b56dfc51d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d7633780-55a5-4aa4-9ac1-450b56dfc51d" (UID: "d7633780-55a5-4aa4-9ac1-450b56dfc51d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:24:39.296042 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.295835 2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d7633780-55a5-4aa4-9ac1-450b56dfc51d-alertmanager-main-db\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:39.296042 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.295859 2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7633780-55a5-4aa4-9ac1-450b56dfc51d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:39.296748 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.296715 2558 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7633780-55a5-4aa4-9ac1-450b56dfc51d-metrics-client-ca\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:39.300035 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.298387 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d7633780-55a5-4aa4-9ac1-450b56dfc51d" (UID: "d7633780-55a5-4aa4-9ac1-450b56dfc51d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:24:39.303167 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.303132 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7633780-55a5-4aa4-9ac1-450b56dfc51d-kube-api-access-4svth" (OuterVolumeSpecName: "kube-api-access-4svth") pod "d7633780-55a5-4aa4-9ac1-450b56dfc51d" (UID: "d7633780-55a5-4aa4-9ac1-450b56dfc51d"). InnerVolumeSpecName "kube-api-access-4svth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:24:39.305366 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.305262 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d7633780-55a5-4aa4-9ac1-450b56dfc51d" (UID: "d7633780-55a5-4aa4-9ac1-450b56dfc51d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:24:39.305476 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.305422 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-config-volume" (OuterVolumeSpecName: "config-volume") pod "d7633780-55a5-4aa4-9ac1-450b56dfc51d" (UID: "d7633780-55a5-4aa4-9ac1-450b56dfc51d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:24:39.305476 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.305438 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7633780-55a5-4aa4-9ac1-450b56dfc51d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d7633780-55a5-4aa4-9ac1-450b56dfc51d" (UID: "d7633780-55a5-4aa4-9ac1-450b56dfc51d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:24:39.305589 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.305509 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d7633780-55a5-4aa4-9ac1-450b56dfc51d" (UID: "d7633780-55a5-4aa4-9ac1-450b56dfc51d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:24:39.305837 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.305790 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7633780-55a5-4aa4-9ac1-450b56dfc51d-config-out" (OuterVolumeSpecName: "config-out") pod "d7633780-55a5-4aa4-9ac1-450b56dfc51d" (UID: "d7633780-55a5-4aa4-9ac1-450b56dfc51d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:24:39.306700 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.306667 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d7633780-55a5-4aa4-9ac1-450b56dfc51d" (UID: "d7633780-55a5-4aa4-9ac1-450b56dfc51d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:24:39.308469 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.308441 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d7633780-55a5-4aa4-9ac1-450b56dfc51d" (UID: "d7633780-55a5-4aa4-9ac1-450b56dfc51d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:24:39.314803 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.314773 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-web-config" (OuterVolumeSpecName: "web-config") pod "d7633780-55a5-4aa4-9ac1-450b56dfc51d" (UID: "d7633780-55a5-4aa4-9ac1-450b56dfc51d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:24:39.398058 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.398015 2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d7633780-55a5-4aa4-9ac1-450b56dfc51d-tls-assets\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:39.398058 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.398054 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:39.398269 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.398071 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:39.398269 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.398087 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4svth\" (UniqueName: \"kubernetes.io/projected/d7633780-55a5-4aa4-9ac1-450b56dfc51d-kube-api-access-4svth\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:39.398269 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.398100 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-secret-alertmanager-main-tls\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:39.398269 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.398111 2558 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-config-volume\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:39.398269 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.398123 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:39.398269 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.398135 2558 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-cluster-tls-config\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:39.398269 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.398147 2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d7633780-55a5-4aa4-9ac1-450b56dfc51d-config-out\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:39.398269 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:39.398159 2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d7633780-55a5-4aa4-9ac1-450b56dfc51d-web-config\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:40.173904 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:40.173862 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7633780-55a5-4aa4-9ac1-450b56dfc51d","Type":"ContainerDied","Data":"f6536dfb5b6770c61bc43b71b64b66d2c3e9914de557b9d335f2c5c4cb67d89b"} Jun 03 03:24:40.174308 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:40.173917 2558 scope.go:117] "RemoveContainer" containerID="5f223e88615bb77b6253cea1a48b2312c21160a388df47e0425180de336b42c8" Jun 03 03:24:40.174308 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:40.173963 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.181483 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:40.181451 2558 scope.go:117] "RemoveContainer" containerID="7655522f6f8a4f6991a210567461c3e1ee14c00fd5312dafb62f1804a5b81a05" Jun 03 03:24:40.188267 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:40.188246 2558 scope.go:117] "RemoveContainer" containerID="1bbc07964f9361fab57534cc26b33a7aa7d74acb90624767877aeedb3f3d06da" Jun 03 03:24:40.194079 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:40.194042 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 03:24:40.195493 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:40.195474 2558 scope.go:117] "RemoveContainer" containerID="112d3b99642d833dc4475477cf90cdcfa9317e0885854bec9c93eeb7020a3fdd" Jun 03 03:24:40.201384 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:40.201352 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 03:24:40.202657 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:40.202643 2558 scope.go:117] "RemoveContainer" containerID="07a0e080e3c8e6247c2728bab8ee809f64531624f21ac324264418397b3e40a0" Jun 03 03:24:40.209374 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:40.209357 2558 scope.go:117] "RemoveContainer" containerID="9997841a8e789b8d5408d87e223cdabaa14687b21b1981030a06dc3a78c9bb1c" Jun 03 03:24:40.217724 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:40.217694 2558 scope.go:117] "RemoveContainer" containerID="15861267f977051a88ab22a3f838000f0edd21b223a4492c4b41bc3946602cae" Jun 03 03:24:41.370525 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:41.370486 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" path="/var/lib/kubelet/pods/d7633780-55a5-4aa4-9ac1-450b56dfc51d/volumes" Jun 03 03:24:42.244497 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.244461 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 03:24:42.245034 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.244951 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="prometheus" containerID="cri-o://e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba" gracePeriod=600 Jun 03 03:24:42.245168 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.245008 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="kube-rbac-proxy" containerID="cri-o://2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa" gracePeriod=600 Jun 03 03:24:42.245168 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.245063 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="kube-rbac-proxy-web" containerID="cri-o://297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf" gracePeriod=600 Jun 03 03:24:42.245168 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.245029 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="config-reloader" containerID="cri-o://dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e" gracePeriod=600 Jun 03 03:24:42.245168 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.245148 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3" gracePeriod=600 Jun 03 03:24:42.245376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.245010 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="thanos-sidecar" containerID="cri-o://3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac" gracePeriod=600 Jun 03 03:24:42.480286 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.480261 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:42.626535 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.626493 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0956636f-a168-4e48-ab68-418c66f35b52-config-out\") pod \"0956636f-a168-4e48-ab68-418c66f35b52\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " Jun 03 03:24:42.626719 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.626606 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-configmap-metrics-client-ca\") pod \"0956636f-a168-4e48-ab68-418c66f35b52\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " Jun 03 03:24:42.626719 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.626656 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-prometheus-k8s-tls\") pod \"0956636f-a168-4e48-ab68-418c66f35b52\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " Jun 03 03:24:42.626719 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.626683 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0956636f-a168-4e48-ab68-418c66f35b52-tls-assets\") pod \"0956636f-a168-4e48-ab68-418c66f35b52\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " Jun 03 03:24:42.626719 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.626711 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-grpc-tls\") pod \"0956636f-a168-4e48-ab68-418c66f35b52\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " Jun 03 03:24:42.626954 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.626752 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgtr8\" (UniqueName: \"kubernetes.io/projected/0956636f-a168-4e48-ab68-418c66f35b52-kube-api-access-cgtr8\") pod \"0956636f-a168-4e48-ab68-418c66f35b52\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " Jun 03 03:24:42.626954 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.626823 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-metrics-client-certs\") pod \"0956636f-a168-4e48-ab68-418c66f35b52\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " Jun 03 03:24:42.626954 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.626870 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-configmap-kubelet-serving-ca-bundle\") pod \"0956636f-a168-4e48-ab68-418c66f35b52\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " Jun 03 03:24:42.626954 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.626904 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-prometheus-trusted-ca-bundle\") pod \"0956636f-a168-4e48-ab68-418c66f35b52\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " Jun 03 03:24:42.626954 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.626942 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"0956636f-a168-4e48-ab68-418c66f35b52\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " Jun 03 03:24:42.627255 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.626975 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-thanos-prometheus-http-client-file\") pod \"0956636f-a168-4e48-ab68-418c66f35b52\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " Jun 03 03:24:42.627255 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.627039 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-configmap-serving-certs-ca-bundle\") pod \"0956636f-a168-4e48-ab68-418c66f35b52\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " Jun 03 03:24:42.627255 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.627076 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "0956636f-a168-4e48-ab68-418c66f35b52" (UID: "0956636f-a168-4e48-ab68-418c66f35b52"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:24:42.627255 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.627087 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-kube-rbac-proxy\") pod \"0956636f-a168-4e48-ab68-418c66f35b52\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " Jun 03 03:24:42.627255 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.627159 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-prometheus-k8s-rulefiles-0\") pod \"0956636f-a168-4e48-ab68-418c66f35b52\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " Jun 03 03:24:42.627255 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.627206 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-config\") pod \"0956636f-a168-4e48-ab68-418c66f35b52\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " Jun 03 03:24:42.627255 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.627232 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0956636f-a168-4e48-ab68-418c66f35b52-prometheus-k8s-db\") pod \"0956636f-a168-4e48-ab68-418c66f35b52\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " Jun 03 03:24:42.627608 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.627270 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"0956636f-a168-4e48-ab68-418c66f35b52\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " Jun 03 03:24:42.627608 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.627294 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-web-config\") pod \"0956636f-a168-4e48-ab68-418c66f35b52\" (UID: \"0956636f-a168-4e48-ab68-418c66f35b52\") " Jun 03 03:24:42.627608 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.627543 2558 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-configmap-metrics-client-ca\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:42.628011 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.627958 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "0956636f-a168-4e48-ab68-418c66f35b52" (UID: "0956636f-a168-4e48-ab68-418c66f35b52"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:24:42.629396 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.629341 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "0956636f-a168-4e48-ab68-418c66f35b52" (UID: "0956636f-a168-4e48-ab68-418c66f35b52"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:24:42.630782 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.629589 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "0956636f-a168-4e48-ab68-418c66f35b52" (UID: "0956636f-a168-4e48-ab68-418c66f35b52"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:24:42.630782 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.629666 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0956636f-a168-4e48-ab68-418c66f35b52-config-out" (OuterVolumeSpecName: "config-out") pod "0956636f-a168-4e48-ab68-418c66f35b52" (UID: "0956636f-a168-4e48-ab68-418c66f35b52"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:24:42.630782 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.629703 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "0956636f-a168-4e48-ab68-418c66f35b52" (UID: "0956636f-a168-4e48-ab68-418c66f35b52"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:24:42.630782 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.629750 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "0956636f-a168-4e48-ab68-418c66f35b52" (UID: "0956636f-a168-4e48-ab68-418c66f35b52"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:24:42.630782 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.629878 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "0956636f-a168-4e48-ab68-418c66f35b52" (UID: "0956636f-a168-4e48-ab68-418c66f35b52"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:24:42.630782 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.630493 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0956636f-a168-4e48-ab68-418c66f35b52-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0956636f-a168-4e48-ab68-418c66f35b52" (UID: "0956636f-a168-4e48-ab68-418c66f35b52"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:24:42.630782 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.630515 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0956636f-a168-4e48-ab68-418c66f35b52-kube-api-access-cgtr8" (OuterVolumeSpecName: "kube-api-access-cgtr8") pod "0956636f-a168-4e48-ab68-418c66f35b52" (UID: "0956636f-a168-4e48-ab68-418c66f35b52"). InnerVolumeSpecName "kube-api-access-cgtr8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:24:42.630782 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.630719 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "0956636f-a168-4e48-ab68-418c66f35b52" (UID: "0956636f-a168-4e48-ab68-418c66f35b52"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:24:42.630782 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.630731 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "0956636f-a168-4e48-ab68-418c66f35b52" (UID: "0956636f-a168-4e48-ab68-418c66f35b52"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:24:42.631470 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.631114 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0956636f-a168-4e48-ab68-418c66f35b52-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "0956636f-a168-4e48-ab68-418c66f35b52" (UID: "0956636f-a168-4e48-ab68-418c66f35b52"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:24:42.631549 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.631527 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "0956636f-a168-4e48-ab68-418c66f35b52" (UID: "0956636f-a168-4e48-ab68-418c66f35b52"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:24:42.631734 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.631716 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-config" (OuterVolumeSpecName: "config") pod "0956636f-a168-4e48-ab68-418c66f35b52" (UID: "0956636f-a168-4e48-ab68-418c66f35b52"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:24:42.631831 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.631818 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "0956636f-a168-4e48-ab68-418c66f35b52" (UID: "0956636f-a168-4e48-ab68-418c66f35b52"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:24:42.632752 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.632730 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "0956636f-a168-4e48-ab68-418c66f35b52" (UID: "0956636f-a168-4e48-ab68-418c66f35b52"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:24:42.640568 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.640544 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-web-config" (OuterVolumeSpecName: "web-config") pod "0956636f-a168-4e48-ab68-418c66f35b52" (UID: "0956636f-a168-4e48-ab68-418c66f35b52"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:24:42.728270 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.728236 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:42.728270 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.728268 2558 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-config\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:42.728270 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.728279 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0956636f-a168-4e48-ab68-418c66f35b52-prometheus-k8s-db\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:42.728495 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.728289 2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:42.728495 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.728299 2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-web-config\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:42.728495 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.728308 2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0956636f-a168-4e48-ab68-418c66f35b52-config-out\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:42.728495 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.728318 2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:42.728495 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.728326 2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0956636f-a168-4e48-ab68-418c66f35b52-tls-assets\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:42.728495 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.728334 2558 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-grpc-tls\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:42.728495 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.728342 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgtr8\" (UniqueName: \"kubernetes.io/projected/0956636f-a168-4e48-ab68-418c66f35b52-kube-api-access-cgtr8\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:42.728495 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.728352 2558 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-metrics-client-certs\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:42.728495 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.728361 2558 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:42.728495 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.728371 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:42.728495 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.728379 2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:42.728495 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.728388 2558 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:42.728495 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.728397 2558 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0956636f-a168-4e48-ab68-418c66f35b52-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:42.728495 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:42.728406 2558 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0956636f-a168-4e48-ab68-418c66f35b52-secret-kube-rbac-proxy\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:24:43.186092 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.186055 2558 generic.go:358] "Generic (PLEG): container finished" podID="0956636f-a168-4e48-ab68-418c66f35b52" containerID="c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3" exitCode=0 Jun 03 03:24:43.186092 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.186086 2558 generic.go:358] "Generic (PLEG): container finished" podID="0956636f-a168-4e48-ab68-418c66f35b52" containerID="2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa" exitCode=0 Jun 03 03:24:43.186092 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.186096 2558 generic.go:358] "Generic (PLEG): container finished" podID="0956636f-a168-4e48-ab68-418c66f35b52" containerID="297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf" exitCode=0 Jun 03 03:24:43.186092 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.186105 2558 generic.go:358] "Generic (PLEG): container finished" podID="0956636f-a168-4e48-ab68-418c66f35b52" containerID="3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac" exitCode=0 Jun 03 03:24:43.186422 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.186114 2558 generic.go:358] "Generic (PLEG): container finished" podID="0956636f-a168-4e48-ab68-418c66f35b52" containerID="dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e" exitCode=0 Jun 03 03:24:43.186422 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.186121 2558 generic.go:358] "Generic (PLEG): container finished" podID="0956636f-a168-4e48-ab68-418c66f35b52" containerID="e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba" exitCode=0 Jun 03 03:24:43.186422 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.186140 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0956636f-a168-4e48-ab68-418c66f35b52","Type":"ContainerDied","Data":"c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3"} Jun 03 03:24:43.186422 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.186183 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0956636f-a168-4e48-ab68-418c66f35b52","Type":"ContainerDied","Data":"2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa"} Jun 03 03:24:43.186422 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.186195 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0956636f-a168-4e48-ab68-418c66f35b52","Type":"ContainerDied","Data":"297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf"} Jun 03 03:24:43.186422 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.186183 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.186422 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.186205 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0956636f-a168-4e48-ab68-418c66f35b52","Type":"ContainerDied","Data":"3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac"} Jun 03 03:24:43.186422 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.186217 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0956636f-a168-4e48-ab68-418c66f35b52","Type":"ContainerDied","Data":"dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e"} Jun 03 03:24:43.186422 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.186227 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0956636f-a168-4e48-ab68-418c66f35b52","Type":"ContainerDied","Data":"e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba"} Jun 03 03:24:43.186422 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.186238 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0956636f-a168-4e48-ab68-418c66f35b52","Type":"ContainerDied","Data":"409e6f4a727891c2bfdb7bea8f23f2cfbc7384bffece8dee6608f28eac263a8c"} Jun 03 03:24:43.186422 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.186196 2558 scope.go:117] "RemoveContainer" containerID="c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3" Jun 03 03:24:43.194732 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.194712 2558 scope.go:117] "RemoveContainer" containerID="2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa" Jun 03 03:24:43.201639 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.201621 2558 scope.go:117] "RemoveContainer" containerID="297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf" Jun 03 03:24:43.208721 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.208700 2558 scope.go:117] "RemoveContainer" containerID="3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac" Jun 03 03:24:43.209393 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.209368 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 03:24:43.213823 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.213799 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 03:24:43.216321 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.216300 2558 scope.go:117] "RemoveContainer" containerID="dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e" Jun 03 03:24:43.222624 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.222603 2558 scope.go:117] "RemoveContainer" containerID="e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba" Jun 03 03:24:43.229574 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.229557 2558 scope.go:117] "RemoveContainer" containerID="b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91" Jun 03 03:24:43.235626 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.235598 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 03:24:43.235906 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.235890 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="init-config-reloader" Jun 03 03:24:43.235987 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.235910 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="init-config-reloader" Jun 03 03:24:43.235987 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.235925 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="alertmanager" Jun 03 03:24:43.235987 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.235935 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="alertmanager" Jun 03 03:24:43.235987 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.235946 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="kube-rbac-proxy" Jun 03 03:24:43.235987 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.235956 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="kube-rbac-proxy" Jun 03 03:24:43.235987 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.235967 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="kube-rbac-proxy-web" Jun 03 03:24:43.235987 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.235976 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="kube-rbac-proxy-web" Jun 03 03:24:43.235987 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.235985 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="prometheus" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236010 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="prometheus" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236022 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="init-config-reloader" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236031 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="init-config-reloader" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236042 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="thanos-sidecar" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236050 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="thanos-sidecar" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236063 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="config-reloader" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236071 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="config-reloader" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236081 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="prom-label-proxy" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236089 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="prom-label-proxy" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236100 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="kube-rbac-proxy-thanos" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236108 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="kube-rbac-proxy-thanos" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236120 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="kube-rbac-proxy-metric" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236129 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="kube-rbac-proxy-metric" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236140 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="kube-rbac-proxy-web" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236149 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="kube-rbac-proxy-web" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236158 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="kube-rbac-proxy" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236167 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="kube-rbac-proxy" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236177 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="config-reloader" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236186 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="config-reloader" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236225 2558 scope.go:117] "RemoveContainer" containerID="c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236262 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="kube-rbac-proxy" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236275 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="prom-label-proxy" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236286 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="thanos-sidecar" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236297 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="kube-rbac-proxy-web" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236308 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="kube-rbac-proxy-metric" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236316 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="kube-rbac-proxy" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236328 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="alertmanager" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236337 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="d7633780-55a5-4aa4-9ac1-450b56dfc51d" containerName="config-reloader" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236347 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="kube-rbac-proxy-thanos" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236358 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="config-reloader" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236368 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="prometheus" Jun 03 03:24:43.236376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236378 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="0956636f-a168-4e48-ab68-418c66f35b52" containerName="kube-rbac-proxy-web" Jun 03 03:24:43.237836 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:24:43.236486 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3\": container with ID starting with c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3 not found: ID does not exist" containerID="c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3" Jun 03 03:24:43.237836 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236511 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3"} err="failed to get container status \"c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3\": rpc error: code = NotFound desc = could not find container \"c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3\": container with ID starting with c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3 not found: ID does not exist" Jun 03 03:24:43.237836 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236543 2558 scope.go:117] "RemoveContainer" containerID="2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa" Jun 03 03:24:43.237836 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:24:43.236761 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa\": container with ID starting with 2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa not found: ID does not exist" containerID="2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa" Jun 03 03:24:43.237836 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236782 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa"} err="failed to get container status \"2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa\": rpc error: code = NotFound desc = could not find container \"2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa\": container with ID starting with 2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa not found: ID does not exist" Jun 03 03:24:43.237836 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.236798 2558 scope.go:117] "RemoveContainer" containerID="297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf" Jun 03 03:24:43.237836 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:24:43.237019 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf\": container with ID starting with 297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf not found: ID does not exist" containerID="297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf" Jun 03 03:24:43.237836 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.237039 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf"} err="failed to get container status \"297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf\": rpc error: code = NotFound desc = could not find container \"297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf\": container with ID starting with 297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf not found: ID does not exist" Jun 03 03:24:43.237836 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.237055 2558 scope.go:117] "RemoveContainer" containerID="3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac" Jun 03 03:24:43.237836 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:24:43.237286 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac\": container with ID starting with 3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac not found: ID does not exist" containerID="3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac" Jun 03 03:24:43.237836 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.237315 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac"} err="failed to get container status \"3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac\": rpc error: code = NotFound desc = could not find container \"3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac\": container with ID starting with 3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac not found: ID does not exist" Jun 03 03:24:43.237836 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.237336 2558 scope.go:117] "RemoveContainer" containerID="dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e" Jun 03 03:24:43.237836 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:24:43.237548 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e\": container with ID starting with dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e not found: ID does not exist" containerID="dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e" Jun 03 03:24:43.237836 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.237562 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e"} err="failed to get container status \"dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e\": rpc error: code = NotFound desc = could not find container \"dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e\": container with ID starting with dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e not found: ID does not exist" Jun 03 03:24:43.237836 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.237574 2558 scope.go:117] "RemoveContainer" containerID="e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba" Jun 03 03:24:43.237836 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:24:43.237744 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba\": container with ID starting with e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba not found: ID does not exist" containerID="e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba" Jun 03 03:24:43.238460 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.237759 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba"} err="failed to get container status \"e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba\": rpc error: code = NotFound desc = could not find container \"e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba\": container with ID starting with e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba not found: ID does not exist" Jun 03 03:24:43.238460 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.237770 2558 scope.go:117] "RemoveContainer" containerID="b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91" Jun 03 03:24:43.238460 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:24:43.237940 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91\": container with ID starting with b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91 not found: ID does not exist" containerID="b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91" Jun 03 03:24:43.238460 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.237956 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91"} err="failed to get container status \"b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91\": rpc error: code = NotFound desc = could not find container \"b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91\": container with ID starting with b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91 not found: ID does not exist" Jun 03 03:24:43.238460 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.237967 2558 scope.go:117] "RemoveContainer" containerID="c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3" Jun 03 03:24:43.238460 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.238150 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3"} err="failed to get container status \"c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3\": rpc error: code = NotFound desc = could not find container \"c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3\": container with ID starting with c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3 not found: ID does not exist" Jun 03 03:24:43.238460 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.238163 2558 scope.go:117] "RemoveContainer" containerID="2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa" Jun 03 03:24:43.238460 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.238337 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa"} err="failed to get container status \"2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa\": rpc error: code = NotFound desc = could not find container \"2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa\": container with ID starting with 2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa not found: ID does not exist" Jun 03 03:24:43.238460 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.238350 2558 scope.go:117] "RemoveContainer" containerID="297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf" Jun 03 03:24:43.242974 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.239094 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf"} err="failed to get container status \"297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf\": rpc error: code = NotFound desc = could not find container \"297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf\": container with ID starting with 297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf not found: ID does not exist" Jun 03 03:24:43.242974 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.239129 2558 scope.go:117] "RemoveContainer" containerID="3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac" Jun 03 03:24:43.243416 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.243390 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac"} err="failed to get container status \"3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac\": rpc error: code = NotFound desc = could not find container \"3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac\": container with ID starting with 3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac not found: ID does not exist" Jun 03 03:24:43.243525 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.243419 2558 scope.go:117] "RemoveContainer" containerID="dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e" Jun 03 03:24:43.243660 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.243641 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e"} err="failed to get container status \"dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e\": rpc error: code = NotFound desc = could not find container \"dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e\": container with ID starting with dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e not found: ID does not exist" Jun 03 03:24:43.243712 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.243662 2558 scope.go:117] "RemoveContainer" containerID="e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba" Jun 03 03:24:43.243886 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.243855 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba"} err="failed to get container status \"e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba\": rpc error: code = NotFound desc = could not find container \"e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba\": container with ID starting with e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba not found: ID does not exist" Jun 03 03:24:43.243886 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.243881 2558 scope.go:117] "RemoveContainer" containerID="b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91" Jun 03 03:24:43.244102 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.244079 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.244215 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.244197 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91"} err="failed to get container status \"b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91\": rpc error: code = NotFound desc = could not find container \"b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91\": container with ID starting with b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91 not found: ID does not exist" Jun 03 03:24:43.244293 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.244218 2558 scope.go:117] "RemoveContainer" containerID="c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3" Jun 03 03:24:43.244586 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.244558 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3"} err="failed to get container status \"c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3\": rpc error: code = NotFound desc = could not find container \"c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3\": container with ID starting with c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3 not found: ID does not exist" Jun 03 03:24:43.244586 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.244589 2558 scope.go:117] "RemoveContainer" containerID="2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa" Jun 03 03:24:43.244883 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.244846 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa"} err="failed to get container status \"2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa\": rpc error: code = NotFound desc = could not find container \"2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa\": container with ID starting with 2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa not found: ID does not exist" Jun 03 03:24:43.244883 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.244874 2558 scope.go:117] "RemoveContainer" containerID="297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf" Jun 03 03:24:43.245131 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.245110 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf"} err="failed to get container status \"297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf\": rpc error: code = NotFound desc = could not find container \"297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf\": container with ID starting with 297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf not found: ID does not exist" Jun 03 03:24:43.245131 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.245131 2558 scope.go:117] "RemoveContainer" containerID="3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac" Jun 03 03:24:43.245376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.245359 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac"} err="failed to get container status \"3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac\": rpc error: code = NotFound desc = could not find container \"3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac\": container with ID starting with 3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac not found: ID does not exist" Jun 03 03:24:43.245376 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.245376 2558 scope.go:117] "RemoveContainer" containerID="dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e" Jun 03 03:24:43.245645 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.245621 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e"} err="failed to get container status \"dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e\": rpc error: code = NotFound desc = could not find container \"dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e\": container with ID starting with dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e not found: ID does not exist" Jun 03 03:24:43.245694 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.245648 2558 scope.go:117] "RemoveContainer" containerID="e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba" Jun 03 03:24:43.245982 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.245951 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba"} err="failed to get container status \"e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba\": rpc error: code = NotFound desc = could not find container \"e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba\": container with ID starting with e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba not found: ID does not exist" Jun 03 03:24:43.246105 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.246014 2558 scope.go:117] "RemoveContainer" containerID="b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91" Jun 03 03:24:43.246351 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.246324 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91"} err="failed to get container status \"b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91\": rpc error: code = NotFound desc = could not find container \"b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91\": container with ID starting with b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91 not found: ID does not exist" Jun 03 03:24:43.246446 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.246356 2558 scope.go:117] "RemoveContainer" containerID="c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3" Jun 03 03:24:43.246844 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.246508 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 03:24:43.246844 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.246529 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-75pp2\"" Jun 03 03:24:43.246844 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.246663 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 03:24:43.246844 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.246684 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3"} err="failed to get container status \"c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3\": rpc error: code = NotFound desc = could not find container \"c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3\": container with ID starting with c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3 not found: ID does not exist" Jun 03 03:24:43.246844 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.246722 2558 scope.go:117] "RemoveContainer" containerID="2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa" Jun 03 03:24:43.246844 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.246785 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 03:24:43.246844 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.246804 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 03:24:43.246844 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.246818 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 03:24:43.247532 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.246936 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa"} err="failed to get container status \"2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa\": rpc error: code = NotFound desc = could not find container \"2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa\": container with ID starting with 2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa not found: ID does not exist" Jun 03 03:24:43.247532 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.246969 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 03:24:43.247532 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.246980 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 03:24:43.247532 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.247030 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 03:24:43.247532 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.247050 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 03:24:43.247532 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.246960 2558 scope.go:117] "RemoveContainer" containerID="297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf" Jun 03 03:24:43.247532 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.247195 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 03:24:43.247532 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.247327 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf"} err="failed to get container status \"297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf\": rpc error: code = NotFound desc = could not find container \"297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf\": container with ID starting with 297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf not found: ID does not exist" Jun 03 03:24:43.247532 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.247349 2558 scope.go:117] "RemoveContainer" containerID="3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac" Jun 03 03:24:43.247532 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.247376 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-pgdub699k7mb\"" Jun 03 03:24:43.248508 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.247591 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac"} err="failed to get container status \"3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac\": rpc error: code = NotFound desc = could not find container \"3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac\": container with ID starting with 3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac not found: ID does not exist" Jun 03 03:24:43.248508 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.247612 2558 scope.go:117] "RemoveContainer" containerID="dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e" Jun 03 03:24:43.248508 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.247955 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e"} err="failed to get container status \"dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e\": rpc error: code = NotFound desc = could not find container \"dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e\": container with ID starting with dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e not found: ID does not exist" Jun 03 03:24:43.248508 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.248012 2558 scope.go:117] "RemoveContainer" containerID="e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba" Jun 03 03:24:43.248508 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.248351 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba"} err="failed to get container status \"e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba\": rpc error: code = NotFound desc = could not find container \"e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba\": container with ID starting with e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba not found: ID does not exist" Jun 03 03:24:43.248508 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.248402 2558 scope.go:117] "RemoveContainer" containerID="b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91" Jun 03 03:24:43.249497 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.248886 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91"} err="failed to get container status \"b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91\": rpc error: code = NotFound desc = could not find container \"b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91\": container with ID starting with b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91 not found: ID does not exist" Jun 03 03:24:43.249497 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.248920 2558 scope.go:117] "RemoveContainer" containerID="c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3" Jun 03 03:24:43.249497 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.249209 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3"} err="failed to get container status \"c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3\": rpc error: code = NotFound desc = could not find container \"c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3\": container with ID starting with c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3 not found: ID does not exist" Jun 03 03:24:43.249497 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.249231 2558 scope.go:117] "RemoveContainer" containerID="2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa" Jun 03 03:24:43.249670 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.249495 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa"} err="failed to get container status \"2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa\": rpc error: code = NotFound desc = could not find container \"2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa\": container with ID starting with 2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa not found: ID does not exist" Jun 03 03:24:43.249670 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.249525 2558 scope.go:117] "RemoveContainer" containerID="297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf" Jun 03 03:24:43.249807 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.249782 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf"} err="failed to get container status \"297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf\": rpc error: code = NotFound desc = could not find container \"297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf\": container with ID starting with 297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf not found: ID does not exist" Jun 03 03:24:43.249874 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.249832 2558 scope.go:117] "RemoveContainer" containerID="3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac" Jun 03 03:24:43.250504 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.250091 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac"} err="failed to get container status \"3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac\": rpc error: code = NotFound desc = could not find container \"3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac\": container with ID starting with 3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac not found: ID does not exist" Jun 03 03:24:43.250504 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.250111 2558 scope.go:117] "RemoveContainer" containerID="dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e" Jun 03 03:24:43.250504 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.250334 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e"} err="failed to get container status \"dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e\": rpc error: code = NotFound desc = could not find container \"dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e\": container with ID starting with dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e not found: ID does not exist" Jun 03 03:24:43.250504 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.250357 2558 scope.go:117] "RemoveContainer" containerID="e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba" Jun 03 03:24:43.251398 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.251379 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 03:24:43.251541 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.251520 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 03:24:43.251839 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.251810 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba"} err="failed to get container status \"e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba\": rpc error: code = NotFound desc = could not find container \"e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba\": container with ID starting with e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba not found: ID does not exist" Jun 03 03:24:43.251839 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.251840 2558 scope.go:117] "RemoveContainer" containerID="b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91" Jun 03 03:24:43.252284 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.252259 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91"} err="failed to get container status \"b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91\": rpc error: code = NotFound desc = could not find container \"b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91\": container with ID starting with b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91 not found: ID does not exist" Jun 03 03:24:43.252284 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.252287 2558 scope.go:117] "RemoveContainer" containerID="c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3" Jun 03 03:24:43.252599 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.252556 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3"} err="failed to get container status \"c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3\": rpc error: code = NotFound desc = could not find container \"c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3\": container with ID starting with c293c294817f4e0d28d51a682a0f654ff9e29c9834489b11745895e84e8e20e3 not found: ID does not exist" Jun 03 03:24:43.252599 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.252582 2558 scope.go:117] "RemoveContainer" containerID="2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa" Jun 03 03:24:43.253150 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.252903 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa"} err="failed to get container status \"2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa\": rpc error: code = NotFound desc = could not find container \"2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa\": container with ID starting with 2d2da89cfb78fd584d027e9e1d2ba00e5b70034bc2122081a28517193dc724fa not found: ID does not exist" Jun 03 03:24:43.253150 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.252926 2558 scope.go:117] "RemoveContainer" containerID="297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf" Jun 03 03:24:43.253289 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.253235 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf"} err="failed to get container status \"297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf\": rpc error: code = NotFound desc = could not find container \"297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf\": container with ID starting with 297b8cd18daeebc668f6bd1a47ac050d47eaa0a72d663051292e413404b9bccf not found: ID does not exist" Jun 03 03:24:43.253289 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.253260 2558 scope.go:117] "RemoveContainer" containerID="3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac" Jun 03 03:24:43.253600 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.253576 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac"} err="failed to get container status \"3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac\": rpc error: code = NotFound desc = could not find container \"3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac\": container with ID starting with 3cb9430b4bfbee02aa1511b911cc2b64cefcecd9d3f562917a2f3caffcb251ac not found: ID does not exist" Jun 03 03:24:43.253688 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.253599 2558 scope.go:117] "RemoveContainer" containerID="dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e" Jun 03 03:24:43.253920 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.253873 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e"} err="failed to get container status \"dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e\": rpc error: code = NotFound desc = could not find container \"dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e\": container with ID starting with dc020449214b7db28b31a3ed4df29db3197054ea733b5ea53a37ee593d8f104e not found: ID does not exist" Jun 03 03:24:43.253920 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.253899 2558 scope.go:117] "RemoveContainer" containerID="e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba" Jun 03 03:24:43.254177 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.254158 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba"} err="failed to get container status \"e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba\": rpc error: code = NotFound desc = could not find container \"e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba\": container with ID starting with e7e757de6244a9643e57e6212bfbe711936face2f8bca7f8d07352c5c5de15ba not found: ID does not exist" Jun 03 03:24:43.254289 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.254178 2558 scope.go:117] "RemoveContainer" containerID="b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91" Jun 03 03:24:43.254345 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.254317 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 03:24:43.254489 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.254468 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91"} err="failed to get container status \"b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91\": rpc error: code = NotFound desc = could not find container \"b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91\": container with ID starting with b6ec083dad15d5deaebf0e51b9a02c5675c3ea0989571348ec33a69787e3ac91 not found: ID does not exist" Jun 03 03:24:43.334972 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.334928 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.334972 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.334974 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/971efc38-e3c8-4574-aca6-d139daa85ee2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.335250 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.335026 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x488\" (UniqueName: \"kubernetes.io/projected/971efc38-e3c8-4574-aca6-d139daa85ee2-kube-api-access-4x488\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.335250 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.335053 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.335250 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.335088 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.335250 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.335122 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/971efc38-e3c8-4574-aca6-d139daa85ee2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.335250 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.335169 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/971efc38-e3c8-4574-aca6-d139daa85ee2-config-out\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.335250 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.335192 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.335250 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.335218 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/971efc38-e3c8-4574-aca6-d139daa85ee2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.335250 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.335242 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/971efc38-e3c8-4574-aca6-d139daa85ee2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.335631 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.335266 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-web-config\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.335631 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.335308 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/971efc38-e3c8-4574-aca6-d139daa85ee2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.335631 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.335371 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.335631 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.335403 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.335631 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.335441 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.335631 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.335466 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/971efc38-e3c8-4574-aca6-d139daa85ee2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.335631 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.335539 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/971efc38-e3c8-4574-aca6-d139daa85ee2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.335631 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.335565 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-config\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.369771 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.369742 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0956636f-a168-4e48-ab68-418c66f35b52" path="/var/lib/kubelet/pods/0956636f-a168-4e48-ab68-418c66f35b52/volumes" Jun 03 03:24:43.436489 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.436404 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/971efc38-e3c8-4574-aca6-d139daa85ee2-config-out\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.436489 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.436444 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.436681 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.436570 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/971efc38-e3c8-4574-aca6-d139daa85ee2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.436681 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.436605 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/971efc38-e3c8-4574-aca6-d139daa85ee2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.436681 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.436626 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-web-config\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.436834 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.436678 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/971efc38-e3c8-4574-aca6-d139daa85ee2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.436834 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.436716 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.437104 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.437058 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.437200 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.437117 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.437200 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.437146 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/971efc38-e3c8-4574-aca6-d139daa85ee2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.437774 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.437216 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/971efc38-e3c8-4574-aca6-d139daa85ee2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.437774 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.437266 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-config\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.437774 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.437312 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.437774 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.437339 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/971efc38-e3c8-4574-aca6-d139daa85ee2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.437774 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.437363 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4x488\" (UniqueName: \"kubernetes.io/projected/971efc38-e3c8-4574-aca6-d139daa85ee2-kube-api-access-4x488\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.437774 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.437362 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/971efc38-e3c8-4574-aca6-d139daa85ee2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.437774 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.437640 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/971efc38-e3c8-4574-aca6-d139daa85ee2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.438617 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.437796 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/971efc38-e3c8-4574-aca6-d139daa85ee2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.438617 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.437845 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.438617 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.437892 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.438617 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.437955 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/971efc38-e3c8-4574-aca6-d139daa85ee2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.438907 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.438623 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/971efc38-e3c8-4574-aca6-d139daa85ee2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.439398 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.439355 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/971efc38-e3c8-4574-aca6-d139daa85ee2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.440649 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.439598 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/971efc38-e3c8-4574-aca6-d139daa85ee2-config-out\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.440649 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.440242 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-config\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.440649 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.440569 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/971efc38-e3c8-4574-aca6-d139daa85ee2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.440850 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.440701 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.441045 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.441028 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-web-config\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.441388 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.441336 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.441575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.441552 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.441840 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.441816 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.441919 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.441902 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.442199 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.442178 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/971efc38-e3c8-4574-aca6-d139daa85ee2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.443126 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.443100 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.443263 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.443245 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/971efc38-e3c8-4574-aca6-d139daa85ee2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.445239 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.445220 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x488\" (UniqueName: \"kubernetes.io/projected/971efc38-e3c8-4574-aca6-d139daa85ee2-kube-api-access-4x488\") pod \"prometheus-k8s-0\" (UID: \"971efc38-e3c8-4574-aca6-d139daa85ee2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.556728 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.556684 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:43.690210 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:43.690114 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 03:24:43.694772 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:24:43.694732 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod971efc38_e3c8_4574_aca6_d139daa85ee2.slice/crio-2ab4f40295ee11742c30d45d0a4a64893cb6c16625efa15fa0743add0cf646a5 WatchSource:0}: Error finding container 2ab4f40295ee11742c30d45d0a4a64893cb6c16625efa15fa0743add0cf646a5: Status 404 returned error can't find the container with id 2ab4f40295ee11742c30d45d0a4a64893cb6c16625efa15fa0743add0cf646a5 Jun 03 03:24:44.191456 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:44.191368 2558 generic.go:358] "Generic (PLEG): container finished" podID="971efc38-e3c8-4574-aca6-d139daa85ee2" containerID="ae9d1dd060edc71f77cb076c5dae864ca59905ac60f637006e3ba71ed6c8d10b" exitCode=0 Jun 03 03:24:44.191630 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:44.191451 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"971efc38-e3c8-4574-aca6-d139daa85ee2","Type":"ContainerDied","Data":"ae9d1dd060edc71f77cb076c5dae864ca59905ac60f637006e3ba71ed6c8d10b"} Jun 03 03:24:44.191630 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:44.191483 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"971efc38-e3c8-4574-aca6-d139daa85ee2","Type":"ContainerStarted","Data":"2ab4f40295ee11742c30d45d0a4a64893cb6c16625efa15fa0743add0cf646a5"} Jun 03 03:24:45.200379 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:45.200347 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"971efc38-e3c8-4574-aca6-d139daa85ee2","Type":"ContainerStarted","Data":"fe9d4730c5964f6c7e6a47e2d0e1337e037fb2754a629c367d148fe11b25117b"} Jun 03 03:24:45.200379 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:45.200382 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"971efc38-e3c8-4574-aca6-d139daa85ee2","Type":"ContainerStarted","Data":"2d3abcd9d9a8df34811d9c50c3e63d63a2ac64324b33ac744546acbbcf0fe309"} Jun 03 03:24:45.200787 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:45.200392 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"971efc38-e3c8-4574-aca6-d139daa85ee2","Type":"ContainerStarted","Data":"e9163cdb145589d11e64086ca888034e32af32968cd8a582fdc638bde2b248f1"} Jun 03 03:24:45.200787 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:45.200401 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"971efc38-e3c8-4574-aca6-d139daa85ee2","Type":"ContainerStarted","Data":"61133056bfb42c31b7ef3ee599afe25f1c61ac3a5d1ce386512faa80abd6a8fe"} Jun 03 03:24:45.200787 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:45.200409 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"971efc38-e3c8-4574-aca6-d139daa85ee2","Type":"ContainerStarted","Data":"5054f450599d8a43d0017b985821ed39f1be40054ef72f31e8b53558ec1fb74c"} Jun 03 03:24:45.200787 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:45.200420 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"971efc38-e3c8-4574-aca6-d139daa85ee2","Type":"ContainerStarted","Data":"42eb5d48260d0d00c9c4714f386ded9ca974040ed9a7bcfd9cb516e1bff784f6"} Jun 03 03:24:45.225070 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:45.224984 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.224962483 podStartE2EDuration="2.224962483s" podCreationTimestamp="2026-06-03 03:24:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:24:45.2220235 +0000 UTC m=+260.393933370" watchObservedRunningTime="2026-06-03 03:24:45.224962483 +0000 UTC m=+260.396872356" Jun 03 03:24:48.557187 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:48.557138 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:24:57.312061 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:24:57.312005 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79598bccf6-bvlf5"] Jun 03 03:25:22.337038 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:22.336955 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-79598bccf6-bvlf5" podUID="f88814b5-a21e-4c3a-890f-c21a5fac5ba9" containerName="console" containerID="cri-o://ccc88d490d695d77e2042755c22d01277ae12f3841f3502a7b9454ee76c22c19" gracePeriod=15 Jun 03 03:25:22.574881 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:22.574861 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-79598bccf6-bvlf5_f88814b5-a21e-4c3a-890f-c21a5fac5ba9/console/0.log" Jun 03 03:25:22.574971 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:22.574925 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:25:22.651946 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:22.651885 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-console-oauth-config\") pod \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " Jun 03 03:25:22.651946 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:22.651924 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-service-ca\") pod \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " Jun 03 03:25:22.651946 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:22.651947 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-oauth-serving-cert\") pod \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " Jun 03 03:25:22.652183 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:22.651973 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-console-serving-cert\") pod \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " Jun 03 03:25:22.652183 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:22.652014 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-trusted-ca-bundle\") pod \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " Jun 03 03:25:22.652183 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:22.652050 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-console-config\") pod \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " Jun 03 03:25:22.652183 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:22.652094 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6hcj\" (UniqueName: \"kubernetes.io/projected/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-kube-api-access-g6hcj\") pod \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\" (UID: \"f88814b5-a21e-4c3a-890f-c21a5fac5ba9\") " Jun 03 03:25:22.652402 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:22.652367 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f88814b5-a21e-4c3a-890f-c21a5fac5ba9" (UID: "f88814b5-a21e-4c3a-890f-c21a5fac5ba9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:25:22.652459 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:22.652428 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f88814b5-a21e-4c3a-890f-c21a5fac5ba9" (UID: "f88814b5-a21e-4c3a-890f-c21a5fac5ba9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:25:22.652459 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:22.652437 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-service-ca" (OuterVolumeSpecName: "service-ca") pod "f88814b5-a21e-4c3a-890f-c21a5fac5ba9" (UID: "f88814b5-a21e-4c3a-890f-c21a5fac5ba9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:25:22.652535 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:22.652456 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-console-config" (OuterVolumeSpecName: "console-config") pod "f88814b5-a21e-4c3a-890f-c21a5fac5ba9" (UID: "f88814b5-a21e-4c3a-890f-c21a5fac5ba9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:25:22.654169 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:22.654149 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-kube-api-access-g6hcj" (OuterVolumeSpecName: "kube-api-access-g6hcj") pod "f88814b5-a21e-4c3a-890f-c21a5fac5ba9" (UID: "f88814b5-a21e-4c3a-890f-c21a5fac5ba9"). InnerVolumeSpecName "kube-api-access-g6hcj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:25:22.654231 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:22.654210 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f88814b5-a21e-4c3a-890f-c21a5fac5ba9" (UID: "f88814b5-a21e-4c3a-890f-c21a5fac5ba9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:25:22.654292 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:22.654271 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f88814b5-a21e-4c3a-890f-c21a5fac5ba9" (UID: "f88814b5-a21e-4c3a-890f-c21a5fac5ba9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:25:22.752779 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:22.752750 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-trusted-ca-bundle\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:25:22.752779 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:22.752776 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-console-config\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:25:22.752779 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:22.752787 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6hcj\" (UniqueName: \"kubernetes.io/projected/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-kube-api-access-g6hcj\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:25:22.753016 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:22.752796 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-console-oauth-config\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:25:22.753016 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:22.752807 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-service-ca\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:25:22.753016 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:22.752816 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-oauth-serving-cert\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:25:22.753016 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:22.752824 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f88814b5-a21e-4c3a-890f-c21a5fac5ba9-console-serving-cert\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:25:23.310176 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:23.310143 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-79598bccf6-bvlf5_f88814b5-a21e-4c3a-890f-c21a5fac5ba9/console/0.log" Jun 03 03:25:23.310412 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:23.310182 2558 generic.go:358] "Generic (PLEG): container finished" podID="f88814b5-a21e-4c3a-890f-c21a5fac5ba9" containerID="ccc88d490d695d77e2042755c22d01277ae12f3841f3502a7b9454ee76c22c19" exitCode=2 Jun 03 03:25:23.310412 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:23.310248 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79598bccf6-bvlf5" Jun 03 03:25:23.310412 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:23.310283 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79598bccf6-bvlf5" event={"ID":"f88814b5-a21e-4c3a-890f-c21a5fac5ba9","Type":"ContainerDied","Data":"ccc88d490d695d77e2042755c22d01277ae12f3841f3502a7b9454ee76c22c19"} Jun 03 03:25:23.310412 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:23.310337 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79598bccf6-bvlf5" event={"ID":"f88814b5-a21e-4c3a-890f-c21a5fac5ba9","Type":"ContainerDied","Data":"6410b6ff6d1c62160974aad49e1f20cdc662b3207eb2e0b51181d410ca674e57"} Jun 03 03:25:23.310412 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:23.310358 2558 scope.go:117] "RemoveContainer" containerID="ccc88d490d695d77e2042755c22d01277ae12f3841f3502a7b9454ee76c22c19" Jun 03 03:25:23.319127 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:23.319110 2558 scope.go:117] "RemoveContainer" containerID="ccc88d490d695d77e2042755c22d01277ae12f3841f3502a7b9454ee76c22c19" Jun 03 03:25:23.319372 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:25:23.319352 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccc88d490d695d77e2042755c22d01277ae12f3841f3502a7b9454ee76c22c19\": container with ID starting with ccc88d490d695d77e2042755c22d01277ae12f3841f3502a7b9454ee76c22c19 not found: ID does not exist" containerID="ccc88d490d695d77e2042755c22d01277ae12f3841f3502a7b9454ee76c22c19" Jun 03 03:25:23.319435 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:23.319379 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccc88d490d695d77e2042755c22d01277ae12f3841f3502a7b9454ee76c22c19"} err="failed to get container status \"ccc88d490d695d77e2042755c22d01277ae12f3841f3502a7b9454ee76c22c19\": rpc error: code = NotFound desc = could not find container \"ccc88d490d695d77e2042755c22d01277ae12f3841f3502a7b9454ee76c22c19\": container with ID starting with ccc88d490d695d77e2042755c22d01277ae12f3841f3502a7b9454ee76c22c19 not found: ID does not exist" Jun 03 03:25:23.329503 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:23.329483 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79598bccf6-bvlf5"] Jun 03 03:25:23.333241 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:23.333221 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79598bccf6-bvlf5"] Jun 03 03:25:23.369851 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:23.369829 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f88814b5-a21e-4c3a-890f-c21a5fac5ba9" path="/var/lib/kubelet/pods/f88814b5-a21e-4c3a-890f-c21a5fac5ba9/volumes" Jun 03 03:25:25.289007 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:25.288962 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-tq7jg_3f53d812-13d2-4aae-9673-a8b3c90386e9/console-operator/1.log" Jun 03 03:25:25.289482 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:25.289389 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-tq7jg_3f53d812-13d2-4aae-9673-a8b3c90386e9/console-operator/1.log" Jun 03 03:25:25.303135 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:25.303113 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/ovn-acl-logging/0.log" Jun 03 03:25:25.303242 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:25.303182 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/ovn-acl-logging/0.log" Jun 03 03:25:25.305658 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:25.305641 2558 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 03:25:43.557202 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:43.557170 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:25:43.572281 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:43.572258 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:25:44.386670 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:25:44.386640 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 03:26:24.109026 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:26:24.108940 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-6rg4l"] Jun 03 03:26:24.109443 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:26:24.109229 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f88814b5-a21e-4c3a-890f-c21a5fac5ba9" containerName="console" Jun 03 03:26:24.109443 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:26:24.109239 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f88814b5-a21e-4c3a-890f-c21a5fac5ba9" containerName="console" Jun 03 03:26:24.109443 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:26:24.109293 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="f88814b5-a21e-4c3a-890f-c21a5fac5ba9" containerName="console" Jun 03 03:26:24.112158 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:26:24.112143 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rg4l" Jun 03 03:26:24.114130 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:26:24.114107 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 03:26:24.118687 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:26:24.118661 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6rg4l"] Jun 03 03:26:24.193418 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:26:24.193394 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7320dc64-d3ac-4db4-9251-6801ac0cc6c8-original-pull-secret\") pod \"global-pull-secret-syncer-6rg4l\" (UID: \"7320dc64-d3ac-4db4-9251-6801ac0cc6c8\") " pod="kube-system/global-pull-secret-syncer-6rg4l" Jun 03 03:26:24.193532 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:26:24.193434 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7320dc64-d3ac-4db4-9251-6801ac0cc6c8-dbus\") pod \"global-pull-secret-syncer-6rg4l\" (UID: \"7320dc64-d3ac-4db4-9251-6801ac0cc6c8\") " pod="kube-system/global-pull-secret-syncer-6rg4l" Jun 03 03:26:24.193585 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:26:24.193521 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7320dc64-d3ac-4db4-9251-6801ac0cc6c8-kubelet-config\") pod \"global-pull-secret-syncer-6rg4l\" (UID: \"7320dc64-d3ac-4db4-9251-6801ac0cc6c8\") " pod="kube-system/global-pull-secret-syncer-6rg4l" Jun 03 03:26:24.294401 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:26:24.294375 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7320dc64-d3ac-4db4-9251-6801ac0cc6c8-dbus\") pod \"global-pull-secret-syncer-6rg4l\" (UID: \"7320dc64-d3ac-4db4-9251-6801ac0cc6c8\") " pod="kube-system/global-pull-secret-syncer-6rg4l" Jun 03 03:26:24.294502 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:26:24.294448 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7320dc64-d3ac-4db4-9251-6801ac0cc6c8-kubelet-config\") pod \"global-pull-secret-syncer-6rg4l\" (UID: \"7320dc64-d3ac-4db4-9251-6801ac0cc6c8\") " pod="kube-system/global-pull-secret-syncer-6rg4l" Jun 03 03:26:24.294502 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:26:24.294486 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7320dc64-d3ac-4db4-9251-6801ac0cc6c8-original-pull-secret\") pod \"global-pull-secret-syncer-6rg4l\" (UID: \"7320dc64-d3ac-4db4-9251-6801ac0cc6c8\") " pod="kube-system/global-pull-secret-syncer-6rg4l" Jun 03 03:26:24.294583 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:26:24.294563 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7320dc64-d3ac-4db4-9251-6801ac0cc6c8-kubelet-config\") pod \"global-pull-secret-syncer-6rg4l\" (UID: \"7320dc64-d3ac-4db4-9251-6801ac0cc6c8\") " pod="kube-system/global-pull-secret-syncer-6rg4l" Jun 03 03:26:24.294622 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:26:24.294570 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7320dc64-d3ac-4db4-9251-6801ac0cc6c8-dbus\") pod \"global-pull-secret-syncer-6rg4l\" (UID: \"7320dc64-d3ac-4db4-9251-6801ac0cc6c8\") " pod="kube-system/global-pull-secret-syncer-6rg4l" Jun 03 03:26:24.296644 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:26:24.296621 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7320dc64-d3ac-4db4-9251-6801ac0cc6c8-original-pull-secret\") pod \"global-pull-secret-syncer-6rg4l\" (UID: \"7320dc64-d3ac-4db4-9251-6801ac0cc6c8\") " pod="kube-system/global-pull-secret-syncer-6rg4l" Jun 03 03:26:24.421670 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:26:24.421600 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rg4l" Jun 03 03:26:24.540948 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:26:24.540899 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6rg4l"] Jun 03 03:26:24.547059 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:26:24.547037 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 03:26:25.477484 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:26:25.477447 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6rg4l" event={"ID":"7320dc64-d3ac-4db4-9251-6801ac0cc6c8","Type":"ContainerStarted","Data":"2d84f8999645979a4dc8c981fa9a78831874e3f88765e0a71556b909f93ceb99"} Jun 03 03:26:29.489284 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:26:29.489250 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6rg4l" event={"ID":"7320dc64-d3ac-4db4-9251-6801ac0cc6c8","Type":"ContainerStarted","Data":"b51e57f0c5b3194add04dc65a0ea0965e174002b74808a81347dc309808787e2"} Jun 03 03:26:29.503877 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:26:29.503832 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6rg4l" podStartSLOduration=1.151399917 podStartE2EDuration="5.503819327s" podCreationTimestamp="2026-06-03 03:26:24 +0000 UTC" firstStartedPulling="2026-06-03 03:26:24.547215142 +0000 UTC m=+359.719124998" lastFinishedPulling="2026-06-03 03:26:28.899634558 +0000 UTC m=+364.071544408" observedRunningTime="2026-06-03 03:26:29.501696587 +0000 UTC m=+364.673606459" watchObservedRunningTime="2026-06-03 03:26:29.503819327 +0000 UTC m=+364.675729199" Jun 03 03:27:44.450792 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:44.450713 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68f864588-n2652"] Jun 03 03:27:44.452943 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:44.452926 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-n2652" Jun 03 03:27:44.455199 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:44.455179 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 03:27:44.455322 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:44.455249 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nqt2b\"" Jun 03 03:27:44.455497 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:44.455480 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 03:27:44.455579 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:44.455481 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 03:27:44.458426 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:44.458406 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 03:27:44.464723 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:44.464697 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68f864588-n2652"] Jun 03 03:27:44.486368 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:44.486343 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xgk4\" (UniqueName: \"kubernetes.io/projected/9cc1571f-d011-4030-9fbe-33388b5ac07d-kube-api-access-5xgk4\") pod \"opendatahub-operator-controller-manager-68f864588-n2652\" (UID: \"9cc1571f-d011-4030-9fbe-33388b5ac07d\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-n2652" Jun 03 03:27:44.486465 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:44.486439 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cc1571f-d011-4030-9fbe-33388b5ac07d-tmp\") pod \"opendatahub-operator-controller-manager-68f864588-n2652\" (UID: \"9cc1571f-d011-4030-9fbe-33388b5ac07d\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-n2652" Jun 03 03:27:44.486519 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:44.486479 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9cc1571f-d011-4030-9fbe-33388b5ac07d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68f864588-n2652\" (UID: \"9cc1571f-d011-4030-9fbe-33388b5ac07d\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-n2652" Jun 03 03:27:44.486519 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:44.486514 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9cc1571f-d011-4030-9fbe-33388b5ac07d-manifests\") pod \"opendatahub-operator-controller-manager-68f864588-n2652\" (UID: \"9cc1571f-d011-4030-9fbe-33388b5ac07d\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-n2652" Jun 03 03:27:44.486604 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:44.486531 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9cc1571f-d011-4030-9fbe-33388b5ac07d-webhook-cert\") pod \"opendatahub-operator-controller-manager-68f864588-n2652\" (UID: \"9cc1571f-d011-4030-9fbe-33388b5ac07d\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-n2652" Jun 03 03:27:44.587879 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:44.587845 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cc1571f-d011-4030-9fbe-33388b5ac07d-tmp\") pod \"opendatahub-operator-controller-manager-68f864588-n2652\" (UID: \"9cc1571f-d011-4030-9fbe-33388b5ac07d\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-n2652" Jun 03 03:27:44.588065 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:44.587898 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9cc1571f-d011-4030-9fbe-33388b5ac07d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68f864588-n2652\" (UID: \"9cc1571f-d011-4030-9fbe-33388b5ac07d\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-n2652" Jun 03 03:27:44.588065 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:44.587931 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9cc1571f-d011-4030-9fbe-33388b5ac07d-manifests\") pod \"opendatahub-operator-controller-manager-68f864588-n2652\" (UID: \"9cc1571f-d011-4030-9fbe-33388b5ac07d\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-n2652" Jun 03 03:27:44.588065 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:44.587954 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9cc1571f-d011-4030-9fbe-33388b5ac07d-webhook-cert\") pod \"opendatahub-operator-controller-manager-68f864588-n2652\" (UID: \"9cc1571f-d011-4030-9fbe-33388b5ac07d\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-n2652" Jun 03 03:27:44.588253 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:44.588108 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5xgk4\" (UniqueName: \"kubernetes.io/projected/9cc1571f-d011-4030-9fbe-33388b5ac07d-kube-api-access-5xgk4\") pod \"opendatahub-operator-controller-manager-68f864588-n2652\" (UID: \"9cc1571f-d011-4030-9fbe-33388b5ac07d\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-n2652" Jun 03 03:27:44.588340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:44.588309 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9cc1571f-d011-4030-9fbe-33388b5ac07d-manifests\") pod \"opendatahub-operator-controller-manager-68f864588-n2652\" (UID: \"9cc1571f-d011-4030-9fbe-33388b5ac07d\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-n2652" Jun 03 03:27:44.590108 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:44.590088 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cc1571f-d011-4030-9fbe-33388b5ac07d-tmp\") pod \"opendatahub-operator-controller-manager-68f864588-n2652\" (UID: \"9cc1571f-d011-4030-9fbe-33388b5ac07d\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-n2652" Jun 03 03:27:44.590349 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:44.590329 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9cc1571f-d011-4030-9fbe-33388b5ac07d-webhook-cert\") pod \"opendatahub-operator-controller-manager-68f864588-n2652\" (UID: \"9cc1571f-d011-4030-9fbe-33388b5ac07d\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-n2652" Jun 03 03:27:44.590413 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:44.590330 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9cc1571f-d011-4030-9fbe-33388b5ac07d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68f864588-n2652\" (UID: \"9cc1571f-d011-4030-9fbe-33388b5ac07d\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-n2652" Jun 03 03:27:44.599354 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:44.599329 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xgk4\" (UniqueName: \"kubernetes.io/projected/9cc1571f-d011-4030-9fbe-33388b5ac07d-kube-api-access-5xgk4\") pod \"opendatahub-operator-controller-manager-68f864588-n2652\" (UID: \"9cc1571f-d011-4030-9fbe-33388b5ac07d\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-n2652" Jun 03 03:27:44.762582 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:44.762558 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-n2652" Jun 03 03:27:44.890423 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:44.890387 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68f864588-n2652"] Jun 03 03:27:44.893043 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:27:44.893017 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cc1571f_d011_4030_9fbe_33388b5ac07d.slice/crio-33cd03f4d246cf19365c10995e75ee6ea0f4a24d663ee640ccc711b60799829f WatchSource:0}: Error finding container 33cd03f4d246cf19365c10995e75ee6ea0f4a24d663ee640ccc711b60799829f: Status 404 returned error can't find the container with id 33cd03f4d246cf19365c10995e75ee6ea0f4a24d663ee640ccc711b60799829f Jun 03 03:27:45.695977 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:45.695936 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-n2652" event={"ID":"9cc1571f-d011-4030-9fbe-33388b5ac07d","Type":"ContainerStarted","Data":"33cd03f4d246cf19365c10995e75ee6ea0f4a24d663ee640ccc711b60799829f"} Jun 03 03:27:48.711825 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:48.711794 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-n2652" event={"ID":"9cc1571f-d011-4030-9fbe-33388b5ac07d","Type":"ContainerStarted","Data":"3c2942a2a23cfca616067b8f2f75b42bb7a496f89563c7918b41a4c80e36e1de"} Jun 03 03:27:49.716367 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:49.716328 2558 generic.go:358] "Generic (PLEG): container finished" podID="9cc1571f-d011-4030-9fbe-33388b5ac07d" containerID="3c2942a2a23cfca616067b8f2f75b42bb7a496f89563c7918b41a4c80e36e1de" exitCode=0 Jun 03 03:27:49.716741 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:49.716383 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-n2652" event={"ID":"9cc1571f-d011-4030-9fbe-33388b5ac07d","Type":"ContainerDied","Data":"3c2942a2a23cfca616067b8f2f75b42bb7a496f89563c7918b41a4c80e36e1de"} Jun 03 03:27:50.722267 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:50.722227 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-n2652" event={"ID":"9cc1571f-d011-4030-9fbe-33388b5ac07d","Type":"ContainerStarted","Data":"27e87c79500e6e803b71940ea3aac4b12aa96334b7668dcde5bbde1ea300d77a"} Jun 03 03:27:50.722705 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:50.722312 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-n2652" Jun 03 03:27:50.742109 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:27:50.742066 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-n2652" podStartSLOduration=1.621018454 podStartE2EDuration="6.742054263s" podCreationTimestamp="2026-06-03 03:27:44 +0000 UTC" firstStartedPulling="2026-06-03 03:27:44.89460294 +0000 UTC m=+440.066512793" lastFinishedPulling="2026-06-03 03:27:50.01563875 +0000 UTC m=+445.187548602" observedRunningTime="2026-06-03 03:27:50.740362442 +0000 UTC m=+445.912272312" watchObservedRunningTime="2026-06-03 03:27:50.742054263 +0000 UTC m=+445.913964133" Jun 03 03:28:01.726979 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:01.726946 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-n2652" Jun 03 03:28:04.307183 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:04.307143 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-865bddc6b6-pgsbm"] Jun 03 03:28:04.315788 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:04.315765 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-pgsbm" Jun 03 03:28:04.318493 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:04.318469 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 03:28:04.318579 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:04.318564 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 03:28:04.319100 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:04.319080 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 03:28:04.319158 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:04.319090 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 03:28:04.319158 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:04.319149 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 03:28:04.319469 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:04.319451 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-r5gnr\"" Jun 03 03:28:04.328950 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:04.328926 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-865bddc6b6-pgsbm"] Jun 03 03:28:04.435028 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:04.434976 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv4dj\" (UniqueName: \"kubernetes.io/projected/adf0ff12-35dc-4702-a0cc-5954c536e140-kube-api-access-mv4dj\") pod \"lws-controller-manager-865bddc6b6-pgsbm\" (UID: \"adf0ff12-35dc-4702-a0cc-5954c536e140\") " pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-pgsbm" Jun 03 03:28:04.435178 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:04.435057 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/adf0ff12-35dc-4702-a0cc-5954c536e140-metrics-cert\") pod \"lws-controller-manager-865bddc6b6-pgsbm\" (UID: \"adf0ff12-35dc-4702-a0cc-5954c536e140\") " pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-pgsbm" Jun 03 03:28:04.435178 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:04.435089 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/adf0ff12-35dc-4702-a0cc-5954c536e140-manager-config\") pod \"lws-controller-manager-865bddc6b6-pgsbm\" (UID: \"adf0ff12-35dc-4702-a0cc-5954c536e140\") " pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-pgsbm" Jun 03 03:28:04.435178 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:04.435104 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/adf0ff12-35dc-4702-a0cc-5954c536e140-cert\") pod \"lws-controller-manager-865bddc6b6-pgsbm\" (UID: \"adf0ff12-35dc-4702-a0cc-5954c536e140\") " pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-pgsbm" Jun 03 03:28:04.535713 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:04.535674 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/adf0ff12-35dc-4702-a0cc-5954c536e140-metrics-cert\") pod \"lws-controller-manager-865bddc6b6-pgsbm\" (UID: \"adf0ff12-35dc-4702-a0cc-5954c536e140\") " pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-pgsbm" Jun 03 03:28:04.535713 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:04.535719 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/adf0ff12-35dc-4702-a0cc-5954c536e140-manager-config\") pod \"lws-controller-manager-865bddc6b6-pgsbm\" (UID: \"adf0ff12-35dc-4702-a0cc-5954c536e140\") " pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-pgsbm" Jun 03 03:28:04.535930 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:04.535736 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/adf0ff12-35dc-4702-a0cc-5954c536e140-cert\") pod \"lws-controller-manager-865bddc6b6-pgsbm\" (UID: \"adf0ff12-35dc-4702-a0cc-5954c536e140\") " pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-pgsbm" Jun 03 03:28:04.535930 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:04.535780 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mv4dj\" (UniqueName: \"kubernetes.io/projected/adf0ff12-35dc-4702-a0cc-5954c536e140-kube-api-access-mv4dj\") pod \"lws-controller-manager-865bddc6b6-pgsbm\" (UID: \"adf0ff12-35dc-4702-a0cc-5954c536e140\") " pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-pgsbm" Jun 03 03:28:04.536457 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:04.536437 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/adf0ff12-35dc-4702-a0cc-5954c536e140-manager-config\") pod \"lws-controller-manager-865bddc6b6-pgsbm\" (UID: \"adf0ff12-35dc-4702-a0cc-5954c536e140\") " pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-pgsbm" Jun 03 03:28:04.538245 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:04.538212 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/adf0ff12-35dc-4702-a0cc-5954c536e140-cert\") pod \"lws-controller-manager-865bddc6b6-pgsbm\" (UID: \"adf0ff12-35dc-4702-a0cc-5954c536e140\") " pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-pgsbm" Jun 03 03:28:04.538355 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:04.538266 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/adf0ff12-35dc-4702-a0cc-5954c536e140-metrics-cert\") pod \"lws-controller-manager-865bddc6b6-pgsbm\" (UID: \"adf0ff12-35dc-4702-a0cc-5954c536e140\") " pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-pgsbm" Jun 03 03:28:04.544087 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:04.544065 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv4dj\" (UniqueName: \"kubernetes.io/projected/adf0ff12-35dc-4702-a0cc-5954c536e140-kube-api-access-mv4dj\") pod \"lws-controller-manager-865bddc6b6-pgsbm\" (UID: \"adf0ff12-35dc-4702-a0cc-5954c536e140\") " pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-pgsbm" Jun 03 03:28:04.625413 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:04.625303 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-pgsbm" Jun 03 03:28:04.766922 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:04.766891 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-865bddc6b6-pgsbm"] Jun 03 03:28:04.770047 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:28:04.770019 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf0ff12_35dc_4702_a0cc_5954c536e140.slice/crio-72472434a31ff6344851eb3c7acd4c0114a74184107a64a586b3fc9d99df92ad WatchSource:0}: Error finding container 72472434a31ff6344851eb3c7acd4c0114a74184107a64a586b3fc9d99df92ad: Status 404 returned error can't find the container with id 72472434a31ff6344851eb3c7acd4c0114a74184107a64a586b3fc9d99df92ad Jun 03 03:28:05.774612 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:05.774571 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-pgsbm" event={"ID":"adf0ff12-35dc-4702-a0cc-5954c536e140","Type":"ContainerStarted","Data":"72472434a31ff6344851eb3c7acd4c0114a74184107a64a586b3fc9d99df92ad"} Jun 03 03:28:07.782227 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:07.782191 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-pgsbm" event={"ID":"adf0ff12-35dc-4702-a0cc-5954c536e140","Type":"ContainerStarted","Data":"0f8010996921432becce255a00adb9c20d0cab77e6426a0e40d3af3f6a5d7fd6"} Jun 03 03:28:07.782675 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:07.782338 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-pgsbm" Jun 03 03:28:07.797889 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:07.797845 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-pgsbm" podStartSLOduration=1.4520007480000001 podStartE2EDuration="3.797832937s" podCreationTimestamp="2026-06-03 03:28:04 +0000 UTC" firstStartedPulling="2026-06-03 03:28:04.77166519 +0000 UTC m=+459.943575042" lastFinishedPulling="2026-06-03 03:28:07.117497369 +0000 UTC m=+462.289407231" observedRunningTime="2026-06-03 03:28:07.795962602 +0000 UTC m=+462.967872474" watchObservedRunningTime="2026-06-03 03:28:07.797832937 +0000 UTC m=+462.969742808" Jun 03 03:28:18.788436 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:18.788405 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-pgsbm" Jun 03 03:28:37.100809 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:37.100773 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5cbbc674f4-sllv8"] Jun 03 03:28:37.105871 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:37.105848 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5cbbc674f4-sllv8" Jun 03 03:28:37.108049 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:37.108025 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-858tf\"" Jun 03 03:28:37.108168 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:37.108105 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 03:28:37.113816 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:37.113434 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5cbbc674f4-sllv8"] Jun 03 03:28:37.291119 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:37.291084 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e59fb0d6-8bce-42ff-84ca-08707bddb76a-redirect-config\") pod \"dashboard-redirect-5cbbc674f4-sllv8\" (UID: \"e59fb0d6-8bce-42ff-84ca-08707bddb76a\") " pod="opendatahub/dashboard-redirect-5cbbc674f4-sllv8" Jun 03 03:28:37.291119 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:37.291116 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzlvr\" (UniqueName: \"kubernetes.io/projected/e59fb0d6-8bce-42ff-84ca-08707bddb76a-kube-api-access-rzlvr\") pod \"dashboard-redirect-5cbbc674f4-sllv8\" (UID: \"e59fb0d6-8bce-42ff-84ca-08707bddb76a\") " pod="opendatahub/dashboard-redirect-5cbbc674f4-sllv8" Jun 03 03:28:37.391774 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:37.391701 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e59fb0d6-8bce-42ff-84ca-08707bddb76a-redirect-config\") pod \"dashboard-redirect-5cbbc674f4-sllv8\" (UID: \"e59fb0d6-8bce-42ff-84ca-08707bddb76a\") " pod="opendatahub/dashboard-redirect-5cbbc674f4-sllv8" Jun 03 03:28:37.391774 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:37.391732 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rzlvr\" (UniqueName: \"kubernetes.io/projected/e59fb0d6-8bce-42ff-84ca-08707bddb76a-kube-api-access-rzlvr\") pod \"dashboard-redirect-5cbbc674f4-sllv8\" (UID: \"e59fb0d6-8bce-42ff-84ca-08707bddb76a\") " pod="opendatahub/dashboard-redirect-5cbbc674f4-sllv8" Jun 03 03:28:37.392459 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:37.392439 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e59fb0d6-8bce-42ff-84ca-08707bddb76a-redirect-config\") pod \"dashboard-redirect-5cbbc674f4-sllv8\" (UID: \"e59fb0d6-8bce-42ff-84ca-08707bddb76a\") " pod="opendatahub/dashboard-redirect-5cbbc674f4-sllv8" Jun 03 03:28:37.398945 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:37.398921 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzlvr\" (UniqueName: \"kubernetes.io/projected/e59fb0d6-8bce-42ff-84ca-08707bddb76a-kube-api-access-rzlvr\") pod \"dashboard-redirect-5cbbc674f4-sllv8\" (UID: \"e59fb0d6-8bce-42ff-84ca-08707bddb76a\") " pod="opendatahub/dashboard-redirect-5cbbc674f4-sllv8" Jun 03 03:28:37.417695 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:37.417673 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5cbbc674f4-sllv8" Jun 03 03:28:37.540141 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:37.540117 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5cbbc674f4-sllv8"] Jun 03 03:28:37.542640 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:28:37.542609 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode59fb0d6_8bce_42ff_84ca_08707bddb76a.slice/crio-ec0db0a717eb3e7487838d61d0124384e6df77e496025ebb05eab879e8fac5f2 WatchSource:0}: Error finding container ec0db0a717eb3e7487838d61d0124384e6df77e496025ebb05eab879e8fac5f2: Status 404 returned error can't find the container with id ec0db0a717eb3e7487838d61d0124384e6df77e496025ebb05eab879e8fac5f2 Jun 03 03:28:37.882657 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:37.882626 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5cbbc674f4-sllv8" event={"ID":"e59fb0d6-8bce-42ff-84ca-08707bddb76a","Type":"ContainerStarted","Data":"ec0db0a717eb3e7487838d61d0124384e6df77e496025ebb05eab879e8fac5f2"} Jun 03 03:28:41.639890 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.639853 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x"] Jun 03 03:28:41.648710 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.648682 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.651105 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.651076 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vz292\"" Jun 03 03:28:41.651536 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.651519 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 03:28:41.656560 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.656534 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x"] Jun 03 03:28:41.821740 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.821707 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdf5d6f6-453f-4740-9e66-169c08a40a53-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.821909 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.821758 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdf5d6f6-453f-4740-9e66-169c08a40a53-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.821909 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.821790 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf5d6f6-453f-4740-9e66-169c08a40a53-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.821909 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.821830 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh54l\" (UniqueName: \"kubernetes.io/projected/fdf5d6f6-453f-4740-9e66-169c08a40a53-kube-api-access-kh54l\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.821909 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.821853 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdf5d6f6-453f-4740-9e66-169c08a40a53-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.821909 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.821898 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdf5d6f6-453f-4740-9e66-169c08a40a53-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.822132 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.821922 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdf5d6f6-453f-4740-9e66-169c08a40a53-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.822132 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.821951 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf5d6f6-453f-4740-9e66-169c08a40a53-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.822132 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.821976 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdf5d6f6-453f-4740-9e66-169c08a40a53-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.923320 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.923253 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdf5d6f6-453f-4740-9e66-169c08a40a53-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.923320 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.923282 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdf5d6f6-453f-4740-9e66-169c08a40a53-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.923320 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.923301 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf5d6f6-453f-4740-9e66-169c08a40a53-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.923567 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.923322 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdf5d6f6-453f-4740-9e66-169c08a40a53-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.923567 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.923438 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdf5d6f6-453f-4740-9e66-169c08a40a53-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.923567 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.923494 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdf5d6f6-453f-4740-9e66-169c08a40a53-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.923567 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.923526 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf5d6f6-453f-4740-9e66-169c08a40a53-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.923567 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.923560 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kh54l\" (UniqueName: \"kubernetes.io/projected/fdf5d6f6-453f-4740-9e66-169c08a40a53-kube-api-access-kh54l\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.923818 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.923591 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdf5d6f6-453f-4740-9e66-169c08a40a53-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.923818 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.923656 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdf5d6f6-453f-4740-9e66-169c08a40a53-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.923914 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.923798 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf5d6f6-453f-4740-9e66-169c08a40a53-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.924032 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.923976 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdf5d6f6-453f-4740-9e66-169c08a40a53-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.924136 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.924117 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf5d6f6-453f-4740-9e66-169c08a40a53-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.924330 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.924306 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdf5d6f6-453f-4740-9e66-169c08a40a53-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.925718 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.925700 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdf5d6f6-453f-4740-9e66-169c08a40a53-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.925881 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.925864 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdf5d6f6-453f-4740-9e66-169c08a40a53-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.934792 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.934772 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh54l\" (UniqueName: \"kubernetes.io/projected/fdf5d6f6-453f-4740-9e66-169c08a40a53-kube-api-access-kh54l\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.934910 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.934795 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdf5d6f6-453f-4740-9e66-169c08a40a53-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5949x\" (UID: \"fdf5d6f6-453f-4740-9e66-169c08a40a53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:41.962594 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:41.962575 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:42.086776 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:42.086708 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x"] Jun 03 03:28:42.089986 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:28:42.089959 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdf5d6f6_453f_4740_9e66_169c08a40a53.slice/crio-0b18f50998a8189b8acd0b2f903b3f9d56cdbc23e68a348ab20670b77478b3d8 WatchSource:0}: Error finding container 0b18f50998a8189b8acd0b2f903b3f9d56cdbc23e68a348ab20670b77478b3d8: Status 404 returned error can't find the container with id 0b18f50998a8189b8acd0b2f903b3f9d56cdbc23e68a348ab20670b77478b3d8 Jun 03 03:28:42.899731 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:42.899687 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" event={"ID":"fdf5d6f6-453f-4740-9e66-169c08a40a53","Type":"ContainerStarted","Data":"0b18f50998a8189b8acd0b2f903b3f9d56cdbc23e68a348ab20670b77478b3d8"} Jun 03 03:28:44.441335 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:44.441296 2558 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 03:28:44.441716 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:44.441377 2558 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 03:28:44.441716 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:44.441423 2558 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 03:28:44.908140 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:44.908107 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" event={"ID":"fdf5d6f6-453f-4740-9e66-169c08a40a53","Type":"ContainerStarted","Data":"c6c47c4e95230e8ed4f505ee11ab05bf5ea36a7f022e00be78aca84b8b9ccbf5"} Jun 03 03:28:44.927009 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:44.926956 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" podStartSLOduration=1.577930681 podStartE2EDuration="3.92694274s" podCreationTimestamp="2026-06-03 03:28:41 +0000 UTC" firstStartedPulling="2026-06-03 03:28:42.09204455 +0000 UTC m=+497.263954402" lastFinishedPulling="2026-06-03 03:28:44.441056612 +0000 UTC m=+499.612966461" observedRunningTime="2026-06-03 03:28:44.92482421 +0000 UTC m=+500.096734097" watchObservedRunningTime="2026-06-03 03:28:44.92694274 +0000 UTC m=+500.098852615" Jun 03 03:28:44.962781 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:44.962754 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:45.967887 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:45.967860 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:46.914581 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:46.914546 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:46.915555 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:46.915533 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5949x" Jun 03 03:28:50.930414 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:50.930378 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5cbbc674f4-sllv8" event={"ID":"e59fb0d6-8bce-42ff-84ca-08707bddb76a","Type":"ContainerStarted","Data":"b10121fa78ad40103b6a33827d4f493cd4758883855873aeca374e8ad2f11ba7"} Jun 03 03:28:50.944365 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:28:50.944318 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5cbbc674f4-sllv8" podStartSLOduration=1.427033221 podStartE2EDuration="13.944302754s" podCreationTimestamp="2026-06-03 03:28:37 +0000 UTC" firstStartedPulling="2026-06-03 03:28:37.544024324 +0000 UTC m=+492.715934174" lastFinishedPulling="2026-06-03 03:28:50.061293855 +0000 UTC m=+505.233203707" observedRunningTime="2026-06-03 03:28:50.942831972 +0000 UTC m=+506.114741844" watchObservedRunningTime="2026-06-03 03:28:50.944302754 +0000 UTC m=+506.116212684" Jun 03 03:29:04.964729 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:04.964695 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p8rgt"] Jun 03 03:29:04.969434 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:04.969414 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-p8rgt" Jun 03 03:29:04.971561 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:04.971539 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 03:29:04.971561 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:04.971552 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-hvcqh\"" Jun 03 03:29:04.972333 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:04.972313 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 03:29:04.975193 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:04.975170 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p8rgt"] Jun 03 03:29:05.006747 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:05.006726 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n56lf\" (UniqueName: \"kubernetes.io/projected/64038c9b-b299-4d88-a865-55b8e1c7a5b4-kube-api-access-n56lf\") pod \"kuadrant-operator-catalog-p8rgt\" (UID: \"64038c9b-b299-4d88-a865-55b8e1c7a5b4\") " pod="kuadrant-system/kuadrant-operator-catalog-p8rgt" Jun 03 03:29:05.107246 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:05.107219 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n56lf\" (UniqueName: \"kubernetes.io/projected/64038c9b-b299-4d88-a865-55b8e1c7a5b4-kube-api-access-n56lf\") pod \"kuadrant-operator-catalog-p8rgt\" (UID: \"64038c9b-b299-4d88-a865-55b8e1c7a5b4\") " pod="kuadrant-system/kuadrant-operator-catalog-p8rgt" Jun 03 03:29:05.119113 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:05.119079 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n56lf\" (UniqueName: \"kubernetes.io/projected/64038c9b-b299-4d88-a865-55b8e1c7a5b4-kube-api-access-n56lf\") pod \"kuadrant-operator-catalog-p8rgt\" (UID: \"64038c9b-b299-4d88-a865-55b8e1c7a5b4\") " pod="kuadrant-system/kuadrant-operator-catalog-p8rgt" Jun 03 03:29:05.280241 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:05.280222 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-p8rgt" Jun 03 03:29:05.338955 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:05.338925 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p8rgt"] Jun 03 03:29:05.403743 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:05.403714 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p8rgt"] Jun 03 03:29:05.405962 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:29:05.405935 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64038c9b_b299_4d88_a865_55b8e1c7a5b4.slice/crio-5f4d32b1b4d559c40c844ee2758e3d16d544e8b0ddcd4a22d8ad9794836ae083 WatchSource:0}: Error finding container 5f4d32b1b4d559c40c844ee2758e3d16d544e8b0ddcd4a22d8ad9794836ae083: Status 404 returned error can't find the container with id 5f4d32b1b4d559c40c844ee2758e3d16d544e8b0ddcd4a22d8ad9794836ae083 Jun 03 03:29:05.546937 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:05.546876 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8rsgg"] Jun 03 03:29:05.552856 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:05.552817 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8rsgg" Jun 03 03:29:05.555916 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:05.555890 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8rsgg"] Jun 03 03:29:05.611747 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:05.611719 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmwgg\" (UniqueName: \"kubernetes.io/projected/61dee4b5-8d4d-49b7-9377-c3cc7f4ff48d-kube-api-access-xmwgg\") pod \"kuadrant-operator-catalog-8rsgg\" (UID: \"61dee4b5-8d4d-49b7-9377-c3cc7f4ff48d\") " pod="kuadrant-system/kuadrant-operator-catalog-8rsgg" Jun 03 03:29:05.712707 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:05.712684 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xmwgg\" (UniqueName: \"kubernetes.io/projected/61dee4b5-8d4d-49b7-9377-c3cc7f4ff48d-kube-api-access-xmwgg\") pod \"kuadrant-operator-catalog-8rsgg\" (UID: \"61dee4b5-8d4d-49b7-9377-c3cc7f4ff48d\") " pod="kuadrant-system/kuadrant-operator-catalog-8rsgg" Jun 03 03:29:05.720415 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:05.720397 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmwgg\" (UniqueName: \"kubernetes.io/projected/61dee4b5-8d4d-49b7-9377-c3cc7f4ff48d-kube-api-access-xmwgg\") pod \"kuadrant-operator-catalog-8rsgg\" (UID: \"61dee4b5-8d4d-49b7-9377-c3cc7f4ff48d\") " pod="kuadrant-system/kuadrant-operator-catalog-8rsgg" Jun 03 03:29:05.863681 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:05.863611 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8rsgg" Jun 03 03:29:05.982608 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:05.982566 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-p8rgt" event={"ID":"64038c9b-b299-4d88-a865-55b8e1c7a5b4","Type":"ContainerStarted","Data":"5f4d32b1b4d559c40c844ee2758e3d16d544e8b0ddcd4a22d8ad9794836ae083"} Jun 03 03:29:05.995867 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:05.995841 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8rsgg"] Jun 03 03:29:06.001782 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:29:06.001755 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61dee4b5_8d4d_49b7_9377_c3cc7f4ff48d.slice/crio-e09041a33c993e3991f4b7144808273ba81ed1af22f416a7494bf579b0076661 WatchSource:0}: Error finding container e09041a33c993e3991f4b7144808273ba81ed1af22f416a7494bf579b0076661: Status 404 returned error can't find the container with id e09041a33c993e3991f4b7144808273ba81ed1af22f416a7494bf579b0076661 Jun 03 03:29:06.988636 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:06.988585 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8rsgg" event={"ID":"61dee4b5-8d4d-49b7-9377-c3cc7f4ff48d","Type":"ContainerStarted","Data":"e09041a33c993e3991f4b7144808273ba81ed1af22f416a7494bf579b0076661"} Jun 03 03:29:07.994032 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:07.993979 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-p8rgt" event={"ID":"64038c9b-b299-4d88-a865-55b8e1c7a5b4","Type":"ContainerStarted","Data":"2f6e006e725b15ec0f62da006c68fbb51ad6601ebcfae503d95de30095ad0306"} Jun 03 03:29:07.994474 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:07.994055 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-p8rgt" podUID="64038c9b-b299-4d88-a865-55b8e1c7a5b4" containerName="registry-server" containerID="cri-o://2f6e006e725b15ec0f62da006c68fbb51ad6601ebcfae503d95de30095ad0306" gracePeriod=2 Jun 03 03:29:07.995319 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:07.995296 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8rsgg" event={"ID":"61dee4b5-8d4d-49b7-9377-c3cc7f4ff48d","Type":"ContainerStarted","Data":"3b57535c05da11783e323feca875bcbe3d76ce2e731cc1771eec13bfb80695a9"} Jun 03 03:29:08.008747 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:08.008704 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-p8rgt" podStartSLOduration=1.969444401 podStartE2EDuration="4.008690479s" podCreationTimestamp="2026-06-03 03:29:04 +0000 UTC" firstStartedPulling="2026-06-03 03:29:05.407229623 +0000 UTC m=+520.579139472" lastFinishedPulling="2026-06-03 03:29:07.446475696 +0000 UTC m=+522.618385550" observedRunningTime="2026-06-03 03:29:08.007723644 +0000 UTC m=+523.179633516" watchObservedRunningTime="2026-06-03 03:29:08.008690479 +0000 UTC m=+523.180600351" Jun 03 03:29:08.021245 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:08.021206 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8rsgg" podStartSLOduration=1.5744727059999999 podStartE2EDuration="3.021195608s" podCreationTimestamp="2026-06-03 03:29:05 +0000 UTC" firstStartedPulling="2026-06-03 03:29:06.00303578 +0000 UTC m=+521.174945632" lastFinishedPulling="2026-06-03 03:29:07.449758681 +0000 UTC m=+522.621668534" observedRunningTime="2026-06-03 03:29:08.020127618 +0000 UTC m=+523.192037488" watchObservedRunningTime="2026-06-03 03:29:08.021195608 +0000 UTC m=+523.193105478" Jun 03 03:29:08.233981 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:08.233959 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-p8rgt" Jun 03 03:29:08.337489 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:08.337462 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n56lf\" (UniqueName: \"kubernetes.io/projected/64038c9b-b299-4d88-a865-55b8e1c7a5b4-kube-api-access-n56lf\") pod \"64038c9b-b299-4d88-a865-55b8e1c7a5b4\" (UID: \"64038c9b-b299-4d88-a865-55b8e1c7a5b4\") " Jun 03 03:29:08.339555 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:08.339532 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64038c9b-b299-4d88-a865-55b8e1c7a5b4-kube-api-access-n56lf" (OuterVolumeSpecName: "kube-api-access-n56lf") pod "64038c9b-b299-4d88-a865-55b8e1c7a5b4" (UID: "64038c9b-b299-4d88-a865-55b8e1c7a5b4"). InnerVolumeSpecName "kube-api-access-n56lf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:29:08.438210 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:08.438183 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n56lf\" (UniqueName: \"kubernetes.io/projected/64038c9b-b299-4d88-a865-55b8e1c7a5b4-kube-api-access-n56lf\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:29:08.999163 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:08.999126 2558 generic.go:358] "Generic (PLEG): container finished" podID="64038c9b-b299-4d88-a865-55b8e1c7a5b4" containerID="2f6e006e725b15ec0f62da006c68fbb51ad6601ebcfae503d95de30095ad0306" exitCode=0 Jun 03 03:29:08.999561 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:08.999188 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-p8rgt" Jun 03 03:29:08.999561 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:08.999209 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-p8rgt" event={"ID":"64038c9b-b299-4d88-a865-55b8e1c7a5b4","Type":"ContainerDied","Data":"2f6e006e725b15ec0f62da006c68fbb51ad6601ebcfae503d95de30095ad0306"} Jun 03 03:29:08.999561 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:08.999245 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-p8rgt" event={"ID":"64038c9b-b299-4d88-a865-55b8e1c7a5b4","Type":"ContainerDied","Data":"5f4d32b1b4d559c40c844ee2758e3d16d544e8b0ddcd4a22d8ad9794836ae083"} Jun 03 03:29:08.999561 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:08.999259 2558 scope.go:117] "RemoveContainer" containerID="2f6e006e725b15ec0f62da006c68fbb51ad6601ebcfae503d95de30095ad0306" Jun 03 03:29:09.007707 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:09.007686 2558 scope.go:117] "RemoveContainer" containerID="2f6e006e725b15ec0f62da006c68fbb51ad6601ebcfae503d95de30095ad0306" Jun 03 03:29:09.007947 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:29:09.007929 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f6e006e725b15ec0f62da006c68fbb51ad6601ebcfae503d95de30095ad0306\": container with ID starting with 2f6e006e725b15ec0f62da006c68fbb51ad6601ebcfae503d95de30095ad0306 not found: ID does not exist" containerID="2f6e006e725b15ec0f62da006c68fbb51ad6601ebcfae503d95de30095ad0306" Jun 03 03:29:09.008020 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:09.007955 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f6e006e725b15ec0f62da006c68fbb51ad6601ebcfae503d95de30095ad0306"} err="failed to get container status \"2f6e006e725b15ec0f62da006c68fbb51ad6601ebcfae503d95de30095ad0306\": rpc error: code = NotFound desc = could not find container \"2f6e006e725b15ec0f62da006c68fbb51ad6601ebcfae503d95de30095ad0306\": container with ID starting with 2f6e006e725b15ec0f62da006c68fbb51ad6601ebcfae503d95de30095ad0306 not found: ID does not exist" Jun 03 03:29:09.018560 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:09.018538 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p8rgt"] Jun 03 03:29:09.021763 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:09.021742 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p8rgt"] Jun 03 03:29:09.369854 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:09.369825 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64038c9b-b299-4d88-a865-55b8e1c7a5b4" path="/var/lib/kubelet/pods/64038c9b-b299-4d88-a865-55b8e1c7a5b4/volumes" Jun 03 03:29:15.864038 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:15.863945 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-8rsgg" Jun 03 03:29:15.864038 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:15.863982 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-8rsgg" Jun 03 03:29:15.885835 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:15.885814 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-8rsgg" Jun 03 03:29:16.043894 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:16.043862 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-8rsgg" Jun 03 03:29:36.610791 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:36.610752 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-pzk6z"] Jun 03 03:29:36.611312 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:36.611229 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64038c9b-b299-4d88-a865-55b8e1c7a5b4" containerName="registry-server" Jun 03 03:29:36.611312 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:36.611247 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="64038c9b-b299-4d88-a865-55b8e1c7a5b4" containerName="registry-server" Jun 03 03:29:36.611429 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:36.611340 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="64038c9b-b299-4d88-a865-55b8e1c7a5b4" containerName="registry-server" Jun 03 03:29:36.636320 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:36.636290 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-pzk6z"] Jun 03 03:29:36.636472 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:36.636404 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-pzk6z" Jun 03 03:29:36.639147 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:36.639095 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-c2smm\"" Jun 03 03:29:36.639281 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:36.639265 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 03 03:29:36.749797 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:36.749767 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnd5q\" (UniqueName: \"kubernetes.io/projected/6e2938e5-f737-44d2-b154-5e9eb0ccb15a-kube-api-access-nnd5q\") pod \"dns-operator-controller-manager-648d5c98bc-pzk6z\" (UID: \"6e2938e5-f737-44d2-b154-5e9eb0ccb15a\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-pzk6z" Jun 03 03:29:36.851009 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:36.850957 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nnd5q\" (UniqueName: \"kubernetes.io/projected/6e2938e5-f737-44d2-b154-5e9eb0ccb15a-kube-api-access-nnd5q\") pod \"dns-operator-controller-manager-648d5c98bc-pzk6z\" (UID: \"6e2938e5-f737-44d2-b154-5e9eb0ccb15a\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-pzk6z" Jun 03 03:29:36.858516 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:36.858496 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnd5q\" (UniqueName: \"kubernetes.io/projected/6e2938e5-f737-44d2-b154-5e9eb0ccb15a-kube-api-access-nnd5q\") pod \"dns-operator-controller-manager-648d5c98bc-pzk6z\" (UID: \"6e2938e5-f737-44d2-b154-5e9eb0ccb15a\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-pzk6z" Jun 03 03:29:36.946031 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:36.945935 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-pzk6z" Jun 03 03:29:37.069738 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:37.069715 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-pzk6z"] Jun 03 03:29:37.072498 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:29:37.072468 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e2938e5_f737_44d2_b154_5e9eb0ccb15a.slice/crio-3aa8333241a1258258aac983f60af3b5abfb22560900715da69e65901ccc313b WatchSource:0}: Error finding container 3aa8333241a1258258aac983f60af3b5abfb22560900715da69e65901ccc313b: Status 404 returned error can't find the container with id 3aa8333241a1258258aac983f60af3b5abfb22560900715da69e65901ccc313b Jun 03 03:29:37.088804 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:37.088771 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-pzk6z" event={"ID":"6e2938e5-f737-44d2-b154-5e9eb0ccb15a","Type":"ContainerStarted","Data":"3aa8333241a1258258aac983f60af3b5abfb22560900715da69e65901ccc313b"} Jun 03 03:29:39.096519 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:39.096491 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-pzk6z" event={"ID":"6e2938e5-f737-44d2-b154-5e9eb0ccb15a","Type":"ContainerStarted","Data":"879a4fcc13d3580bef8553d7d1c8727cb56b05f24cff13545c6cd0b16d3ec4fe"} Jun 03 03:29:39.096833 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:39.096542 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-pzk6z" Jun 03 03:29:39.111959 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:39.111908 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-pzk6z" podStartSLOduration=1.203651741 podStartE2EDuration="3.11189436s" podCreationTimestamp="2026-06-03 03:29:36 +0000 UTC" firstStartedPulling="2026-06-03 03:29:37.074316234 +0000 UTC m=+552.246226083" lastFinishedPulling="2026-06-03 03:29:38.982558849 +0000 UTC m=+554.154468702" observedRunningTime="2026-06-03 03:29:39.110767368 +0000 UTC m=+554.282677238" watchObservedRunningTime="2026-06-03 03:29:39.11189436 +0000 UTC m=+554.283804230" Jun 03 03:29:40.207107 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:40.207066 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nrmln"] Jun 03 03:29:40.213930 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:40.213903 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nrmln" Jun 03 03:29:40.216437 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:40.216416 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-bxn2f\"" Jun 03 03:29:40.221108 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:40.221087 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nrmln"] Jun 03 03:29:40.380351 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:40.380324 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v92gn\" (UniqueName: \"kubernetes.io/projected/e31b4206-a350-4ee6-82e6-dee85e54a5ba-kube-api-access-v92gn\") pod \"limitador-operator-controller-manager-85c4996f8c-nrmln\" (UID: \"e31b4206-a350-4ee6-82e6-dee85e54a5ba\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nrmln" Jun 03 03:29:40.480682 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:40.480622 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v92gn\" (UniqueName: \"kubernetes.io/projected/e31b4206-a350-4ee6-82e6-dee85e54a5ba-kube-api-access-v92gn\") pod \"limitador-operator-controller-manager-85c4996f8c-nrmln\" (UID: \"e31b4206-a350-4ee6-82e6-dee85e54a5ba\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nrmln" Jun 03 03:29:40.495590 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:40.495559 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v92gn\" (UniqueName: \"kubernetes.io/projected/e31b4206-a350-4ee6-82e6-dee85e54a5ba-kube-api-access-v92gn\") pod \"limitador-operator-controller-manager-85c4996f8c-nrmln\" (UID: \"e31b4206-a350-4ee6-82e6-dee85e54a5ba\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nrmln" Jun 03 03:29:40.524487 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:40.524465 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nrmln" Jun 03 03:29:40.654628 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:40.654601 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nrmln"] Jun 03 03:29:40.656652 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:29:40.656622 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode31b4206_a350_4ee6_82e6_dee85e54a5ba.slice/crio-0f000d2f81d4a3986467656ab6092c5ba502e13f2e445ae95fc10eebea9f7a8e WatchSource:0}: Error finding container 0f000d2f81d4a3986467656ab6092c5ba502e13f2e445ae95fc10eebea9f7a8e: Status 404 returned error can't find the container with id 0f000d2f81d4a3986467656ab6092c5ba502e13f2e445ae95fc10eebea9f7a8e Jun 03 03:29:41.103919 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:41.103883 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nrmln" event={"ID":"e31b4206-a350-4ee6-82e6-dee85e54a5ba","Type":"ContainerStarted","Data":"0f000d2f81d4a3986467656ab6092c5ba502e13f2e445ae95fc10eebea9f7a8e"} Jun 03 03:29:43.112193 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:43.112159 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nrmln" event={"ID":"e31b4206-a350-4ee6-82e6-dee85e54a5ba","Type":"ContainerStarted","Data":"aeee5f1efd5ed19f71dc0c87304b3c9c0715a9c82769cfca1286ee333af6c5ae"} Jun 03 03:29:43.112638 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:43.112292 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nrmln" Jun 03 03:29:43.127820 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:43.127779 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nrmln" podStartSLOduration=1.1326352339999999 podStartE2EDuration="3.127767022s" podCreationTimestamp="2026-06-03 03:29:40 +0000 UTC" firstStartedPulling="2026-06-03 03:29:40.659309582 +0000 UTC m=+555.831219440" lastFinishedPulling="2026-06-03 03:29:42.654441377 +0000 UTC m=+557.826351228" observedRunningTime="2026-06-03 03:29:43.126442026 +0000 UTC m=+558.298351896" watchObservedRunningTime="2026-06-03 03:29:43.127767022 +0000 UTC m=+558.299676892" Jun 03 03:29:47.775725 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:47.775694 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-njwd5"] Jun 03 03:29:47.778947 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:47.778932 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-njwd5" Jun 03 03:29:47.781227 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:47.781206 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-njrtb\"" Jun 03 03:29:47.787817 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:47.787792 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-njwd5"] Jun 03 03:29:47.938711 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:47.938677 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2hxw\" (UniqueName: \"kubernetes.io/projected/d1b6f979-aab9-429f-9f96-0f40a47ceb46-kube-api-access-q2hxw\") pod \"authorino-operator-657f44b778-njwd5\" (UID: \"d1b6f979-aab9-429f-9f96-0f40a47ceb46\") " pod="kuadrant-system/authorino-operator-657f44b778-njwd5" Jun 03 03:29:48.039659 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:48.039581 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q2hxw\" (UniqueName: \"kubernetes.io/projected/d1b6f979-aab9-429f-9f96-0f40a47ceb46-kube-api-access-q2hxw\") pod \"authorino-operator-657f44b778-njwd5\" (UID: \"d1b6f979-aab9-429f-9f96-0f40a47ceb46\") " pod="kuadrant-system/authorino-operator-657f44b778-njwd5" Jun 03 03:29:48.047089 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:48.047069 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2hxw\" (UniqueName: \"kubernetes.io/projected/d1b6f979-aab9-429f-9f96-0f40a47ceb46-kube-api-access-q2hxw\") pod \"authorino-operator-657f44b778-njwd5\" (UID: \"d1b6f979-aab9-429f-9f96-0f40a47ceb46\") " pod="kuadrant-system/authorino-operator-657f44b778-njwd5" Jun 03 03:29:48.088979 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:48.088956 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-njwd5" Jun 03 03:29:48.216476 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:48.216449 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-njwd5"] Jun 03 03:29:48.218979 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:29:48.218950 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1b6f979_aab9_429f_9f96_0f40a47ceb46.slice/crio-3055180a26caadf4086e92161884d8961c6d1b2aa1c4bf3faf3742b90d062686 WatchSource:0}: Error finding container 3055180a26caadf4086e92161884d8961c6d1b2aa1c4bf3faf3742b90d062686: Status 404 returned error can't find the container with id 3055180a26caadf4086e92161884d8961c6d1b2aa1c4bf3faf3742b90d062686 Jun 03 03:29:49.138007 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:49.137953 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-njwd5" event={"ID":"d1b6f979-aab9-429f-9f96-0f40a47ceb46","Type":"ContainerStarted","Data":"3055180a26caadf4086e92161884d8961c6d1b2aa1c4bf3faf3742b90d062686"} Jun 03 03:29:50.102483 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:50.102455 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-pzk6z" Jun 03 03:29:51.146514 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:51.146472 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-njwd5" event={"ID":"d1b6f979-aab9-429f-9f96-0f40a47ceb46","Type":"ContainerStarted","Data":"06605d8b98626784ec8ad80eb92233f47944197136a0234dad988de67ce97d70"} Jun 03 03:29:51.146957 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:51.146531 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-njwd5" Jun 03 03:29:51.161162 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:51.161120 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-njwd5" podStartSLOduration=2.004454113 podStartE2EDuration="4.161108124s" podCreationTimestamp="2026-06-03 03:29:47 +0000 UTC" firstStartedPulling="2026-06-03 03:29:48.220861463 +0000 UTC m=+563.392771311" lastFinishedPulling="2026-06-03 03:29:50.37751546 +0000 UTC m=+565.549425322" observedRunningTime="2026-06-03 03:29:51.160238147 +0000 UTC m=+566.332148020" watchObservedRunningTime="2026-06-03 03:29:51.161108124 +0000 UTC m=+566.333017994" Jun 03 03:29:54.118651 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:29:54.118613 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nrmln" Jun 03 03:30:02.151563 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:02.151532 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-njwd5" Jun 03 03:30:03.482538 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:03.482449 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-slll6"] Jun 03 03:30:03.485920 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:03.485904 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-slll6" Jun 03 03:30:03.491180 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:03.491160 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-75hbz\"" Jun 03 03:30:03.500549 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:03.500506 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-slll6"] Jun 03 03:30:03.555419 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:03.555377 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d774p\" (UniqueName: \"kubernetes.io/projected/1f90a015-9d27-48f4-b90a-62947611c674-kube-api-access-d774p\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-slll6\" (UID: \"1f90a015-9d27-48f4-b90a-62947611c674\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-slll6" Jun 03 03:30:03.555419 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:03.555425 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f90a015-9d27-48f4-b90a-62947611c674-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-slll6\" (UID: \"1f90a015-9d27-48f4-b90a-62947611c674\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-slll6" Jun 03 03:30:03.656256 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:03.656220 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d774p\" (UniqueName: \"kubernetes.io/projected/1f90a015-9d27-48f4-b90a-62947611c674-kube-api-access-d774p\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-slll6\" (UID: \"1f90a015-9d27-48f4-b90a-62947611c674\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-slll6" Jun 03 03:30:03.656256 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:03.656260 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f90a015-9d27-48f4-b90a-62947611c674-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-slll6\" (UID: \"1f90a015-9d27-48f4-b90a-62947611c674\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-slll6" Jun 03 03:30:03.656610 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:03.656592 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f90a015-9d27-48f4-b90a-62947611c674-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-slll6\" (UID: \"1f90a015-9d27-48f4-b90a-62947611c674\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-slll6" Jun 03 03:30:03.664834 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:03.664800 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d774p\" (UniqueName: \"kubernetes.io/projected/1f90a015-9d27-48f4-b90a-62947611c674-kube-api-access-d774p\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-slll6\" (UID: \"1f90a015-9d27-48f4-b90a-62947611c674\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-slll6" Jun 03 03:30:03.802325 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:03.802284 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-slll6" Jun 03 03:30:03.932284 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:03.932255 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-slll6"] Jun 03 03:30:03.934876 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:30:03.934846 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f90a015_9d27_48f4_b90a_62947611c674.slice/crio-a27e5a9b92de07ad6c9cd56eab52b57fed0029e44bd6303211e8fdfe5011074d WatchSource:0}: Error finding container a27e5a9b92de07ad6c9cd56eab52b57fed0029e44bd6303211e8fdfe5011074d: Status 404 returned error can't find the container with id a27e5a9b92de07ad6c9cd56eab52b57fed0029e44bd6303211e8fdfe5011074d Jun 03 03:30:04.133262 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:04.133183 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-slll6"] Jun 03 03:30:04.142092 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:04.142050 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-slll6"] Jun 03 03:30:04.157048 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:04.157021 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr"] Jun 03 03:30:04.162058 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:04.162033 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr" Jun 03 03:30:04.162199 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:04.162064 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nrmln"] Jun 03 03:30:04.162473 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:04.162417 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nrmln" podUID="e31b4206-a350-4ee6-82e6-dee85e54a5ba" containerName="manager" containerID="cri-o://aeee5f1efd5ed19f71dc0c87304b3c9c0715a9c82769cfca1286ee333af6c5ae" gracePeriod=2 Jun 03 03:30:04.174692 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:04.174640 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr"] Jun 03 03:30:04.178315 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:04.178290 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nrmln"] Jun 03 03:30:04.192286 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:04.192254 2558 status_manager.go:895] "Failed to get status for pod" podUID="e31b4206-a350-4ee6-82e6-dee85e54a5ba" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nrmln" err="pods \"limitador-operator-controller-manager-85c4996f8c-nrmln\" is forbidden: User \"system:node:ip-10-0-141-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-253.ec2.internal' and this object" Jun 03 03:30:04.259930 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:04.259891 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tx8c\" (UniqueName: \"kubernetes.io/projected/a5db7316-6efa-49a2-8879-ce3808cb0a17-kube-api-access-6tx8c\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr\" (UID: \"a5db7316-6efa-49a2-8879-ce3808cb0a17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr" Jun 03 03:30:04.260119 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:04.259963 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5db7316-6efa-49a2-8879-ce3808cb0a17-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr\" (UID: \"a5db7316-6efa-49a2-8879-ce3808cb0a17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr" Jun 03 03:30:04.360639 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:04.360595 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5db7316-6efa-49a2-8879-ce3808cb0a17-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr\" (UID: \"a5db7316-6efa-49a2-8879-ce3808cb0a17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr" Jun 03 03:30:04.360892 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:04.360690 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6tx8c\" (UniqueName: \"kubernetes.io/projected/a5db7316-6efa-49a2-8879-ce3808cb0a17-kube-api-access-6tx8c\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr\" (UID: \"a5db7316-6efa-49a2-8879-ce3808cb0a17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr" Jun 03 03:30:04.361082 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:04.361051 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5db7316-6efa-49a2-8879-ce3808cb0a17-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr\" (UID: \"a5db7316-6efa-49a2-8879-ce3808cb0a17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr" Jun 03 03:30:04.374958 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:04.374929 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tx8c\" (UniqueName: \"kubernetes.io/projected/a5db7316-6efa-49a2-8879-ce3808cb0a17-kube-api-access-6tx8c\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr\" (UID: \"a5db7316-6efa-49a2-8879-ce3808cb0a17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr" Jun 03 03:30:04.384722 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:04.384668 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nrmln" Jun 03 03:30:04.386496 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:04.386457 2558 status_manager.go:895] "Failed to get status for pod" podUID="e31b4206-a350-4ee6-82e6-dee85e54a5ba" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nrmln" err="pods \"limitador-operator-controller-manager-85c4996f8c-nrmln\" is forbidden: User \"system:node:ip-10-0-141-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-253.ec2.internal' and this object" Jun 03 03:30:04.461187 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:04.461151 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v92gn\" (UniqueName: \"kubernetes.io/projected/e31b4206-a350-4ee6-82e6-dee85e54a5ba-kube-api-access-v92gn\") pod \"e31b4206-a350-4ee6-82e6-dee85e54a5ba\" (UID: \"e31b4206-a350-4ee6-82e6-dee85e54a5ba\") " Jun 03 03:30:04.463463 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:04.463431 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e31b4206-a350-4ee6-82e6-dee85e54a5ba-kube-api-access-v92gn" (OuterVolumeSpecName: "kube-api-access-v92gn") pod "e31b4206-a350-4ee6-82e6-dee85e54a5ba" (UID: "e31b4206-a350-4ee6-82e6-dee85e54a5ba"). InnerVolumeSpecName "kube-api-access-v92gn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:30:04.530732 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:04.530695 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr" Jun 03 03:30:04.561922 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:04.561883 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v92gn\" (UniqueName: \"kubernetes.io/projected/e31b4206-a350-4ee6-82e6-dee85e54a5ba-kube-api-access-v92gn\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:30:04.691588 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:04.691561 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr"] Jun 03 03:30:04.694391 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:30:04.694368 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5db7316_6efa_49a2_8879_ce3808cb0a17.slice/crio-9471c4070467fb7b178426c1f36bcd9bdd181e868e239fa1331666490ff3ab2f WatchSource:0}: Error finding container 9471c4070467fb7b178426c1f36bcd9bdd181e868e239fa1331666490ff3ab2f: Status 404 returned error can't find the container with id 9471c4070467fb7b178426c1f36bcd9bdd181e868e239fa1331666490ff3ab2f Jun 03 03:30:05.197981 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:05.197943 2558 generic.go:358] "Generic (PLEG): container finished" podID="e31b4206-a350-4ee6-82e6-dee85e54a5ba" containerID="aeee5f1efd5ed19f71dc0c87304b3c9c0715a9c82769cfca1286ee333af6c5ae" exitCode=0 Jun 03 03:30:05.198179 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:05.198021 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nrmln" Jun 03 03:30:05.198179 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:05.198046 2558 scope.go:117] "RemoveContainer" containerID="aeee5f1efd5ed19f71dc0c87304b3c9c0715a9c82769cfca1286ee333af6c5ae" Jun 03 03:30:05.200136 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:05.200100 2558 status_manager.go:895] "Failed to get status for pod" podUID="e31b4206-a350-4ee6-82e6-dee85e54a5ba" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nrmln" err="pods \"limitador-operator-controller-manager-85c4996f8c-nrmln\" is forbidden: User \"system:node:ip-10-0-141-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-253.ec2.internal' and this object" Jun 03 03:30:05.200307 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:05.200280 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr" event={"ID":"a5db7316-6efa-49a2-8879-ce3808cb0a17","Type":"ContainerStarted","Data":"9471c4070467fb7b178426c1f36bcd9bdd181e868e239fa1331666490ff3ab2f"} Jun 03 03:30:05.210379 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:05.210359 2558 scope.go:117] "RemoveContainer" containerID="aeee5f1efd5ed19f71dc0c87304b3c9c0715a9c82769cfca1286ee333af6c5ae" Jun 03 03:30:05.211138 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:30:05.211090 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aeee5f1efd5ed19f71dc0c87304b3c9c0715a9c82769cfca1286ee333af6c5ae\": container with ID starting with aeee5f1efd5ed19f71dc0c87304b3c9c0715a9c82769cfca1286ee333af6c5ae not found: ID does not exist" containerID="aeee5f1efd5ed19f71dc0c87304b3c9c0715a9c82769cfca1286ee333af6c5ae" Jun 03 03:30:05.211261 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:05.211140 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeee5f1efd5ed19f71dc0c87304b3c9c0715a9c82769cfca1286ee333af6c5ae"} err="failed to get container status \"aeee5f1efd5ed19f71dc0c87304b3c9c0715a9c82769cfca1286ee333af6c5ae\": rpc error: code = NotFound desc = could not find container \"aeee5f1efd5ed19f71dc0c87304b3c9c0715a9c82769cfca1286ee333af6c5ae\": container with ID starting with aeee5f1efd5ed19f71dc0c87304b3c9c0715a9c82769cfca1286ee333af6c5ae not found: ID does not exist" Jun 03 03:30:05.212830 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:05.212734 2558 status_manager.go:895] "Failed to get status for pod" podUID="e31b4206-a350-4ee6-82e6-dee85e54a5ba" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nrmln" err="pods \"limitador-operator-controller-manager-85c4996f8c-nrmln\" is forbidden: User \"system:node:ip-10-0-141-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-253.ec2.internal' and this object" Jun 03 03:30:05.371007 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:05.370962 2558 status_manager.go:895] "Failed to get status for pod" podUID="e31b4206-a350-4ee6-82e6-dee85e54a5ba" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nrmln" err="pods \"limitador-operator-controller-manager-85c4996f8c-nrmln\" is forbidden: User \"system:node:ip-10-0-141-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-253.ec2.internal' and this object" Jun 03 03:30:05.371680 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:05.371653 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e31b4206-a350-4ee6-82e6-dee85e54a5ba" path="/var/lib/kubelet/pods/e31b4206-a350-4ee6-82e6-dee85e54a5ba/volumes" Jun 03 03:30:09.217058 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:09.217021 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr" event={"ID":"a5db7316-6efa-49a2-8879-ce3808cb0a17","Type":"ContainerStarted","Data":"c4d4096dfdb7289d664e7125dc245526898f268f7bfc8fe495498d9dc7c1de0d"} Jun 03 03:30:09.217469 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:09.217138 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr" Jun 03 03:30:09.218415 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:09.218392 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-slll6" podUID="1f90a015-9d27-48f4-b90a-62947611c674" containerName="manager" containerID="cri-o://d85b48f52fef2806242d562115abd5b7aa2f979a4f0636ffe139384a569fba8a" gracePeriod=2 Jun 03 03:30:09.234763 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:09.234723 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr" podStartSLOduration=1.5752002539999999 podStartE2EDuration="5.234712269s" podCreationTimestamp="2026-06-03 03:30:04 +0000 UTC" firstStartedPulling="2026-06-03 03:30:04.697627538 +0000 UTC m=+579.869537390" lastFinishedPulling="2026-06-03 03:30:08.357139554 +0000 UTC m=+583.529049405" observedRunningTime="2026-06-03 03:30:09.232840421 +0000 UTC m=+584.404750291" watchObservedRunningTime="2026-06-03 03:30:09.234712269 +0000 UTC m=+584.406622138" Jun 03 03:30:09.446384 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:09.446364 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-slll6" Jun 03 03:30:09.505789 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:09.505762 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d774p\" (UniqueName: \"kubernetes.io/projected/1f90a015-9d27-48f4-b90a-62947611c674-kube-api-access-d774p\") pod \"1f90a015-9d27-48f4-b90a-62947611c674\" (UID: \"1f90a015-9d27-48f4-b90a-62947611c674\") " Jun 03 03:30:09.505924 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:09.505831 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f90a015-9d27-48f4-b90a-62947611c674-extensions-socket-volume\") pod \"1f90a015-9d27-48f4-b90a-62947611c674\" (UID: \"1f90a015-9d27-48f4-b90a-62947611c674\") " Jun 03 03:30:09.506104 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:09.506082 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f90a015-9d27-48f4-b90a-62947611c674-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1f90a015-9d27-48f4-b90a-62947611c674" (UID: "1f90a015-9d27-48f4-b90a-62947611c674"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:30:09.507765 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:09.507747 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f90a015-9d27-48f4-b90a-62947611c674-kube-api-access-d774p" (OuterVolumeSpecName: "kube-api-access-d774p") pod "1f90a015-9d27-48f4-b90a-62947611c674" (UID: "1f90a015-9d27-48f4-b90a-62947611c674"). InnerVolumeSpecName "kube-api-access-d774p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:30:09.606864 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:09.606831 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d774p\" (UniqueName: \"kubernetes.io/projected/1f90a015-9d27-48f4-b90a-62947611c674-kube-api-access-d774p\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:30:09.606864 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:09.606864 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f90a015-9d27-48f4-b90a-62947611c674-extensions-socket-volume\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:30:10.223093 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:10.223059 2558 generic.go:358] "Generic (PLEG): container finished" podID="1f90a015-9d27-48f4-b90a-62947611c674" containerID="d85b48f52fef2806242d562115abd5b7aa2f979a4f0636ffe139384a569fba8a" exitCode=2 Jun 03 03:30:10.223543 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:10.223118 2558 scope.go:117] "RemoveContainer" containerID="d85b48f52fef2806242d562115abd5b7aa2f979a4f0636ffe139384a569fba8a" Jun 03 03:30:10.223543 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:10.223120 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-slll6" Jun 03 03:30:10.225421 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:10.225394 2558 status_manager.go:895] "Failed to get status for pod" podUID="1f90a015-9d27-48f4-b90a-62947611c674" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-slll6" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-slll6\" is forbidden: User \"system:node:ip-10-0-141-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-253.ec2.internal' and this object" Jun 03 03:30:10.231027 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:10.231012 2558 scope.go:117] "RemoveContainer" containerID="d85b48f52fef2806242d562115abd5b7aa2f979a4f0636ffe139384a569fba8a" Jun 03 03:30:10.231350 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:30:10.231332 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d85b48f52fef2806242d562115abd5b7aa2f979a4f0636ffe139384a569fba8a\": container with ID starting with d85b48f52fef2806242d562115abd5b7aa2f979a4f0636ffe139384a569fba8a not found: ID does not exist" containerID="d85b48f52fef2806242d562115abd5b7aa2f979a4f0636ffe139384a569fba8a" Jun 03 03:30:10.231408 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:10.231360 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d85b48f52fef2806242d562115abd5b7aa2f979a4f0636ffe139384a569fba8a"} err="failed to get container status \"d85b48f52fef2806242d562115abd5b7aa2f979a4f0636ffe139384a569fba8a\": rpc error: code = NotFound desc = could not find container \"d85b48f52fef2806242d562115abd5b7aa2f979a4f0636ffe139384a569fba8a\": container with ID starting with d85b48f52fef2806242d562115abd5b7aa2f979a4f0636ffe139384a569fba8a not found: ID does not exist" Jun 03 03:30:10.232889 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:10.232868 2558 status_manager.go:895] "Failed to get status for pod" podUID="1f90a015-9d27-48f4-b90a-62947611c674" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-slll6" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-slll6\" is forbidden: User \"system:node:ip-10-0-141-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-253.ec2.internal' and this object" Jun 03 03:30:11.370319 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:11.370285 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f90a015-9d27-48f4-b90a-62947611c674" path="/var/lib/kubelet/pods/1f90a015-9d27-48f4-b90a-62947611c674/volumes" Jun 03 03:30:20.225857 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:20.225825 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr" Jun 03 03:30:25.322620 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:25.322595 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-tq7jg_3f53d812-13d2-4aae-9673-a8b3c90386e9/console-operator/1.log" Jun 03 03:30:25.323050 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:25.322646 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-tq7jg_3f53d812-13d2-4aae-9673-a8b3c90386e9/console-operator/1.log" Jun 03 03:30:25.328420 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:25.328401 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/ovn-acl-logging/0.log" Jun 03 03:30:25.328420 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:25.328408 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/ovn-acl-logging/0.log" Jun 03 03:30:32.666154 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:32.666117 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr"] Jun 03 03:30:32.666563 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:32.666371 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr" podUID="a5db7316-6efa-49a2-8879-ce3808cb0a17" containerName="manager" containerID="cri-o://c4d4096dfdb7289d664e7125dc245526898f268f7bfc8fe495498d9dc7c1de0d" gracePeriod=10 Jun 03 03:30:32.914811 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:32.914782 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr" Jun 03 03:30:32.990217 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:32.990158 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5db7316-6efa-49a2-8879-ce3808cb0a17-extensions-socket-volume\") pod \"a5db7316-6efa-49a2-8879-ce3808cb0a17\" (UID: \"a5db7316-6efa-49a2-8879-ce3808cb0a17\") " Jun 03 03:30:32.990335 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:32.990227 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tx8c\" (UniqueName: \"kubernetes.io/projected/a5db7316-6efa-49a2-8879-ce3808cb0a17-kube-api-access-6tx8c\") pod \"a5db7316-6efa-49a2-8879-ce3808cb0a17\" (UID: \"a5db7316-6efa-49a2-8879-ce3808cb0a17\") " Jun 03 03:30:32.990527 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:32.990508 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5db7316-6efa-49a2-8879-ce3808cb0a17-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a5db7316-6efa-49a2-8879-ce3808cb0a17" (UID: "a5db7316-6efa-49a2-8879-ce3808cb0a17"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:30:32.992236 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:32.992216 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5db7316-6efa-49a2-8879-ce3808cb0a17-kube-api-access-6tx8c" (OuterVolumeSpecName: "kube-api-access-6tx8c") pod "a5db7316-6efa-49a2-8879-ce3808cb0a17" (UID: "a5db7316-6efa-49a2-8879-ce3808cb0a17"). InnerVolumeSpecName "kube-api-access-6tx8c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:30:33.093086 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:33.093056 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5db7316-6efa-49a2-8879-ce3808cb0a17-extensions-socket-volume\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:30:33.093086 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:33.093083 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tx8c\" (UniqueName: \"kubernetes.io/projected/a5db7316-6efa-49a2-8879-ce3808cb0a17-kube-api-access-6tx8c\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:30:33.298173 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:33.298142 2558 generic.go:358] "Generic (PLEG): container finished" podID="a5db7316-6efa-49a2-8879-ce3808cb0a17" containerID="c4d4096dfdb7289d664e7125dc245526898f268f7bfc8fe495498d9dc7c1de0d" exitCode=0 Jun 03 03:30:33.298367 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:33.298231 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr" Jun 03 03:30:33.298367 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:33.298229 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr" event={"ID":"a5db7316-6efa-49a2-8879-ce3808cb0a17","Type":"ContainerDied","Data":"c4d4096dfdb7289d664e7125dc245526898f268f7bfc8fe495498d9dc7c1de0d"} Jun 03 03:30:33.298367 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:33.298284 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr" event={"ID":"a5db7316-6efa-49a2-8879-ce3808cb0a17","Type":"ContainerDied","Data":"9471c4070467fb7b178426c1f36bcd9bdd181e868e239fa1331666490ff3ab2f"} Jun 03 03:30:33.298367 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:33.298304 2558 scope.go:117] "RemoveContainer" containerID="c4d4096dfdb7289d664e7125dc245526898f268f7bfc8fe495498d9dc7c1de0d" Jun 03 03:30:33.306394 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:33.306378 2558 scope.go:117] "RemoveContainer" containerID="c4d4096dfdb7289d664e7125dc245526898f268f7bfc8fe495498d9dc7c1de0d" Jun 03 03:30:33.306614 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:30:33.306597 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4d4096dfdb7289d664e7125dc245526898f268f7bfc8fe495498d9dc7c1de0d\": container with ID starting with c4d4096dfdb7289d664e7125dc245526898f268f7bfc8fe495498d9dc7c1de0d not found: ID does not exist" containerID="c4d4096dfdb7289d664e7125dc245526898f268f7bfc8fe495498d9dc7c1de0d" Jun 03 03:30:33.306664 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:33.306620 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4d4096dfdb7289d664e7125dc245526898f268f7bfc8fe495498d9dc7c1de0d"} err="failed to get container status \"c4d4096dfdb7289d664e7125dc245526898f268f7bfc8fe495498d9dc7c1de0d\": rpc error: code = NotFound desc = could not find container \"c4d4096dfdb7289d664e7125dc245526898f268f7bfc8fe495498d9dc7c1de0d\": container with ID starting with c4d4096dfdb7289d664e7125dc245526898f268f7bfc8fe495498d9dc7c1de0d not found: ID does not exist" Jun 03 03:30:33.320701 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:33.320682 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr"] Jun 03 03:30:33.324606 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:33.324588 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-wtjvr"] Jun 03 03:30:33.369908 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:33.369886 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5db7316-6efa-49a2-8879-ce3808cb0a17" path="/var/lib/kubelet/pods/a5db7316-6efa-49a2-8879-ce3808cb0a17/volumes" Jun 03 03:30:36.516457 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.516427 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44"] Jun 03 03:30:36.516810 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.516734 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5db7316-6efa-49a2-8879-ce3808cb0a17" containerName="manager" Jun 03 03:30:36.516810 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.516744 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5db7316-6efa-49a2-8879-ce3808cb0a17" containerName="manager" Jun 03 03:30:36.516810 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.516761 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f90a015-9d27-48f4-b90a-62947611c674" containerName="manager" Jun 03 03:30:36.516810 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.516766 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f90a015-9d27-48f4-b90a-62947611c674" containerName="manager" Jun 03 03:30:36.516810 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.516774 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e31b4206-a350-4ee6-82e6-dee85e54a5ba" containerName="manager" Jun 03 03:30:36.516810 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.516779 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e31b4206-a350-4ee6-82e6-dee85e54a5ba" containerName="manager" Jun 03 03:30:36.516987 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.516847 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="a5db7316-6efa-49a2-8879-ce3808cb0a17" containerName="manager" Jun 03 03:30:36.516987 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.516854 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="e31b4206-a350-4ee6-82e6-dee85e54a5ba" containerName="manager" Jun 03 03:30:36.516987 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.516865 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f90a015-9d27-48f4-b90a-62947611c674" containerName="manager" Jun 03 03:30:36.521158 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.521142 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.523279 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.523259 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-xg9vh\"" Jun 03 03:30:36.527806 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.527784 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44"] Jun 03 03:30:36.624382 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.624353 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.624497 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.624386 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.624497 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.624409 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.624497 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.624483 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.624595 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.624528 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6pbm\" (UniqueName: \"kubernetes.io/projected/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-kube-api-access-d6pbm\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.624634 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.624601 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.624634 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.624628 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.624695 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.624657 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.624695 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.624686 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.726073 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.726043 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.726209 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.726077 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.726209 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.726109 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.726209 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.726137 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.726368 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.726208 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.726368 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.726238 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.726368 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.726274 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.726368 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.726328 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.726570 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.726396 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d6pbm\" (UniqueName: \"kubernetes.io/projected/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-kube-api-access-d6pbm\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.726570 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.726480 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.726570 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.726523 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.726828 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.726798 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.726920 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.726857 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.727246 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.727223 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.728471 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.728452 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.728698 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.728679 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.733681 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.733658 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6pbm\" (UniqueName: \"kubernetes.io/projected/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-kube-api-access-d6pbm\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.733868 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.733851 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e09cbaba-4ad4-49c4-b717-379ca8a1b59d-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-xzr44\" (UID: \"e09cbaba-4ad4-49c4-b717-379ca8a1b59d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.833832 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.833766 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:36.969852 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.969829 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44"] Jun 03 03:30:36.972125 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:30:36.972092 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode09cbaba_4ad4_49c4_b717_379ca8a1b59d.slice/crio-d95b1ea7295ec2111b65f56bf1daeab29f8fadb45e8ef685e16801b3f7caa743 WatchSource:0}: Error finding container d95b1ea7295ec2111b65f56bf1daeab29f8fadb45e8ef685e16801b3f7caa743: Status 404 returned error can't find the container with id d95b1ea7295ec2111b65f56bf1daeab29f8fadb45e8ef685e16801b3f7caa743 Jun 03 03:30:36.974220 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.974188 2558 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 03:30:36.974325 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.974260 2558 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 03:30:36.974325 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:36.974299 2558 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 03:30:37.321830 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:37.321776 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" event={"ID":"e09cbaba-4ad4-49c4-b717-379ca8a1b59d","Type":"ContainerStarted","Data":"5e9843c08f0dc3baafad7a5c1e4127efef2f69a5977db779f4cbf8e26f41ce4d"} Jun 03 03:30:37.321830 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:37.321829 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" event={"ID":"e09cbaba-4ad4-49c4-b717-379ca8a1b59d","Type":"ContainerStarted","Data":"d95b1ea7295ec2111b65f56bf1daeab29f8fadb45e8ef685e16801b3f7caa743"} Jun 03 03:30:37.340508 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:37.340462 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" podStartSLOduration=1.340448637 podStartE2EDuration="1.340448637s" podCreationTimestamp="2026-06-03 03:30:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:30:37.338817197 +0000 UTC m=+612.510727070" watchObservedRunningTime="2026-06-03 03:30:37.340448637 +0000 UTC m=+612.512358508" Jun 03 03:30:37.834862 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:37.834837 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:38.839205 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:38.839173 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:39.328264 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:39.328235 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:39.329231 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:39.329213 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-xzr44" Jun 03 03:30:53.030508 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:53.030471 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-6tgkc"] Jun 03 03:30:53.033762 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:53.033747 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-6tgkc" Jun 03 03:30:53.035950 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:53.035913 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 03:30:53.036072 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:53.035950 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kxdrd\"" Jun 03 03:30:53.039331 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:53.039307 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-6tgkc"] Jun 03 03:30:53.133025 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:53.132980 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-6tgkc"] Jun 03 03:30:53.176085 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:53.176055 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3b352465-ce84-4746-865b-6153c0d9ea3e-config-file\") pod \"limitador-limitador-7d549b5b-6tgkc\" (UID: \"3b352465-ce84-4746-865b-6153c0d9ea3e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-6tgkc" Jun 03 03:30:53.176245 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:53.176113 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfk8f\" (UniqueName: \"kubernetes.io/projected/3b352465-ce84-4746-865b-6153c0d9ea3e-kube-api-access-vfk8f\") pod \"limitador-limitador-7d549b5b-6tgkc\" (UID: \"3b352465-ce84-4746-865b-6153c0d9ea3e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-6tgkc" Jun 03 03:30:53.277144 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:53.277110 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfk8f\" (UniqueName: \"kubernetes.io/projected/3b352465-ce84-4746-865b-6153c0d9ea3e-kube-api-access-vfk8f\") pod \"limitador-limitador-7d549b5b-6tgkc\" (UID: \"3b352465-ce84-4746-865b-6153c0d9ea3e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-6tgkc" Jun 03 03:30:53.277303 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:53.277185 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3b352465-ce84-4746-865b-6153c0d9ea3e-config-file\") pod \"limitador-limitador-7d549b5b-6tgkc\" (UID: \"3b352465-ce84-4746-865b-6153c0d9ea3e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-6tgkc" Jun 03 03:30:53.277715 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:53.277697 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3b352465-ce84-4746-865b-6153c0d9ea3e-config-file\") pod \"limitador-limitador-7d549b5b-6tgkc\" (UID: \"3b352465-ce84-4746-865b-6153c0d9ea3e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-6tgkc" Jun 03 03:30:53.285100 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:53.285035 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfk8f\" (UniqueName: \"kubernetes.io/projected/3b352465-ce84-4746-865b-6153c0d9ea3e-kube-api-access-vfk8f\") pod \"limitador-limitador-7d549b5b-6tgkc\" (UID: \"3b352465-ce84-4746-865b-6153c0d9ea3e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-6tgkc" Jun 03 03:30:53.345499 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:53.345461 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-6tgkc" Jun 03 03:30:53.474568 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:53.474507 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-6tgkc"] Jun 03 03:30:53.476822 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:30:53.476795 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b352465_ce84_4746_865b_6153c0d9ea3e.slice/crio-c5318306644b9c1c967b11e0e2f48d769c44d9387dbd7754fa06d822b2ab13ee WatchSource:0}: Error finding container c5318306644b9c1c967b11e0e2f48d769c44d9387dbd7754fa06d822b2ab13ee: Status 404 returned error can't find the container with id c5318306644b9c1c967b11e0e2f48d769c44d9387dbd7754fa06d822b2ab13ee Jun 03 03:30:54.006919 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:54.006886 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-cjlvf"] Jun 03 03:30:54.010184 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:54.010169 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-cjlvf" Jun 03 03:30:54.012245 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:54.012224 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8f24r\"" Jun 03 03:30:54.021367 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:54.021345 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-cjlvf"] Jun 03 03:30:54.184933 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:54.184894 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tktj5\" (UniqueName: \"kubernetes.io/projected/f0b51389-31c1-4f34-967e-0a57ea642212-kube-api-access-tktj5\") pod \"authorino-7498df8756-cjlvf\" (UID: \"f0b51389-31c1-4f34-967e-0a57ea642212\") " pod="kuadrant-system/authorino-7498df8756-cjlvf" Jun 03 03:30:54.285896 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:54.285813 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tktj5\" (UniqueName: \"kubernetes.io/projected/f0b51389-31c1-4f34-967e-0a57ea642212-kube-api-access-tktj5\") pod \"authorino-7498df8756-cjlvf\" (UID: \"f0b51389-31c1-4f34-967e-0a57ea642212\") " pod="kuadrant-system/authorino-7498df8756-cjlvf" Jun 03 03:30:54.299289 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:54.299225 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tktj5\" (UniqueName: \"kubernetes.io/projected/f0b51389-31c1-4f34-967e-0a57ea642212-kube-api-access-tktj5\") pod \"authorino-7498df8756-cjlvf\" (UID: \"f0b51389-31c1-4f34-967e-0a57ea642212\") " pod="kuadrant-system/authorino-7498df8756-cjlvf" Jun 03 03:30:54.327256 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:54.326737 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-cjlvf" Jun 03 03:30:54.379788 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:54.379720 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-6tgkc" event={"ID":"3b352465-ce84-4746-865b-6153c0d9ea3e","Type":"ContainerStarted","Data":"c5318306644b9c1c967b11e0e2f48d769c44d9387dbd7754fa06d822b2ab13ee"} Jun 03 03:30:54.493921 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:54.493891 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-cjlvf"] Jun 03 03:30:54.496809 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:30:54.496768 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0b51389_31c1_4f34_967e_0a57ea642212.slice/crio-b0d2521938abe73a99ae01d9d25000a0321e8b93f015ec6f2499dd6461d55775 WatchSource:0}: Error finding container b0d2521938abe73a99ae01d9d25000a0321e8b93f015ec6f2499dd6461d55775: Status 404 returned error can't find the container with id b0d2521938abe73a99ae01d9d25000a0321e8b93f015ec6f2499dd6461d55775 Jun 03 03:30:55.384781 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:55.384748 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-cjlvf" event={"ID":"f0b51389-31c1-4f34-967e-0a57ea642212","Type":"ContainerStarted","Data":"b0d2521938abe73a99ae01d9d25000a0321e8b93f015ec6f2499dd6461d55775"} Jun 03 03:30:56.391603 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:56.391549 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-6tgkc" event={"ID":"3b352465-ce84-4746-865b-6153c0d9ea3e","Type":"ContainerStarted","Data":"6fb04471f1973e8063553db0431dc76f46a0c375c533d0b5235a7644d5a32468"} Jun 03 03:30:56.392070 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:56.391795 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-6tgkc" Jun 03 03:30:56.407893 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:56.407805 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-6tgkc" podStartSLOduration=0.602104046 podStartE2EDuration="3.407787162s" podCreationTimestamp="2026-06-03 03:30:53 +0000 UTC" firstStartedPulling="2026-06-03 03:30:53.478473294 +0000 UTC m=+628.650383144" lastFinishedPulling="2026-06-03 03:30:56.284156397 +0000 UTC m=+631.456066260" observedRunningTime="2026-06-03 03:30:56.405387232 +0000 UTC m=+631.577297104" watchObservedRunningTime="2026-06-03 03:30:56.407787162 +0000 UTC m=+631.579697036" Jun 03 03:30:59.404171 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:59.404138 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-cjlvf" event={"ID":"f0b51389-31c1-4f34-967e-0a57ea642212","Type":"ContainerStarted","Data":"15242ff9f5cfae80e62227fb08b0780cc58e6943f82c5dcf99977cf061210669"} Jun 03 03:30:59.416960 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:30:59.416902 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-cjlvf" podStartSLOduration=2.275627198 podStartE2EDuration="6.416884431s" podCreationTimestamp="2026-06-03 03:30:53 +0000 UTC" firstStartedPulling="2026-06-03 03:30:54.498566623 +0000 UTC m=+629.670476476" lastFinishedPulling="2026-06-03 03:30:58.639823841 +0000 UTC m=+633.811733709" observedRunningTime="2026-06-03 03:30:59.416067719 +0000 UTC m=+634.587977590" watchObservedRunningTime="2026-06-03 03:30:59.416884431 +0000 UTC m=+634.588794304" Jun 03 03:31:07.395985 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:07.395943 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-6tgkc" Jun 03 03:31:07.773944 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:07.773907 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-6tgkc"] Jun 03 03:31:07.774175 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:07.774124 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-6tgkc" podUID="3b352465-ce84-4746-865b-6153c0d9ea3e" containerName="limitador" containerID="cri-o://6fb04471f1973e8063553db0431dc76f46a0c375c533d0b5235a7644d5a32468" gracePeriod=30 Jun 03 03:31:08.437239 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:08.437144 2558 generic.go:358] "Generic (PLEG): container finished" podID="3b352465-ce84-4746-865b-6153c0d9ea3e" containerID="6fb04471f1973e8063553db0431dc76f46a0c375c533d0b5235a7644d5a32468" exitCode=0 Jun 03 03:31:08.437239 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:08.437217 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-6tgkc" event={"ID":"3b352465-ce84-4746-865b-6153c0d9ea3e","Type":"ContainerDied","Data":"6fb04471f1973e8063553db0431dc76f46a0c375c533d0b5235a7644d5a32468"} Jun 03 03:31:08.721557 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:08.721532 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-6tgkc" Jun 03 03:31:08.808302 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:08.808267 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3b352465-ce84-4746-865b-6153c0d9ea3e-config-file\") pod \"3b352465-ce84-4746-865b-6153c0d9ea3e\" (UID: \"3b352465-ce84-4746-865b-6153c0d9ea3e\") " Jun 03 03:31:08.808302 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:08.808308 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfk8f\" (UniqueName: \"kubernetes.io/projected/3b352465-ce84-4746-865b-6153c0d9ea3e-kube-api-access-vfk8f\") pod \"3b352465-ce84-4746-865b-6153c0d9ea3e\" (UID: \"3b352465-ce84-4746-865b-6153c0d9ea3e\") " Jun 03 03:31:08.808696 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:08.808670 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b352465-ce84-4746-865b-6153c0d9ea3e-config-file" (OuterVolumeSpecName: "config-file") pod "3b352465-ce84-4746-865b-6153c0d9ea3e" (UID: "3b352465-ce84-4746-865b-6153c0d9ea3e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:31:08.810434 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:08.810407 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b352465-ce84-4746-865b-6153c0d9ea3e-kube-api-access-vfk8f" (OuterVolumeSpecName: "kube-api-access-vfk8f") pod "3b352465-ce84-4746-865b-6153c0d9ea3e" (UID: "3b352465-ce84-4746-865b-6153c0d9ea3e"). InnerVolumeSpecName "kube-api-access-vfk8f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:31:08.908920 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:08.908881 2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3b352465-ce84-4746-865b-6153c0d9ea3e-config-file\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:31:08.908920 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:08.908915 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfk8f\" (UniqueName: \"kubernetes.io/projected/3b352465-ce84-4746-865b-6153c0d9ea3e-kube-api-access-vfk8f\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:31:09.441217 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:09.441181 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-6tgkc" event={"ID":"3b352465-ce84-4746-865b-6153c0d9ea3e","Type":"ContainerDied","Data":"c5318306644b9c1c967b11e0e2f48d769c44d9387dbd7754fa06d822b2ab13ee"} Jun 03 03:31:09.441217 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:09.441226 2558 scope.go:117] "RemoveContainer" containerID="6fb04471f1973e8063553db0431dc76f46a0c375c533d0b5235a7644d5a32468" Jun 03 03:31:09.441679 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:09.441244 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-6tgkc" Jun 03 03:31:09.455773 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:09.455747 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-6tgkc"] Jun 03 03:31:09.460255 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:09.460230 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-6tgkc"] Jun 03 03:31:11.370120 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:11.370087 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b352465-ce84-4746-865b-6153c0d9ea3e" path="/var/lib/kubelet/pods/3b352465-ce84-4746-865b-6153c0d9ea3e/volumes" Jun 03 03:31:11.838637 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:11.838603 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-wwx4c"] Jun 03 03:31:11.838943 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:11.838930 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b352465-ce84-4746-865b-6153c0d9ea3e" containerName="limitador" Jun 03 03:31:11.839015 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:11.838944 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b352465-ce84-4746-865b-6153c0d9ea3e" containerName="limitador" Jun 03 03:31:11.839079 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:11.839066 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="3b352465-ce84-4746-865b-6153c0d9ea3e" containerName="limitador" Jun 03 03:31:11.843568 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:11.843551 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-wwx4c" Jun 03 03:31:11.845673 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:11.845655 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 03 03:31:11.848973 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:11.848949 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-wwx4c"] Jun 03 03:31:11.931544 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:11.931516 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/733c3d37-8ba8-4a05-9c1d-15d428413fee-data\") pod \"postgres-68c4fbbd6f-wwx4c\" (UID: \"733c3d37-8ba8-4a05-9c1d-15d428413fee\") " pod="opendatahub/postgres-68c4fbbd6f-wwx4c" Jun 03 03:31:11.931694 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:11.931575 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww5zt\" (UniqueName: \"kubernetes.io/projected/733c3d37-8ba8-4a05-9c1d-15d428413fee-kube-api-access-ww5zt\") pod \"postgres-68c4fbbd6f-wwx4c\" (UID: \"733c3d37-8ba8-4a05-9c1d-15d428413fee\") " pod="opendatahub/postgres-68c4fbbd6f-wwx4c" Jun 03 03:31:12.032545 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:12.032518 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/733c3d37-8ba8-4a05-9c1d-15d428413fee-data\") pod \"postgres-68c4fbbd6f-wwx4c\" (UID: \"733c3d37-8ba8-4a05-9c1d-15d428413fee\") " pod="opendatahub/postgres-68c4fbbd6f-wwx4c" Jun 03 03:31:12.032687 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:12.032579 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ww5zt\" (UniqueName: \"kubernetes.io/projected/733c3d37-8ba8-4a05-9c1d-15d428413fee-kube-api-access-ww5zt\") pod \"postgres-68c4fbbd6f-wwx4c\" (UID: \"733c3d37-8ba8-4a05-9c1d-15d428413fee\") " pod="opendatahub/postgres-68c4fbbd6f-wwx4c" Jun 03 03:31:12.032897 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:12.032879 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/733c3d37-8ba8-4a05-9c1d-15d428413fee-data\") pod \"postgres-68c4fbbd6f-wwx4c\" (UID: \"733c3d37-8ba8-4a05-9c1d-15d428413fee\") " pod="opendatahub/postgres-68c4fbbd6f-wwx4c" Jun 03 03:31:12.040059 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:12.040036 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww5zt\" (UniqueName: \"kubernetes.io/projected/733c3d37-8ba8-4a05-9c1d-15d428413fee-kube-api-access-ww5zt\") pod \"postgres-68c4fbbd6f-wwx4c\" (UID: \"733c3d37-8ba8-4a05-9c1d-15d428413fee\") " pod="opendatahub/postgres-68c4fbbd6f-wwx4c" Jun 03 03:31:12.154895 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:12.154834 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-wwx4c" Jun 03 03:31:12.283627 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:12.283603 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-wwx4c"] Jun 03 03:31:12.285812 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:31:12.285783 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod733c3d37_8ba8_4a05_9c1d_15d428413fee.slice/crio-22ac7d6a6780b14a91264ed3382b89be1464f7d383fe0f5a49412771eb9b4d17 WatchSource:0}: Error finding container 22ac7d6a6780b14a91264ed3382b89be1464f7d383fe0f5a49412771eb9b4d17: Status 404 returned error can't find the container with id 22ac7d6a6780b14a91264ed3382b89be1464f7d383fe0f5a49412771eb9b4d17 Jun 03 03:31:12.451689 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:12.451617 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-wwx4c" event={"ID":"733c3d37-8ba8-4a05-9c1d-15d428413fee","Type":"ContainerStarted","Data":"22ac7d6a6780b14a91264ed3382b89be1464f7d383fe0f5a49412771eb9b4d17"} Jun 03 03:31:15.462449 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:15.462414 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-wwx4c" event={"ID":"733c3d37-8ba8-4a05-9c1d-15d428413fee","Type":"ContainerStarted","Data":"45b05e1885d8e9803b3c9cda184cb37dc284820be6e4979795fdea4b59713dec"} Jun 03 03:31:15.462895 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:15.462574 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-wwx4c" Jun 03 03:31:15.478740 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:15.478697 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-wwx4c" podStartSLOduration=2.180648913 podStartE2EDuration="4.478684404s" podCreationTimestamp="2026-06-03 03:31:11 +0000 UTC" firstStartedPulling="2026-06-03 03:31:12.287298936 +0000 UTC m=+647.459208791" lastFinishedPulling="2026-06-03 03:31:14.58533443 +0000 UTC m=+649.757244282" observedRunningTime="2026-06-03 03:31:15.477796953 +0000 UTC m=+650.649706825" watchObservedRunningTime="2026-06-03 03:31:15.478684404 +0000 UTC m=+650.650594275" Jun 03 03:31:21.496561 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:21.496532 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-wwx4c" Jun 03 03:31:30.128663 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:30.128618 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-fwqvr"] Jun 03 03:31:30.137476 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:30.137452 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-fwqvr" Jun 03 03:31:30.140169 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:30.140148 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-p5sq7\"" Jun 03 03:31:30.140169 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:30.140163 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 03:31:30.140392 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:30.140164 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 03:31:30.141099 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:30.141069 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-fwqvr"] Jun 03 03:31:30.191935 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:30.191897 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4thxw\" (UniqueName: \"kubernetes.io/projected/0bce10bf-ba99-4589-9df1-880bf117ca29-kube-api-access-4thxw\") pod \"keycloak-operator-7864d68cbd-fwqvr\" (UID: \"0bce10bf-ba99-4589-9df1-880bf117ca29\") " pod="keycloak-system/keycloak-operator-7864d68cbd-fwqvr" Jun 03 03:31:30.293004 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:30.292966 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4thxw\" (UniqueName: \"kubernetes.io/projected/0bce10bf-ba99-4589-9df1-880bf117ca29-kube-api-access-4thxw\") pod \"keycloak-operator-7864d68cbd-fwqvr\" (UID: \"0bce10bf-ba99-4589-9df1-880bf117ca29\") " pod="keycloak-system/keycloak-operator-7864d68cbd-fwqvr" Jun 03 03:31:30.300899 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:30.300872 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4thxw\" (UniqueName: \"kubernetes.io/projected/0bce10bf-ba99-4589-9df1-880bf117ca29-kube-api-access-4thxw\") pod \"keycloak-operator-7864d68cbd-fwqvr\" (UID: \"0bce10bf-ba99-4589-9df1-880bf117ca29\") " pod="keycloak-system/keycloak-operator-7864d68cbd-fwqvr" Jun 03 03:31:30.448386 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:30.448306 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-fwqvr" Jun 03 03:31:30.578286 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:30.578262 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-fwqvr"] Jun 03 03:31:30.580593 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:31:30.580565 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bce10bf_ba99_4589_9df1_880bf117ca29.slice/crio-912d682d96bb8833674945007644dea4fbd8f4a8e630d5e80160222bdffd532c WatchSource:0}: Error finding container 912d682d96bb8833674945007644dea4fbd8f4a8e630d5e80160222bdffd532c: Status 404 returned error can't find the container with id 912d682d96bb8833674945007644dea4fbd8f4a8e630d5e80160222bdffd532c Jun 03 03:31:30.582386 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:30.582370 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 03:31:31.521058 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:31.521019 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-fwqvr" event={"ID":"0bce10bf-ba99-4589-9df1-880bf117ca29","Type":"ContainerStarted","Data":"912d682d96bb8833674945007644dea4fbd8f4a8e630d5e80160222bdffd532c"} Jun 03 03:31:37.541866 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:37.541828 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-fwqvr" event={"ID":"0bce10bf-ba99-4589-9df1-880bf117ca29","Type":"ContainerStarted","Data":"b2f558a427bb95737e36a29f97775506409db846d788ec07866d78b4bcca1959"} Jun 03 03:31:37.558407 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:31:37.558342 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-fwqvr" podStartSLOduration=1.432351867 podStartE2EDuration="7.558324279s" podCreationTimestamp="2026-06-03 03:31:30 +0000 UTC" firstStartedPulling="2026-06-03 03:31:30.58248743 +0000 UTC m=+665.754397279" lastFinishedPulling="2026-06-03 03:31:36.708459839 +0000 UTC m=+671.880369691" observedRunningTime="2026-06-03 03:31:37.555273202 +0000 UTC m=+672.727183074" watchObservedRunningTime="2026-06-03 03:31:37.558324279 +0000 UTC m=+672.730234153" Jun 03 03:32:18.196115 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:18.196033 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-798x7"] Jun 03 03:32:18.198280 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:18.198264 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-798x7" Jun 03 03:32:18.204319 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:18.204297 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-798x7"] Jun 03 03:32:18.314241 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:18.314202 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9qlh\" (UniqueName: \"kubernetes.io/projected/732861af-0d12-49f6-9c93-7af46b78cf1c-kube-api-access-c9qlh\") pod \"authorino-8b475cf9f-798x7\" (UID: \"732861af-0d12-49f6-9c93-7af46b78cf1c\") " pod="kuadrant-system/authorino-8b475cf9f-798x7" Jun 03 03:32:18.414952 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:18.414914 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c9qlh\" (UniqueName: \"kubernetes.io/projected/732861af-0d12-49f6-9c93-7af46b78cf1c-kube-api-access-c9qlh\") pod \"authorino-8b475cf9f-798x7\" (UID: \"732861af-0d12-49f6-9c93-7af46b78cf1c\") " pod="kuadrant-system/authorino-8b475cf9f-798x7" Jun 03 03:32:18.421399 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:18.421376 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-798x7"] Jun 03 03:32:18.421599 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:32:18.421580 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-c9qlh], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-798x7" podUID="732861af-0d12-49f6-9c93-7af46b78cf1c" Jun 03 03:32:18.424018 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:18.423981 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9qlh\" (UniqueName: \"kubernetes.io/projected/732861af-0d12-49f6-9c93-7af46b78cf1c-kube-api-access-c9qlh\") pod \"authorino-8b475cf9f-798x7\" (UID: \"732861af-0d12-49f6-9c93-7af46b78cf1c\") " pod="kuadrant-system/authorino-8b475cf9f-798x7" Jun 03 03:32:18.684500 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:18.684468 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-798x7" Jun 03 03:32:18.689410 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:18.689392 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-798x7" Jun 03 03:32:18.819333 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:18.819302 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9qlh\" (UniqueName: \"kubernetes.io/projected/732861af-0d12-49f6-9c93-7af46b78cf1c-kube-api-access-c9qlh\") pod \"732861af-0d12-49f6-9c93-7af46b78cf1c\" (UID: \"732861af-0d12-49f6-9c93-7af46b78cf1c\") " Jun 03 03:32:18.821284 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:18.821263 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/732861af-0d12-49f6-9c93-7af46b78cf1c-kube-api-access-c9qlh" (OuterVolumeSpecName: "kube-api-access-c9qlh") pod "732861af-0d12-49f6-9c93-7af46b78cf1c" (UID: "732861af-0d12-49f6-9c93-7af46b78cf1c"). InnerVolumeSpecName "kube-api-access-c9qlh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:32:18.920311 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:18.920284 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9qlh\" (UniqueName: \"kubernetes.io/projected/732861af-0d12-49f6-9c93-7af46b78cf1c-kube-api-access-c9qlh\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:32:19.687530 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:19.687449 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-798x7" Jun 03 03:32:19.710737 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:19.710708 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-798x7"] Jun 03 03:32:19.712856 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:19.712833 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-798x7"] Jun 03 03:32:20.090237 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:20.090195 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-cjlvf"] Jun 03 03:32:20.090457 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:20.090431 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-cjlvf" podUID="f0b51389-31c1-4f34-967e-0a57ea642212" containerName="authorino" containerID="cri-o://15242ff9f5cfae80e62227fb08b0780cc58e6943f82c5dcf99977cf061210669" gracePeriod=30 Jun 03 03:32:20.338061 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:20.338037 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-cjlvf" Jun 03 03:32:20.434298 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:20.434212 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tktj5\" (UniqueName: \"kubernetes.io/projected/f0b51389-31c1-4f34-967e-0a57ea642212-kube-api-access-tktj5\") pod \"f0b51389-31c1-4f34-967e-0a57ea642212\" (UID: \"f0b51389-31c1-4f34-967e-0a57ea642212\") " Jun 03 03:32:20.436364 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:20.436333 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0b51389-31c1-4f34-967e-0a57ea642212-kube-api-access-tktj5" (OuterVolumeSpecName: "kube-api-access-tktj5") pod "f0b51389-31c1-4f34-967e-0a57ea642212" (UID: "f0b51389-31c1-4f34-967e-0a57ea642212"). InnerVolumeSpecName "kube-api-access-tktj5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:32:20.535474 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:20.535432 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tktj5\" (UniqueName: \"kubernetes.io/projected/f0b51389-31c1-4f34-967e-0a57ea642212-kube-api-access-tktj5\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:32:20.692189 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:20.692095 2558 generic.go:358] "Generic (PLEG): container finished" podID="f0b51389-31c1-4f34-967e-0a57ea642212" containerID="15242ff9f5cfae80e62227fb08b0780cc58e6943f82c5dcf99977cf061210669" exitCode=0 Jun 03 03:32:20.692189 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:20.692143 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-cjlvf" Jun 03 03:32:20.692189 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:20.692162 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-cjlvf" event={"ID":"f0b51389-31c1-4f34-967e-0a57ea642212","Type":"ContainerDied","Data":"15242ff9f5cfae80e62227fb08b0780cc58e6943f82c5dcf99977cf061210669"} Jun 03 03:32:20.692189 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:20.692187 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-cjlvf" event={"ID":"f0b51389-31c1-4f34-967e-0a57ea642212","Type":"ContainerDied","Data":"b0d2521938abe73a99ae01d9d25000a0321e8b93f015ec6f2499dd6461d55775"} Jun 03 03:32:20.692709 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:20.692202 2558 scope.go:117] "RemoveContainer" containerID="15242ff9f5cfae80e62227fb08b0780cc58e6943f82c5dcf99977cf061210669" Jun 03 03:32:20.700579 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:20.700559 2558 scope.go:117] "RemoveContainer" containerID="15242ff9f5cfae80e62227fb08b0780cc58e6943f82c5dcf99977cf061210669" Jun 03 03:32:20.700827 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:32:20.700809 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15242ff9f5cfae80e62227fb08b0780cc58e6943f82c5dcf99977cf061210669\": container with ID starting with 15242ff9f5cfae80e62227fb08b0780cc58e6943f82c5dcf99977cf061210669 not found: ID does not exist" containerID="15242ff9f5cfae80e62227fb08b0780cc58e6943f82c5dcf99977cf061210669" Jun 03 03:32:20.700870 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:20.700834 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15242ff9f5cfae80e62227fb08b0780cc58e6943f82c5dcf99977cf061210669"} err="failed to get container status \"15242ff9f5cfae80e62227fb08b0780cc58e6943f82c5dcf99977cf061210669\": rpc error: code = NotFound desc = could not find container \"15242ff9f5cfae80e62227fb08b0780cc58e6943f82c5dcf99977cf061210669\": container with ID starting with 15242ff9f5cfae80e62227fb08b0780cc58e6943f82c5dcf99977cf061210669 not found: ID does not exist" Jun 03 03:32:20.722257 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:20.718073 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-cjlvf"] Jun 03 03:32:20.725338 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:20.725312 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-cjlvf"] Jun 03 03:32:21.370216 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:21.370181 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="732861af-0d12-49f6-9c93-7af46b78cf1c" path="/var/lib/kubelet/pods/732861af-0d12-49f6-9c93-7af46b78cf1c/volumes" Jun 03 03:32:21.370450 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:21.370437 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0b51389-31c1-4f34-967e-0a57ea642212" path="/var/lib/kubelet/pods/f0b51389-31c1-4f34-967e-0a57ea642212/volumes" Jun 03 03:32:23.533187 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:23.533151 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7477944ccd-qczgp"] Jun 03 03:32:23.533569 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:23.533531 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0b51389-31c1-4f34-967e-0a57ea642212" containerName="authorino" Jun 03 03:32:23.533569 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:23.533546 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0b51389-31c1-4f34-967e-0a57ea642212" containerName="authorino" Jun 03 03:32:23.533639 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:23.533596 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="f0b51389-31c1-4f34-967e-0a57ea642212" containerName="authorino" Jun 03 03:32:23.536255 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:23.536238 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7477944ccd-qczgp" Jun 03 03:32:23.538217 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:23.538194 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tbl6d\"" Jun 03 03:32:23.538330 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:23.538270 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 03:32:23.546135 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:23.546114 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7477944ccd-qczgp"] Jun 03 03:32:23.663971 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:23.663930 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhmhb\" (UniqueName: \"kubernetes.io/projected/b7a3aeb4-072f-4df8-b694-a3b9468ce291-kube-api-access-nhmhb\") pod \"maas-controller-7477944ccd-qczgp\" (UID: \"b7a3aeb4-072f-4df8-b694-a3b9468ce291\") " pod="opendatahub/maas-controller-7477944ccd-qczgp" Jun 03 03:32:23.764787 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:23.764738 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhmhb\" (UniqueName: \"kubernetes.io/projected/b7a3aeb4-072f-4df8-b694-a3b9468ce291-kube-api-access-nhmhb\") pod \"maas-controller-7477944ccd-qczgp\" (UID: \"b7a3aeb4-072f-4df8-b694-a3b9468ce291\") " pod="opendatahub/maas-controller-7477944ccd-qczgp" Jun 03 03:32:23.773045 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:23.773013 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhmhb\" (UniqueName: \"kubernetes.io/projected/b7a3aeb4-072f-4df8-b694-a3b9468ce291-kube-api-access-nhmhb\") pod \"maas-controller-7477944ccd-qczgp\" (UID: \"b7a3aeb4-072f-4df8-b694-a3b9468ce291\") " pod="opendatahub/maas-controller-7477944ccd-qczgp" Jun 03 03:32:23.847238 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:23.847152 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7477944ccd-qczgp" Jun 03 03:32:23.972671 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:23.972642 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7477944ccd-qczgp"] Jun 03 03:32:23.975075 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:32:23.975049 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7a3aeb4_072f_4df8_b694_a3b9468ce291.slice/crio-ee895160d3630dcdc5058d288fedd1554bbe0d9eeaa102777aca47fa61e9d1f1 WatchSource:0}: Error finding container ee895160d3630dcdc5058d288fedd1554bbe0d9eeaa102777aca47fa61e9d1f1: Status 404 returned error can't find the container with id ee895160d3630dcdc5058d288fedd1554bbe0d9eeaa102777aca47fa61e9d1f1 Jun 03 03:32:24.709959 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:24.709895 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7477944ccd-qczgp" event={"ID":"b7a3aeb4-072f-4df8-b694-a3b9468ce291","Type":"ContainerStarted","Data":"ee895160d3630dcdc5058d288fedd1554bbe0d9eeaa102777aca47fa61e9d1f1"} Jun 03 03:32:26.191160 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:26.191136 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 03:32:26.718897 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:26.718861 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7477944ccd-qczgp" event={"ID":"b7a3aeb4-072f-4df8-b694-a3b9468ce291","Type":"ContainerStarted","Data":"66135229c733290ab8b0c163c2ec2b9099b420b020e43b37b3e31b48ab251199"} Jun 03 03:32:26.719123 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:26.719017 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7477944ccd-qczgp" Jun 03 03:32:26.734855 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:26.734808 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7477944ccd-qczgp" podStartSLOduration=1.5222180509999998 podStartE2EDuration="3.734795865s" podCreationTimestamp="2026-06-03 03:32:23 +0000 UTC" firstStartedPulling="2026-06-03 03:32:23.976313382 +0000 UTC m=+719.148223235" lastFinishedPulling="2026-06-03 03:32:26.188891197 +0000 UTC m=+721.360801049" observedRunningTime="2026-06-03 03:32:26.733293986 +0000 UTC m=+721.905203857" watchObservedRunningTime="2026-06-03 03:32:26.734795865 +0000 UTC m=+721.906705736" Jun 03 03:32:37.728037 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:32:37.728006 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7477944ccd-qczgp" Jun 03 03:33:46.370361 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:33:46.370280 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7b8995dd6b-6j4lh"] Jun 03 03:33:46.374621 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:33:46.374514 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b8995dd6b-6j4lh" Jun 03 03:33:46.379203 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:33:46.378969 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8f24r\"" Jun 03 03:33:46.379203 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:33:46.379071 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 03:33:46.379203 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:33:46.379129 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 03 03:33:46.381456 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:33:46.381430 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b8995dd6b-6j4lh"] Jun 03 03:33:46.479639 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:33:46.479605 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/641d1b7a-7c74-40ff-a088-c446b407a157-tls-cert\") pod \"authorino-7b8995dd6b-6j4lh\" (UID: \"641d1b7a-7c74-40ff-a088-c446b407a157\") " pod="kuadrant-system/authorino-7b8995dd6b-6j4lh" Jun 03 03:33:46.479787 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:33:46.479653 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqplr\" (UniqueName: \"kubernetes.io/projected/641d1b7a-7c74-40ff-a088-c446b407a157-kube-api-access-nqplr\") pod \"authorino-7b8995dd6b-6j4lh\" (UID: \"641d1b7a-7c74-40ff-a088-c446b407a157\") " pod="kuadrant-system/authorino-7b8995dd6b-6j4lh" Jun 03 03:33:46.479787 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:33:46.479719 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/641d1b7a-7c74-40ff-a088-c446b407a157-oidc-ca\") pod \"authorino-7b8995dd6b-6j4lh\" (UID: \"641d1b7a-7c74-40ff-a088-c446b407a157\") " pod="kuadrant-system/authorino-7b8995dd6b-6j4lh" Jun 03 03:33:46.580813 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:33:46.580785 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/641d1b7a-7c74-40ff-a088-c446b407a157-tls-cert\") pod \"authorino-7b8995dd6b-6j4lh\" (UID: \"641d1b7a-7c74-40ff-a088-c446b407a157\") " pod="kuadrant-system/authorino-7b8995dd6b-6j4lh" Jun 03 03:33:46.580981 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:33:46.580826 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nqplr\" (UniqueName: \"kubernetes.io/projected/641d1b7a-7c74-40ff-a088-c446b407a157-kube-api-access-nqplr\") pod \"authorino-7b8995dd6b-6j4lh\" (UID: \"641d1b7a-7c74-40ff-a088-c446b407a157\") " pod="kuadrant-system/authorino-7b8995dd6b-6j4lh" Jun 03 03:33:46.580981 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:33:46.580858 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/641d1b7a-7c74-40ff-a088-c446b407a157-oidc-ca\") pod \"authorino-7b8995dd6b-6j4lh\" (UID: \"641d1b7a-7c74-40ff-a088-c446b407a157\") " pod="kuadrant-system/authorino-7b8995dd6b-6j4lh" Jun 03 03:33:46.581401 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:33:46.581380 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/641d1b7a-7c74-40ff-a088-c446b407a157-oidc-ca\") pod \"authorino-7b8995dd6b-6j4lh\" (UID: \"641d1b7a-7c74-40ff-a088-c446b407a157\") " pod="kuadrant-system/authorino-7b8995dd6b-6j4lh" Jun 03 03:33:46.583093 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:33:46.583063 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/641d1b7a-7c74-40ff-a088-c446b407a157-tls-cert\") pod \"authorino-7b8995dd6b-6j4lh\" (UID: \"641d1b7a-7c74-40ff-a088-c446b407a157\") " pod="kuadrant-system/authorino-7b8995dd6b-6j4lh" Jun 03 03:33:46.587399 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:33:46.587378 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqplr\" (UniqueName: \"kubernetes.io/projected/641d1b7a-7c74-40ff-a088-c446b407a157-kube-api-access-nqplr\") pod \"authorino-7b8995dd6b-6j4lh\" (UID: \"641d1b7a-7c74-40ff-a088-c446b407a157\") " pod="kuadrant-system/authorino-7b8995dd6b-6j4lh" Jun 03 03:33:46.696899 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:33:46.696819 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b8995dd6b-6j4lh" Jun 03 03:33:46.822205 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:33:46.822181 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b8995dd6b-6j4lh"] Jun 03 03:33:46.824784 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:33:46.824752 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod641d1b7a_7c74_40ff_a088_c446b407a157.slice/crio-f97280ef406c6dad2cdee4741025ff31e47fe445df18abaafbcfc026febd23bd WatchSource:0}: Error finding container f97280ef406c6dad2cdee4741025ff31e47fe445df18abaafbcfc026febd23bd: Status 404 returned error can't find the container with id f97280ef406c6dad2cdee4741025ff31e47fe445df18abaafbcfc026febd23bd Jun 03 03:33:46.996612 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:33:46.996525 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b8995dd6b-6j4lh" event={"ID":"641d1b7a-7c74-40ff-a088-c446b407a157","Type":"ContainerStarted","Data":"f97280ef406c6dad2cdee4741025ff31e47fe445df18abaafbcfc026febd23bd"} Jun 03 03:33:48.001255 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:33:48.001216 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b8995dd6b-6j4lh" event={"ID":"641d1b7a-7c74-40ff-a088-c446b407a157","Type":"ContainerStarted","Data":"87cc12d4568bdfa790307ca314493244a3b38da03867943a54c943b6dc2a5b98"} Jun 03 03:33:48.014863 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:33:48.014820 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7b8995dd6b-6j4lh" podStartSLOduration=1.602257701 podStartE2EDuration="2.014806032s" podCreationTimestamp="2026-06-03 03:33:46 +0000 UTC" firstStartedPulling="2026-06-03 03:33:46.826100691 +0000 UTC m=+801.998010540" lastFinishedPulling="2026-06-03 03:33:47.238649017 +0000 UTC m=+802.410558871" observedRunningTime="2026-06-03 03:33:48.01336614 +0000 UTC m=+803.185276012" watchObservedRunningTime="2026-06-03 03:33:48.014806032 +0000 UTC m=+803.186715904" Jun 03 03:35:25.346929 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:35:25.346850 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-tq7jg_3f53d812-13d2-4aae-9673-a8b3c90386e9/console-operator/1.log" Jun 03 03:35:25.348471 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:35:25.348448 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-tq7jg_3f53d812-13d2-4aae-9673-a8b3c90386e9/console-operator/1.log" Jun 03 03:35:25.353365 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:35:25.353344 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/ovn-acl-logging/0.log" Jun 03 03:35:25.354665 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:35:25.354447 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/ovn-acl-logging/0.log" Jun 03 03:36:01.091585 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:01.091549 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-676d885b79-2rn6f"] Jun 03 03:36:01.094741 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:01.094725 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-676d885b79-2rn6f" Jun 03 03:36:01.101240 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:01.101216 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-676d885b79-2rn6f"] Jun 03 03:36:01.209316 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:01.209287 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbg6j\" (UniqueName: \"kubernetes.io/projected/e5e1ef60-cf5e-47e5-bd91-24f0823304a0-kube-api-access-qbg6j\") pod \"authorino-676d885b79-2rn6f\" (UID: \"e5e1ef60-cf5e-47e5-bd91-24f0823304a0\") " pod="kuadrant-system/authorino-676d885b79-2rn6f" Jun 03 03:36:01.209462 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:01.209337 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/e5e1ef60-cf5e-47e5-bd91-24f0823304a0-oidc-ca\") pod \"authorino-676d885b79-2rn6f\" (UID: \"e5e1ef60-cf5e-47e5-bd91-24f0823304a0\") " pod="kuadrant-system/authorino-676d885b79-2rn6f" Jun 03 03:36:01.209462 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:01.209359 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5e1ef60-cf5e-47e5-bd91-24f0823304a0-tls-cert\") pod \"authorino-676d885b79-2rn6f\" (UID: \"e5e1ef60-cf5e-47e5-bd91-24f0823304a0\") " pod="kuadrant-system/authorino-676d885b79-2rn6f" Jun 03 03:36:01.310591 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:01.310558 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/e5e1ef60-cf5e-47e5-bd91-24f0823304a0-oidc-ca\") pod \"authorino-676d885b79-2rn6f\" (UID: \"e5e1ef60-cf5e-47e5-bd91-24f0823304a0\") " pod="kuadrant-system/authorino-676d885b79-2rn6f" Jun 03 03:36:01.310591 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:01.310594 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5e1ef60-cf5e-47e5-bd91-24f0823304a0-tls-cert\") pod \"authorino-676d885b79-2rn6f\" (UID: \"e5e1ef60-cf5e-47e5-bd91-24f0823304a0\") " pod="kuadrant-system/authorino-676d885b79-2rn6f" Jun 03 03:36:01.310749 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:01.310648 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qbg6j\" (UniqueName: \"kubernetes.io/projected/e5e1ef60-cf5e-47e5-bd91-24f0823304a0-kube-api-access-qbg6j\") pod \"authorino-676d885b79-2rn6f\" (UID: \"e5e1ef60-cf5e-47e5-bd91-24f0823304a0\") " pod="kuadrant-system/authorino-676d885b79-2rn6f" Jun 03 03:36:01.311227 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:01.311198 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/e5e1ef60-cf5e-47e5-bd91-24f0823304a0-oidc-ca\") pod \"authorino-676d885b79-2rn6f\" (UID: \"e5e1ef60-cf5e-47e5-bd91-24f0823304a0\") " pod="kuadrant-system/authorino-676d885b79-2rn6f" Jun 03 03:36:01.312960 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:01.312940 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5e1ef60-cf5e-47e5-bd91-24f0823304a0-tls-cert\") pod \"authorino-676d885b79-2rn6f\" (UID: \"e5e1ef60-cf5e-47e5-bd91-24f0823304a0\") " pod="kuadrant-system/authorino-676d885b79-2rn6f" Jun 03 03:36:01.317716 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:01.317694 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbg6j\" (UniqueName: \"kubernetes.io/projected/e5e1ef60-cf5e-47e5-bd91-24f0823304a0-kube-api-access-qbg6j\") pod \"authorino-676d885b79-2rn6f\" (UID: \"e5e1ef60-cf5e-47e5-bd91-24f0823304a0\") " pod="kuadrant-system/authorino-676d885b79-2rn6f" Jun 03 03:36:01.405434 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:01.405375 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-676d885b79-2rn6f" Jun 03 03:36:01.532615 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:01.532589 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-676d885b79-2rn6f"] Jun 03 03:36:01.534767 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:36:01.534740 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5e1ef60_cf5e_47e5_bd91_24f0823304a0.slice/crio-4c2aa7d8724ccd1f5f812202720ab7ffb9bff2a97bf1194fa9e686bf2911e895 WatchSource:0}: Error finding container 4c2aa7d8724ccd1f5f812202720ab7ffb9bff2a97bf1194fa9e686bf2911e895: Status 404 returned error can't find the container with id 4c2aa7d8724ccd1f5f812202720ab7ffb9bff2a97bf1194fa9e686bf2911e895 Jun 03 03:36:02.478356 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:02.478312 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-676d885b79-2rn6f" event={"ID":"e5e1ef60-cf5e-47e5-bd91-24f0823304a0","Type":"ContainerStarted","Data":"b327532c11d48532f0479ba3017cfe68a2337e8f65a58050008d1848fcdb5db6"} Jun 03 03:36:02.478356 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:02.478353 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-676d885b79-2rn6f" event={"ID":"e5e1ef60-cf5e-47e5-bd91-24f0823304a0","Type":"ContainerStarted","Data":"4c2aa7d8724ccd1f5f812202720ab7ffb9bff2a97bf1194fa9e686bf2911e895"} Jun 03 03:36:02.502493 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:02.502435 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-676d885b79-2rn6f" podStartSLOduration=1.121750202 podStartE2EDuration="1.50241786s" podCreationTimestamp="2026-06-03 03:36:01 +0000 UTC" firstStartedPulling="2026-06-03 03:36:01.536074705 +0000 UTC m=+936.707984558" lastFinishedPulling="2026-06-03 03:36:01.916742354 +0000 UTC m=+937.088652216" observedRunningTime="2026-06-03 03:36:02.499507072 +0000 UTC m=+937.671416943" watchObservedRunningTime="2026-06-03 03:36:02.50241786 +0000 UTC m=+937.674327732" Jun 03 03:36:02.527899 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:02.527860 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b8995dd6b-6j4lh"] Jun 03 03:36:02.528567 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:02.528528 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7b8995dd6b-6j4lh" podUID="641d1b7a-7c74-40ff-a088-c446b407a157" containerName="authorino" containerID="cri-o://87cc12d4568bdfa790307ca314493244a3b38da03867943a54c943b6dc2a5b98" gracePeriod=30 Jun 03 03:36:02.782310 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:02.782280 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b8995dd6b-6j4lh" Jun 03 03:36:02.924710 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:02.924664 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/641d1b7a-7c74-40ff-a088-c446b407a157-tls-cert\") pod \"641d1b7a-7c74-40ff-a088-c446b407a157\" (UID: \"641d1b7a-7c74-40ff-a088-c446b407a157\") " Jun 03 03:36:02.924891 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:02.924776 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqplr\" (UniqueName: \"kubernetes.io/projected/641d1b7a-7c74-40ff-a088-c446b407a157-kube-api-access-nqplr\") pod \"641d1b7a-7c74-40ff-a088-c446b407a157\" (UID: \"641d1b7a-7c74-40ff-a088-c446b407a157\") " Jun 03 03:36:02.924891 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:02.924847 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/641d1b7a-7c74-40ff-a088-c446b407a157-oidc-ca\") pod \"641d1b7a-7c74-40ff-a088-c446b407a157\" (UID: \"641d1b7a-7c74-40ff-a088-c446b407a157\") " Jun 03 03:36:02.926861 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:02.926826 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/641d1b7a-7c74-40ff-a088-c446b407a157-kube-api-access-nqplr" (OuterVolumeSpecName: "kube-api-access-nqplr") pod "641d1b7a-7c74-40ff-a088-c446b407a157" (UID: "641d1b7a-7c74-40ff-a088-c446b407a157"). InnerVolumeSpecName "kube-api-access-nqplr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:36:02.929803 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:02.929776 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/641d1b7a-7c74-40ff-a088-c446b407a157-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "641d1b7a-7c74-40ff-a088-c446b407a157" (UID: "641d1b7a-7c74-40ff-a088-c446b407a157"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:36:02.934540 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:02.934515 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/641d1b7a-7c74-40ff-a088-c446b407a157-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "641d1b7a-7c74-40ff-a088-c446b407a157" (UID: "641d1b7a-7c74-40ff-a088-c446b407a157"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:36:03.025917 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:03.025834 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqplr\" (UniqueName: \"kubernetes.io/projected/641d1b7a-7c74-40ff-a088-c446b407a157-kube-api-access-nqplr\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:36:03.025917 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:03.025865 2558 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/641d1b7a-7c74-40ff-a088-c446b407a157-oidc-ca\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:36:03.025917 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:03.025875 2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/641d1b7a-7c74-40ff-a088-c446b407a157-tls-cert\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:36:03.482575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:03.482540 2558 generic.go:358] "Generic (PLEG): container finished" podID="641d1b7a-7c74-40ff-a088-c446b407a157" containerID="87cc12d4568bdfa790307ca314493244a3b38da03867943a54c943b6dc2a5b98" exitCode=0 Jun 03 03:36:03.482984 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:03.482601 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b8995dd6b-6j4lh" Jun 03 03:36:03.482984 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:03.482602 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b8995dd6b-6j4lh" event={"ID":"641d1b7a-7c74-40ff-a088-c446b407a157","Type":"ContainerDied","Data":"87cc12d4568bdfa790307ca314493244a3b38da03867943a54c943b6dc2a5b98"} Jun 03 03:36:03.482984 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:03.482647 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b8995dd6b-6j4lh" event={"ID":"641d1b7a-7c74-40ff-a088-c446b407a157","Type":"ContainerDied","Data":"f97280ef406c6dad2cdee4741025ff31e47fe445df18abaafbcfc026febd23bd"} Jun 03 03:36:03.482984 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:03.482665 2558 scope.go:117] "RemoveContainer" containerID="87cc12d4568bdfa790307ca314493244a3b38da03867943a54c943b6dc2a5b98" Jun 03 03:36:03.490715 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:03.490699 2558 scope.go:117] "RemoveContainer" containerID="87cc12d4568bdfa790307ca314493244a3b38da03867943a54c943b6dc2a5b98" Jun 03 03:36:03.490942 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:36:03.490920 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87cc12d4568bdfa790307ca314493244a3b38da03867943a54c943b6dc2a5b98\": container with ID starting with 87cc12d4568bdfa790307ca314493244a3b38da03867943a54c943b6dc2a5b98 not found: ID does not exist" containerID="87cc12d4568bdfa790307ca314493244a3b38da03867943a54c943b6dc2a5b98" Jun 03 03:36:03.491033 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:03.490954 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87cc12d4568bdfa790307ca314493244a3b38da03867943a54c943b6dc2a5b98"} err="failed to get container status \"87cc12d4568bdfa790307ca314493244a3b38da03867943a54c943b6dc2a5b98\": rpc error: code = NotFound desc = could not find container \"87cc12d4568bdfa790307ca314493244a3b38da03867943a54c943b6dc2a5b98\": container with ID starting with 87cc12d4568bdfa790307ca314493244a3b38da03867943a54c943b6dc2a5b98 not found: ID does not exist" Jun 03 03:36:03.496739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:03.496713 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b8995dd6b-6j4lh"] Jun 03 03:36:03.500499 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:03.500479 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7b8995dd6b-6j4lh"] Jun 03 03:36:05.371432 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:36:05.371402 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="641d1b7a-7c74-40ff-a088-c446b407a157" path="/var/lib/kubelet/pods/641d1b7a-7c74-40ff-a088-c446b407a157/volumes" Jun 03 03:37:27.478649 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:27.478615 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7477944ccd-qczgp"] Jun 03 03:37:27.479199 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:27.478830 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7477944ccd-qczgp" podUID="b7a3aeb4-072f-4df8-b694-a3b9468ce291" containerName="manager" containerID="cri-o://66135229c733290ab8b0c163c2ec2b9099b420b020e43b37b3e31b48ab251199" gracePeriod=30 Jun 03 03:37:27.726391 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:27.726368 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7477944ccd-qczgp" Jun 03 03:37:27.781440 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:27.781400 2558 generic.go:358] "Generic (PLEG): container finished" podID="b7a3aeb4-072f-4df8-b694-a3b9468ce291" containerID="66135229c733290ab8b0c163c2ec2b9099b420b020e43b37b3e31b48ab251199" exitCode=0 Jun 03 03:37:27.781598 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:27.781468 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7477944ccd-qczgp" Jun 03 03:37:27.781598 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:27.781483 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7477944ccd-qczgp" event={"ID":"b7a3aeb4-072f-4df8-b694-a3b9468ce291","Type":"ContainerDied","Data":"66135229c733290ab8b0c163c2ec2b9099b420b020e43b37b3e31b48ab251199"} Jun 03 03:37:27.781598 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:27.781523 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7477944ccd-qczgp" event={"ID":"b7a3aeb4-072f-4df8-b694-a3b9468ce291","Type":"ContainerDied","Data":"ee895160d3630dcdc5058d288fedd1554bbe0d9eeaa102777aca47fa61e9d1f1"} Jun 03 03:37:27.781598 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:27.781538 2558 scope.go:117] "RemoveContainer" containerID="66135229c733290ab8b0c163c2ec2b9099b420b020e43b37b3e31b48ab251199" Jun 03 03:37:27.789450 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:27.789434 2558 scope.go:117] "RemoveContainer" containerID="66135229c733290ab8b0c163c2ec2b9099b420b020e43b37b3e31b48ab251199" Jun 03 03:37:27.789692 ip-10-0-141-253 kubenswrapper[2558]: E0603 03:37:27.789673 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66135229c733290ab8b0c163c2ec2b9099b420b020e43b37b3e31b48ab251199\": container with ID starting with 66135229c733290ab8b0c163c2ec2b9099b420b020e43b37b3e31b48ab251199 not found: ID does not exist" containerID="66135229c733290ab8b0c163c2ec2b9099b420b020e43b37b3e31b48ab251199" Jun 03 03:37:27.789747 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:27.789699 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66135229c733290ab8b0c163c2ec2b9099b420b020e43b37b3e31b48ab251199"} err="failed to get container status \"66135229c733290ab8b0c163c2ec2b9099b420b020e43b37b3e31b48ab251199\": rpc error: code = NotFound desc = could not find container \"66135229c733290ab8b0c163c2ec2b9099b420b020e43b37b3e31b48ab251199\": container with ID starting with 66135229c733290ab8b0c163c2ec2b9099b420b020e43b37b3e31b48ab251199 not found: ID does not exist" Jun 03 03:37:27.868223 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:27.868188 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhmhb\" (UniqueName: \"kubernetes.io/projected/b7a3aeb4-072f-4df8-b694-a3b9468ce291-kube-api-access-nhmhb\") pod \"b7a3aeb4-072f-4df8-b694-a3b9468ce291\" (UID: \"b7a3aeb4-072f-4df8-b694-a3b9468ce291\") " Jun 03 03:37:27.870298 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:27.870270 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7a3aeb4-072f-4df8-b694-a3b9468ce291-kube-api-access-nhmhb" (OuterVolumeSpecName: "kube-api-access-nhmhb") pod "b7a3aeb4-072f-4df8-b694-a3b9468ce291" (UID: "b7a3aeb4-072f-4df8-b694-a3b9468ce291"). InnerVolumeSpecName "kube-api-access-nhmhb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:37:27.968863 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:27.968834 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhmhb\" (UniqueName: \"kubernetes.io/projected/b7a3aeb4-072f-4df8-b694-a3b9468ce291-kube-api-access-nhmhb\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:37:28.102873 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:28.102840 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7477944ccd-qczgp"] Jun 03 03:37:28.106681 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:28.106657 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7477944ccd-qczgp"] Jun 03 03:37:28.724111 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:28.724050 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-7477944ccd-qczgp" podUID="b7a3aeb4-072f-4df8-b694-a3b9468ce291" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.40:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jun 03 03:37:28.815568 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:28.815534 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7477944ccd-t4gvg"] Jun 03 03:37:28.815882 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:28.815870 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7a3aeb4-072f-4df8-b694-a3b9468ce291" containerName="manager" Jun 03 03:37:28.815924 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:28.815883 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7a3aeb4-072f-4df8-b694-a3b9468ce291" containerName="manager" Jun 03 03:37:28.815924 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:28.815895 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="641d1b7a-7c74-40ff-a088-c446b407a157" containerName="authorino" Jun 03 03:37:28.815924 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:28.815902 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="641d1b7a-7c74-40ff-a088-c446b407a157" containerName="authorino" Jun 03 03:37:28.816062 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:28.815964 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="b7a3aeb4-072f-4df8-b694-a3b9468ce291" containerName="manager" Jun 03 03:37:28.816062 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:28.815973 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="641d1b7a-7c74-40ff-a088-c446b407a157" containerName="authorino" Jun 03 03:37:28.819986 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:28.819969 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7477944ccd-t4gvg" Jun 03 03:37:28.822190 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:28.822143 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 03:37:28.822470 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:28.822156 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tbl6d\"" Jun 03 03:37:28.824873 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:28.824852 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7477944ccd-t4gvg"] Jun 03 03:37:28.977747 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:28.977678 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5w56\" (UniqueName: \"kubernetes.io/projected/aeb00d5a-1f98-4f23-acad-abde430ec44a-kube-api-access-h5w56\") pod \"maas-controller-7477944ccd-t4gvg\" (UID: \"aeb00d5a-1f98-4f23-acad-abde430ec44a\") " pod="opendatahub/maas-controller-7477944ccd-t4gvg" Jun 03 03:37:29.078950 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:29.078924 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h5w56\" (UniqueName: \"kubernetes.io/projected/aeb00d5a-1f98-4f23-acad-abde430ec44a-kube-api-access-h5w56\") pod \"maas-controller-7477944ccd-t4gvg\" (UID: \"aeb00d5a-1f98-4f23-acad-abde430ec44a\") " pod="opendatahub/maas-controller-7477944ccd-t4gvg" Jun 03 03:37:29.086436 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:29.086411 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5w56\" (UniqueName: \"kubernetes.io/projected/aeb00d5a-1f98-4f23-acad-abde430ec44a-kube-api-access-h5w56\") pod \"maas-controller-7477944ccd-t4gvg\" (UID: \"aeb00d5a-1f98-4f23-acad-abde430ec44a\") " pod="opendatahub/maas-controller-7477944ccd-t4gvg" Jun 03 03:37:29.131044 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:29.131021 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7477944ccd-t4gvg" Jun 03 03:37:29.254017 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:29.253961 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7477944ccd-t4gvg"] Jun 03 03:37:29.256587 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:37:29.256560 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeb00d5a_1f98_4f23_acad_abde430ec44a.slice/crio-856c834cacbdaef277cc49199eff1031df4a709c1528a970bdfdbd6849ae6104 WatchSource:0}: Error finding container 856c834cacbdaef277cc49199eff1031df4a709c1528a970bdfdbd6849ae6104: Status 404 returned error can't find the container with id 856c834cacbdaef277cc49199eff1031df4a709c1528a970bdfdbd6849ae6104 Jun 03 03:37:29.257875 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:29.257854 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 03:37:29.370707 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:29.370675 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7a3aeb4-072f-4df8-b694-a3b9468ce291" path="/var/lib/kubelet/pods/b7a3aeb4-072f-4df8-b694-a3b9468ce291/volumes" Jun 03 03:37:29.790195 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:29.790161 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7477944ccd-t4gvg" event={"ID":"aeb00d5a-1f98-4f23-acad-abde430ec44a","Type":"ContainerStarted","Data":"fe1c3008d16d86f77e291479496663cc575a011c8903466c3a326809291e06fb"} Jun 03 03:37:29.790515 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:29.790198 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7477944ccd-t4gvg" event={"ID":"aeb00d5a-1f98-4f23-acad-abde430ec44a","Type":"ContainerStarted","Data":"856c834cacbdaef277cc49199eff1031df4a709c1528a970bdfdbd6849ae6104"} Jun 03 03:37:29.790515 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:29.790284 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7477944ccd-t4gvg" Jun 03 03:37:29.806757 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:29.806714 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7477944ccd-t4gvg" podStartSLOduration=1.3676052140000001 podStartE2EDuration="1.80670256s" podCreationTimestamp="2026-06-03 03:37:28 +0000 UTC" firstStartedPulling="2026-06-03 03:37:29.25797613 +0000 UTC m=+1024.429885981" lastFinishedPulling="2026-06-03 03:37:29.697073464 +0000 UTC m=+1024.868983327" observedRunningTime="2026-06-03 03:37:29.804612005 +0000 UTC m=+1024.976521879" watchObservedRunningTime="2026-06-03 03:37:29.80670256 +0000 UTC m=+1024.978612430" Jun 03 03:37:40.799019 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:37:40.798970 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7477944ccd-t4gvg" Jun 03 03:40:25.372543 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:40:25.372516 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-tq7jg_3f53d812-13d2-4aae-9673-a8b3c90386e9/console-operator/1.log" Jun 03 03:40:25.375194 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:40:25.375169 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-tq7jg_3f53d812-13d2-4aae-9673-a8b3c90386e9/console-operator/1.log" Jun 03 03:40:25.378175 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:40:25.378151 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/ovn-acl-logging/0.log" Jun 03 03:40:25.380555 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:40:25.380538 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/ovn-acl-logging/0.log" Jun 03 03:45:00.133798 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:45:00.133760 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29674305-s62t5"] Jun 03 03:45:00.137340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:45:00.137322 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29674305-s62t5" Jun 03 03:45:00.139582 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:45:00.139560 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-lfsk5\"" Jun 03 03:45:00.148245 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:45:00.148218 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29674305-s62t5"] Jun 03 03:45:00.180866 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:45:00.180842 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqkp9\" (UniqueName: \"kubernetes.io/projected/c5a1f534-60a9-4429-9ebd-62c2c8556b59-kube-api-access-xqkp9\") pod \"maas-api-key-cleanup-29674305-s62t5\" (UID: \"c5a1f534-60a9-4429-9ebd-62c2c8556b59\") " pod="opendatahub/maas-api-key-cleanup-29674305-s62t5" Jun 03 03:45:00.282054 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:45:00.282027 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xqkp9\" (UniqueName: \"kubernetes.io/projected/c5a1f534-60a9-4429-9ebd-62c2c8556b59-kube-api-access-xqkp9\") pod \"maas-api-key-cleanup-29674305-s62t5\" (UID: \"c5a1f534-60a9-4429-9ebd-62c2c8556b59\") " pod="opendatahub/maas-api-key-cleanup-29674305-s62t5" Jun 03 03:45:00.289431 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:45:00.289397 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqkp9\" (UniqueName: \"kubernetes.io/projected/c5a1f534-60a9-4429-9ebd-62c2c8556b59-kube-api-access-xqkp9\") pod \"maas-api-key-cleanup-29674305-s62t5\" (UID: \"c5a1f534-60a9-4429-9ebd-62c2c8556b59\") " pod="opendatahub/maas-api-key-cleanup-29674305-s62t5" Jun 03 03:45:00.447327 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:45:00.447266 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29674305-s62t5" Jun 03 03:45:00.575121 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:45:00.575093 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29674305-s62t5"] Jun 03 03:45:00.578552 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:45:00.578523 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5a1f534_60a9_4429_9ebd_62c2c8556b59.slice/crio-b1f4fa205a90b3294c4e618c95836a40b885d071bd3fe32f0d649c8c4a92e7f5 WatchSource:0}: Error finding container b1f4fa205a90b3294c4e618c95836a40b885d071bd3fe32f0d649c8c4a92e7f5: Status 404 returned error can't find the container with id b1f4fa205a90b3294c4e618c95836a40b885d071bd3fe32f0d649c8c4a92e7f5 Jun 03 03:45:00.580282 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:45:00.580266 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 03:45:01.357689 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:45:01.357656 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29674305-s62t5" event={"ID":"c5a1f534-60a9-4429-9ebd-62c2c8556b59","Type":"ContainerStarted","Data":"b1f4fa205a90b3294c4e618c95836a40b885d071bd3fe32f0d649c8c4a92e7f5"} Jun 03 03:45:04.368749 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:45:04.368711 2558 generic.go:358] "Generic (PLEG): container finished" podID="c5a1f534-60a9-4429-9ebd-62c2c8556b59" containerID="8298b9be91200fb60348e894cd3282afc0a3df6fb7b0670b0b5a9226782acbe2" exitCode=0 Jun 03 03:45:04.369180 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:45:04.368786 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29674305-s62t5" event={"ID":"c5a1f534-60a9-4429-9ebd-62c2c8556b59","Type":"ContainerDied","Data":"8298b9be91200fb60348e894cd3282afc0a3df6fb7b0670b0b5a9226782acbe2"} Jun 03 03:45:05.504940 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:45:05.504916 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29674305-s62t5" Jun 03 03:45:05.530348 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:45:05.530312 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqkp9\" (UniqueName: \"kubernetes.io/projected/c5a1f534-60a9-4429-9ebd-62c2c8556b59-kube-api-access-xqkp9\") pod \"c5a1f534-60a9-4429-9ebd-62c2c8556b59\" (UID: \"c5a1f534-60a9-4429-9ebd-62c2c8556b59\") " Jun 03 03:45:05.532455 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:45:05.532430 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5a1f534-60a9-4429-9ebd-62c2c8556b59-kube-api-access-xqkp9" (OuterVolumeSpecName: "kube-api-access-xqkp9") pod "c5a1f534-60a9-4429-9ebd-62c2c8556b59" (UID: "c5a1f534-60a9-4429-9ebd-62c2c8556b59"). InnerVolumeSpecName "kube-api-access-xqkp9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:45:05.632141 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:45:05.632058 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqkp9\" (UniqueName: \"kubernetes.io/projected/c5a1f534-60a9-4429-9ebd-62c2c8556b59-kube-api-access-xqkp9\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\"" Jun 03 03:45:06.376285 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:45:06.376248 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29674305-s62t5" event={"ID":"c5a1f534-60a9-4429-9ebd-62c2c8556b59","Type":"ContainerDied","Data":"b1f4fa205a90b3294c4e618c95836a40b885d071bd3fe32f0d649c8c4a92e7f5"} Jun 03 03:45:06.376285 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:45:06.376285 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1f4fa205a90b3294c4e618c95836a40b885d071bd3fe32f0d649c8c4a92e7f5" Jun 03 03:45:06.376285 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:45:06.376267 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29674305-s62t5" Jun 03 03:45:25.399448 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:45:25.399421 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-tq7jg_3f53d812-13d2-4aae-9673-a8b3c90386e9/console-operator/1.log" Jun 03 03:45:25.402717 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:45:25.402691 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-tq7jg_3f53d812-13d2-4aae-9673-a8b3c90386e9/console-operator/1.log" Jun 03 03:45:25.405820 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:45:25.405798 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/ovn-acl-logging/0.log" Jun 03 03:45:25.408425 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:45:25.408407 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/ovn-acl-logging/0.log" Jun 03 03:48:55.320919 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:48:55.320876 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xt2h5"] Jun 03 03:48:55.321501 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:48:55.321294 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5a1f534-60a9-4429-9ebd-62c2c8556b59" containerName="cleanup" Jun 03 03:48:55.321501 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:48:55.321308 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5a1f534-60a9-4429-9ebd-62c2c8556b59" containerName="cleanup" Jun 03 03:48:55.321501 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:48:55.321374 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="c5a1f534-60a9-4429-9ebd-62c2c8556b59" containerName="cleanup" Jun 03 03:48:55.324223 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:48:55.324207 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xt2h5" Jun 03 03:48:55.326811 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:48:55.326791 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-75hbz\"" Jun 03 03:48:55.337326 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:48:55.337303 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xt2h5"] Jun 03 03:48:55.413045 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:48:55.413015 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2b22\" (UniqueName: \"kubernetes.io/projected/82861104-f226-4ff6-a22e-534b3763d433-kube-api-access-z2b22\") pod \"kuadrant-operator-controller-manager-55c7f4c975-xt2h5\" (UID: \"82861104-f226-4ff6-a22e-534b3763d433\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xt2h5" Jun 03 03:48:55.413137 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:48:55.413078 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/82861104-f226-4ff6-a22e-534b3763d433-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-xt2h5\" (UID: \"82861104-f226-4ff6-a22e-534b3763d433\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xt2h5" Jun 03 03:48:55.513926 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:48:55.513885 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z2b22\" (UniqueName: \"kubernetes.io/projected/82861104-f226-4ff6-a22e-534b3763d433-kube-api-access-z2b22\") pod \"kuadrant-operator-controller-manager-55c7f4c975-xt2h5\" (UID: \"82861104-f226-4ff6-a22e-534b3763d433\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xt2h5" Jun 03 03:48:55.514078 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:48:55.514037 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/82861104-f226-4ff6-a22e-534b3763d433-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-xt2h5\" (UID: \"82861104-f226-4ff6-a22e-534b3763d433\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xt2h5" Jun 03 03:48:55.514365 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:48:55.514348 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/82861104-f226-4ff6-a22e-534b3763d433-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-xt2h5\" (UID: \"82861104-f226-4ff6-a22e-534b3763d433\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xt2h5" Jun 03 03:48:55.529404 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:48:55.529382 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2b22\" (UniqueName: \"kubernetes.io/projected/82861104-f226-4ff6-a22e-534b3763d433-kube-api-access-z2b22\") pod \"kuadrant-operator-controller-manager-55c7f4c975-xt2h5\" (UID: \"82861104-f226-4ff6-a22e-534b3763d433\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xt2h5" Jun 03 03:48:55.635077 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:48:55.634973 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xt2h5" Jun 03 03:48:55.771390 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:48:55.771130 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xt2h5"] Jun 03 03:48:56.190096 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:48:56.190057 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xt2h5" event={"ID":"82861104-f226-4ff6-a22e-534b3763d433","Type":"ContainerStarted","Data":"c4f006ed228c2ce391feedc0df3332e1a08b00a6cf2ad40d0b651858d8c06a1d"} Jun 03 03:48:56.190096 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:48:56.190099 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xt2h5" event={"ID":"82861104-f226-4ff6-a22e-534b3763d433","Type":"ContainerStarted","Data":"1a1dd063558dea0f486962d2b45778a9e9f6a8a1ddef312eb78f49059717f6f1"} Jun 03 03:48:56.190320 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:48:56.190205 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xt2h5" Jun 03 03:48:56.209430 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:48:56.209385 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xt2h5" podStartSLOduration=1.209371274 podStartE2EDuration="1.209371274s" podCreationTimestamp="2026-06-03 03:48:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:48:56.207327135 +0000 UTC m=+1711.379237009" watchObservedRunningTime="2026-06-03 03:48:56.209371274 +0000 UTC m=+1711.381281191" Jun 03 03:49:07.196157 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:49:07.196123 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xt2h5" Jun 03 03:50:25.424699 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:50:25.424670 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-tq7jg_3f53d812-13d2-4aae-9673-a8b3c90386e9/console-operator/1.log" Jun 03 03:50:25.427704 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:50:25.427676 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-tq7jg_3f53d812-13d2-4aae-9673-a8b3c90386e9/console-operator/1.log" Jun 03 03:50:25.430452 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:50:25.430432 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/ovn-acl-logging/0.log" Jun 03 03:50:25.433050 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:50:25.433035 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/ovn-acl-logging/0.log" Jun 03 03:55:25.448958 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:55:25.448925 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-tq7jg_3f53d812-13d2-4aae-9673-a8b3c90386e9/console-operator/1.log" Jun 03 03:55:25.454060 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:55:25.454037 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-tq7jg_3f53d812-13d2-4aae-9673-a8b3c90386e9/console-operator/1.log" Jun 03 03:55:25.454774 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:55:25.454754 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/ovn-acl-logging/0.log" Jun 03 03:55:25.459743 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:55:25.459722 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/ovn-acl-logging/0.log" Jun 03 03:59:10.567166 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:10.567129 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-676d885b79-2rn6f_e5e1ef60-cf5e-47e5-bd91-24f0823304a0/authorino/0.log" Jun 03 03:59:14.970606 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:14.970530 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5cbbc674f4-sllv8_e59fb0d6-8bce-42ff-84ca-08707bddb76a/nginx/0.log" Jun 03 03:59:15.418798 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:15.418772 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29674305-s62t5_c5a1f534-60a9-4429-9ebd-62c2c8556b59/cleanup/0.log" Jun 03 03:59:15.532340 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:15.532312 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7477944ccd-t4gvg_aeb00d5a-1f98-4f23-acad-abde430ec44a/manager/0.log" Jun 03 03:59:16.091413 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:16.091383 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f864588-n2652_9cc1571f-d011-4030-9fbe-33388b5ac07d/copy-manifests/0.log" Jun 03 03:59:16.097103 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:16.097082 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f864588-n2652_9cc1571f-d011-4030-9fbe-33388b5ac07d/manager/0.log" Jun 03 03:59:16.198758 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:16.198731 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-wwx4c_733c3d37-8ba8-4a05-9c1d-15d428413fee/postgres/0.log" Jun 03 03:59:17.402953 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:17.402926 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-676d885b79-2rn6f_e5e1ef60-cf5e-47e5-bd91-24f0823304a0/authorino/0.log" Jun 03 03:59:17.524783 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:17.524751 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-njwd5_d1b6f979-aab9-429f-9f96-0f40a47ceb46/manager/0.log" Jun 03 03:59:17.628895 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:17.628868 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-pzk6z_6e2938e5-f737-44d2-b154-5e9eb0ccb15a/manager/0.log" Jun 03 03:59:17.849192 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:17.849161 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8rsgg_61dee4b5-8d4d-49b7-9377-c3cc7f4ff48d/registry-server/0.log" Jun 03 03:59:17.969070 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:17.969043 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-xt2h5_82861104-f226-4ff6-a22e-534b3763d433/manager/0.log" Jun 03 03:59:18.545484 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:18.545453 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b5949x_fdf5d6f6-453f-4740-9e66-169c08a40a53/istio-proxy/0.log" Jun 03 03:59:18.982520 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:18.982447 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-xzr44_e09cbaba-4ad4-49c4-b717-379ca8a1b59d/istio-proxy/0.log" Jun 03 03:59:19.205975 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:19.205947 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-746645b9b9-vw7dh_663f11c6-a48b-4193-8a3d-9feea74d8b0c/router/0.log" Jun 03 03:59:24.240622 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:24.240558 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hsqd8/must-gather-bq4vq"] Jun 03 03:59:24.245163 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:24.245143 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hsqd8/must-gather-bq4vq" Jun 03 03:59:24.247428 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:24.247404 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hsqd8\"/\"openshift-service-ca.crt\"" Jun 03 03:59:24.247555 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:24.247499 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hsqd8\"/\"kube-root-ca.crt\"" Jun 03 03:59:24.248256 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:24.248237 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hsqd8\"/\"default-dockercfg-x9tf6\"" Jun 03 03:59:24.258890 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:24.258869 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hsqd8/must-gather-bq4vq"] Jun 03 03:59:24.346687 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:24.346658 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vfhh\" (UniqueName: \"kubernetes.io/projected/2864196c-d673-462c-9c58-ed44ebf91d91-kube-api-access-8vfhh\") pod \"must-gather-bq4vq\" (UID: \"2864196c-d673-462c-9c58-ed44ebf91d91\") " pod="openshift-must-gather-hsqd8/must-gather-bq4vq" Jun 03 03:59:24.346824 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:24.346732 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2864196c-d673-462c-9c58-ed44ebf91d91-must-gather-output\") pod \"must-gather-bq4vq\" (UID: \"2864196c-d673-462c-9c58-ed44ebf91d91\") " pod="openshift-must-gather-hsqd8/must-gather-bq4vq" Jun 03 03:59:24.447425 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:24.447399 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2864196c-d673-462c-9c58-ed44ebf91d91-must-gather-output\") pod \"must-gather-bq4vq\" (UID: \"2864196c-d673-462c-9c58-ed44ebf91d91\") " pod="openshift-must-gather-hsqd8/must-gather-bq4vq" Jun 03 03:59:24.447551 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:24.447460 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8vfhh\" (UniqueName: \"kubernetes.io/projected/2864196c-d673-462c-9c58-ed44ebf91d91-kube-api-access-8vfhh\") pod \"must-gather-bq4vq\" (UID: \"2864196c-d673-462c-9c58-ed44ebf91d91\") " pod="openshift-must-gather-hsqd8/must-gather-bq4vq" Jun 03 03:59:24.447743 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:24.447708 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2864196c-d673-462c-9c58-ed44ebf91d91-must-gather-output\") pod \"must-gather-bq4vq\" (UID: \"2864196c-d673-462c-9c58-ed44ebf91d91\") " pod="openshift-must-gather-hsqd8/must-gather-bq4vq" Jun 03 03:59:24.454359 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:24.454337 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vfhh\" (UniqueName: \"kubernetes.io/projected/2864196c-d673-462c-9c58-ed44ebf91d91-kube-api-access-8vfhh\") pod \"must-gather-bq4vq\" (UID: \"2864196c-d673-462c-9c58-ed44ebf91d91\") " pod="openshift-must-gather-hsqd8/must-gather-bq4vq" Jun 03 03:59:24.554669 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:24.554648 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hsqd8/must-gather-bq4vq" Jun 03 03:59:24.678930 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:24.678902 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hsqd8/must-gather-bq4vq"] Jun 03 03:59:24.681206 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:59:24.681175 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2864196c_d673_462c_9c58_ed44ebf91d91.slice/crio-f35f26d487dbbf74d9d3853bee3de2c43c5be8791d63b6dbcde1d8c4e9849a76 WatchSource:0}: Error finding container f35f26d487dbbf74d9d3853bee3de2c43c5be8791d63b6dbcde1d8c4e9849a76: Status 404 returned error can't find the container with id f35f26d487dbbf74d9d3853bee3de2c43c5be8791d63b6dbcde1d8c4e9849a76 Jun 03 03:59:24.683100 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:24.683079 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 03:59:25.411894 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:25.411860 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hsqd8/must-gather-bq4vq" event={"ID":"2864196c-d673-462c-9c58-ed44ebf91d91","Type":"ContainerStarted","Data":"f35f26d487dbbf74d9d3853bee3de2c43c5be8791d63b6dbcde1d8c4e9849a76"} Jun 03 03:59:26.417803 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:26.417765 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hsqd8/must-gather-bq4vq" event={"ID":"2864196c-d673-462c-9c58-ed44ebf91d91","Type":"ContainerStarted","Data":"e8c846fae90c040a37974c03cc55a3ab1f91a4bbed419536e07cfff6b7117d3d"} Jun 03 03:59:26.418309 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:26.417815 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hsqd8/must-gather-bq4vq" event={"ID":"2864196c-d673-462c-9c58-ed44ebf91d91","Type":"ContainerStarted","Data":"ad9a2859b558e731d43cb7a364ca46caa2ef1723525842aa64b60bbf924b4a8f"} Jun 03 03:59:26.433908 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:26.433856 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-hsqd8/must-gather-bq4vq" podStartSLOduration=1.6280702439999999 podStartE2EDuration="2.433841737s" podCreationTimestamp="2026-06-03 03:59:24 +0000 UTC" firstStartedPulling="2026-06-03 03:59:24.683243966 +0000 UTC m=+2339.855153815" lastFinishedPulling="2026-06-03 03:59:25.489015457 +0000 UTC m=+2340.660925308" observedRunningTime="2026-06-03 03:59:26.432024952 +0000 UTC m=+2341.603934821" watchObservedRunningTime="2026-06-03 03:59:26.433841737 +0000 UTC m=+2341.605751608" Jun 03 03:59:27.210715 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:27.210683 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6rg4l_7320dc64-d3ac-4db4-9251-6801ac0cc6c8/global-pull-secret-syncer/0.log" Jun 03 03:59:27.333050 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:27.333020 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7rz6d_b836c825-35f6-4fc3-8b10-e098282ab5d3/konnectivity-agent/0.log" Jun 03 03:59:27.443944 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:27.443913 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-253.ec2.internal_51754ad4b56dbdc3429426f262ad029e/haproxy/0.log" Jun 03 03:59:32.416620 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:32.416531 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-676d885b79-2rn6f_e5e1ef60-cf5e-47e5-bd91-24f0823304a0/authorino/0.log" Jun 03 03:59:32.443011 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:32.442868 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-njwd5_d1b6f979-aab9-429f-9f96-0f40a47ceb46/manager/0.log" Jun 03 03:59:32.463655 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:32.463624 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-pzk6z_6e2938e5-f737-44d2-b154-5e9eb0ccb15a/manager/0.log" Jun 03 03:59:32.523838 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:32.523808 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8rsgg_61dee4b5-8d4d-49b7-9377-c3cc7f4ff48d/registry-server/0.log" Jun 03 03:59:32.619030 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:32.618681 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-xt2h5_82861104-f226-4ff6-a22e-534b3763d433/manager/0.log" Jun 03 03:59:34.496007 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:34.495957 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7cd4b46c8f-tjh5m_9ee77936-416a-42cc-ae9d-679fad90febb/metrics-server/0.log" Jun 03 03:59:34.545327 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:34.545259 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7mtdh_d4b1bdd0-3ff3-400d-8572-c72324b24d8a/node-exporter/0.log" Jun 03 03:59:34.565154 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:34.565124 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7mtdh_d4b1bdd0-3ff3-400d-8572-c72324b24d8a/kube-rbac-proxy/0.log" Jun 03 03:59:34.582678 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:34.582650 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7mtdh_d4b1bdd0-3ff3-400d-8572-c72324b24d8a/init-textfile/0.log" Jun 03 03:59:34.827520 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:34.827488 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_971efc38-e3c8-4574-aca6-d139daa85ee2/prometheus/0.log" Jun 03 03:59:34.845239 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:34.845209 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_971efc38-e3c8-4574-aca6-d139daa85ee2/config-reloader/0.log" Jun 03 03:59:34.863104 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:34.863081 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_971efc38-e3c8-4574-aca6-d139daa85ee2/thanos-sidecar/0.log" Jun 03 03:59:34.881434 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:34.881405 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_971efc38-e3c8-4574-aca6-d139daa85ee2/kube-rbac-proxy-web/0.log" Jun 03 03:59:34.900686 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:34.900658 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_971efc38-e3c8-4574-aca6-d139daa85ee2/kube-rbac-proxy/0.log" Jun 03 03:59:34.918435 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:34.918409 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_971efc38-e3c8-4574-aca6-d139daa85ee2/kube-rbac-proxy-thanos/0.log" Jun 03 03:59:34.937013 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:34.936975 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_971efc38-e3c8-4574-aca6-d139daa85ee2/init-config-reloader/0.log" Jun 03 03:59:35.005739 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:35.005712 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-496p5_0ba294b4-6b4a-461e-a770-34568283b965/prometheus-operator-admission-webhook/0.log" Jun 03 03:59:36.768511 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:36.768466 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-tq7jg_3f53d812-13d2-4aae-9673-a8b3c90386e9/console-operator/1.log" Jun 03 03:59:36.774934 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:36.774910 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-tq7jg_3f53d812-13d2-4aae-9673-a8b3c90386e9/console-operator/2.log" Jun 03 03:59:37.309826 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:37.309797 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-k2qsz_11ee73ec-0499-4f10-8e48-62e7280059e6/download-server/0.log" Jun 03 03:59:37.778170 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:37.778136 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-g27np_0175a2dd-1bca-4635-b4bd-bdaa20a4de6f/volume-data-source-validator/0.log" Jun 03 03:59:38.179870 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:38.179788 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hsqd8/perf-node-gather-daemonset-mk4mk"] Jun 03 03:59:38.189297 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:38.189266 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hsqd8/perf-node-gather-daemonset-mk4mk"] Jun 03 03:59:38.189516 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:38.189411 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-mk4mk" Jun 03 03:59:38.203937 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:38.203890 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksx55\" (UniqueName: \"kubernetes.io/projected/5391fa43-b967-4cde-bd21-02ecedf59a93-kube-api-access-ksx55\") pod \"perf-node-gather-daemonset-mk4mk\" (UID: \"5391fa43-b967-4cde-bd21-02ecedf59a93\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-mk4mk" Jun 03 03:59:38.204095 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:38.203977 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5391fa43-b967-4cde-bd21-02ecedf59a93-proc\") pod \"perf-node-gather-daemonset-mk4mk\" (UID: \"5391fa43-b967-4cde-bd21-02ecedf59a93\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-mk4mk" Jun 03 03:59:38.204169 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:38.204106 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5391fa43-b967-4cde-bd21-02ecedf59a93-sys\") pod \"perf-node-gather-daemonset-mk4mk\" (UID: \"5391fa43-b967-4cde-bd21-02ecedf59a93\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-mk4mk" Jun 03 03:59:38.204169 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:38.204154 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5391fa43-b967-4cde-bd21-02ecedf59a93-lib-modules\") pod \"perf-node-gather-daemonset-mk4mk\" (UID: \"5391fa43-b967-4cde-bd21-02ecedf59a93\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-mk4mk" Jun 03 03:59:38.204284 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:38.204195 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5391fa43-b967-4cde-bd21-02ecedf59a93-podres\") pod \"perf-node-gather-daemonset-mk4mk\" (UID: \"5391fa43-b967-4cde-bd21-02ecedf59a93\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-mk4mk" Jun 03 03:59:38.305378 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:38.305336 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5391fa43-b967-4cde-bd21-02ecedf59a93-proc\") pod \"perf-node-gather-daemonset-mk4mk\" (UID: \"5391fa43-b967-4cde-bd21-02ecedf59a93\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-mk4mk" Jun 03 03:59:38.305569 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:38.305442 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5391fa43-b967-4cde-bd21-02ecedf59a93-sys\") pod \"perf-node-gather-daemonset-mk4mk\" (UID: \"5391fa43-b967-4cde-bd21-02ecedf59a93\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-mk4mk" Jun 03 03:59:38.305569 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:38.305456 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5391fa43-b967-4cde-bd21-02ecedf59a93-proc\") pod \"perf-node-gather-daemonset-mk4mk\" (UID: \"5391fa43-b967-4cde-bd21-02ecedf59a93\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-mk4mk" Jun 03 03:59:38.305569 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:38.305486 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5391fa43-b967-4cde-bd21-02ecedf59a93-lib-modules\") pod \"perf-node-gather-daemonset-mk4mk\" (UID: \"5391fa43-b967-4cde-bd21-02ecedf59a93\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-mk4mk" Jun 03 03:59:38.305569 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:38.305519 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5391fa43-b967-4cde-bd21-02ecedf59a93-sys\") pod \"perf-node-gather-daemonset-mk4mk\" (UID: \"5391fa43-b967-4cde-bd21-02ecedf59a93\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-mk4mk" Jun 03 03:59:38.305569 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:38.305524 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5391fa43-b967-4cde-bd21-02ecedf59a93-podres\") pod \"perf-node-gather-daemonset-mk4mk\" (UID: \"5391fa43-b967-4cde-bd21-02ecedf59a93\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-mk4mk" Jun 03 03:59:38.305569 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:38.305557 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ksx55\" (UniqueName: \"kubernetes.io/projected/5391fa43-b967-4cde-bd21-02ecedf59a93-kube-api-access-ksx55\") pod \"perf-node-gather-daemonset-mk4mk\" (UID: \"5391fa43-b967-4cde-bd21-02ecedf59a93\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-mk4mk" Jun 03 03:59:38.305911 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:38.305631 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5391fa43-b967-4cde-bd21-02ecedf59a93-lib-modules\") pod \"perf-node-gather-daemonset-mk4mk\" (UID: \"5391fa43-b967-4cde-bd21-02ecedf59a93\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-mk4mk" Jun 03 03:59:38.305911 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:38.305704 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5391fa43-b967-4cde-bd21-02ecedf59a93-podres\") pod \"perf-node-gather-daemonset-mk4mk\" (UID: \"5391fa43-b967-4cde-bd21-02ecedf59a93\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-mk4mk" Jun 03 03:59:38.313722 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:38.313694 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksx55\" (UniqueName: \"kubernetes.io/projected/5391fa43-b967-4cde-bd21-02ecedf59a93-kube-api-access-ksx55\") pod \"perf-node-gather-daemonset-mk4mk\" (UID: \"5391fa43-b967-4cde-bd21-02ecedf59a93\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-mk4mk" Jun 03 03:59:38.505339 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:38.505301 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-mk4mk" Jun 03 03:59:38.679028 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:38.677484 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hsqd8/perf-node-gather-daemonset-mk4mk"] Jun 03 03:59:38.681801 ip-10-0-141-253 kubenswrapper[2558]: W0603 03:59:38.681770 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5391fa43_b967_4cde_bd21_02ecedf59a93.slice/crio-69190874c6420b403472e3a344a607718a2e135f2a3f60b3bb2c6b7193ed5919 WatchSource:0}: Error finding container 69190874c6420b403472e3a344a607718a2e135f2a3f60b3bb2c6b7193ed5919: Status 404 returned error can't find the container with id 69190874c6420b403472e3a344a607718a2e135f2a3f60b3bb2c6b7193ed5919 Jun 03 03:59:38.818564 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:38.818511 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v2qx2_a2546001-186b-47fb-a1e3-059132eabef5/dns/0.log" Jun 03 03:59:38.836175 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:38.836148 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v2qx2_a2546001-186b-47fb-a1e3-059132eabef5/kube-rbac-proxy/0.log" Jun 03 03:59:38.900709 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:38.900685 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nbf8p_ea8e1018-9d63-4b7a-b241-4b9f6d563906/dns-node-resolver/0.log" Jun 03 03:59:39.357383 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:39.357354 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5d5cd555fc-hsjb5_6fe97911-57a8-4e31-ade8-c2ff46c7319f/registry/0.log" Jun 03 03:59:39.418184 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:39.418157 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wrjnf_8af70d99-31a6-49ef-91bb-735be0eb8536/node-ca/0.log" Jun 03 03:59:39.476760 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:39.476721 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-mk4mk" event={"ID":"5391fa43-b967-4cde-bd21-02ecedf59a93","Type":"ContainerStarted","Data":"5d8bd6e337941b3fbee31d63197d81732b102f7c75dc6aa49aed5868a105fefa"} Jun 03 03:59:39.476760 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:39.476763 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-mk4mk" event={"ID":"5391fa43-b967-4cde-bd21-02ecedf59a93","Type":"ContainerStarted","Data":"69190874c6420b403472e3a344a607718a2e135f2a3f60b3bb2c6b7193ed5919"} Jun 03 03:59:39.477039 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:39.476837 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-mk4mk" Jun 03 03:59:39.491797 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:39.491746 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-mk4mk" podStartSLOduration=1.491729562 podStartE2EDuration="1.491729562s" podCreationTimestamp="2026-06-03 03:59:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:59:39.490536113 +0000 UTC m=+2354.662445985" watchObservedRunningTime="2026-06-03 03:59:39.491729562 +0000 UTC m=+2354.663639434" Jun 03 03:59:40.210287 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:40.210259 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b5949x_fdf5d6f6-453f-4740-9e66-169c08a40a53/istio-proxy/0.log" Jun 03 03:59:40.398763 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:40.398735 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-xzr44_e09cbaba-4ad4-49c4-b717-379ca8a1b59d/istio-proxy/0.log" Jun 03 03:59:40.479902 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:40.479824 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-746645b9b9-vw7dh_663f11c6-a48b-4193-8a3d-9feea74d8b0c/router/0.log" Jun 03 03:59:41.014517 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:41.014489 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qzwsf_07bbf7cb-60c5-4184-a023-5a4bef630b32/serve-healthcheck-canary/0.log" Jun 03 03:59:41.413575 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:41.413491 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-q2g2j_c54da6ba-c2e2-40c7-92ad-cf73160ad5ee/insights-operator/0.log" Jun 03 03:59:41.413965 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:41.413782 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-q2g2j_c54da6ba-c2e2-40c7-92ad-cf73160ad5ee/insights-operator/1.log" Jun 03 03:59:41.543716 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:41.543688 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rqfr8_c6a6e7d5-d65b-47fc-9ecc-48acf9195f73/kube-rbac-proxy/0.log" Jun 03 03:59:41.561562 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:41.561539 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rqfr8_c6a6e7d5-d65b-47fc-9ecc-48acf9195f73/exporter/0.log" Jun 03 03:59:41.580439 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:41.580420 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rqfr8_c6a6e7d5-d65b-47fc-9ecc-48acf9195f73/extractor/0.log" Jun 03 03:59:43.514590 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:43.514561 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5cbbc674f4-sllv8_e59fb0d6-8bce-42ff-84ca-08707bddb76a/nginx/0.log" Jun 03 03:59:43.659167 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:43.659139 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29674305-s62t5_c5a1f534-60a9-4429-9ebd-62c2c8556b59/cleanup/0.log" Jun 03 03:59:43.738729 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:43.738696 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7477944ccd-t4gvg_aeb00d5a-1f98-4f23-acad-abde430ec44a/manager/0.log" Jun 03 03:59:43.987458 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:43.987379 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f864588-n2652_9cc1571f-d011-4030-9fbe-33388b5ac07d/manager/0.log" Jun 03 03:59:44.004022 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:44.003987 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f864588-n2652_9cc1571f-d011-4030-9fbe-33388b5ac07d/copy-manifests/0.log" Jun 03 03:59:44.029363 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:44.025243 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-wwx4c_733c3d37-8ba8-4a05-9c1d-15d428413fee/postgres/0.log" Jun 03 03:59:45.316847 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:45.316818 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-865bddc6b6-pgsbm_adf0ff12-35dc-4702-a0cc-5954c536e140/manager/0.log" Jun 03 03:59:45.489786 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:45.489751 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-mk4mk" Jun 03 03:59:50.059507 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:50.059480 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-zgrzg_34261552-be96-4a42-828e-f5ed06ccafe5/migrator/0.log" Jun 03 03:59:50.078387 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:50.078357 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-zgrzg_34261552-be96-4a42-828e-f5ed06ccafe5/graceful-termination/0.log" Jun 03 03:59:50.414789 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:50.414755 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-mg788_a2d2c179-f717-45c3-8e52-94168d354ff9/kube-storage-version-migrator-operator/1.log" Jun 03 03:59:50.415569 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:50.415553 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-mg788_a2d2c179-f717-45c3-8e52-94168d354ff9/kube-storage-version-migrator-operator/0.log" Jun 03 03:59:51.641413 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:51.641379 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pdxhs_b49ee6d0-1785-4901-9e01-29a2b91214cd/kube-multus-additional-cni-plugins/0.log" Jun 03 03:59:51.661371 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:51.661352 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pdxhs_b49ee6d0-1785-4901-9e01-29a2b91214cd/egress-router-binary-copy/0.log" Jun 03 03:59:51.680302 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:51.680284 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pdxhs_b49ee6d0-1785-4901-9e01-29a2b91214cd/cni-plugins/0.log" Jun 03 03:59:51.698190 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:51.698169 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pdxhs_b49ee6d0-1785-4901-9e01-29a2b91214cd/bond-cni-plugin/0.log" Jun 03 03:59:51.717644 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:51.717622 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pdxhs_b49ee6d0-1785-4901-9e01-29a2b91214cd/routeoverride-cni/0.log" Jun 03 03:59:51.735233 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:51.735214 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pdxhs_b49ee6d0-1785-4901-9e01-29a2b91214cd/whereabouts-cni-bincopy/0.log" Jun 03 03:59:51.757103 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:51.757084 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pdxhs_b49ee6d0-1785-4901-9e01-29a2b91214cd/whereabouts-cni/0.log" Jun 03 03:59:51.815257 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:51.815236 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-t6wx4_087a08d4-5cd4-40dc-ac07-07a516cb3602/kube-multus/0.log" Jun 03 03:59:51.874359 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:51.874335 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rp75f_55469fc3-4142-42c5-8420-af3316559074/network-metrics-daemon/0.log" Jun 03 03:59:51.891290 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:51.891251 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rp75f_55469fc3-4142-42c5-8420-af3316559074/kube-rbac-proxy/0.log" Jun 03 03:59:52.732125 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:52.732085 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/ovn-controller/0.log" Jun 03 03:59:52.749152 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:52.749127 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/ovn-acl-logging/0.log" Jun 03 03:59:52.760629 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:52.760608 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/ovn-acl-logging/1.log" Jun 03 03:59:52.779798 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:52.779777 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/kube-rbac-proxy-node/0.log" Jun 03 03:59:52.798425 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:52.798408 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 03:59:52.814199 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:52.814183 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/northd/0.log" Jun 03 03:59:52.831932 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:52.831911 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/nbdb/0.log" Jun 03 03:59:52.854177 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:52.854133 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/sbdb/0.log" Jun 03 03:59:52.976425 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:52.976376 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4fv96_d70d6dc6-b06b-4651-88d9-d08322361734/ovnkube-controller/0.log" Jun 03 03:59:54.554890 ip-10-0-141-253 kubenswrapper[2558]: I0603 03:59:54.554857 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-gqszd_3de6cab3-243e-4cc5-91c5-458eec3e5180/network-check-target-container/0.log"