Jun 02 16:41:15.439328 ip-10-0-132-45 systemd[1]: Starting Kubernetes Kubelet... Jun 02 16:41:15.829938 ip-10-0-132-45 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 16:41:15.829938 ip-10-0-132-45 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 16:41:15.829938 ip-10-0-132-45 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 16:41:15.829938 ip-10-0-132-45 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 16:41:15.829938 ip-10-0-132-45 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 16:41:15.831978 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.831894 2565 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 16:41:15.835202 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835186 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 16:41:15.835202 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835202 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 16:41:15.835270 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835206 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 16:41:15.835270 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835210 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 16:41:15.835270 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835213 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 16:41:15.835270 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835216 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 16:41:15.835270 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835219 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 16:41:15.835270 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835221 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 16:41:15.835270 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835224 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 16:41:15.835270 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835226 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 16:41:15.835270 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835229 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 16:41:15.835270 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835231 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 16:41:15.835270 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835234 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 16:41:15.835270 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835242 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 16:41:15.835270 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835245 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 16:41:15.835270 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835248 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 16:41:15.835270 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835250 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 16:41:15.835270 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835253 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 16:41:15.835270 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835255 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 16:41:15.835270 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835258 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 16:41:15.835270 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835261 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 16:41:15.835270 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835263 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 16:41:15.835738 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835266 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 16:41:15.835738 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835268 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 16:41:15.835738 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835273 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 16:41:15.835738 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835276 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 16:41:15.835738 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835280 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 16:41:15.835738 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835283 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 16:41:15.835738 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835286 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 16:41:15.835738 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835288 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 16:41:15.835738 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835291 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 02 16:41:15.835738 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835293 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 16:41:15.835738 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835296 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 16:41:15.835738 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835298 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 16:41:15.835738 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835300 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 16:41:15.835738 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835303 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 16:41:15.835738 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835305 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 16:41:15.835738 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835308 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 16:41:15.835738 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835310 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 16:41:15.835738 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835313 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 16:41:15.835738 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835316 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 16:41:15.835738 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835318 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 16:41:15.836268 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835320 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 16:41:15.836268 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835324 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 16:41:15.836268 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835326 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 16:41:15.836268 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835329 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 16:41:15.836268 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835331 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 16:41:15.836268 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835334 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 16:41:15.836268 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835336 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 16:41:15.836268 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835338 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 16:41:15.836268 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835341 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 16:41:15.836268 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835343 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 16:41:15.836268 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835346 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 16:41:15.836268 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835348 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 16:41:15.836268 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835351 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 16:41:15.836268 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835354 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 16:41:15.836268 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835356 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 16:41:15.836268 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835359 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 16:41:15.836268 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835361 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 16:41:15.836268 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835364 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 16:41:15.836268 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835367 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 16:41:15.836268 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835369 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 16:41:15.836794 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835372 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 16:41:15.836794 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835374 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 16:41:15.836794 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835380 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 16:41:15.836794 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835383 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 16:41:15.836794 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835386 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 16:41:15.836794 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835388 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 16:41:15.836794 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835391 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 16:41:15.836794 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835393 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 16:41:15.836794 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835396 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 16:41:15.836794 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835398 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 16:41:15.836794 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835401 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 16:41:15.836794 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835403 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 16:41:15.836794 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835407 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 16:41:15.836794 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835410 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 16:41:15.836794 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835413 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 16:41:15.836794 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835415 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 16:41:15.836794 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835418 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 16:41:15.836794 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835420 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 16:41:15.836794 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835422 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 16:41:15.836794 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835425 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 16:41:15.837285 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835428 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 16:41:15.837285 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835431 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 16:41:15.837285 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835433 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 16:41:15.837285 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.835436 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 16:41:15.837285 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836444 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 16:41:15.837285 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836451 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 16:41:15.837285 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836454 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 16:41:15.837285 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836457 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 16:41:15.837285 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836460 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 16:41:15.837285 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836462 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 16:41:15.837285 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836465 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 16:41:15.837285 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836467 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 16:41:15.837285 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836469 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 16:41:15.837285 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836473 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 16:41:15.837285 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836476 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 16:41:15.837285 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836478 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 16:41:15.837285 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836481 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 16:41:15.837285 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836485 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 16:41:15.837285 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836487 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 16:41:15.837285 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836490 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 16:41:15.837792 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836501 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 16:41:15.837792 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836504 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 16:41:15.837792 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836507 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 16:41:15.837792 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836510 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 16:41:15.837792 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836513 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 16:41:15.837792 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836515 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 16:41:15.837792 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836518 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 16:41:15.837792 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836520 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 16:41:15.837792 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836523 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 16:41:15.837792 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836525 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 16:41:15.837792 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836528 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 16:41:15.837792 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836531 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 16:41:15.837792 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836533 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 16:41:15.837792 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836537 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 16:41:15.837792 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836539 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 16:41:15.837792 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836541 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 16:41:15.837792 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836544 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 16:41:15.837792 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836546 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 16:41:15.837792 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836549 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 16:41:15.837792 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836552 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 16:41:15.838333 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836554 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 16:41:15.838333 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836556 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 16:41:15.838333 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836559 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 16:41:15.838333 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836561 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 16:41:15.838333 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836563 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 16:41:15.838333 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836567 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 16:41:15.838333 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836569 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 16:41:15.838333 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836572 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 16:41:15.838333 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836574 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 16:41:15.838333 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836577 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 16:41:15.838333 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836580 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 16:41:15.838333 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836582 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 16:41:15.838333 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836585 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 16:41:15.838333 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836587 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 02 16:41:15.838333 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836589 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 16:41:15.838333 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836592 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 16:41:15.838333 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836594 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 16:41:15.838333 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836597 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 16:41:15.838333 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836599 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 16:41:15.838333 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836601 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 16:41:15.838828 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836604 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 16:41:15.838828 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836608 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 16:41:15.838828 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836610 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 16:41:15.838828 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836613 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 16:41:15.838828 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836615 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 16:41:15.838828 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836618 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 16:41:15.838828 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836620 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 16:41:15.838828 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836622 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 16:41:15.838828 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836625 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 16:41:15.838828 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836627 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 16:41:15.838828 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836631 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 16:41:15.838828 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836634 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 16:41:15.838828 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836637 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 16:41:15.838828 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836640 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 16:41:15.838828 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836642 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 16:41:15.838828 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836644 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 16:41:15.838828 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836647 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 16:41:15.838828 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836651 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 16:41:15.838828 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836654 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 16:41:15.839308 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836656 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 16:41:15.839308 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836658 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 16:41:15.839308 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836661 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 16:41:15.839308 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836663 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 16:41:15.839308 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836666 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 16:41:15.839308 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836668 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 16:41:15.839308 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836670 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 16:41:15.839308 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836673 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 16:41:15.839308 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836675 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 16:41:15.839308 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836678 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 16:41:15.839308 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.836683 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 16:41:15.839308 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836753 2565 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 16:41:15.839308 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836760 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 16:41:15.839308 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836769 2565 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 16:41:15.839308 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836776 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 16:41:15.839308 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836782 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 16:41:15.839308 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836787 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 16:41:15.839308 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836791 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 16:41:15.839308 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836796 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 16:41:15.839308 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836799 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 16:41:15.839788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836802 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 16:41:15.839788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836806 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 16:41:15.839788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836809 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 16:41:15.839788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836812 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 16:41:15.839788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836815 2565 flags.go:64] FLAG: --cgroup-root="" Jun 02 16:41:15.839788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836817 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 16:41:15.839788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836820 2565 flags.go:64] FLAG: --client-ca-file="" Jun 02 16:41:15.839788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836823 2565 flags.go:64] FLAG: --cloud-config="" Jun 02 16:41:15.839788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836826 2565 flags.go:64] FLAG: --cloud-provider="external" Jun 02 16:41:15.839788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836828 2565 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 16:41:15.839788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836833 2565 flags.go:64] FLAG: --cluster-domain="" Jun 02 16:41:15.839788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836836 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 16:41:15.839788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836839 2565 flags.go:64] FLAG: --config-dir="" Jun 02 16:41:15.839788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836842 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 16:41:15.839788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836845 2565 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 16:41:15.839788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836849 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 16:41:15.839788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836852 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 16:41:15.839788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836855 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 16:41:15.839788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836858 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 16:41:15.839788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836861 2565 flags.go:64] FLAG: --contention-profiling="false" Jun 02 16:41:15.839788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836863 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 16:41:15.839788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836866 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 16:41:15.839788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836870 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 16:41:15.839788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836873 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 16:41:15.839788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836877 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 16:41:15.840398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836880 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 16:41:15.840398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836882 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 16:41:15.840398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836885 2565 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 16:41:15.840398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836888 2565 flags.go:64] FLAG: --enable-server="true" Jun 02 16:41:15.840398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836891 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 16:41:15.840398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836896 2565 flags.go:64] FLAG: --event-burst="100" Jun 02 16:41:15.840398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836899 2565 flags.go:64] FLAG: --event-qps="50" Jun 02 16:41:15.840398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836902 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 16:41:15.840398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836905 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 16:41:15.840398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836908 2565 flags.go:64] FLAG: --eviction-hard="" Jun 02 16:41:15.840398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836912 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 16:41:15.840398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836915 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 16:41:15.840398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836918 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 16:41:15.840398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836920 2565 flags.go:64] FLAG: --eviction-soft="" Jun 02 16:41:15.840398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836923 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 16:41:15.840398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836926 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 16:41:15.840398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836929 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 16:41:15.840398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836932 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 16:41:15.840398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836935 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 16:41:15.840398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836938 2565 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 16:41:15.840398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836941 2565 flags.go:64] FLAG: --feature-gates="" Jun 02 16:41:15.840398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836945 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 16:41:15.840398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836948 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 16:41:15.840398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836951 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 16:41:15.840398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836954 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 16:41:15.841001 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836957 2565 flags.go:64] FLAG: --healthz-port="10248" Jun 02 16:41:15.841001 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836959 2565 flags.go:64] FLAG: --help="false" Jun 02 16:41:15.841001 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836962 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-132-45.ec2.internal" Jun 02 16:41:15.841001 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836965 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 16:41:15.841001 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836968 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 16:41:15.841001 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836972 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 16:41:15.841001 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836975 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 16:41:15.841001 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836978 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 16:41:15.841001 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836981 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 16:41:15.841001 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836984 2565 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 16:41:15.841001 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836986 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 16:41:15.841001 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836989 2565 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 16:41:15.841001 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836992 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 16:41:15.841001 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836995 2565 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 16:41:15.841001 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.836998 2565 flags.go:64] FLAG: --kube-reserved="" Jun 02 16:41:15.841001 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837000 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 16:41:15.841001 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837003 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 16:41:15.841001 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837019 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 16:41:15.841001 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837022 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 16:41:15.841001 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837025 2565 flags.go:64] FLAG: --lock-file="" Jun 02 16:41:15.841001 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837028 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 16:41:15.841001 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837030 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 16:41:15.841001 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837033 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 16:41:15.841001 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837039 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 16:41:15.841587 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837042 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 16:41:15.841587 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837046 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 16:41:15.841587 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837048 2565 flags.go:64] FLAG: --logging-format="text" Jun 02 16:41:15.841587 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837051 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 16:41:15.841587 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837055 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 16:41:15.841587 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837058 2565 flags.go:64] FLAG: --manifest-url="" Jun 02 16:41:15.841587 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837060 2565 flags.go:64] FLAG: --manifest-url-header="" Jun 02 16:41:15.841587 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837065 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 16:41:15.841587 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837068 2565 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 16:41:15.841587 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837071 2565 flags.go:64] FLAG: --max-pods="110" Jun 02 16:41:15.841587 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837074 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 16:41:15.841587 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837077 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 16:41:15.841587 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837080 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 16:41:15.841587 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837083 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 16:41:15.841587 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837086 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 16:41:15.841587 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837089 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 16:41:15.841587 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837092 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 16:41:15.841587 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837099 2565 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 16:41:15.841587 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837102 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 16:41:15.841587 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837105 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 16:41:15.841587 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837108 2565 flags.go:64] FLAG: --pod-cidr="" Jun 02 16:41:15.841587 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837111 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 16:41:15.841587 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837116 2565 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837119 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837122 2565 flags.go:64] FLAG: --pods-per-core="0" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837124 2565 flags.go:64] FLAG: --port="10250" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837127 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837130 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-092264e61125d8c4b" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837133 2565 flags.go:64] FLAG: --qos-reserved="" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837137 2565 flags.go:64] FLAG: --read-only-port="10255" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837139 2565 flags.go:64] FLAG: --register-node="true" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837142 2565 flags.go:64] FLAG: --register-schedulable="true" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837146 2565 flags.go:64] FLAG: --register-with-taints="" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837150 2565 flags.go:64] FLAG: --registry-burst="10" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837153 2565 flags.go:64] FLAG: --registry-qps="5" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837156 2565 flags.go:64] FLAG: --reserved-cpus="" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837158 2565 flags.go:64] FLAG: --reserved-memory="" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837162 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837165 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837168 2565 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837170 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837173 2565 flags.go:64] FLAG: --runonce="false" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837176 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837179 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837182 2565 flags.go:64] FLAG: --seccomp-default="false" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837185 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837187 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837191 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 16:41:15.842137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837194 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 16:41:15.842762 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837197 2565 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 16:41:15.842762 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837199 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 16:41:15.842762 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837202 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 16:41:15.842762 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837205 2565 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 16:41:15.842762 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837207 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 16:41:15.842762 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837210 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 16:41:15.842762 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837213 2565 flags.go:64] FLAG: --system-cgroups="" Jun 02 16:41:15.842762 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837216 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 16:41:15.842762 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837222 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 16:41:15.842762 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837224 2565 flags.go:64] FLAG: --tls-cert-file="" Jun 02 16:41:15.842762 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837227 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 16:41:15.842762 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837231 2565 flags.go:64] FLAG: --tls-min-version="" Jun 02 16:41:15.842762 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837233 2565 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 16:41:15.842762 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837238 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 16:41:15.842762 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837241 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 16:41:15.842762 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837244 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 16:41:15.842762 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837247 2565 flags.go:64] FLAG: --v="2" Jun 02 16:41:15.842762 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837251 2565 flags.go:64] FLAG: --version="false" Jun 02 16:41:15.842762 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837255 2565 flags.go:64] FLAG: --vmodule="" Jun 02 16:41:15.842762 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837259 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 16:41:15.842762 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.837263 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 16:41:15.842762 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837372 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 16:41:15.842762 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837377 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 16:41:15.842762 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837380 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 16:41:15.843384 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837383 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 16:41:15.843384 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837386 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 16:41:15.843384 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837388 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 16:41:15.843384 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837391 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 16:41:15.843384 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837393 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 16:41:15.843384 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837396 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 16:41:15.843384 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837398 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 16:41:15.843384 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837401 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 16:41:15.843384 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837404 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 16:41:15.843384 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837406 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 16:41:15.843384 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837408 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 16:41:15.843384 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837411 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 16:41:15.843384 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837413 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 16:41:15.843384 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837417 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 16:41:15.843384 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837420 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 16:41:15.843384 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837422 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 16:41:15.843384 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837425 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 16:41:15.843384 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837427 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 16:41:15.843384 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837430 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 16:41:15.843384 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837433 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 16:41:15.844062 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837436 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 16:41:15.844062 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837441 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 16:41:15.844062 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837444 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 16:41:15.844062 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837446 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 16:41:15.844062 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837449 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 16:41:15.844062 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837451 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 02 16:41:15.844062 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837454 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 16:41:15.844062 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837456 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 16:41:15.844062 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837459 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 16:41:15.844062 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837461 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 16:41:15.844062 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837464 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 16:41:15.844062 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837466 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 16:41:15.844062 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837469 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 16:41:15.844062 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837471 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 16:41:15.844062 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837473 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 16:41:15.844062 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837476 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 16:41:15.844062 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837478 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 16:41:15.844062 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837481 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 16:41:15.844062 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837483 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 16:41:15.844785 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837486 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 16:41:15.844785 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837488 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 16:41:15.844785 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837491 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 16:41:15.844785 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837493 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 16:41:15.844785 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837496 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 16:41:15.844785 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837498 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 16:41:15.844785 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837502 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 16:41:15.844785 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837504 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 16:41:15.844785 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837506 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 16:41:15.844785 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837509 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 16:41:15.844785 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837512 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 16:41:15.844785 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837514 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 16:41:15.844785 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837516 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 16:41:15.844785 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837519 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 16:41:15.844785 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837522 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 16:41:15.844785 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837525 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 16:41:15.844785 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837527 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 16:41:15.844785 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837530 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 16:41:15.844785 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837532 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 16:41:15.844785 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837535 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 16:41:15.845332 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837537 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 16:41:15.845332 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837540 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 16:41:15.845332 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837542 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 16:41:15.845332 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837545 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 16:41:15.845332 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837547 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 16:41:15.845332 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837549 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 16:41:15.845332 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837552 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 16:41:15.845332 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837554 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 16:41:15.845332 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837557 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 16:41:15.845332 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837559 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 16:41:15.845332 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837562 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 16:41:15.845332 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837564 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 16:41:15.845332 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837567 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 16:41:15.845332 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837569 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 16:41:15.845332 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837573 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 16:41:15.845332 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837575 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 16:41:15.845332 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837578 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 16:41:15.845332 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837580 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 16:41:15.845332 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837584 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 16:41:15.845823 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837586 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 16:41:15.845823 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837588 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 16:41:15.845823 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837591 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 16:41:15.845823 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837595 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 16:41:15.845823 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.837598 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 16:41:15.845823 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.838160 2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 16:41:15.845979 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.845844 2565 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 16:41:15.845979 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.845860 2565 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 16:41:15.845979 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845911 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 16:41:15.845979 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845916 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 16:41:15.845979 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845920 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 16:41:15.845979 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845923 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 16:41:15.845979 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845926 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 16:41:15.845979 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845928 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 16:41:15.845979 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845931 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 16:41:15.845979 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845934 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 16:41:15.845979 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845937 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 16:41:15.845979 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845940 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 16:41:15.845979 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845942 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 16:41:15.845979 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845945 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 16:41:15.845979 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845947 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 16:41:15.845979 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845949 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 16:41:15.845979 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845952 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 16:41:15.845979 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845954 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 16:41:15.845979 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845957 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 16:41:15.845979 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845960 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 16:41:15.846489 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845963 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 16:41:15.846489 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845965 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 16:41:15.846489 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845968 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 16:41:15.846489 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845971 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 16:41:15.846489 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845973 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 16:41:15.846489 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845976 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 16:41:15.846489 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845978 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 16:41:15.846489 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845981 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 16:41:15.846489 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845984 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 16:41:15.846489 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845986 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 16:41:15.846489 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845989 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 16:41:15.846489 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845992 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 16:41:15.846489 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845994 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 16:41:15.846489 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845997 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 16:41:15.846489 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.845999 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 16:41:15.846489 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846002 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 16:41:15.846489 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846019 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 16:41:15.846489 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846022 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 16:41:15.846489 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846024 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 16:41:15.846489 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846027 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 16:41:15.846958 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846029 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 16:41:15.846958 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846032 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 16:41:15.846958 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846034 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 16:41:15.846958 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846037 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 16:41:15.846958 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846039 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 16:41:15.846958 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846042 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 16:41:15.846958 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846044 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 16:41:15.846958 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846046 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 16:41:15.846958 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846049 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 16:41:15.846958 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846051 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 16:41:15.846958 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846054 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 02 16:41:15.846958 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846056 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 16:41:15.846958 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846059 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 16:41:15.846958 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846062 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 16:41:15.846958 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846064 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 16:41:15.846958 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846067 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 16:41:15.846958 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846069 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 16:41:15.846958 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846072 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 16:41:15.846958 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846074 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 16:41:15.846958 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846076 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 16:41:15.847460 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846079 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 16:41:15.847460 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846082 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 16:41:15.847460 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846084 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 16:41:15.847460 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846086 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 16:41:15.847460 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846089 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 16:41:15.847460 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846091 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 16:41:15.847460 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846094 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 16:41:15.847460 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846096 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 16:41:15.847460 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846099 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 16:41:15.847460 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846101 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 16:41:15.847460 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846103 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 16:41:15.847460 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846106 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 16:41:15.847460 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846110 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 16:41:15.847460 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846114 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 16:41:15.847460 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846117 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 16:41:15.847460 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846121 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 16:41:15.847460 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846123 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 16:41:15.847460 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846126 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 16:41:15.847460 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846130 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 16:41:15.847919 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846132 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 16:41:15.847919 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846135 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 16:41:15.847919 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846138 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 16:41:15.847919 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846141 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 16:41:15.847919 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846143 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 16:41:15.847919 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846147 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 16:41:15.847919 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846151 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 16:41:15.847919 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846154 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 16:41:15.847919 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846157 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 16:41:15.847919 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.846162 2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 16:41:15.847919 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846253 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 16:41:15.847919 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846259 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 16:41:15.847919 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846261 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 16:41:15.847919 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846264 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 16:41:15.847919 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846267 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 16:41:15.848307 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846269 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 16:41:15.848307 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846272 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 16:41:15.848307 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846275 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 02 16:41:15.848307 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846277 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 16:41:15.848307 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846280 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 16:41:15.848307 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846282 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 16:41:15.848307 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846284 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 16:41:15.848307 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846287 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 16:41:15.848307 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846289 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 16:41:15.848307 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846291 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 16:41:15.848307 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846294 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 16:41:15.848307 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846296 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 16:41:15.848307 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846299 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 16:41:15.848307 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846301 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 16:41:15.848307 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846303 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 16:41:15.848307 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846306 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 16:41:15.848307 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846309 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 16:41:15.848307 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846311 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 16:41:15.848307 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846314 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 16:41:15.848307 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846316 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 16:41:15.848799 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846319 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 16:41:15.848799 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846321 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 16:41:15.848799 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846324 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 16:41:15.848799 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846326 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 16:41:15.848799 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846329 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 16:41:15.848799 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846332 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 16:41:15.848799 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846336 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 16:41:15.848799 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846339 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 16:41:15.848799 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846342 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 16:41:15.848799 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846344 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 16:41:15.848799 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846347 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 16:41:15.848799 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846350 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 16:41:15.848799 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846352 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 16:41:15.848799 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846355 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 16:41:15.848799 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846358 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 16:41:15.848799 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846360 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 16:41:15.848799 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846364 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 16:41:15.848799 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846367 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 16:41:15.848799 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846370 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 16:41:15.849320 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846372 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 16:41:15.849320 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846375 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 16:41:15.849320 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846377 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 16:41:15.849320 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846379 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 16:41:15.849320 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846382 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 16:41:15.849320 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846385 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 16:41:15.849320 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846387 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 16:41:15.849320 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846390 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 16:41:15.849320 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846392 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 16:41:15.849320 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846394 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 16:41:15.849320 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846397 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 16:41:15.849320 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846400 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 16:41:15.849320 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846402 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 16:41:15.849320 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846405 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 16:41:15.849320 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846407 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 16:41:15.849320 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846410 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 16:41:15.849320 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846412 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 16:41:15.849320 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846415 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 16:41:15.849320 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846417 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 16:41:15.849320 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846420 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 16:41:15.849798 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846422 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 16:41:15.849798 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846425 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 16:41:15.849798 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846427 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 16:41:15.849798 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846430 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 16:41:15.849798 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846432 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 16:41:15.849798 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846434 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 16:41:15.849798 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846437 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 16:41:15.849798 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846439 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 16:41:15.849798 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846442 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 16:41:15.849798 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846444 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 16:41:15.849798 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846446 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 16:41:15.849798 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846449 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 16:41:15.849798 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846451 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 16:41:15.849798 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846453 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 16:41:15.849798 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846456 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 16:41:15.849798 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846458 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 16:41:15.849798 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846460 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 16:41:15.849798 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846463 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 16:41:15.849798 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846465 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 16:41:15.849798 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846467 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 16:41:15.850303 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846469 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 16:41:15.850303 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:15.846472 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 16:41:15.850303 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.846477 2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 16:41:15.850303 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.847138 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 16:41:15.850303 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.849743 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 16:41:15.850948 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.850936 2565 server.go:1019] "Starting client certificate rotation" Jun 02 16:41:15.851054 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.851036 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 16:41:15.851090 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.851084 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 16:41:15.871880 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.871859 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 16:41:15.873791 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.873773 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 16:41:15.887883 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.887867 2565 log.go:25] "Validated CRI v1 runtime API" Jun 02 16:41:15.894930 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.894906 2565 log.go:25] "Validated CRI v1 image API" Jun 02 16:41:15.896329 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.896305 2565 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 16:41:15.899731 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.899713 2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9e988d83-ba0f-4081-bdeb-8ffb5077ccf4:/dev/nvme0n1p4 d04dc6f7-50c5-467b-bdeb-ee77648634bc:/dev/nvme0n1p3] Jun 02 16:41:15.899799 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.899731 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 16:41:15.902693 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.902672 2565 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 16:41:15.904391 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.904289 2565 manager.go:217] Machine: {Timestamp:2026-06-02 16:41:15.90376371 +0000 UTC m=+0.359847958 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100726 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec208a931bafe65e9775f1d630ea1557 SystemUUID:ec208a93-1baf-e65e-9775-f1d630ea1557 BootID:2f4bb31e-628f-4a46-8106-6223cc1635fc Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1f:4a:b1:c2:cf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1f:4a:b1:c2:cf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:6f:99:cb:c4:31 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 16:41:15.905003 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.904992 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 16:41:15.905132 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.905119 2565 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 16:41:15.908205 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.908180 2565 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 16:41:15.908336 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.908208 2565 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-45.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 16:41:15.908380 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.908346 2565 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 16:41:15.908380 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.908354 2565 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 16:41:15.908380 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.908362 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 16:41:15.909057 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.909046 2565 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 16:41:15.909828 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.909818 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 02 16:41:15.910119 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.910109 2565 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 16:41:15.911952 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.911942 2565 kubelet.go:491] "Attempting to sync node with API server" Jun 02 16:41:15.911989 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.911956 2565 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 16:41:15.911989 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.911968 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 16:41:15.911989 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.911977 2565 kubelet.go:397] "Adding apiserver pod source" Jun 02 16:41:15.911989 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.911986 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 16:41:15.912827 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.912814 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 16:41:15.912872 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.912833 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 16:41:15.915118 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.915102 2565 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 16:41:15.916810 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.916791 2565 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 16:41:15.919062 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.919050 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 16:41:15.919113 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.919068 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 16:41:15.919113 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.919074 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 16:41:15.919113 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.919080 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 16:41:15.919113 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.919090 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 16:41:15.919113 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.919095 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 16:41:15.919113 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.919101 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 16:41:15.919113 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.919106 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 16:41:15.919113 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.919113 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 16:41:15.919322 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.919119 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 16:41:15.919322 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.919128 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 16:41:15.919322 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.919133 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 16:41:15.919892 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.919883 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 16:41:15.919920 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.919892 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 16:41:15.923074 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.923061 2565 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 16:41:15.923155 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.923089 2565 server.go:1295] "Started kubelet" Jun 02 16:41:15.923417 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.923401 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 16:41:15.923766 ip-10-0-132-45 systemd[1]: Started Kubernetes Kubelet. Jun 02 16:41:15.924991 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.924940 2565 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 16:41:15.925080 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.925031 2565 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 16:41:15.926261 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.926241 2565 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 16:41:15.926540 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.926509 2565 server.go:317] "Adding debug handlers to kubelet server" Jun 02 16:41:15.934105 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.932941 2565 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-45.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 16:41:15.934105 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:15.932998 2565 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-45.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 16:41:15.934105 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:15.933080 2565 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 16:41:15.935357 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.935339 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 16:41:15.935477 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.935371 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 16:41:15.936093 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.935608 2565 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 16:41:15.936674 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.936657 2565 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 16:41:15.936776 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.935617 2565 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 16:41:15.936776 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.936798 2565 factory.go:55] Registering systemd factory Jun 02 16:41:15.936900 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.936814 2565 factory.go:223] Registration of the systemd container factory successfully Jun 02 16:41:15.936900 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.936848 2565 reconstruct.go:97] "Volume reconstruction finished" Jun 02 16:41:15.936900 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.936856 2565 reconciler.go:26] "Reconciler: start to sync state" Jun 02 16:41:15.937112 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:15.936977 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found" Jun 02 16:41:15.937112 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.937086 2565 factory.go:153] Registering CRI-O factory Jun 02 16:41:15.937112 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.937098 2565 factory.go:223] Registration of the crio container factory successfully Jun 02 16:41:15.937261 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.937170 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 16:41:15.937261 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.937203 2565 factory.go:103] Registering Raw factory Jun 02 16:41:15.937261 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.937224 2565 manager.go:1196] Started watching for new ooms in manager Jun 02 16:41:15.937634 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.937613 2565 manager.go:319] Starting recovery of all containers Jun 02 16:41:15.941435 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:15.941404 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-45.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 16:41:15.941579 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:15.941555 2565 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 16:41:15.943209 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:15.941654 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-45.ec2.internal.18b5512bb8efe43e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-45.ec2.internal,UID:ip-10-0-132-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-45.ec2.internal,},FirstTimestamp:2026-06-02 16:41:15.923072062 +0000 UTC m=+0.379156310,LastTimestamp:2026-06-02 16:41:15.923072062 +0000 UTC m=+0.379156310,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-45.ec2.internal,}" Jun 02 16:41:15.948974 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.948958 2565 manager.go:324] Recovery completed Jun 02 16:41:15.953460 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.953448 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:41:15.955358 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.955344 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:41:15.955411 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.955371 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:41:15.955411 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.955381 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:41:15.956174 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.956157 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 16:41:15.956272 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.956262 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 16:41:15.956395 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.956386 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 02 16:41:15.958162 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:15.958100 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-45.ec2.internal.18b5512bbadc8cb2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-45.ec2.internal,UID:ip-10-0-132-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-45.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-45.ec2.internal,},FirstTimestamp:2026-06-02 16:41:15.955358898 +0000 UTC m=+0.411443145,LastTimestamp:2026-06-02 16:41:15.955358898 +0000 UTC m=+0.411443145,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-45.ec2.internal,}" Jun 02 16:41:15.958489 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.958471 2565 policy_none.go:49] "None policy: Start" Jun 02 16:41:15.958489 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.958491 2565 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 16:41:15.958602 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.958503 2565 state_mem.go:35] "Initializing new in-memory state store" Jun 02 16:41:15.963591 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.963576 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ffxh6" Jun 02 16:41:15.964922 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:15.964859 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-45.ec2.internal.18b5512bbadcd0ef default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-45.ec2.internal,UID:ip-10-0-132-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-45.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-45.ec2.internal,},FirstTimestamp:2026-06-02 16:41:15.955376367 +0000 UTC m=+0.411460614,LastTimestamp:2026-06-02 16:41:15.955376367 +0000 UTC m=+0.411460614,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-45.ec2.internal,}" Jun 02 16:41:15.975778 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.975755 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ffxh6" Jun 02 16:41:15.977688 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:15.977622 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-45.ec2.internal.18b5512bbadd0a34 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-45.ec2.internal,UID:ip-10-0-132-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-45.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-45.ec2.internal,},FirstTimestamp:2026-06-02 16:41:15.955391028 +0000 UTC m=+0.411475275,LastTimestamp:2026-06-02 16:41:15.955391028 +0000 UTC m=+0.411475275,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-45.ec2.internal,}" Jun 02 16:41:15.987540 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.987521 2565 manager.go:341] "Starting Device Plugin manager" Jun 02 16:41:15.987617 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:15.987554 2565 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 16:41:15.987617 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.987565 2565 server.go:85] "Starting device plugin registration server" Jun 02 16:41:15.987771 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.987759 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 16:41:15.987821 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.987773 2565 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 16:41:15.988000 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.987872 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 16:41:15.988000 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.987947 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 16:41:15.988000 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:15.987956 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 16:41:15.988374 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:15.988350 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 16:41:15.988465 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:15.988396 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-45.ec2.internal\" not found" Jun 02 16:41:16.039650 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.039623 2565 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 16:41:16.040910 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.040887 2565 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 16:41:16.040910 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.040914 2565 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 16:41:16.041063 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.040930 2565 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 16:41:16.041063 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.040936 2565 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 16:41:16.041063 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:16.040970 2565 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 16:41:16.043721 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.043705 2565 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:41:16.088077 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.088036 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:41:16.088911 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.088899 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:41:16.088966 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.088928 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:41:16.088966 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.088941 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:41:16.088966 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.088962 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-45.ec2.internal" Jun 02 16:41:16.097952 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.097939 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-45.ec2.internal" Jun 02 16:41:16.097998 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:16.097959 2565 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-45.ec2.internal\": node \"ip-10-0-132-45.ec2.internal\" not found" Jun 02 16:41:16.118910 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:16.118888 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found" Jun 02 16:41:16.141824 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.141802 2565 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal"] Jun 02 16:41:16.141868 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.141860 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:41:16.142984 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.142971 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:41:16.143071 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.142997 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:41:16.143071 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.143025 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:41:16.144279 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.144266 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:41:16.144444 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.144432 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" Jun 02 16:41:16.144481 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.144459 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:41:16.144969 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.144943 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:41:16.144969 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.144956 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:41:16.144969 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.144970 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:41:16.144969 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.144973 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:41:16.145170 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.144981 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:41:16.145170 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.144984 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:41:16.146328 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.146312 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal" Jun 02 16:41:16.146376 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.146345 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:41:16.146986 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.146971 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:41:16.147078 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.146996 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:41:16.147078 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.147021 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:41:16.167546 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:16.167530 2565 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-45.ec2.internal\" not found" node="ip-10-0-132-45.ec2.internal" Jun 02 16:41:16.171453 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:16.171437 2565 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-45.ec2.internal\" not found" node="ip-10-0-132-45.ec2.internal" Jun 02 16:41:16.219613 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:16.219593 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found" Jun 02 16:41:16.239614 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.239596 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4a3eebd2da0da535847e15e1fd405896-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal\" (UID: \"4a3eebd2da0da535847e15e1fd405896\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" Jun 02 16:41:16.239662 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.239618 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a3eebd2da0da535847e15e1fd405896-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal\" (UID: \"4a3eebd2da0da535847e15e1fd405896\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" Jun 02 16:41:16.239662 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.239639 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a95576eca65fd8a1e75b2eee015468be-config\") pod \"kube-apiserver-proxy-ip-10-0-132-45.ec2.internal\" (UID: \"a95576eca65fd8a1e75b2eee015468be\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal" Jun 02 16:41:16.320033 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:16.319983 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found" Jun 02 16:41:16.340435 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.340390 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a95576eca65fd8a1e75b2eee015468be-config\") pod \"kube-apiserver-proxy-ip-10-0-132-45.ec2.internal\" (UID: \"a95576eca65fd8a1e75b2eee015468be\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal" Jun 02 16:41:16.340435 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.340416 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4a3eebd2da0da535847e15e1fd405896-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal\" (UID: \"4a3eebd2da0da535847e15e1fd405896\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" Jun 02 16:41:16.340540 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.340444 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a3eebd2da0da535847e15e1fd405896-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal\" (UID: \"4a3eebd2da0da535847e15e1fd405896\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" Jun 02 16:41:16.340540 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.340507 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a95576eca65fd8a1e75b2eee015468be-config\") pod \"kube-apiserver-proxy-ip-10-0-132-45.ec2.internal\" (UID: \"a95576eca65fd8a1e75b2eee015468be\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal" Jun 02 16:41:16.340540 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.340514 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a3eebd2da0da535847e15e1fd405896-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal\" (UID: \"4a3eebd2da0da535847e15e1fd405896\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" Jun 02 16:41:16.340540 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.340516 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4a3eebd2da0da535847e15e1fd405896-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal\" (UID: \"4a3eebd2da0da535847e15e1fd405896\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" Jun 02 16:41:16.420802 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:16.420783 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found" Jun 02 16:41:16.469346 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.469321 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" Jun 02 16:41:16.474706 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.474689 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal" Jun 02 16:41:16.521358 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:16.521330 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found" Jun 02 16:41:16.621946 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:16.621874 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found" Jun 02 16:41:16.722443 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:16.722414 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found" Jun 02 16:41:16.775341 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.775319 2565 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:41:16.780541 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.780523 2565 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:41:16.836121 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.836098 2565 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal" Jun 02 16:41:16.847580 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.847563 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 16:41:16.849070 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.849057 2565 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" Jun 02 16:41:16.851019 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.850994 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 16:41:16.851165 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.851142 2565 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 16:41:16.851165 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.851149 2565 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 16:41:16.851296 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:16.851209 2565 kubelet.go:3342] "Failed creating a mirror pod" err="Post \"https://a9ddc4a367999432faae98e6239782c6-d4f5108e69c4c160.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.132.45:59696->52.3.177.162:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" Jun 02 16:41:16.912246 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.912222 2565 apiserver.go:52] "Watching apiserver" Jun 02 16:41:16.923314 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.923287 2565 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 16:41:16.923626 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.923602 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-7sjt8","kube-system/konnectivity-agent-7fvwq","openshift-dns/node-resolver-xzbtx","openshift-multus/multus-additional-cni-plugins-fhcjt","openshift-multus/multus-fjcc9","kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4","openshift-cluster-node-tuning-operator/tuned-l7kpg","openshift-image-registry/node-ca-hhv9c","openshift-multus/network-metrics-daemon-5p7z4","openshift-network-diagnostics/network-check-target-vgkxp","openshift-network-operator/iptables-alerter-dbpdg"] Jun 02 16:41:16.925364 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.925345 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:16.926561 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.926539 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7fvwq" Jun 02 16:41:16.927688 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.927670 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xzbtx" Jun 02 16:41:16.927796 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.927720 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 16:41:16.927862 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.927839 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 16:41:16.927921 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.927874 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 16:41:16.927921 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.927727 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 16:41:16.928125 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.928095 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6jxj7\"" Jun 02 16:41:16.928309 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.928209 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 16:41:16.928374 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.928308 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 16:41:16.928374 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.928318 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 16:41:16.928498 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.928448 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sg5dx\"" Jun 02 16:41:16.928607 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.928591 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 16:41:16.928848 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.928831 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:16.929598 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.929553 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 16:41:16.929762 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.929646 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-76rfd\"" Jun 02 16:41:16.929762 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.929665 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 16:41:16.930127 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.930108 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fjcc9" Jun 02 16:41:16.930509 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.930493 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 16:41:16.930773 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.930756 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 16:41:16.930773 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.930769 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 16:41:16.930972 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.930818 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 16:41:16.931214 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.931196 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7kjf4\"" Jun 02 16:41:16.931214 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.931210 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 16:41:16.931460 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.931441 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" Jun 02 16:41:16.932119 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.932099 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 16:41:16.932311 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.932295 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-49tn4\"" Jun 02 16:41:16.932775 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.932756 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:16.932880 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.932866 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 16:41:16.933342 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.933328 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 16:41:16.933427 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.933341 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 16:41:16.933691 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.933677 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4s276\"" Jun 02 16:41:16.934036 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.934018 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hhv9c" Jun 02 16:41:16.934488 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.934469 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 16:41:16.934597 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.934583 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 16:41:16.934705 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.934691 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wxgbl\"" Jun 02 16:41:16.935258 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.935243 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:16.938447 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:16.935772 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5p7z4" podUID="ab630523-7064-4dc5-a730-7b6b06551777" Jun 02 16:41:16.938447 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.935788 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 16:41:16.938447 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.935791 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 16:41:16.938447 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.935933 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xwzzd\"" Jun 02 16:41:16.938447 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.936294 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 16:41:16.938447 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.936642 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 16:41:16.938777 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.938529 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:16.938777 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:16.938595 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgkxp" podUID="4505a0c0-1c04-42cd-b0ab-cc964485cef7" Jun 02 16:41:16.940042 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.939998 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dbpdg" Jun 02 16:41:16.941847 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.941827 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 16:41:16.941847 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.941843 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 16:41:16.941984 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.941890 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 16:41:16.942076 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.941997 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q44vt\"" Jun 02 16:41:16.943414 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.943398 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-host-run-netns\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:16.943486 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.943421 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl9ql\" (UniqueName: \"kubernetes.io/projected/c231d988-ab86-41d3-be47-375ab32a84c2-kube-api-access-sl9ql\") pod \"node-ca-hhv9c\" (UID: \"c231d988-ab86-41d3-be47-375ab32a84c2\") " pod="openshift-image-registry/node-ca-hhv9c" Jun 02 16:41:16.943486 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.943439 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e662b53-0cfd-4ec3-94ee-554c1450e245-tmp-dir\") pod \"node-resolver-xzbtx\" (UID: \"7e662b53-0cfd-4ec3-94ee-554c1450e245\") " pod="openshift-dns/node-resolver-xzbtx" Jun 02 16:41:16.943486 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.943454 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed-cni-binary-copy\") pod \"multus-additional-cni-plugins-fhcjt\" (UID: \"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed\") " pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:16.943486 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.943476 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-sys\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:16.943618 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.943539 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j8z2\" (UniqueName: \"kubernetes.io/projected/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-kube-api-access-9j8z2\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:16.943618 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.943578 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-host-run-netns\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:16.943618 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.943609 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9275b379-3d40-4353-82a5-d43ef7341575-socket-dir\") pod \"aws-ebs-csi-driver-node-lwmx4\" (UID: \"9275b379-3d40-4353-82a5-d43ef7341575\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" Jun 02 16:41:16.943700 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.943636 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-systemd-units\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:16.943700 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.943662 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-host-cni-bin\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:16.943769 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.943721 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9902c57-5190-456a-83a9-948e46bec4a0-env-overrides\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:16.943769 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.943758 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c231d988-ab86-41d3-be47-375ab32a84c2-host\") pod \"node-ca-hhv9c\" (UID: \"c231d988-ab86-41d3-be47-375ab32a84c2\") " pod="openshift-image-registry/node-ca-hhv9c" Jun 02 16:41:16.943854 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.943784 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7e662b53-0cfd-4ec3-94ee-554c1450e245-hosts-file\") pod \"node-resolver-xzbtx\" (UID: \"7e662b53-0cfd-4ec3-94ee-554c1450e245\") " pod="openshift-dns/node-resolver-xzbtx" Jun 02 16:41:16.943854 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.943814 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fhcjt\" (UID: \"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed\") " pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:16.943854 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.943840 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-host\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:16.944144 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.943867 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-etc-tuned\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:16.944144 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.943891 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-host-var-lib-cni-bin\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:16.944144 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.943916 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-host-var-lib-kubelet\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:16.944144 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.943941 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-multus-conf-dir\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:16.944144 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.943984 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-etc-openvswitch\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:16.944144 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944049 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-os-release\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:16.944144 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944076 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-host-var-lib-cni-multus\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:16.944144 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944103 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jln2\" (UniqueName: \"kubernetes.io/projected/a1c0d918-3ad4-446a-94dc-a29ff79b8476-kube-api-access-2jln2\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:16.944144 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944126 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-log-socket\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:16.944523 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944150 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:16.944523 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944174 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-etc-modprobe-d\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:16.944523 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944199 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-etc-sysconfig\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:16.944523 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944223 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/64a330d1-ae24-4e85-88b8-f595933f5d4a-agent-certs\") pod \"konnectivity-agent-7fvwq\" (UID: \"64a330d1-ae24-4e85-88b8-f595933f5d4a\") " pod="kube-system/konnectivity-agent-7fvwq" Jun 02 16:41:16.944523 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944260 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9275b379-3d40-4353-82a5-d43ef7341575-device-dir\") pod \"aws-ebs-csi-driver-node-lwmx4\" (UID: \"9275b379-3d40-4353-82a5-d43ef7341575\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" Jun 02 16:41:16.944523 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944290 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9275b379-3d40-4353-82a5-d43ef7341575-etc-selinux\") pod \"aws-ebs-csi-driver-node-lwmx4\" (UID: \"9275b379-3d40-4353-82a5-d43ef7341575\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" Jun 02 16:41:16.944523 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944317 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqtpf\" (UniqueName: \"kubernetes.io/projected/a9902c57-5190-456a-83a9-948e46bec4a0-kube-api-access-xqtpf\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:16.944523 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944336 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hk5s\" (UniqueName: \"kubernetes.io/projected/7e662b53-0cfd-4ec3-94ee-554c1450e245-kube-api-access-7hk5s\") pod \"node-resolver-xzbtx\" (UID: \"7e662b53-0cfd-4ec3-94ee-554c1450e245\") " pod="openshift-dns/node-resolver-xzbtx" Jun 02 16:41:16.944523 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944378 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-tmp\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:16.944523 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944414 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-host-run-multus-certs\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:16.944523 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944443 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9902c57-5190-456a-83a9-948e46bec4a0-ovnkube-script-lib\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:16.944523 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944488 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fhcjt\" (UID: \"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed\") " pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:16.945023 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944549 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-etc-kubernetes\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:16.945023 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944569 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-run-ovn\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:16.945023 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944594 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-node-log\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:16.945023 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944647 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-host-slash\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:16.945023 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944676 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed-os-release\") pod \"multus-additional-cni-plugins-fhcjt\" (UID: \"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed\") " pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:16.945023 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944700 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-run\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:16.945023 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944724 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a1c0d918-3ad4-446a-94dc-a29ff79b8476-multus-daemon-config\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:16.945023 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944746 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-lib-modules\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:16.945023 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944765 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c231d988-ab86-41d3-be47-375ab32a84c2-serviceca\") pod \"node-ca-hhv9c\" (UID: \"c231d988-ab86-41d3-be47-375ab32a84c2\") " pod="openshift-image-registry/node-ca-hhv9c" Jun 02 16:41:16.945023 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944782 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9275b379-3d40-4353-82a5-d43ef7341575-registration-dir\") pod \"aws-ebs-csi-driver-node-lwmx4\" (UID: \"9275b379-3d40-4353-82a5-d43ef7341575\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" Jun 02 16:41:16.945023 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944797 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4dxd\" (UniqueName: \"kubernetes.io/projected/ab630523-7064-4dc5-a730-7b6b06551777-kube-api-access-p4dxd\") pod \"network-metrics-daemon-5p7z4\" (UID: \"ab630523-7064-4dc5-a730-7b6b06551777\") " pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:16.945023 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944811 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9275b379-3d40-4353-82a5-d43ef7341575-sys-fs\") pod \"aws-ebs-csi-driver-node-lwmx4\" (UID: \"9275b379-3d40-4353-82a5-d43ef7341575\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" Jun 02 16:41:16.945023 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944825 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-host-run-ovn-kubernetes\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:16.945023 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944839 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9902c57-5190-456a-83a9-948e46bec4a0-ovnkube-config\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:16.945023 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944860 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed-system-cni-dir\") pod \"multus-additional-cni-plugins-fhcjt\" (UID: \"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed\") " pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:16.945023 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944875 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-etc-sysctl-conf\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:16.945488 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944889 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-system-cni-dir\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:16.945488 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944902 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-multus-cni-dir\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:16.945488 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944928 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-var-lib-openvswitch\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:16.945488 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944954 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-host-cni-netd\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:16.945488 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.944984 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-etc-kubernetes\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:16.945488 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.945023 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-multus-socket-dir-parent\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:16.945488 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.945047 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-hostroot\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:16.945488 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.945074 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9275b379-3d40-4353-82a5-d43ef7341575-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lwmx4\" (UID: \"9275b379-3d40-4353-82a5-d43ef7341575\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" Jun 02 16:41:16.945488 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.945092 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed-cnibin\") pod \"multus-additional-cni-plugins-fhcjt\" (UID: \"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed\") " pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:16.945488 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.945115 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxhds\" (UniqueName: \"kubernetes.io/projected/6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed-kube-api-access-fxhds\") pod \"multus-additional-cni-plugins-fhcjt\" (UID: \"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed\") " pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:16.945488 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.945143 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-var-lib-kubelet\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:16.945488 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.945165 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1c0d918-3ad4-446a-94dc-a29ff79b8476-cni-binary-copy\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:16.945488 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.945182 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfqfh\" (UniqueName: \"kubernetes.io/projected/4505a0c0-1c04-42cd-b0ab-cc964485cef7-kube-api-access-gfqfh\") pod \"network-check-target-vgkxp\" (UID: \"4505a0c0-1c04-42cd-b0ab-cc964485cef7\") " pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:16.945488 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.945208 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-run-openvswitch\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:16.945488 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.945228 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-run-systemd\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:16.945488 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.945241 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9902c57-5190-456a-83a9-948e46bec4a0-ovn-node-metrics-cert\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:16.945974 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.945267 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fhcjt\" (UID: \"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed\") " pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:16.945974 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.945289 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-etc-systemd\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:16.945974 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.945304 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs\") pod \"network-metrics-daemon-5p7z4\" (UID: \"ab630523-7064-4dc5-a730-7b6b06551777\") " pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:16.945974 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.945320 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/64a330d1-ae24-4e85-88b8-f595933f5d4a-konnectivity-ca\") pod \"konnectivity-agent-7fvwq\" (UID: \"64a330d1-ae24-4e85-88b8-f595933f5d4a\") " pod="kube-system/konnectivity-agent-7fvwq" Jun 02 16:41:16.945974 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.945334 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-cnibin\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:16.945974 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.945356 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-host-kubelet\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:16.945974 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.945370 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-etc-sysctl-d\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:16.945974 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.945384 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-host-run-k8s-cni-cncf-io\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:16.945974 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.945399 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcfjx\" (UniqueName: \"kubernetes.io/projected/9275b379-3d40-4353-82a5-d43ef7341575-kube-api-access-lcfjx\") pod \"aws-ebs-csi-driver-node-lwmx4\" (UID: \"9275b379-3d40-4353-82a5-d43ef7341575\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" Jun 02 16:41:16.951689 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.951671 2565 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 16:41:16.975943 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.975914 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lzpvs" Jun 02 16:41:16.977530 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.977490 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 16:36:15 +0000 UTC" deadline="2028-01-14 16:50:03.764732059 +0000 UTC" Jun 02 16:41:16.977589 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.977531 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14184h8m46.787204881s" Jun 02 16:41:16.983624 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:16.983605 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lzpvs" Jun 02 16:41:16.994996 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:16.994947 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a3eebd2da0da535847e15e1fd405896.slice/crio-96f48a04d279406770066b4d506412e578e74e176ba07fd27703e54c35635a74 WatchSource:0}: Error finding container 96f48a04d279406770066b4d506412e578e74e176ba07fd27703e54c35635a74: Status 404 returned error can't find the container with id 96f48a04d279406770066b4d506412e578e74e176ba07fd27703e54c35635a74 Jun 02 16:41:17.000682 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.000664 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 16:41:17.038128 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.038103 2565 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 16:41:17.044166 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.044114 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" event={"ID":"4a3eebd2da0da535847e15e1fd405896","Type":"ContainerStarted","Data":"96f48a04d279406770066b4d506412e578e74e176ba07fd27703e54c35635a74"} Jun 02 16:41:17.046383 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.046362 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hk5s\" (UniqueName: \"kubernetes.io/projected/7e662b53-0cfd-4ec3-94ee-554c1450e245-kube-api-access-7hk5s\") pod \"node-resolver-xzbtx\" (UID: \"7e662b53-0cfd-4ec3-94ee-554c1450e245\") " pod="openshift-dns/node-resolver-xzbtx" Jun 02 16:41:17.046443 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.046391 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-tmp\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.046443 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.046429 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-host-run-multus-certs\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.046519 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.046453 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9902c57-5190-456a-83a9-948e46bec4a0-ovnkube-script-lib\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.046519 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.046476 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fhcjt\" (UID: \"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed\") " pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:17.046519 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.046498 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-etc-kubernetes\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.046653 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.046519 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-run-ovn\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.046653 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.046541 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-node-log\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.046653 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.046597 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-host-run-multus-certs\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.046994 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.046864 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-host-slash\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.048668 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.046991 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 16:41:17.048668 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.047064 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-run-ovn\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.048668 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.047120 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-node-log\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.048668 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.047151 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-etc-kubernetes\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.048668 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.046580 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-host-slash\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.048668 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.047336 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed-os-release\") pod \"multus-additional-cni-plugins-fhcjt\" (UID: \"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed\") " pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:17.048668 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.047389 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-run\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.048668 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.047409 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a1c0d918-3ad4-446a-94dc-a29ff79b8476-multus-daemon-config\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.048668 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.047430 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-lib-modules\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.048668 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.047509 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c231d988-ab86-41d3-be47-375ab32a84c2-serviceca\") pod \"node-ca-hhv9c\" (UID: \"c231d988-ab86-41d3-be47-375ab32a84c2\") " pod="openshift-image-registry/node-ca-hhv9c" Jun 02 16:41:17.048668 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.047536 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-lib-modules\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.048668 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.047549 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9275b379-3d40-4353-82a5-d43ef7341575-registration-dir\") pod \"aws-ebs-csi-driver-node-lwmx4\" (UID: \"9275b379-3d40-4353-82a5-d43ef7341575\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" Jun 02 16:41:17.048668 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.047586 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p4dxd\" (UniqueName: \"kubernetes.io/projected/ab630523-7064-4dc5-a730-7b6b06551777-kube-api-access-p4dxd\") pod \"network-metrics-daemon-5p7z4\" (UID: \"ab630523-7064-4dc5-a730-7b6b06551777\") " pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:17.048668 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.047617 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9275b379-3d40-4353-82a5-d43ef7341575-sys-fs\") pod \"aws-ebs-csi-driver-node-lwmx4\" (UID: \"9275b379-3d40-4353-82a5-d43ef7341575\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" Jun 02 16:41:17.048668 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.047611 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed-os-release\") pod \"multus-additional-cni-plugins-fhcjt\" (UID: \"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed\") " pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:17.048668 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.047651 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-host-run-ovn-kubernetes\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.048668 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.047686 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9902c57-5190-456a-83a9-948e46bec4a0-ovnkube-config\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.048668 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.047717 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed-system-cni-dir\") pod \"multus-additional-cni-plugins-fhcjt\" (UID: \"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed\") " pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:17.049378 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.047748 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-etc-sysctl-conf\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.049378 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.047777 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-system-cni-dir\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.049378 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.047805 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-multus-cni-dir\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.049378 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.047813 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9275b379-3d40-4353-82a5-d43ef7341575-sys-fs\") pod \"aws-ebs-csi-driver-node-lwmx4\" (UID: \"9275b379-3d40-4353-82a5-d43ef7341575\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" Jun 02 16:41:17.049378 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.047835 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-var-lib-openvswitch\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.049378 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.047866 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-host-cni-netd\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.049378 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.047923 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-host-cni-netd\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.049378 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.047985 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-host-run-ovn-kubernetes\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.049378 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048056 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-run\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.049378 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048170 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fhcjt\" (UID: \"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed\") " pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:17.049378 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048207 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a1c0d918-3ad4-446a-94dc-a29ff79b8476-multus-daemon-config\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.049378 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048212 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9902c57-5190-456a-83a9-948e46bec4a0-ovnkube-script-lib\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.049378 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048324 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-multus-cni-dir\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.049378 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048324 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c231d988-ab86-41d3-be47-375ab32a84c2-serviceca\") pod \"node-ca-hhv9c\" (UID: \"c231d988-ab86-41d3-be47-375ab32a84c2\") " pod="openshift-image-registry/node-ca-hhv9c" Jun 02 16:41:17.049378 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048354 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-etc-kubernetes\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.049378 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048383 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-system-cni-dir\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.049378 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048397 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-multus-socket-dir-parent\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.049378 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048407 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-etc-sysctl-conf\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.050121 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048426 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed-system-cni-dir\") pod \"multus-additional-cni-plugins-fhcjt\" (UID: \"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed\") " pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:17.050121 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048431 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-hostroot\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.050121 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048466 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-etc-kubernetes\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.050121 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048477 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9275b379-3d40-4353-82a5-d43ef7341575-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lwmx4\" (UID: \"9275b379-3d40-4353-82a5-d43ef7341575\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" Jun 02 16:41:17.050121 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048516 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9275b379-3d40-4353-82a5-d43ef7341575-registration-dir\") pod \"aws-ebs-csi-driver-node-lwmx4\" (UID: \"9275b379-3d40-4353-82a5-d43ef7341575\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" Jun 02 16:41:17.050121 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048523 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed-cnibin\") pod \"multus-additional-cni-plugins-fhcjt\" (UID: \"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed\") " pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:17.050121 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048544 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-multus-socket-dir-parent\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.050121 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048551 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9902c57-5190-456a-83a9-948e46bec4a0-ovnkube-config\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.050121 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048480 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-hostroot\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.050121 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048564 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed-cnibin\") pod \"multus-additional-cni-plugins-fhcjt\" (UID: \"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed\") " pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:17.050121 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048556 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxhds\" (UniqueName: \"kubernetes.io/projected/6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed-kube-api-access-fxhds\") pod \"multus-additional-cni-plugins-fhcjt\" (UID: \"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed\") " pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:17.050121 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048590 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9275b379-3d40-4353-82a5-d43ef7341575-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lwmx4\" (UID: \"9275b379-3d40-4353-82a5-d43ef7341575\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" Jun 02 16:41:17.050121 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048604 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-var-lib-openvswitch\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.050121 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048620 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-var-lib-kubelet\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.050121 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048655 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1c0d918-3ad4-446a-94dc-a29ff79b8476-cni-binary-copy\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.050121 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048679 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gfqfh\" (UniqueName: \"kubernetes.io/projected/4505a0c0-1c04-42cd-b0ab-cc964485cef7-kube-api-access-gfqfh\") pod \"network-check-target-vgkxp\" (UID: \"4505a0c0-1c04-42cd-b0ab-cc964485cef7\") " pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:17.050121 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048712 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cabae08f-9b7a-44e4-adc6-1544f0f861bd-iptables-alerter-script\") pod \"iptables-alerter-dbpdg\" (UID: \"cabae08f-9b7a-44e4-adc6-1544f0f861bd\") " pod="openshift-network-operator/iptables-alerter-dbpdg" Jun 02 16:41:17.050675 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048741 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cabae08f-9b7a-44e4-adc6-1544f0f861bd-host-slash\") pod \"iptables-alerter-dbpdg\" (UID: \"cabae08f-9b7a-44e4-adc6-1544f0f861bd\") " pod="openshift-network-operator/iptables-alerter-dbpdg" Jun 02 16:41:17.050675 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048768 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-var-lib-kubelet\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.050675 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048873 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-run-openvswitch\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.050675 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048916 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-run-systemd\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.050675 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048945 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9902c57-5190-456a-83a9-948e46bec4a0-ovn-node-metrics-cert\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.050675 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048976 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fhcjt\" (UID: \"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed\") " pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:17.050675 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.048999 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-etc-systemd\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.050675 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.049050 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs\") pod \"network-metrics-daemon-5p7z4\" (UID: \"ab630523-7064-4dc5-a730-7b6b06551777\") " pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:17.050675 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.049080 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/64a330d1-ae24-4e85-88b8-f595933f5d4a-konnectivity-ca\") pod \"konnectivity-agent-7fvwq\" (UID: \"64a330d1-ae24-4e85-88b8-f595933f5d4a\") " pod="kube-system/konnectivity-agent-7fvwq" Jun 02 16:41:17.050675 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.049109 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-cnibin\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.050675 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.049137 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-host-kubelet\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.050675 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.049190 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-etc-sysctl-d\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.050675 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.049227 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-host-run-k8s-cni-cncf-io\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.050675 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.049253 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lcfjx\" (UniqueName: \"kubernetes.io/projected/9275b379-3d40-4353-82a5-d43ef7341575-kube-api-access-lcfjx\") pod \"aws-ebs-csi-driver-node-lwmx4\" (UID: \"9275b379-3d40-4353-82a5-d43ef7341575\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" Jun 02 16:41:17.050675 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.049262 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1c0d918-3ad4-446a-94dc-a29ff79b8476-cni-binary-copy\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.050675 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.049303 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-host-run-netns\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.050675 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.049344 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sl9ql\" (UniqueName: \"kubernetes.io/projected/c231d988-ab86-41d3-be47-375ab32a84c2-kube-api-access-sl9ql\") pod \"node-ca-hhv9c\" (UID: \"c231d988-ab86-41d3-be47-375ab32a84c2\") " pod="openshift-image-registry/node-ca-hhv9c" Jun 02 16:41:17.051325 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.049373 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e662b53-0cfd-4ec3-94ee-554c1450e245-tmp-dir\") pod \"node-resolver-xzbtx\" (UID: \"7e662b53-0cfd-4ec3-94ee-554c1450e245\") " pod="openshift-dns/node-resolver-xzbtx" Jun 02 16:41:17.051325 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.049401 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed-cni-binary-copy\") pod \"multus-additional-cni-plugins-fhcjt\" (UID: \"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed\") " pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:17.051325 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.049423 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-sys\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.051325 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.049451 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9j8z2\" (UniqueName: \"kubernetes.io/projected/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-kube-api-access-9j8z2\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.051325 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.049477 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-host-run-netns\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.051325 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.049775 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fhcjt\" (UID: \"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed\") " pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:17.051325 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.049909 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9275b379-3d40-4353-82a5-d43ef7341575-socket-dir\") pod \"aws-ebs-csi-driver-node-lwmx4\" (UID: \"9275b379-3d40-4353-82a5-d43ef7341575\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" Jun 02 16:41:17.051325 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:17.050024 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:17.051325 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.050359 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-host-run-netns\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.051325 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.050584 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-host-run-netns\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.051325 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.050636 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-etc-systemd\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.051325 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.050728 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-host-run-k8s-cni-cncf-io\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.051325 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.050814 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/64a330d1-ae24-4e85-88b8-f595933f5d4a-konnectivity-ca\") pod \"konnectivity-agent-7fvwq\" (UID: \"64a330d1-ae24-4e85-88b8-f595933f5d4a\") " pod="kube-system/konnectivity-agent-7fvwq" Jun 02 16:41:17.051325 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.050858 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-etc-sysctl-d\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.051325 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.050921 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e662b53-0cfd-4ec3-94ee-554c1450e245-tmp-dir\") pod \"node-resolver-xzbtx\" (UID: \"7e662b53-0cfd-4ec3-94ee-554c1450e245\") " pod="openshift-dns/node-resolver-xzbtx" Jun 02 16:41:17.051325 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.050998 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-systemd-units\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.051325 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.051054 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-host-cni-bin\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.051325 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.051083 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9902c57-5190-456a-83a9-948e46bec4a0-env-overrides\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.052640 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.051096 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-run-openvswitch\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.052640 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.051116 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c231d988-ab86-41d3-be47-375ab32a84c2-host\") pod \"node-ca-hhv9c\" (UID: \"c231d988-ab86-41d3-be47-375ab32a84c2\") " pod="openshift-image-registry/node-ca-hhv9c" Jun 02 16:41:17.052640 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.051156 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-sys\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.052640 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.051211 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7e662b53-0cfd-4ec3-94ee-554c1450e245-hosts-file\") pod \"node-resolver-xzbtx\" (UID: \"7e662b53-0cfd-4ec3-94ee-554c1450e245\") " pod="openshift-dns/node-resolver-xzbtx" Jun 02 16:41:17.052640 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.051244 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fhcjt\" (UID: \"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed\") " pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:17.052640 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.051269 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-host-kubelet\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.052640 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.051276 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-host\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.052640 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.051305 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed-cni-binary-copy\") pod \"multus-additional-cni-plugins-fhcjt\" (UID: \"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed\") " pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:17.052640 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.051307 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-etc-tuned\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.052640 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.051331 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c231d988-ab86-41d3-be47-375ab32a84c2-host\") pod \"node-ca-hhv9c\" (UID: \"c231d988-ab86-41d3-be47-375ab32a84c2\") " pod="openshift-image-registry/node-ca-hhv9c" Jun 02 16:41:17.052640 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.051414 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9275b379-3d40-4353-82a5-d43ef7341575-socket-dir\") pod \"aws-ebs-csi-driver-node-lwmx4\" (UID: \"9275b379-3d40-4353-82a5-d43ef7341575\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" Jun 02 16:41:17.052640 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.051466 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-cnibin\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.052640 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:17.051571 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs podName:ab630523-7064-4dc5-a730-7b6b06551777 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:17.551530074 +0000 UTC m=+2.007614327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs") pod "network-metrics-daemon-5p7z4" (UID: "ab630523-7064-4dc5-a730-7b6b06551777") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:17.052640 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.051742 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9902c57-5190-456a-83a9-948e46bec4a0-env-overrides\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.052640 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.051826 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7e662b53-0cfd-4ec3-94ee-554c1450e245-hosts-file\") pod \"node-resolver-xzbtx\" (UID: \"7e662b53-0cfd-4ec3-94ee-554c1450e245\") " pod="openshift-dns/node-resolver-xzbtx" Jun 02 16:41:17.052640 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.051871 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-run-systemd\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.052640 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.052039 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-systemd-units\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.053947 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.052084 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-host-cni-bin\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.053947 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.052142 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-host\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.053947 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.052345 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-host-var-lib-cni-bin\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.053947 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.052379 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-host-var-lib-kubelet\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.053947 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.052406 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fhcjt\" (UID: \"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed\") " pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:17.053947 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.052443 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-host-var-lib-cni-bin\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.053947 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.052487 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-multus-conf-dir\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.053947 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.052527 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-etc-openvswitch\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.053947 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.052540 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-host-var-lib-kubelet\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.053947 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.052559 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-os-release\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.053947 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.052584 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-multus-conf-dir\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.053947 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.052587 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-host-var-lib-cni-multus\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.053947 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.052624 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-host-var-lib-cni-multus\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.053947 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.052635 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2jln2\" (UniqueName: \"kubernetes.io/projected/a1c0d918-3ad4-446a-94dc-a29ff79b8476-kube-api-access-2jln2\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.053947 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.052669 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4zwm\" (UniqueName: \"kubernetes.io/projected/cabae08f-9b7a-44e4-adc6-1544f0f861bd-kube-api-access-w4zwm\") pod \"iptables-alerter-dbpdg\" (UID: \"cabae08f-9b7a-44e4-adc6-1544f0f861bd\") " pod="openshift-network-operator/iptables-alerter-dbpdg" Jun 02 16:41:17.053947 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.052699 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1c0d918-3ad4-446a-94dc-a29ff79b8476-os-release\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.053947 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.052700 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-log-socket\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.053947 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.052773 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-etc-openvswitch\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.054878 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.052809 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.054878 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.052868 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-log-socket\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.054878 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.052925 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-etc-modprobe-d\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.054878 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.052954 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-etc-sysconfig\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.054878 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.052988 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/64a330d1-ae24-4e85-88b8-f595933f5d4a-agent-certs\") pod \"konnectivity-agent-7fvwq\" (UID: \"64a330d1-ae24-4e85-88b8-f595933f5d4a\") " pod="kube-system/konnectivity-agent-7fvwq" Jun 02 16:41:17.054878 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.053121 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-etc-modprobe-d\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.054878 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.053161 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9902c57-5190-456a-83a9-948e46bec4a0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.054878 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.053215 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9275b379-3d40-4353-82a5-d43ef7341575-device-dir\") pod \"aws-ebs-csi-driver-node-lwmx4\" (UID: \"9275b379-3d40-4353-82a5-d43ef7341575\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" Jun 02 16:41:17.054878 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.053865 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9275b379-3d40-4353-82a5-d43ef7341575-device-dir\") pod \"aws-ebs-csi-driver-node-lwmx4\" (UID: \"9275b379-3d40-4353-82a5-d43ef7341575\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" Jun 02 16:41:17.054878 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.053869 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-etc-sysconfig\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.054878 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.054254 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9275b379-3d40-4353-82a5-d43ef7341575-etc-selinux\") pod \"aws-ebs-csi-driver-node-lwmx4\" (UID: \"9275b379-3d40-4353-82a5-d43ef7341575\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" Jun 02 16:41:17.054878 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.054301 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xqtpf\" (UniqueName: \"kubernetes.io/projected/a9902c57-5190-456a-83a9-948e46bec4a0-kube-api-access-xqtpf\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.054878 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.054278 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9275b379-3d40-4353-82a5-d43ef7341575-etc-selinux\") pod \"aws-ebs-csi-driver-node-lwmx4\" (UID: \"9275b379-3d40-4353-82a5-d43ef7341575\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" Jun 02 16:41:17.055449 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.055191 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-etc-tuned\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.055449 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.055307 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9902c57-5190-456a-83a9-948e46bec4a0-ovn-node-metrics-cert\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.055449 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.055339 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-tmp\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.055696 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.055677 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/64a330d1-ae24-4e85-88b8-f595933f5d4a-agent-certs\") pod \"konnectivity-agent-7fvwq\" (UID: \"64a330d1-ae24-4e85-88b8-f595933f5d4a\") " pod="kube-system/konnectivity-agent-7fvwq" Jun 02 16:41:17.057174 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:17.057140 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:41:17.057174 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:17.057160 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:41:17.057174 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:17.057174 2565 projected.go:194] Error preparing data for projected volume kube-api-access-gfqfh for pod openshift-network-diagnostics/network-check-target-vgkxp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:17.057369 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:17.057232 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4505a0c0-1c04-42cd-b0ab-cc964485cef7-kube-api-access-gfqfh podName:4505a0c0-1c04-42cd-b0ab-cc964485cef7 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:17.557215613 +0000 UTC m=+2.013299847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gfqfh" (UniqueName: "kubernetes.io/projected/4505a0c0-1c04-42cd-b0ab-cc964485cef7-kube-api-access-gfqfh") pod "network-check-target-vgkxp" (UID: "4505a0c0-1c04-42cd-b0ab-cc964485cef7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:17.057610 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.057592 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4dxd\" (UniqueName: \"kubernetes.io/projected/ab630523-7064-4dc5-a730-7b6b06551777-kube-api-access-p4dxd\") pod \"network-metrics-daemon-5p7z4\" (UID: \"ab630523-7064-4dc5-a730-7b6b06551777\") " pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:17.059546 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.059525 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hk5s\" (UniqueName: \"kubernetes.io/projected/7e662b53-0cfd-4ec3-94ee-554c1450e245-kube-api-access-7hk5s\") pod \"node-resolver-xzbtx\" (UID: \"7e662b53-0cfd-4ec3-94ee-554c1450e245\") " pod="openshift-dns/node-resolver-xzbtx" Jun 02 16:41:17.059707 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.059687 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxhds\" (UniqueName: \"kubernetes.io/projected/6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed-kube-api-access-fxhds\") pod \"multus-additional-cni-plugins-fhcjt\" (UID: \"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed\") " pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:17.060113 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.060091 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j8z2\" (UniqueName: \"kubernetes.io/projected/a710b0f9-d6e8-4ead-b28f-2e4c3fc18160-kube-api-access-9j8z2\") pod \"tuned-l7kpg\" (UID: \"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160\") " pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.060574 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.060550 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl9ql\" (UniqueName: \"kubernetes.io/projected/c231d988-ab86-41d3-be47-375ab32a84c2-kube-api-access-sl9ql\") pod \"node-ca-hhv9c\" (UID: \"c231d988-ab86-41d3-be47-375ab32a84c2\") " pod="openshift-image-registry/node-ca-hhv9c" Jun 02 16:41:17.061295 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.061276 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcfjx\" (UniqueName: \"kubernetes.io/projected/9275b379-3d40-4353-82a5-d43ef7341575-kube-api-access-lcfjx\") pod \"aws-ebs-csi-driver-node-lwmx4\" (UID: \"9275b379-3d40-4353-82a5-d43ef7341575\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" Jun 02 16:41:17.062100 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:17.062080 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda95576eca65fd8a1e75b2eee015468be.slice/crio-0dbca72589947a5d0944f0b3df4d11c50e6813a616b50d8a79116b7fdbc3afed WatchSource:0}: Error finding container 0dbca72589947a5d0944f0b3df4d11c50e6813a616b50d8a79116b7fdbc3afed: Status 404 returned error can't find the container with id 0dbca72589947a5d0944f0b3df4d11c50e6813a616b50d8a79116b7fdbc3afed Jun 02 16:41:17.068270 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.068246 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jln2\" (UniqueName: \"kubernetes.io/projected/a1c0d918-3ad4-446a-94dc-a29ff79b8476-kube-api-access-2jln2\") pod \"multus-fjcc9\" (UID: \"a1c0d918-3ad4-446a-94dc-a29ff79b8476\") " pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.068425 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.068409 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqtpf\" (UniqueName: \"kubernetes.io/projected/a9902c57-5190-456a-83a9-948e46bec4a0-kube-api-access-xqtpf\") pod \"ovnkube-node-7sjt8\" (UID: \"a9902c57-5190-456a-83a9-948e46bec4a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.155566 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.155488 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cabae08f-9b7a-44e4-adc6-1544f0f861bd-iptables-alerter-script\") pod \"iptables-alerter-dbpdg\" (UID: \"cabae08f-9b7a-44e4-adc6-1544f0f861bd\") " pod="openshift-network-operator/iptables-alerter-dbpdg" Jun 02 16:41:17.155566 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.155528 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cabae08f-9b7a-44e4-adc6-1544f0f861bd-host-slash\") pod \"iptables-alerter-dbpdg\" (UID: \"cabae08f-9b7a-44e4-adc6-1544f0f861bd\") " pod="openshift-network-operator/iptables-alerter-dbpdg" Jun 02 16:41:17.155566 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.155561 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w4zwm\" (UniqueName: \"kubernetes.io/projected/cabae08f-9b7a-44e4-adc6-1544f0f861bd-kube-api-access-w4zwm\") pod \"iptables-alerter-dbpdg\" (UID: \"cabae08f-9b7a-44e4-adc6-1544f0f861bd\") " pod="openshift-network-operator/iptables-alerter-dbpdg" Jun 02 16:41:17.155782 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.155612 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cabae08f-9b7a-44e4-adc6-1544f0f861bd-host-slash\") pod \"iptables-alerter-dbpdg\" (UID: \"cabae08f-9b7a-44e4-adc6-1544f0f861bd\") " pod="openshift-network-operator/iptables-alerter-dbpdg" Jun 02 16:41:17.156005 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.155985 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cabae08f-9b7a-44e4-adc6-1544f0f861bd-iptables-alerter-script\") pod \"iptables-alerter-dbpdg\" (UID: \"cabae08f-9b7a-44e4-adc6-1544f0f861bd\") " pod="openshift-network-operator/iptables-alerter-dbpdg" Jun 02 16:41:17.166486 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.166460 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4zwm\" (UniqueName: \"kubernetes.io/projected/cabae08f-9b7a-44e4-adc6-1544f0f861bd-kube-api-access-w4zwm\") pod \"iptables-alerter-dbpdg\" (UID: \"cabae08f-9b7a-44e4-adc6-1544f0f861bd\") " pod="openshift-network-operator/iptables-alerter-dbpdg" Jun 02 16:41:17.258633 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.258601 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:17.265310 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:17.265277 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9902c57_5190_456a_83a9_948e46bec4a0.slice/crio-5d44f07ed772810ef52dbf7a085dd6312d35af5d778430b2e40e1a7899ab95ff WatchSource:0}: Error finding container 5d44f07ed772810ef52dbf7a085dd6312d35af5d778430b2e40e1a7899ab95ff: Status 404 returned error can't find the container with id 5d44f07ed772810ef52dbf7a085dd6312d35af5d778430b2e40e1a7899ab95ff Jun 02 16:41:17.274108 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.274089 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7fvwq" Jun 02 16:41:17.280396 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:17.280374 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a330d1_ae24_4e85_88b8_f595933f5d4a.slice/crio-3bd982a1cdcb6b6aa9b2dd6d34ee8a0e2c7c32566795c3a30e162e2742fe59a2 WatchSource:0}: Error finding container 3bd982a1cdcb6b6aa9b2dd6d34ee8a0e2c7c32566795c3a30e162e2742fe59a2: Status 404 returned error can't find the container with id 3bd982a1cdcb6b6aa9b2dd6d34ee8a0e2c7c32566795c3a30e162e2742fe59a2 Jun 02 16:41:17.300575 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.300543 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xzbtx" Jun 02 16:41:17.305139 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.305119 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fhcjt" Jun 02 16:41:17.306555 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:17.306530 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e662b53_0cfd_4ec3_94ee_554c1450e245.slice/crio-c925a2102cff6ce68c53673a76695de7b356e8073c7747b78b864d974540dd0a WatchSource:0}: Error finding container c925a2102cff6ce68c53673a76695de7b356e8073c7747b78b864d974540dd0a: Status 404 returned error can't find the container with id c925a2102cff6ce68c53673a76695de7b356e8073c7747b78b864d974540dd0a Jun 02 16:41:17.310566 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.310548 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fjcc9" Jun 02 16:41:17.311130 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:17.311111 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d5ee87e_2516_4e3c_9136_b1ea06f0c5ed.slice/crio-f6d670afc7e511fc639a19dc2bfd44ffa878ce46fd2a1fa972369243cf47764c WatchSource:0}: Error finding container f6d670afc7e511fc639a19dc2bfd44ffa878ce46fd2a1fa972369243cf47764c: Status 404 returned error can't find the container with id f6d670afc7e511fc639a19dc2bfd44ffa878ce46fd2a1fa972369243cf47764c Jun 02 16:41:17.315275 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.315255 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" Jun 02 16:41:17.317732 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:17.317665 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1c0d918_3ad4_446a_94dc_a29ff79b8476.slice/crio-43e93de5c318df6acbc5169ca7e14bedf9c8956cd3acc8461077278b2f03594c WatchSource:0}: Error finding container 43e93de5c318df6acbc5169ca7e14bedf9c8956cd3acc8461077278b2f03594c: Status 404 returned error can't find the container with id 43e93de5c318df6acbc5169ca7e14bedf9c8956cd3acc8461077278b2f03594c Jun 02 16:41:17.320715 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.320662 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" Jun 02 16:41:17.323099 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:17.323073 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9275b379_3d40_4353_82a5_d43ef7341575.slice/crio-8cc7e04636d178f06702e913411d3ee51783ba54a6ea3324e98c86b4cbb86dd8 WatchSource:0}: Error finding container 8cc7e04636d178f06702e913411d3ee51783ba54a6ea3324e98c86b4cbb86dd8: Status 404 returned error can't find the container with id 8cc7e04636d178f06702e913411d3ee51783ba54a6ea3324e98c86b4cbb86dd8 Jun 02 16:41:17.326725 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.326705 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hhv9c" Jun 02 16:41:17.328463 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:17.328442 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda710b0f9_d6e8_4ead_b28f_2e4c3fc18160.slice/crio-1033d732da385c4563d5e956e3e10c76d219418005860556213486e01c065459 WatchSource:0}: Error finding container 1033d732da385c4563d5e956e3e10c76d219418005860556213486e01c065459: Status 404 returned error can't find the container with id 1033d732da385c4563d5e956e3e10c76d219418005860556213486e01c065459 Jun 02 16:41:17.332111 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.332088 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dbpdg" Jun 02 16:41:17.334935 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:17.334915 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc231d988_ab86_41d3_be47_375ab32a84c2.slice/crio-5d405ab50922dae972c785f0e04abd9071c84acbc35269eb63681cd75835a26b WatchSource:0}: Error finding container 5d405ab50922dae972c785f0e04abd9071c84acbc35269eb63681cd75835a26b: Status 404 returned error can't find the container with id 5d405ab50922dae972c785f0e04abd9071c84acbc35269eb63681cd75835a26b Jun 02 16:41:17.339474 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:17.339453 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcabae08f_9b7a_44e4_adc6_1544f0f861bd.slice/crio-9e20aee22385d60e2a871be9f49bfe083b157299a9de9a53a55b9750da9646ef WatchSource:0}: Error finding container 9e20aee22385d60e2a871be9f49bfe083b157299a9de9a53a55b9750da9646ef: Status 404 returned error can't find the container with id 9e20aee22385d60e2a871be9f49bfe083b157299a9de9a53a55b9750da9646ef Jun 02 16:41:17.409137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.409062 2565 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:41:17.559503 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.559465 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gfqfh\" (UniqueName: \"kubernetes.io/projected/4505a0c0-1c04-42cd-b0ab-cc964485cef7-kube-api-access-gfqfh\") pod \"network-check-target-vgkxp\" (UID: \"4505a0c0-1c04-42cd-b0ab-cc964485cef7\") " pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:17.559682 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.559513 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs\") pod \"network-metrics-daemon-5p7z4\" (UID: \"ab630523-7064-4dc5-a730-7b6b06551777\") " pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:17.559682 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:17.559644 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:17.559796 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:17.559700 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs podName:ab630523-7064-4dc5-a730-7b6b06551777 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:18.559683606 +0000 UTC m=+3.015767856 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs") pod "network-metrics-daemon-5p7z4" (UID: "ab630523-7064-4dc5-a730-7b6b06551777") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:17.560185 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:17.560163 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:41:17.560315 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:17.560191 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:41:17.560315 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:17.560203 2565 projected.go:194] Error preparing data for projected volume kube-api-access-gfqfh for pod openshift-network-diagnostics/network-check-target-vgkxp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:17.560315 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:17.560256 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4505a0c0-1c04-42cd-b0ab-cc964485cef7-kube-api-access-gfqfh podName:4505a0c0-1c04-42cd-b0ab-cc964485cef7 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:18.560240076 +0000 UTC m=+3.016324314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gfqfh" (UniqueName: "kubernetes.io/projected/4505a0c0-1c04-42cd-b0ab-cc964485cef7-kube-api-access-gfqfh") pod "network-check-target-vgkxp" (UID: "4505a0c0-1c04-42cd-b0ab-cc964485cef7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:17.575284 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.575257 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-fbqmz"] Jun 02 16:41:17.577237 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.577216 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:17.577339 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:17.577294 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbqmz" podUID="749a190a-f808-49fc-8cd2-81342e6da38b" Jun 02 16:41:17.660859 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.660781 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/749a190a-f808-49fc-8cd2-81342e6da38b-original-pull-secret\") pod \"global-pull-secret-syncer-fbqmz\" (UID: \"749a190a-f808-49fc-8cd2-81342e6da38b\") " pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:17.660859 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.660846 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/749a190a-f808-49fc-8cd2-81342e6da38b-dbus\") pod \"global-pull-secret-syncer-fbqmz\" (UID: \"749a190a-f808-49fc-8cd2-81342e6da38b\") " pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:17.661106 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.660898 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/749a190a-f808-49fc-8cd2-81342e6da38b-kubelet-config\") pod \"global-pull-secret-syncer-fbqmz\" (UID: \"749a190a-f808-49fc-8cd2-81342e6da38b\") " pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:17.762292 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.762251 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/749a190a-f808-49fc-8cd2-81342e6da38b-dbus\") pod \"global-pull-secret-syncer-fbqmz\" (UID: \"749a190a-f808-49fc-8cd2-81342e6da38b\") " pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:17.762565 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.762335 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/749a190a-f808-49fc-8cd2-81342e6da38b-kubelet-config\") pod \"global-pull-secret-syncer-fbqmz\" (UID: \"749a190a-f808-49fc-8cd2-81342e6da38b\") " pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:17.762565 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.762406 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/749a190a-f808-49fc-8cd2-81342e6da38b-original-pull-secret\") pod \"global-pull-secret-syncer-fbqmz\" (UID: \"749a190a-f808-49fc-8cd2-81342e6da38b\") " pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:17.762565 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:17.762531 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:17.762751 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:17.762594 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749a190a-f808-49fc-8cd2-81342e6da38b-original-pull-secret podName:749a190a-f808-49fc-8cd2-81342e6da38b nodeName:}" failed. No retries permitted until 2026-06-02 16:41:18.262574685 +0000 UTC m=+2.718658924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/749a190a-f808-49fc-8cd2-81342e6da38b-original-pull-secret") pod "global-pull-secret-syncer-fbqmz" (UID: "749a190a-f808-49fc-8cd2-81342e6da38b") : object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:17.762967 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.762940 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/749a190a-f808-49fc-8cd2-81342e6da38b-dbus\") pod \"global-pull-secret-syncer-fbqmz\" (UID: \"749a190a-f808-49fc-8cd2-81342e6da38b\") " pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:17.763050 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.763033 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/749a190a-f808-49fc-8cd2-81342e6da38b-kubelet-config\") pod \"global-pull-secret-syncer-fbqmz\" (UID: \"749a190a-f808-49fc-8cd2-81342e6da38b\") " pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:17.985369 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.985205 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 16:36:16 +0000 UTC" deadline="2028-02-13 02:53:06.518895192 +0000 UTC" Jun 02 16:41:17.985369 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:17.985251 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14890h11m48.533649314s" Jun 02 16:41:18.090234 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:18.090188 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" event={"ID":"a9902c57-5190-456a-83a9-948e46bec4a0","Type":"ContainerStarted","Data":"5d44f07ed772810ef52dbf7a085dd6312d35af5d778430b2e40e1a7899ab95ff"} Jun 02 16:41:18.102263 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:18.102217 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dbpdg" event={"ID":"cabae08f-9b7a-44e4-adc6-1544f0f861bd","Type":"ContainerStarted","Data":"9e20aee22385d60e2a871be9f49bfe083b157299a9de9a53a55b9750da9646ef"} Jun 02 16:41:18.116044 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:18.115987 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" event={"ID":"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160","Type":"ContainerStarted","Data":"1033d732da385c4563d5e956e3e10c76d219418005860556213486e01c065459"} Jun 02 16:41:18.131557 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:18.131474 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fjcc9" event={"ID":"a1c0d918-3ad4-446a-94dc-a29ff79b8476","Type":"ContainerStarted","Data":"43e93de5c318df6acbc5169ca7e14bedf9c8956cd3acc8461077278b2f03594c"} Jun 02 16:41:18.140503 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:18.140446 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7fvwq" event={"ID":"64a330d1-ae24-4e85-88b8-f595933f5d4a","Type":"ContainerStarted","Data":"3bd982a1cdcb6b6aa9b2dd6d34ee8a0e2c7c32566795c3a30e162e2742fe59a2"} Jun 02 16:41:18.147431 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:18.147388 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal" event={"ID":"a95576eca65fd8a1e75b2eee015468be","Type":"ContainerStarted","Data":"0dbca72589947a5d0944f0b3df4d11c50e6813a616b50d8a79116b7fdbc3afed"} Jun 02 16:41:18.148869 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:18.148844 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hhv9c" event={"ID":"c231d988-ab86-41d3-be47-375ab32a84c2","Type":"ContainerStarted","Data":"5d405ab50922dae972c785f0e04abd9071c84acbc35269eb63681cd75835a26b"} Jun 02 16:41:18.153490 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:18.153463 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" event={"ID":"9275b379-3d40-4353-82a5-d43ef7341575","Type":"ContainerStarted","Data":"8cc7e04636d178f06702e913411d3ee51783ba54a6ea3324e98c86b4cbb86dd8"} Jun 02 16:41:18.162469 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:18.162442 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhcjt" event={"ID":"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed","Type":"ContainerStarted","Data":"f6d670afc7e511fc639a19dc2bfd44ffa878ce46fd2a1fa972369243cf47764c"} Jun 02 16:41:18.170983 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:18.170955 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xzbtx" event={"ID":"7e662b53-0cfd-4ec3-94ee-554c1450e245","Type":"ContainerStarted","Data":"c925a2102cff6ce68c53673a76695de7b356e8073c7747b78b864d974540dd0a"} Jun 02 16:41:18.267395 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:18.267300 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/749a190a-f808-49fc-8cd2-81342e6da38b-original-pull-secret\") pod \"global-pull-secret-syncer-fbqmz\" (UID: \"749a190a-f808-49fc-8cd2-81342e6da38b\") " pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:18.267596 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:18.267563 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:18.267667 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:18.267631 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749a190a-f808-49fc-8cd2-81342e6da38b-original-pull-secret podName:749a190a-f808-49fc-8cd2-81342e6da38b nodeName:}" failed. No retries permitted until 2026-06-02 16:41:19.267613514 +0000 UTC m=+3.723697750 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/749a190a-f808-49fc-8cd2-81342e6da38b-original-pull-secret") pod "global-pull-secret-syncer-fbqmz" (UID: "749a190a-f808-49fc-8cd2-81342e6da38b") : object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:18.332003 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:18.331964 2565 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:41:18.570615 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:18.570519 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gfqfh\" (UniqueName: \"kubernetes.io/projected/4505a0c0-1c04-42cd-b0ab-cc964485cef7-kube-api-access-gfqfh\") pod \"network-check-target-vgkxp\" (UID: \"4505a0c0-1c04-42cd-b0ab-cc964485cef7\") " pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:18.570615 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:18.570577 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs\") pod \"network-metrics-daemon-5p7z4\" (UID: \"ab630523-7064-4dc5-a730-7b6b06551777\") " pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:18.570845 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:18.570709 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:18.570845 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:18.570718 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:41:18.570845 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:18.570742 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:41:18.570845 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:18.570754 2565 projected.go:194] Error preparing data for projected volume kube-api-access-gfqfh for pod openshift-network-diagnostics/network-check-target-vgkxp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:18.570845 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:18.570766 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs podName:ab630523-7064-4dc5-a730-7b6b06551777 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:20.570744634 +0000 UTC m=+5.026828869 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs") pod "network-metrics-daemon-5p7z4" (UID: "ab630523-7064-4dc5-a730-7b6b06551777") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:18.570845 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:18.570810 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4505a0c0-1c04-42cd-b0ab-cc964485cef7-kube-api-access-gfqfh podName:4505a0c0-1c04-42cd-b0ab-cc964485cef7 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:20.570793065 +0000 UTC m=+5.026877303 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gfqfh" (UniqueName: "kubernetes.io/projected/4505a0c0-1c04-42cd-b0ab-cc964485cef7-kube-api-access-gfqfh") pod "network-check-target-vgkxp" (UID: "4505a0c0-1c04-42cd-b0ab-cc964485cef7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:18.986353 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:18.986255 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 16:36:16 +0000 UTC" deadline="2027-11-13 11:01:37.64718533 +0000 UTC" Jun 02 16:41:18.986353 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:18.986301 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12690h20m18.660888907s" Jun 02 16:41:19.041768 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:19.041736 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:19.041940 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:19.041873 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbqmz" podUID="749a190a-f808-49fc-8cd2-81342e6da38b" Jun 02 16:41:19.042137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:19.042118 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:19.042283 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:19.042227 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgkxp" podUID="4505a0c0-1c04-42cd-b0ab-cc964485cef7" Jun 02 16:41:19.042359 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:19.042325 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:19.042455 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:19.042410 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5p7z4" podUID="ab630523-7064-4dc5-a730-7b6b06551777" Jun 02 16:41:19.277246 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:19.277161 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/749a190a-f808-49fc-8cd2-81342e6da38b-original-pull-secret\") pod \"global-pull-secret-syncer-fbqmz\" (UID: \"749a190a-f808-49fc-8cd2-81342e6da38b\") " pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:19.277412 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:19.277341 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:19.277412 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:19.277406 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749a190a-f808-49fc-8cd2-81342e6da38b-original-pull-secret podName:749a190a-f808-49fc-8cd2-81342e6da38b nodeName:}" failed. No retries permitted until 2026-06-02 16:41:21.277388029 +0000 UTC m=+5.733472272 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/749a190a-f808-49fc-8cd2-81342e6da38b-original-pull-secret") pod "global-pull-secret-syncer-fbqmz" (UID: "749a190a-f808-49fc-8cd2-81342e6da38b") : object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:19.947696 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:19.947668 2565 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:41:20.591496 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:20.591457 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gfqfh\" (UniqueName: \"kubernetes.io/projected/4505a0c0-1c04-42cd-b0ab-cc964485cef7-kube-api-access-gfqfh\") pod \"network-check-target-vgkxp\" (UID: \"4505a0c0-1c04-42cd-b0ab-cc964485cef7\") " pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:20.591920 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:20.591518 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs\") pod \"network-metrics-daemon-5p7z4\" (UID: \"ab630523-7064-4dc5-a730-7b6b06551777\") " pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:20.591920 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:20.591655 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:41:20.591920 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:20.591679 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:41:20.591920 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:20.591693 2565 projected.go:194] Error preparing data for projected volume kube-api-access-gfqfh for pod openshift-network-diagnostics/network-check-target-vgkxp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:20.591920 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:20.591711 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:20.591920 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:20.591759 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4505a0c0-1c04-42cd-b0ab-cc964485cef7-kube-api-access-gfqfh podName:4505a0c0-1c04-42cd-b0ab-cc964485cef7 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:24.591735363 +0000 UTC m=+9.047819602 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gfqfh" (UniqueName: "kubernetes.io/projected/4505a0c0-1c04-42cd-b0ab-cc964485cef7-kube-api-access-gfqfh") pod "network-check-target-vgkxp" (UID: "4505a0c0-1c04-42cd-b0ab-cc964485cef7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:20.591920 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:20.591781 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs podName:ab630523-7064-4dc5-a730-7b6b06551777 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:24.591770473 +0000 UTC m=+9.047854714 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs") pod "network-metrics-daemon-5p7z4" (UID: "ab630523-7064-4dc5-a730-7b6b06551777") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:21.041595 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:21.041331 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:21.041751 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:21.041507 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:21.041751 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:21.041536 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:21.041751 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:21.041676 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5p7z4" podUID="ab630523-7064-4dc5-a730-7b6b06551777" Jun 02 16:41:21.042140 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:21.042115 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgkxp" podUID="4505a0c0-1c04-42cd-b0ab-cc964485cef7" Jun 02 16:41:21.042239 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:21.042217 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbqmz" podUID="749a190a-f808-49fc-8cd2-81342e6da38b" Jun 02 16:41:21.296697 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:21.296615 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/749a190a-f808-49fc-8cd2-81342e6da38b-original-pull-secret\") pod \"global-pull-secret-syncer-fbqmz\" (UID: \"749a190a-f808-49fc-8cd2-81342e6da38b\") " pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:21.296846 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:21.296751 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:21.296846 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:21.296814 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749a190a-f808-49fc-8cd2-81342e6da38b-original-pull-secret podName:749a190a-f808-49fc-8cd2-81342e6da38b nodeName:}" failed. No retries permitted until 2026-06-02 16:41:25.296795735 +0000 UTC m=+9.752879972 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/749a190a-f808-49fc-8cd2-81342e6da38b-original-pull-secret") pod "global-pull-secret-syncer-fbqmz" (UID: "749a190a-f808-49fc-8cd2-81342e6da38b") : object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:23.041208 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:23.041169 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:23.041208 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:23.041205 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:23.041668 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:23.041290 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5p7z4" podUID="ab630523-7064-4dc5-a730-7b6b06551777" Jun 02 16:41:23.041668 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:23.041169 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:23.041668 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:23.041403 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbqmz" podUID="749a190a-f808-49fc-8cd2-81342e6da38b" Jun 02 16:41:23.041668 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:23.041480 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgkxp" podUID="4505a0c0-1c04-42cd-b0ab-cc964485cef7" Jun 02 16:41:24.625587 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:24.625546 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gfqfh\" (UniqueName: \"kubernetes.io/projected/4505a0c0-1c04-42cd-b0ab-cc964485cef7-kube-api-access-gfqfh\") pod \"network-check-target-vgkxp\" (UID: \"4505a0c0-1c04-42cd-b0ab-cc964485cef7\") " pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:24.626151 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:24.625603 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs\") pod \"network-metrics-daemon-5p7z4\" (UID: \"ab630523-7064-4dc5-a730-7b6b06551777\") " pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:24.626151 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:24.625715 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:24.626151 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:24.625743 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:41:24.626151 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:24.625770 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:41:24.626151 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:24.625781 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs podName:ab630523-7064-4dc5-a730-7b6b06551777 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:32.625759846 +0000 UTC m=+17.081844085 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs") pod "network-metrics-daemon-5p7z4" (UID: "ab630523-7064-4dc5-a730-7b6b06551777") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:24.626151 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:24.625783 2565 projected.go:194] Error preparing data for projected volume kube-api-access-gfqfh for pod openshift-network-diagnostics/network-check-target-vgkxp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:24.626151 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:24.625839 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4505a0c0-1c04-42cd-b0ab-cc964485cef7-kube-api-access-gfqfh podName:4505a0c0-1c04-42cd-b0ab-cc964485cef7 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:32.625821483 +0000 UTC m=+17.081905720 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gfqfh" (UniqueName: "kubernetes.io/projected/4505a0c0-1c04-42cd-b0ab-cc964485cef7-kube-api-access-gfqfh") pod "network-check-target-vgkxp" (UID: "4505a0c0-1c04-42cd-b0ab-cc964485cef7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:25.042638 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:25.041793 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:25.042638 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:25.041919 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbqmz" podUID="749a190a-f808-49fc-8cd2-81342e6da38b" Jun 02 16:41:25.042638 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:25.042351 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:25.042638 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:25.042439 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5p7z4" podUID="ab630523-7064-4dc5-a730-7b6b06551777" Jun 02 16:41:25.042638 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:25.042489 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:25.042638 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:25.042542 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgkxp" podUID="4505a0c0-1c04-42cd-b0ab-cc964485cef7" Jun 02 16:41:25.331853 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:25.331770 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/749a190a-f808-49fc-8cd2-81342e6da38b-original-pull-secret\") pod \"global-pull-secret-syncer-fbqmz\" (UID: \"749a190a-f808-49fc-8cd2-81342e6da38b\") " pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:25.331996 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:25.331929 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:25.332125 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:25.332000 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749a190a-f808-49fc-8cd2-81342e6da38b-original-pull-secret podName:749a190a-f808-49fc-8cd2-81342e6da38b nodeName:}" failed. No retries permitted until 2026-06-02 16:41:33.331982355 +0000 UTC m=+17.788066593 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/749a190a-f808-49fc-8cd2-81342e6da38b-original-pull-secret") pod "global-pull-secret-syncer-fbqmz" (UID: "749a190a-f808-49fc-8cd2-81342e6da38b") : object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:27.041776 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:27.041734 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:27.042275 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:27.041851 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgkxp" podUID="4505a0c0-1c04-42cd-b0ab-cc964485cef7" Jun 02 16:41:27.042275 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:27.041734 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:27.042275 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:27.041961 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5p7z4" podUID="ab630523-7064-4dc5-a730-7b6b06551777" Jun 02 16:41:27.042275 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:27.041729 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:27.042275 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:27.042059 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbqmz" podUID="749a190a-f808-49fc-8cd2-81342e6da38b" Jun 02 16:41:29.041865 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:29.041836 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:29.042247 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:29.041836 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:29.042247 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:29.041972 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:29.042247 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:29.041986 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbqmz" podUID="749a190a-f808-49fc-8cd2-81342e6da38b" Jun 02 16:41:29.042247 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:29.042095 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5p7z4" podUID="ab630523-7064-4dc5-a730-7b6b06551777" Jun 02 16:41:29.042247 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:29.042205 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgkxp" podUID="4505a0c0-1c04-42cd-b0ab-cc964485cef7" Jun 02 16:41:31.042155 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:31.042117 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:31.042155 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:31.042150 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:31.042585 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:31.042264 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:31.042585 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:31.042275 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5p7z4" podUID="ab630523-7064-4dc5-a730-7b6b06551777" Jun 02 16:41:31.042585 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:31.042353 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgkxp" podUID="4505a0c0-1c04-42cd-b0ab-cc964485cef7" Jun 02 16:41:31.042585 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:31.042388 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbqmz" podUID="749a190a-f808-49fc-8cd2-81342e6da38b" Jun 02 16:41:32.686327 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:32.686282 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gfqfh\" (UniqueName: \"kubernetes.io/projected/4505a0c0-1c04-42cd-b0ab-cc964485cef7-kube-api-access-gfqfh\") pod \"network-check-target-vgkxp\" (UID: \"4505a0c0-1c04-42cd-b0ab-cc964485cef7\") " pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:32.686782 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:32.686343 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs\") pod \"network-metrics-daemon-5p7z4\" (UID: \"ab630523-7064-4dc5-a730-7b6b06551777\") " pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:32.686782 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:32.686469 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:32.686782 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:32.686469 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:41:32.686782 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:32.686502 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:41:32.686782 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:32.686518 2565 projected.go:194] Error preparing data for projected volume kube-api-access-gfqfh for pod openshift-network-diagnostics/network-check-target-vgkxp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:32.686782 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:32.686534 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs podName:ab630523-7064-4dc5-a730-7b6b06551777 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:48.68651479 +0000 UTC m=+33.142599026 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs") pod "network-metrics-daemon-5p7z4" (UID: "ab630523-7064-4dc5-a730-7b6b06551777") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:32.686782 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:32.686559 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4505a0c0-1c04-42cd-b0ab-cc964485cef7-kube-api-access-gfqfh podName:4505a0c0-1c04-42cd-b0ab-cc964485cef7 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:48.686547815 +0000 UTC m=+33.142632061 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gfqfh" (UniqueName: "kubernetes.io/projected/4505a0c0-1c04-42cd-b0ab-cc964485cef7-kube-api-access-gfqfh") pod "network-check-target-vgkxp" (UID: "4505a0c0-1c04-42cd-b0ab-cc964485cef7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:33.041582 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:33.041510 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:33.041582 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:33.041545 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:33.041796 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:33.041618 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5p7z4" podUID="ab630523-7064-4dc5-a730-7b6b06551777" Jun 02 16:41:33.041796 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:33.041665 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbqmz" podUID="749a190a-f808-49fc-8cd2-81342e6da38b" Jun 02 16:41:33.041796 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:33.041703 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:33.041796 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:33.041771 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgkxp" podUID="4505a0c0-1c04-42cd-b0ab-cc964485cef7" Jun 02 16:41:33.392671 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:33.392641 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/749a190a-f808-49fc-8cd2-81342e6da38b-original-pull-secret\") pod \"global-pull-secret-syncer-fbqmz\" (UID: \"749a190a-f808-49fc-8cd2-81342e6da38b\") " pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:33.392833 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:33.392769 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:33.392877 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:33.392845 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749a190a-f808-49fc-8cd2-81342e6da38b-original-pull-secret podName:749a190a-f808-49fc-8cd2-81342e6da38b nodeName:}" failed. No retries permitted until 2026-06-02 16:41:49.392828497 +0000 UTC m=+33.848912754 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/749a190a-f808-49fc-8cd2-81342e6da38b-original-pull-secret") pod "global-pull-secret-syncer-fbqmz" (UID: "749a190a-f808-49fc-8cd2-81342e6da38b") : object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:35.041640 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:35.041601 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:35.042155 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:35.041712 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgkxp" podUID="4505a0c0-1c04-42cd-b0ab-cc964485cef7" Jun 02 16:41:35.042155 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:35.041603 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:35.042155 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:35.041841 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:35.042155 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:35.041840 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5p7z4" podUID="ab630523-7064-4dc5-a730-7b6b06551777" Jun 02 16:41:35.042155 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:35.041947 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbqmz" podUID="749a190a-f808-49fc-8cd2-81342e6da38b" Jun 02 16:41:37.041460 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:37.041427 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:37.041813 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:37.041538 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:37.041813 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:37.041542 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbqmz" podUID="749a190a-f808-49fc-8cd2-81342e6da38b" Jun 02 16:41:37.041813 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:37.041555 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:37.041813 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:37.041637 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgkxp" podUID="4505a0c0-1c04-42cd-b0ab-cc964485cef7" Jun 02 16:41:37.041813 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:37.041708 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5p7z4" podUID="ab630523-7064-4dc5-a730-7b6b06551777" Jun 02 16:41:38.221646 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.221283 2565 generic.go:358] "Generic (PLEG): container finished" podID="4a3eebd2da0da535847e15e1fd405896" containerID="05cf5324ed14f2b3794042f4f2bb04788a6b584e0e63923daace8104ca801e94" exitCode=0 Jun 02 16:41:38.222396 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.221366 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" event={"ID":"4a3eebd2da0da535847e15e1fd405896","Type":"ContainerDied","Data":"05cf5324ed14f2b3794042f4f2bb04788a6b584e0e63923daace8104ca801e94"} Jun 02 16:41:38.222396 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.221492 2565 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" Jun 02 16:41:38.222980 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.222947 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" event={"ID":"a710b0f9-d6e8-4ead-b28f-2e4c3fc18160","Type":"ContainerStarted","Data":"7ac812dd538aa25107a834465a6aa683ba094692f44f10f9ea6d8147c6135d62"} Jun 02 16:41:38.224230 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.224195 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fjcc9" event={"ID":"a1c0d918-3ad4-446a-94dc-a29ff79b8476","Type":"ContainerStarted","Data":"81ed7d1b81a94aeb93b95e79062781640f54923820332db793c7fd0348564b26"} Jun 02 16:41:38.225336 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.225316 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7fvwq" event={"ID":"64a330d1-ae24-4e85-88b8-f595933f5d4a","Type":"ContainerStarted","Data":"e97b2120c3aac903c8257ea128b76eb3aebafef133687f3ecf5eeebf01dcd412"} Jun 02 16:41:38.226584 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.226563 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal" event={"ID":"a95576eca65fd8a1e75b2eee015468be","Type":"ContainerStarted","Data":"eb5f54cb2e46eaf5a835d738aac6d1f14def7933424079eada2af60ba3dcfa9e"} Jun 02 16:41:38.227692 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.227669 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hhv9c" event={"ID":"c231d988-ab86-41d3-be47-375ab32a84c2","Type":"ContainerStarted","Data":"db6a23b246b28b0ef256adc6437efc7b9ad0d1af21f795c7c2245501246b8f2b"} Jun 02 16:41:38.228852 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.228833 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" event={"ID":"9275b379-3d40-4353-82a5-d43ef7341575","Type":"ContainerStarted","Data":"0950846ebe470f88b4be1e97b050b9b665daf573d169d6933794dd4ce48ee2a3"} Jun 02 16:41:38.229851 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.229831 2565 generic.go:358] "Generic (PLEG): container finished" podID="6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed" containerID="1473f831a003feee977b8950b6ba6b0fd5a9cf9a9afa3f65807143850fc7d378" exitCode=0 Jun 02 16:41:38.229929 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.229870 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhcjt" event={"ID":"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed","Type":"ContainerDied","Data":"1473f831a003feee977b8950b6ba6b0fd5a9cf9a9afa3f65807143850fc7d378"} Jun 02 16:41:38.231087 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.231046 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xzbtx" event={"ID":"7e662b53-0cfd-4ec3-94ee-554c1450e245","Type":"ContainerStarted","Data":"139efabf12562e5c5fb49a1e0aab83604fd4c0cabe4c9d9c1f1a5e613cf7aebe"} Jun 02 16:41:38.231501 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.231484 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 16:41:38.232235 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.232211 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal"] Jun 02 16:41:38.233546 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.233531 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sjt8_a9902c57-5190-456a-83a9-948e46bec4a0/ovn-acl-logging/0.log" Jun 02 16:41:38.233838 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.233820 2565 generic.go:358] "Generic (PLEG): container finished" podID="a9902c57-5190-456a-83a9-948e46bec4a0" containerID="ebc53b2e6be21c30e3d38772fea63c84ad805c32a4f365dee56d44fe111bd355" exitCode=1 Jun 02 16:41:38.233928 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.233838 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" event={"ID":"a9902c57-5190-456a-83a9-948e46bec4a0","Type":"ContainerStarted","Data":"c4bfd407c53236f8b6f07cbf7388aae4423f55c57d14cb50116149ba8de58529"} Jun 02 16:41:38.233928 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.233859 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" event={"ID":"a9902c57-5190-456a-83a9-948e46bec4a0","Type":"ContainerStarted","Data":"ab4b089135206523831f9f3298dfaa33854962b428c76f8c4fd82b96a0227451"} Jun 02 16:41:38.233928 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.233870 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" event={"ID":"a9902c57-5190-456a-83a9-948e46bec4a0","Type":"ContainerStarted","Data":"8256ea91294590d50159cce02cd4c4065c00695b94f0b8472e02f3bd56d5bef2"} Jun 02 16:41:38.233928 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.233883 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" event={"ID":"a9902c57-5190-456a-83a9-948e46bec4a0","Type":"ContainerStarted","Data":"f45f8e8a354b14782756736a1f40f05a959d891670a692fb222e8b4c70e9ea6a"} Jun 02 16:41:38.233928 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.233891 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" event={"ID":"a9902c57-5190-456a-83a9-948e46bec4a0","Type":"ContainerDied","Data":"ebc53b2e6be21c30e3d38772fea63c84ad805c32a4f365dee56d44fe111bd355"} Jun 02 16:41:38.233928 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.233900 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" event={"ID":"a9902c57-5190-456a-83a9-948e46bec4a0","Type":"ContainerStarted","Data":"caf31bc0bc84603bcfbd5367864acbc329f3bc2d8c43ec566c4ed6e4dbdfb657"} Jun 02 16:41:38.252522 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.252476 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-l7kpg" podStartSLOduration=2.391611561 podStartE2EDuration="22.252463018s" podCreationTimestamp="2026-06-02 16:41:16 +0000 UTC" firstStartedPulling="2026-06-02 16:41:17.330108153 +0000 UTC m=+1.786192389" lastFinishedPulling="2026-06-02 16:41:37.190959606 +0000 UTC m=+21.647043846" observedRunningTime="2026-06-02 16:41:38.236722018 +0000 UTC m=+22.692806274" watchObservedRunningTime="2026-06-02 16:41:38.252463018 +0000 UTC m=+22.708547275" Jun 02 16:41:38.316616 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.316579 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-xzbtx" podStartSLOduration=2.469163787 podStartE2EDuration="22.316564591s" podCreationTimestamp="2026-06-02 16:41:16 +0000 UTC" firstStartedPulling="2026-06-02 16:41:17.308064514 +0000 UTC m=+1.764148749" lastFinishedPulling="2026-06-02 16:41:37.155465314 +0000 UTC m=+21.611549553" observedRunningTime="2026-06-02 16:41:38.28197996 +0000 UTC m=+22.738064215" watchObservedRunningTime="2026-06-02 16:41:38.316564591 +0000 UTC m=+22.772648848" Jun 02 16:41:38.331204 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.331151 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hhv9c" podStartSLOduration=2.512184656 podStartE2EDuration="22.331132684s" podCreationTimestamp="2026-06-02 16:41:16 +0000 UTC" firstStartedPulling="2026-06-02 16:41:17.336522667 +0000 UTC m=+1.792606903" lastFinishedPulling="2026-06-02 16:41:37.155470681 +0000 UTC m=+21.611554931" observedRunningTime="2026-06-02 16:41:38.331079954 +0000 UTC m=+22.787164212" watchObservedRunningTime="2026-06-02 16:41:38.331132684 +0000 UTC m=+22.787216942" Jun 02 16:41:38.344268 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.344229 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal" podStartSLOduration=22.34421493 podStartE2EDuration="22.34421493s" podCreationTimestamp="2026-06-02 16:41:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:41:38.34381843 +0000 UTC m=+22.799902687" watchObservedRunningTime="2026-06-02 16:41:38.34421493 +0000 UTC m=+22.800299187" Jun 02 16:41:38.359882 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.359827 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7fvwq" podStartSLOduration=10.662728288 podStartE2EDuration="22.359809764s" podCreationTimestamp="2026-06-02 16:41:16 +0000 UTC" firstStartedPulling="2026-06-02 16:41:17.281834966 +0000 UTC m=+1.737919201" lastFinishedPulling="2026-06-02 16:41:28.97891644 +0000 UTC m=+13.435000677" observedRunningTime="2026-06-02 16:41:38.359466081 +0000 UTC m=+22.815550337" watchObservedRunningTime="2026-06-02 16:41:38.359809764 +0000 UTC m=+22.815894024" Jun 02 16:41:38.379573 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:38.379533 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-fjcc9" podStartSLOduration=2.277152569 podStartE2EDuration="22.379523181s" podCreationTimestamp="2026-06-02 16:41:16 +0000 UTC" firstStartedPulling="2026-06-02 16:41:17.319297201 +0000 UTC m=+1.775381440" lastFinishedPulling="2026-06-02 16:41:37.421667816 +0000 UTC m=+21.877752052" observedRunningTime="2026-06-02 16:41:38.379312455 +0000 UTC m=+22.835396724" watchObservedRunningTime="2026-06-02 16:41:38.379523181 +0000 UTC m=+22.835607437" Jun 02 16:41:39.041357 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:39.041328 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:39.041490 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:39.041360 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:39.041490 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:39.041390 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:39.041596 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:39.041498 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5p7z4" podUID="ab630523-7064-4dc5-a730-7b6b06551777" Jun 02 16:41:39.041774 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:39.041746 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbqmz" podUID="749a190a-f808-49fc-8cd2-81342e6da38b" Jun 02 16:41:39.041903 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:39.041832 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgkxp" podUID="4505a0c0-1c04-42cd-b0ab-cc964485cef7" Jun 02 16:41:39.084352 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:39.084331 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 16:41:39.239942 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:39.239858 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" event={"ID":"9275b379-3d40-4353-82a5-d43ef7341575","Type":"ContainerStarted","Data":"3002b0349b8cb1d43df258dd9a9fe16487e4ffb0f381c3d2cb388de685e9b16a"} Jun 02 16:41:39.241407 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:39.241370 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" event={"ID":"4a3eebd2da0da535847e15e1fd405896","Type":"ContainerStarted","Data":"84227d2775b89226524de31b0871dc9e5807fb498e6ec49ed30e9cec55b21b89"} Jun 02 16:41:39.242571 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:39.242538 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dbpdg" event={"ID":"cabae08f-9b7a-44e4-adc6-1544f0f861bd","Type":"ContainerStarted","Data":"dc79770aa9bcde8979b503e9510bd4e332d81f1e00657686f8aa05e04add7619"} Jun 02 16:41:39.273917 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:39.273870 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" podStartSLOduration=1.2738591879999999 podStartE2EDuration="1.273859188s" podCreationTimestamp="2026-06-02 16:41:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:41:39.27358437 +0000 UTC m=+23.729668626" watchObservedRunningTime="2026-06-02 16:41:39.273859188 +0000 UTC m=+23.729943444" Jun 02 16:41:39.288030 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:39.287974 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dbpdg" podStartSLOduration=3.440664651 podStartE2EDuration="23.287965732s" podCreationTimestamp="2026-06-02 16:41:16 +0000 UTC" firstStartedPulling="2026-06-02 16:41:17.340931892 +0000 UTC m=+1.797016127" lastFinishedPulling="2026-06-02 16:41:37.188232958 +0000 UTC m=+21.644317208" observedRunningTime="2026-06-02 16:41:39.287717257 +0000 UTC m=+23.743801514" watchObservedRunningTime="2026-06-02 16:41:39.287965732 +0000 UTC m=+23.744049989" Jun 02 16:41:40.009095 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:40.008958 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T16:41:39.084349053Z","UUID":"2d2b2e21-cfe8-4bd6-ba38-44c9a7d0a2c5","Handler":null,"Name":"","Endpoint":""} Jun 02 16:41:40.010819 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:40.010789 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 16:41:40.010819 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:40.010822 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 16:41:40.252400 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:40.252373 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sjt8_a9902c57-5190-456a-83a9-948e46bec4a0/ovn-acl-logging/0.log" Jun 02 16:41:40.253022 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:40.252910 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" event={"ID":"a9902c57-5190-456a-83a9-948e46bec4a0","Type":"ContainerStarted","Data":"1d859f689719b991cc334e718b4f1cfdfdb4e39417755f24b831cda003be6d9f"} Jun 02 16:41:41.041821 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:41.041790 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:41.041821 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:41.041807 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:41.042057 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:41.041798 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:41.042057 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:41.041884 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbqmz" podUID="749a190a-f808-49fc-8cd2-81342e6da38b" Jun 02 16:41:41.042057 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:41.041944 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgkxp" podUID="4505a0c0-1c04-42cd-b0ab-cc964485cef7" Jun 02 16:41:41.042057 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:41.042042 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5p7z4" podUID="ab630523-7064-4dc5-a730-7b6b06551777" Jun 02 16:41:41.256910 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:41.256730 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" event={"ID":"9275b379-3d40-4353-82a5-d43ef7341575","Type":"ContainerStarted","Data":"30ff2936c629e6ff39813b2953396dda182d78be7d4f1ad5f4de70653f29082b"} Jun 02 16:41:41.815214 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:41.815177 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7fvwq" Jun 02 16:41:41.815889 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:41.815867 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7fvwq" Jun 02 16:41:41.840843 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:41.840790 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwmx4" podStartSLOduration=3.012765337 podStartE2EDuration="25.84077334s" podCreationTimestamp="2026-06-02 16:41:16 +0000 UTC" firstStartedPulling="2026-06-02 16:41:17.325416376 +0000 UTC m=+1.781500611" lastFinishedPulling="2026-06-02 16:41:40.153424375 +0000 UTC m=+24.609508614" observedRunningTime="2026-06-02 16:41:41.282141534 +0000 UTC m=+25.738225816" watchObservedRunningTime="2026-06-02 16:41:41.84077334 +0000 UTC m=+26.296857597" Jun 02 16:41:43.041663 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:43.041633 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:43.041663 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:43.041665 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:43.042593 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:43.041640 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:43.042593 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:43.041755 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgkxp" podUID="4505a0c0-1c04-42cd-b0ab-cc964485cef7" Jun 02 16:41:43.042593 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:43.041854 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5p7z4" podUID="ab630523-7064-4dc5-a730-7b6b06551777" Jun 02 16:41:43.042593 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:43.041914 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbqmz" podUID="749a190a-f808-49fc-8cd2-81342e6da38b" Jun 02 16:41:43.263343 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:43.263313 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sjt8_a9902c57-5190-456a-83a9-948e46bec4a0/ovn-acl-logging/0.log" Jun 02 16:41:43.263729 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:43.263694 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" event={"ID":"a9902c57-5190-456a-83a9-948e46bec4a0","Type":"ContainerStarted","Data":"98e745f0ece580906c1d0afd763dca95daf25c805afc08e5a8295c2a89d27ed5"} Jun 02 16:41:43.264041 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:43.264002 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:43.264166 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:43.264052 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:43.264287 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:43.264269 2565 scope.go:117] "RemoveContainer" containerID="ebc53b2e6be21c30e3d38772fea63c84ad805c32a4f365dee56d44fe111bd355" Jun 02 16:41:43.282506 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:43.282337 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:44.235671 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:44.235632 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5p7z4"] Jun 02 16:41:44.236047 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:44.235769 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:44.236047 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:44.235863 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5p7z4" podUID="ab630523-7064-4dc5-a730-7b6b06551777" Jun 02 16:41:44.242615 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:44.242585 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fbqmz"] Jun 02 16:41:44.242748 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:44.242730 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:44.242866 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:44.242845 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbqmz" podUID="749a190a-f808-49fc-8cd2-81342e6da38b" Jun 02 16:41:44.245203 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:44.245178 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vgkxp"] Jun 02 16:41:44.245304 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:44.245279 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:44.245364 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:44.245347 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgkxp" podUID="4505a0c0-1c04-42cd-b0ab-cc964485cef7" Jun 02 16:41:44.271631 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:44.271608 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sjt8_a9902c57-5190-456a-83a9-948e46bec4a0/ovn-acl-logging/0.log" Jun 02 16:41:44.271995 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:44.271964 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" event={"ID":"a9902c57-5190-456a-83a9-948e46bec4a0","Type":"ContainerStarted","Data":"515835c2c941c74ae65c5437718e147488a65cdffde32e8bcd3e032efa969513"} Jun 02 16:41:44.272398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:44.272374 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:44.289826 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:44.289796 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:41:44.305901 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:44.305855 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" podStartSLOduration=8.377295266 podStartE2EDuration="28.305839256s" podCreationTimestamp="2026-06-02 16:41:16 +0000 UTC" firstStartedPulling="2026-06-02 16:41:17.266853629 +0000 UTC m=+1.722937864" lastFinishedPulling="2026-06-02 16:41:37.195397617 +0000 UTC m=+21.651481854" observedRunningTime="2026-06-02 16:41:44.305716817 +0000 UTC m=+28.761801075" watchObservedRunningTime="2026-06-02 16:41:44.305839256 +0000 UTC m=+28.761923513" Jun 02 16:41:45.275286 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:45.275249 2565 generic.go:358] "Generic (PLEG): container finished" podID="6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed" containerID="5e9203cfe294e4fe8bb2bcbd60681c8a6f88b9af76bcf67bdb194aea5fd13724" exitCode=0 Jun 02 16:41:45.275681 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:45.275315 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhcjt" event={"ID":"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed","Type":"ContainerDied","Data":"5e9203cfe294e4fe8bb2bcbd60681c8a6f88b9af76bcf67bdb194aea5fd13724"} Jun 02 16:41:45.828561 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:45.828530 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7fvwq" Jun 02 16:41:45.828709 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:45.828647 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 16:41:45.829161 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:45.829145 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7fvwq" Jun 02 16:41:46.042694 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:46.042664 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:46.042872 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:46.042762 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5p7z4" podUID="ab630523-7064-4dc5-a730-7b6b06551777" Jun 02 16:41:46.042872 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:46.042834 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:46.042997 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:46.042922 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:46.043074 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:46.042917 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgkxp" podUID="4505a0c0-1c04-42cd-b0ab-cc964485cef7" Jun 02 16:41:46.043074 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:46.043020 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbqmz" podUID="749a190a-f808-49fc-8cd2-81342e6da38b" Jun 02 16:41:47.281233 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:47.281149 2565 generic.go:358] "Generic (PLEG): container finished" podID="6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed" containerID="25999e0e5a1a2859e920e6751f6033ef8eb6e2d36c36be71aacd2b67a495ab3f" exitCode=0 Jun 02 16:41:47.281233 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:47.281215 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhcjt" event={"ID":"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed","Type":"ContainerDied","Data":"25999e0e5a1a2859e920e6751f6033ef8eb6e2d36c36be71aacd2b67a495ab3f"} Jun 02 16:41:48.041471 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:48.041434 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:48.041645 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:48.041481 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:48.041645 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:48.041516 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:48.041645 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:48.041629 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5p7z4" podUID="ab630523-7064-4dc5-a730-7b6b06551777" Jun 02 16:41:48.041816 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:48.041680 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbqmz" podUID="749a190a-f808-49fc-8cd2-81342e6da38b" Jun 02 16:41:48.041816 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:48.041750 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgkxp" podUID="4505a0c0-1c04-42cd-b0ab-cc964485cef7" Jun 02 16:41:48.284550 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:48.284518 2565 generic.go:358] "Generic (PLEG): container finished" podID="6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed" containerID="dd9ae0c57d86ff0ecf215a545896126f1a7a7cedadc258465d2e9228632c5f4a" exitCode=0 Jun 02 16:41:48.284970 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:48.284570 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhcjt" event={"ID":"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed","Type":"ContainerDied","Data":"dd9ae0c57d86ff0ecf215a545896126f1a7a7cedadc258465d2e9228632c5f4a"} Jun 02 16:41:48.711038 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:48.710498 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gfqfh\" (UniqueName: \"kubernetes.io/projected/4505a0c0-1c04-42cd-b0ab-cc964485cef7-kube-api-access-gfqfh\") pod \"network-check-target-vgkxp\" (UID: \"4505a0c0-1c04-42cd-b0ab-cc964485cef7\") " pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:48.711038 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:48.710539 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs\") pod \"network-metrics-daemon-5p7z4\" (UID: \"ab630523-7064-4dc5-a730-7b6b06551777\") " pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:48.711038 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:48.710649 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:48.711038 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:48.710670 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:41:48.711038 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:48.710694 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:41:48.711038 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:48.710707 2565 projected.go:194] Error preparing data for projected volume kube-api-access-gfqfh for pod openshift-network-diagnostics/network-check-target-vgkxp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:48.711038 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:48.710714 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs podName:ab630523-7064-4dc5-a730-7b6b06551777 nodeName:}" failed. No retries permitted until 2026-06-02 16:42:20.710697944 +0000 UTC m=+65.166782180 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs") pod "network-metrics-daemon-5p7z4" (UID: "ab630523-7064-4dc5-a730-7b6b06551777") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:48.711038 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:48.710757 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4505a0c0-1c04-42cd-b0ab-cc964485cef7-kube-api-access-gfqfh podName:4505a0c0-1c04-42cd-b0ab-cc964485cef7 nodeName:}" failed. No retries permitted until 2026-06-02 16:42:20.710740423 +0000 UTC m=+65.166824664 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gfqfh" (UniqueName: "kubernetes.io/projected/4505a0c0-1c04-42cd-b0ab-cc964485cef7-kube-api-access-gfqfh") pod "network-check-target-vgkxp" (UID: "4505a0c0-1c04-42cd-b0ab-cc964485cef7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:49.416126 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:49.416088 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/749a190a-f808-49fc-8cd2-81342e6da38b-original-pull-secret\") pod \"global-pull-secret-syncer-fbqmz\" (UID: \"749a190a-f808-49fc-8cd2-81342e6da38b\") " pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:49.416611 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:49.416252 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:49.416611 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:49.416338 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749a190a-f808-49fc-8cd2-81342e6da38b-original-pull-secret podName:749a190a-f808-49fc-8cd2-81342e6da38b nodeName:}" failed. No retries permitted until 2026-06-02 16:42:21.416318521 +0000 UTC m=+65.872402772 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/749a190a-f808-49fc-8cd2-81342e6da38b-original-pull-secret") pod "global-pull-secret-syncer-fbqmz" (UID: "749a190a-f808-49fc-8cd2-81342e6da38b") : object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:50.045467 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.045434 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:50.045666 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.045434 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:50.045666 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:50.045580 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5p7z4" podUID="ab630523-7064-4dc5-a730-7b6b06551777" Jun 02 16:41:50.045666 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.045435 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:50.045666 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:50.045640 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fbqmz" podUID="749a190a-f808-49fc-8cd2-81342e6da38b" Jun 02 16:41:50.045891 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:50.045727 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgkxp" podUID="4505a0c0-1c04-42cd-b0ab-cc964485cef7" Jun 02 16:41:50.380117 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.380086 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeReady" Jun 02 16:41:50.380315 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.380259 2565 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 16:41:50.417148 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.417109 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5dd754dc-vc928"] Jun 02 16:41:50.420699 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.420670 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt"] Jun 02 16:41:50.420872 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.420846 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:50.422948 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.422920 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 16:41:50.423406 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.423390 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2fzdf\"" Jun 02 16:41:50.424136 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.424113 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 16:41:50.424246 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.424205 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 16:41:50.424702 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.424681 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-w82gl"] Jun 02 16:41:50.424902 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.424879 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt" Jun 02 16:41:50.426643 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.426620 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 02 16:41:50.426861 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.426821 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mnl2n\"" Jun 02 16:41:50.426963 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.426916 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 02 16:41:50.428878 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.428855 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-w82gl" Jun 02 16:41:50.429258 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.429236 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 16:41:50.430850 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.430807 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 16:41:50.430955 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.430914 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-dlvbx\"" Jun 02 16:41:50.431040 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.430808 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 16:41:50.435663 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.435635 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5dd754dc-vc928"] Jun 02 16:41:50.436240 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.436213 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt"] Jun 02 16:41:50.451748 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.451717 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7n7dn"] Jun 02 16:41:50.455750 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.455721 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lgc2j"] Jun 02 16:41:50.455915 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.455895 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7n7dn" Jun 02 16:41:50.458305 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.458260 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qcz2w\"" Jun 02 16:41:50.459061 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.459043 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 16:41:50.459264 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.459247 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-w82gl"] Jun 02 16:41:50.459373 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.459362 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lgc2j" Jun 02 16:41:50.459665 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.459642 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 16:41:50.464105 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.464060 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vq24k\"" Jun 02 16:41:50.464319 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.464298 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 16:41:50.464319 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.464313 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 16:41:50.464684 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.464624 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 16:41:50.468885 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.468856 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lgc2j"] Jun 02 16:41:50.469630 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.469602 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7n7dn"] Jun 02 16:41:50.523777 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.523733 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/83ffe287-d220-41cd-a102-77b8029422ea-image-registry-private-configuration\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:50.523974 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.523785 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/83ffe287-d220-41cd-a102-77b8029422ea-ca-trust-extracted\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:50.523974 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.523816 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c9pv\" (UniqueName: \"kubernetes.io/projected/9b3c3828-74bf-4ade-bc25-dc4df6925d4e-kube-api-access-5c9pv\") pod \"network-check-source-56d84b9f44-w82gl\" (UID: \"9b3c3828-74bf-4ade-bc25-dc4df6925d4e\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-w82gl" Jun 02 16:41:50.523974 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.523847 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/83ffe287-d220-41cd-a102-77b8029422ea-installation-pull-secrets\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:50.523974 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.523896 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-mfzpt\" (UID: \"2eb49fdc-49ec-4844-a2ed-108e1ad6a300\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt" Jun 02 16:41:50.523974 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.523913 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-mfzpt\" (UID: \"2eb49fdc-49ec-4844-a2ed-108e1ad6a300\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt" Jun 02 16:41:50.523974 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.523936 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-bound-sa-token\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:50.523974 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.523952 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/83ffe287-d220-41cd-a102-77b8029422ea-trusted-ca\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:50.524282 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.524038 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:50.524282 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.524101 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/83ffe287-d220-41cd-a102-77b8029422ea-registry-certificates\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:50.524282 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.524158 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr7qx\" (UniqueName: \"kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-kube-api-access-mr7qx\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:50.625611 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.625573 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgbdb\" (UniqueName: \"kubernetes.io/projected/6d6fcc1b-ce7e-4077-a070-269119a8e723-kube-api-access-zgbdb\") pod \"dns-default-7n7dn\" (UID: \"6d6fcc1b-ce7e-4077-a070-269119a8e723\") " pod="openshift-dns/dns-default-7n7dn" Jun 02 16:41:50.625815 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.625625 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/83ffe287-d220-41cd-a102-77b8029422ea-installation-pull-secrets\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:50.625815 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.625674 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-mfzpt\" (UID: \"2eb49fdc-49ec-4844-a2ed-108e1ad6a300\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt" Jun 02 16:41:50.625815 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.625701 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-mfzpt\" (UID: \"2eb49fdc-49ec-4844-a2ed-108e1ad6a300\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt" Jun 02 16:41:50.625815 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:50.625801 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 16:41:50.626067 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:50.625869 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert podName:2eb49fdc-49ec-4844-a2ed-108e1ad6a300 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:51.125847253 +0000 UTC m=+35.581931488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-mfzpt" (UID: "2eb49fdc-49ec-4844-a2ed-108e1ad6a300") : secret "networking-console-plugin-cert" not found Jun 02 16:41:50.626067 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.625891 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls\") pod \"dns-default-7n7dn\" (UID: \"6d6fcc1b-ce7e-4077-a070-269119a8e723\") " pod="openshift-dns/dns-default-7n7dn" Jun 02 16:41:50.626067 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.625930 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-bound-sa-token\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:50.626067 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.625959 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/83ffe287-d220-41cd-a102-77b8029422ea-trusted-ca\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:50.626067 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.625989 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:50.626067 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.626035 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/83ffe287-d220-41cd-a102-77b8029422ea-registry-certificates\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:50.626067 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.626056 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d6fcc1b-ce7e-4077-a070-269119a8e723-tmp-dir\") pod \"dns-default-7n7dn\" (UID: \"6d6fcc1b-ce7e-4077-a070-269119a8e723\") " pod="openshift-dns/dns-default-7n7dn" Jun 02 16:41:50.626382 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.626078 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6d6fcc1b-ce7e-4077-a070-269119a8e723-config-volume\") pod \"dns-default-7n7dn\" (UID: \"6d6fcc1b-ce7e-4077-a070-269119a8e723\") " pod="openshift-dns/dns-default-7n7dn" Jun 02 16:41:50.626382 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.626120 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mr7qx\" (UniqueName: \"kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-kube-api-access-mr7qx\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:50.626382 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.626142 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/83ffe287-d220-41cd-a102-77b8029422ea-image-registry-private-configuration\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:50.626382 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:50.626227 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 16:41:50.626382 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:50.626249 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dd754dc-vc928: secret "image-registry-tls" not found Jun 02 16:41:50.626382 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:50.626297 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls podName:83ffe287-d220-41cd-a102-77b8029422ea nodeName:}" failed. No retries permitted until 2026-06-02 16:41:51.126281613 +0000 UTC m=+35.582365847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls") pod "image-registry-5dd754dc-vc928" (UID: "83ffe287-d220-41cd-a102-77b8029422ea") : secret "image-registry-tls" not found Jun 02 16:41:50.626645 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.626470 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-mfzpt\" (UID: \"2eb49fdc-49ec-4844-a2ed-108e1ad6a300\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt" Jun 02 16:41:50.626645 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.626557 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/83ffe287-d220-41cd-a102-77b8029422ea-ca-trust-extracted\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:50.626645 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.626596 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5c9pv\" (UniqueName: \"kubernetes.io/projected/9b3c3828-74bf-4ade-bc25-dc4df6925d4e-kube-api-access-5c9pv\") pod \"network-check-source-56d84b9f44-w82gl\" (UID: \"9b3c3828-74bf-4ade-bc25-dc4df6925d4e\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-w82gl" Jun 02 16:41:50.626645 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.626629 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert\") pod \"ingress-canary-lgc2j\" (UID: \"70235929-1fb6-4b5d-bda3-f77b2899b79c\") " pod="openshift-ingress-canary/ingress-canary-lgc2j" Jun 02 16:41:50.626788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.626655 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-964lq\" (UniqueName: \"kubernetes.io/projected/70235929-1fb6-4b5d-bda3-f77b2899b79c-kube-api-access-964lq\") pod \"ingress-canary-lgc2j\" (UID: \"70235929-1fb6-4b5d-bda3-f77b2899b79c\") " pod="openshift-ingress-canary/ingress-canary-lgc2j" Jun 02 16:41:50.626832 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.626806 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/83ffe287-d220-41cd-a102-77b8029422ea-registry-certificates\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:50.627076 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.627051 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/83ffe287-d220-41cd-a102-77b8029422ea-ca-trust-extracted\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:50.627218 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.627176 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/83ffe287-d220-41cd-a102-77b8029422ea-trusted-ca\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:50.631112 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.631038 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/83ffe287-d220-41cd-a102-77b8029422ea-image-registry-private-configuration\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:50.631446 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.631420 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/83ffe287-d220-41cd-a102-77b8029422ea-installation-pull-secrets\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:50.635743 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.635712 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-bound-sa-token\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:50.635917 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.635899 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr7qx\" (UniqueName: \"kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-kube-api-access-mr7qx\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:50.636278 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.636253 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c9pv\" (UniqueName: \"kubernetes.io/projected/9b3c3828-74bf-4ade-bc25-dc4df6925d4e-kube-api-access-5c9pv\") pod \"network-check-source-56d84b9f44-w82gl\" (UID: \"9b3c3828-74bf-4ade-bc25-dc4df6925d4e\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-w82gl" Jun 02 16:41:50.727283 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.727228 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls\") pod \"dns-default-7n7dn\" (UID: \"6d6fcc1b-ce7e-4077-a070-269119a8e723\") " pod="openshift-dns/dns-default-7n7dn" Jun 02 16:41:50.727510 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.727296 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d6fcc1b-ce7e-4077-a070-269119a8e723-tmp-dir\") pod \"dns-default-7n7dn\" (UID: \"6d6fcc1b-ce7e-4077-a070-269119a8e723\") " pod="openshift-dns/dns-default-7n7dn" Jun 02 16:41:50.727510 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.727326 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6d6fcc1b-ce7e-4077-a070-269119a8e723-config-volume\") pod \"dns-default-7n7dn\" (UID: \"6d6fcc1b-ce7e-4077-a070-269119a8e723\") " pod="openshift-dns/dns-default-7n7dn" Jun 02 16:41:50.727510 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:50.727387 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:41:50.727510 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:50.727456 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls podName:6d6fcc1b-ce7e-4077-a070-269119a8e723 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:51.227437217 +0000 UTC m=+35.683521452 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls") pod "dns-default-7n7dn" (UID: "6d6fcc1b-ce7e-4077-a070-269119a8e723") : secret "dns-default-metrics-tls" not found Jun 02 16:41:50.727755 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.727666 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d6fcc1b-ce7e-4077-a070-269119a8e723-tmp-dir\") pod \"dns-default-7n7dn\" (UID: \"6d6fcc1b-ce7e-4077-a070-269119a8e723\") " pod="openshift-dns/dns-default-7n7dn" Jun 02 16:41:50.727819 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.727754 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert\") pod \"ingress-canary-lgc2j\" (UID: \"70235929-1fb6-4b5d-bda3-f77b2899b79c\") " pod="openshift-ingress-canary/ingress-canary-lgc2j" Jun 02 16:41:50.727819 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.727782 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-964lq\" (UniqueName: \"kubernetes.io/projected/70235929-1fb6-4b5d-bda3-f77b2899b79c-kube-api-access-964lq\") pod \"ingress-canary-lgc2j\" (UID: \"70235929-1fb6-4b5d-bda3-f77b2899b79c\") " pod="openshift-ingress-canary/ingress-canary-lgc2j" Jun 02 16:41:50.727819 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.727818 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zgbdb\" (UniqueName: \"kubernetes.io/projected/6d6fcc1b-ce7e-4077-a070-269119a8e723-kube-api-access-zgbdb\") pod \"dns-default-7n7dn\" (UID: \"6d6fcc1b-ce7e-4077-a070-269119a8e723\") " pod="openshift-dns/dns-default-7n7dn" Jun 02 16:41:50.727977 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:50.727842 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:41:50.727977 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:50.727897 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert podName:70235929-1fb6-4b5d-bda3-f77b2899b79c nodeName:}" failed. No retries permitted until 2026-06-02 16:41:51.2278781 +0000 UTC m=+35.683962356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert") pod "ingress-canary-lgc2j" (UID: "70235929-1fb6-4b5d-bda3-f77b2899b79c") : secret "canary-serving-cert" not found Jun 02 16:41:50.727977 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.727927 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6d6fcc1b-ce7e-4077-a070-269119a8e723-config-volume\") pod \"dns-default-7n7dn\" (UID: \"6d6fcc1b-ce7e-4077-a070-269119a8e723\") " pod="openshift-dns/dns-default-7n7dn" Jun 02 16:41:50.744064 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.744030 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-964lq\" (UniqueName: \"kubernetes.io/projected/70235929-1fb6-4b5d-bda3-f77b2899b79c-kube-api-access-964lq\") pod \"ingress-canary-lgc2j\" (UID: \"70235929-1fb6-4b5d-bda3-f77b2899b79c\") " pod="openshift-ingress-canary/ingress-canary-lgc2j" Jun 02 16:41:50.748844 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.748810 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgbdb\" (UniqueName: \"kubernetes.io/projected/6d6fcc1b-ce7e-4077-a070-269119a8e723-kube-api-access-zgbdb\") pod \"dns-default-7n7dn\" (UID: \"6d6fcc1b-ce7e-4077-a070-269119a8e723\") " pod="openshift-dns/dns-default-7n7dn" Jun 02 16:41:50.751534 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.751508 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-w82gl" Jun 02 16:41:50.915234 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:50.914926 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-w82gl"] Jun 02 16:41:50.922353 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:41:50.922312 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b3c3828_74bf_4ade_bc25_dc4df6925d4e.slice/crio-cc4e1aa821008d66750262be0994f17faa88f8869de8c18973973f6d4a4bacec WatchSource:0}: Error finding container cc4e1aa821008d66750262be0994f17faa88f8869de8c18973973f6d4a4bacec: Status 404 returned error can't find the container with id cc4e1aa821008d66750262be0994f17faa88f8869de8c18973973f6d4a4bacec Jun 02 16:41:51.132577 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:51.132540 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-mfzpt\" (UID: \"2eb49fdc-49ec-4844-a2ed-108e1ad6a300\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt" Jun 02 16:41:51.132779 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:51.132610 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:51.132779 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:51.132726 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 16:41:51.132858 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:51.132782 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 16:41:51.132858 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:51.132805 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dd754dc-vc928: secret "image-registry-tls" not found Jun 02 16:41:51.132858 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:51.132810 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert podName:2eb49fdc-49ec-4844-a2ed-108e1ad6a300 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:52.13279148 +0000 UTC m=+36.588875714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-mfzpt" (UID: "2eb49fdc-49ec-4844-a2ed-108e1ad6a300") : secret "networking-console-plugin-cert" not found Jun 02 16:41:51.132971 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:51.132869 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls podName:83ffe287-d220-41cd-a102-77b8029422ea nodeName:}" failed. No retries permitted until 2026-06-02 16:41:52.132851037 +0000 UTC m=+36.588935287 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls") pod "image-registry-5dd754dc-vc928" (UID: "83ffe287-d220-41cd-a102-77b8029422ea") : secret "image-registry-tls" not found Jun 02 16:41:51.233985 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:51.233890 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert\") pod \"ingress-canary-lgc2j\" (UID: \"70235929-1fb6-4b5d-bda3-f77b2899b79c\") " pod="openshift-ingress-canary/ingress-canary-lgc2j" Jun 02 16:41:51.233985 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:51.233972 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls\") pod \"dns-default-7n7dn\" (UID: \"6d6fcc1b-ce7e-4077-a070-269119a8e723\") " pod="openshift-dns/dns-default-7n7dn" Jun 02 16:41:51.234238 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:51.234082 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:41:51.234238 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:51.234115 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:41:51.234238 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:51.234164 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert podName:70235929-1fb6-4b5d-bda3-f77b2899b79c nodeName:}" failed. No retries permitted until 2026-06-02 16:41:52.234143019 +0000 UTC m=+36.690227270 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert") pod "ingress-canary-lgc2j" (UID: "70235929-1fb6-4b5d-bda3-f77b2899b79c") : secret "canary-serving-cert" not found Jun 02 16:41:51.234238 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:51.234185 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls podName:6d6fcc1b-ce7e-4077-a070-269119a8e723 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:52.234174241 +0000 UTC m=+36.690258477 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls") pod "dns-default-7n7dn" (UID: "6d6fcc1b-ce7e-4077-a070-269119a8e723") : secret "dns-default-metrics-tls" not found Jun 02 16:41:51.292169 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:51.292124 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-w82gl" event={"ID":"9b3c3828-74bf-4ade-bc25-dc4df6925d4e","Type":"ContainerStarted","Data":"cc4e1aa821008d66750262be0994f17faa88f8869de8c18973973f6d4a4bacec"} Jun 02 16:41:52.045139 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:52.045110 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:41:52.045795 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:52.045521 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:41:52.045883 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:52.045861 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:41:52.048384 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:52.048363 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 16:41:52.048560 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:52.048548 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 16:41:52.048698 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:52.048686 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-729km\"" Jun 02 16:41:52.048831 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:52.048819 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f4pj7\"" Jun 02 16:41:52.142629 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:52.142575 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-mfzpt\" (UID: \"2eb49fdc-49ec-4844-a2ed-108e1ad6a300\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt" Jun 02 16:41:52.142855 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:52.142667 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:52.142855 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:52.142745 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 16:41:52.142855 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:52.142831 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert podName:2eb49fdc-49ec-4844-a2ed-108e1ad6a300 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:54.142809691 +0000 UTC m=+38.598893953 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-mfzpt" (UID: "2eb49fdc-49ec-4844-a2ed-108e1ad6a300") : secret "networking-console-plugin-cert" not found Jun 02 16:41:52.142855 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:52.142839 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 16:41:52.142855 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:52.142860 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dd754dc-vc928: secret "image-registry-tls" not found Jun 02 16:41:52.143127 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:52.142915 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls podName:83ffe287-d220-41cd-a102-77b8029422ea nodeName:}" failed. No retries permitted until 2026-06-02 16:41:54.142901614 +0000 UTC m=+38.598985849 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls") pod "image-registry-5dd754dc-vc928" (UID: "83ffe287-d220-41cd-a102-77b8029422ea") : secret "image-registry-tls" not found Jun 02 16:41:52.243535 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:52.243493 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls\") pod \"dns-default-7n7dn\" (UID: \"6d6fcc1b-ce7e-4077-a070-269119a8e723\") " pod="openshift-dns/dns-default-7n7dn" Jun 02 16:41:52.243743 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:52.243578 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert\") pod \"ingress-canary-lgc2j\" (UID: \"70235929-1fb6-4b5d-bda3-f77b2899b79c\") " pod="openshift-ingress-canary/ingress-canary-lgc2j" Jun 02 16:41:52.244151 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:52.244127 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:41:52.244287 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:52.244194 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls podName:6d6fcc1b-ce7e-4077-a070-269119a8e723 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:54.244174343 +0000 UTC m=+38.700258579 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls") pod "dns-default-7n7dn" (UID: "6d6fcc1b-ce7e-4077-a070-269119a8e723") : secret "dns-default-metrics-tls" not found Jun 02 16:41:52.244622 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:52.244596 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:41:52.244718 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:52.244648 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert podName:70235929-1fb6-4b5d-bda3-f77b2899b79c nodeName:}" failed. No retries permitted until 2026-06-02 16:41:54.244633157 +0000 UTC m=+38.700717392 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert") pod "ingress-canary-lgc2j" (UID: "70235929-1fb6-4b5d-bda3-f77b2899b79c") : secret "canary-serving-cert" not found Jun 02 16:41:54.161239 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:54.161189 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:54.161743 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:54.161343 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 16:41:54.161743 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:54.161369 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dd754dc-vc928: secret "image-registry-tls" not found Jun 02 16:41:54.161743 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:54.161347 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-mfzpt\" (UID: \"2eb49fdc-49ec-4844-a2ed-108e1ad6a300\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt" Jun 02 16:41:54.161743 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:54.161441 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls podName:83ffe287-d220-41cd-a102-77b8029422ea nodeName:}" failed. No retries permitted until 2026-06-02 16:41:58.161417778 +0000 UTC m=+42.617502034 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls") pod "image-registry-5dd754dc-vc928" (UID: "83ffe287-d220-41cd-a102-77b8029422ea") : secret "image-registry-tls" not found Jun 02 16:41:54.161743 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:54.161440 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 16:41:54.161743 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:54.161505 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert podName:2eb49fdc-49ec-4844-a2ed-108e1ad6a300 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:58.16148675 +0000 UTC m=+42.617571008 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-mfzpt" (UID: "2eb49fdc-49ec-4844-a2ed-108e1ad6a300") : secret "networking-console-plugin-cert" not found Jun 02 16:41:54.262388 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:54.262340 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls\") pod \"dns-default-7n7dn\" (UID: \"6d6fcc1b-ce7e-4077-a070-269119a8e723\") " pod="openshift-dns/dns-default-7n7dn" Jun 02 16:41:54.262592 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:54.262460 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert\") pod \"ingress-canary-lgc2j\" (UID: \"70235929-1fb6-4b5d-bda3-f77b2899b79c\") " pod="openshift-ingress-canary/ingress-canary-lgc2j" Jun 02 16:41:54.262592 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:54.262491 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:41:54.262592 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:54.262570 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:41:54.262592 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:54.262582 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls podName:6d6fcc1b-ce7e-4077-a070-269119a8e723 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:58.262558981 +0000 UTC m=+42.718643239 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls") pod "dns-default-7n7dn" (UID: "6d6fcc1b-ce7e-4077-a070-269119a8e723") : secret "dns-default-metrics-tls" not found Jun 02 16:41:54.262795 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:54.262636 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert podName:70235929-1fb6-4b5d-bda3-f77b2899b79c nodeName:}" failed. No retries permitted until 2026-06-02 16:41:58.262623644 +0000 UTC m=+42.718707878 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert") pod "ingress-canary-lgc2j" (UID: "70235929-1fb6-4b5d-bda3-f77b2899b79c") : secret "canary-serving-cert" not found Jun 02 16:41:56.304323 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:56.304273 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-w82gl" event={"ID":"9b3c3828-74bf-4ade-bc25-dc4df6925d4e","Type":"ContainerStarted","Data":"d1b160b662b212a31caaa62387bcc65a7d2ef29e91d9d687a29bbbd31a4eb98e"} Jun 02 16:41:56.306723 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:56.306692 2565 generic.go:358] "Generic (PLEG): container finished" podID="6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed" containerID="31d88d0c43b6f0cf01c18e2d89d1f1e82e8db4d8f38e732fdbba4d727d2277f3" exitCode=0 Jun 02 16:41:56.306856 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:56.306736 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhcjt" event={"ID":"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed","Type":"ContainerDied","Data":"31d88d0c43b6f0cf01c18e2d89d1f1e82e8db4d8f38e732fdbba4d727d2277f3"} Jun 02 16:41:56.329982 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:56.329932 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-w82gl" podStartSLOduration=32.862182673 podStartE2EDuration="37.329914845s" podCreationTimestamp="2026-06-02 16:41:19 +0000 UTC" firstStartedPulling="2026-06-02 16:41:50.924110907 +0000 UTC m=+35.380195142" lastFinishedPulling="2026-06-02 16:41:55.391843076 +0000 UTC m=+39.847927314" observedRunningTime="2026-06-02 16:41:56.328814571 +0000 UTC m=+40.784898828" watchObservedRunningTime="2026-06-02 16:41:56.329914845 +0000 UTC m=+40.785999105" Jun 02 16:41:57.313658 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:57.313622 2565 generic.go:358] "Generic (PLEG): container finished" podID="6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed" containerID="dd20cd39bd16ea27b0a858efa16a0e066a325c9da909cf1d8c711ed60dfc1893" exitCode=0 Jun 02 16:41:57.314156 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:57.313709 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhcjt" event={"ID":"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed","Type":"ContainerDied","Data":"dd20cd39bd16ea27b0a858efa16a0e066a325c9da909cf1d8c711ed60dfc1893"} Jun 02 16:41:58.198075 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:58.198004 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-mfzpt\" (UID: \"2eb49fdc-49ec-4844-a2ed-108e1ad6a300\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt" Jun 02 16:41:58.198297 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:58.198113 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:41:58.198297 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:58.198159 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 16:41:58.198297 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:58.198234 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert podName:2eb49fdc-49ec-4844-a2ed-108e1ad6a300 nodeName:}" failed. No retries permitted until 2026-06-02 16:42:06.198215844 +0000 UTC m=+50.654300084 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-mfzpt" (UID: "2eb49fdc-49ec-4844-a2ed-108e1ad6a300") : secret "networking-console-plugin-cert" not found Jun 02 16:41:58.198297 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:58.198253 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 16:41:58.198297 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:58.198272 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dd754dc-vc928: secret "image-registry-tls" not found Jun 02 16:41:58.198487 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:58.198316 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls podName:83ffe287-d220-41cd-a102-77b8029422ea nodeName:}" failed. No retries permitted until 2026-06-02 16:42:06.198303365 +0000 UTC m=+50.654387604 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls") pod "image-registry-5dd754dc-vc928" (UID: "83ffe287-d220-41cd-a102-77b8029422ea") : secret "image-registry-tls" not found Jun 02 16:41:58.298828 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:58.298784 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert\") pod \"ingress-canary-lgc2j\" (UID: \"70235929-1fb6-4b5d-bda3-f77b2899b79c\") " pod="openshift-ingress-canary/ingress-canary-lgc2j" Jun 02 16:41:58.299043 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:58.298872 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls\") pod \"dns-default-7n7dn\" (UID: \"6d6fcc1b-ce7e-4077-a070-269119a8e723\") " pod="openshift-dns/dns-default-7n7dn" Jun 02 16:41:58.299043 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:58.298941 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:41:58.299043 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:58.298987 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:41:58.299043 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:58.299036 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert podName:70235929-1fb6-4b5d-bda3-f77b2899b79c nodeName:}" failed. No retries permitted until 2026-06-02 16:42:06.298997869 +0000 UTC m=+50.755082108 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert") pod "ingress-canary-lgc2j" (UID: "70235929-1fb6-4b5d-bda3-f77b2899b79c") : secret "canary-serving-cert" not found Jun 02 16:41:58.299187 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:41:58.299053 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls podName:6d6fcc1b-ce7e-4077-a070-269119a8e723 nodeName:}" failed. No retries permitted until 2026-06-02 16:42:06.299045831 +0000 UTC m=+50.755130065 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls") pod "dns-default-7n7dn" (UID: "6d6fcc1b-ce7e-4077-a070-269119a8e723") : secret "dns-default-metrics-tls" not found Jun 02 16:41:58.320878 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:58.320837 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhcjt" event={"ID":"6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed","Type":"ContainerStarted","Data":"6fa2b60f04e621fa65510b47bf60242f4da4796712c1aef9e9613e4c88a54e21"} Jun 02 16:41:58.345298 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:41:58.345242 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fhcjt" podStartSLOduration=4.268824542 podStartE2EDuration="42.345224399s" podCreationTimestamp="2026-06-02 16:41:16 +0000 UTC" firstStartedPulling="2026-06-02 16:41:17.313397662 +0000 UTC m=+1.769481896" lastFinishedPulling="2026-06-02 16:41:55.389797515 +0000 UTC m=+39.845881753" observedRunningTime="2026-06-02 16:41:58.343296885 +0000 UTC m=+42.799381142" watchObservedRunningTime="2026-06-02 16:41:58.345224399 +0000 UTC m=+42.801308695" Jun 02 16:42:06.263272 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:06.263218 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-mfzpt\" (UID: \"2eb49fdc-49ec-4844-a2ed-108e1ad6a300\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt" Jun 02 16:42:06.268826 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:06.263282 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:42:06.268826 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:06.263377 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 16:42:06.268826 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:06.263440 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 16:42:06.268826 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:06.263450 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert podName:2eb49fdc-49ec-4844-a2ed-108e1ad6a300 nodeName:}" failed. No retries permitted until 2026-06-02 16:42:22.263434748 +0000 UTC m=+66.719518983 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-mfzpt" (UID: "2eb49fdc-49ec-4844-a2ed-108e1ad6a300") : secret "networking-console-plugin-cert" not found Jun 02 16:42:06.268826 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:06.263456 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dd754dc-vc928: secret "image-registry-tls" not found Jun 02 16:42:06.268826 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:06.263509 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls podName:83ffe287-d220-41cd-a102-77b8029422ea nodeName:}" failed. No retries permitted until 2026-06-02 16:42:22.263492851 +0000 UTC m=+66.719577086 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls") pod "image-registry-5dd754dc-vc928" (UID: "83ffe287-d220-41cd-a102-77b8029422ea") : secret "image-registry-tls" not found Jun 02 16:42:06.364461 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:06.364417 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls\") pod \"dns-default-7n7dn\" (UID: \"6d6fcc1b-ce7e-4077-a070-269119a8e723\") " pod="openshift-dns/dns-default-7n7dn" Jun 02 16:42:06.364674 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:06.364509 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert\") pod \"ingress-canary-lgc2j\" (UID: \"70235929-1fb6-4b5d-bda3-f77b2899b79c\") " pod="openshift-ingress-canary/ingress-canary-lgc2j" Jun 02 16:42:06.364674 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:06.364586 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:42:06.364674 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:06.364595 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:42:06.364674 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:06.364652 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert podName:70235929-1fb6-4b5d-bda3-f77b2899b79c nodeName:}" failed. No retries permitted until 2026-06-02 16:42:22.36463761 +0000 UTC m=+66.820721845 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert") pod "ingress-canary-lgc2j" (UID: "70235929-1fb6-4b5d-bda3-f77b2899b79c") : secret "canary-serving-cert" not found Jun 02 16:42:06.364674 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:06.364666 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls podName:6d6fcc1b-ce7e-4077-a070-269119a8e723 nodeName:}" failed. No retries permitted until 2026-06-02 16:42:22.364659759 +0000 UTC m=+66.820743993 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls") pod "dns-default-7n7dn" (UID: "6d6fcc1b-ce7e-4077-a070-269119a8e723") : secret "dns-default-metrics-tls" not found Jun 02 16:42:16.296500 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:16.296468 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7sjt8" Jun 02 16:42:20.787107 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:20.787064 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gfqfh\" (UniqueName: \"kubernetes.io/projected/4505a0c0-1c04-42cd-b0ab-cc964485cef7-kube-api-access-gfqfh\") pod \"network-check-target-vgkxp\" (UID: \"4505a0c0-1c04-42cd-b0ab-cc964485cef7\") " pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:42:20.787107 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:20.787113 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs\") pod \"network-metrics-daemon-5p7z4\" (UID: \"ab630523-7064-4dc5-a730-7b6b06551777\") " pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:42:20.790001 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:20.789982 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 16:42:20.791134 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:20.791113 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfqfh\" (UniqueName: \"kubernetes.io/projected/4505a0c0-1c04-42cd-b0ab-cc964485cef7-kube-api-access-gfqfh\") pod \"network-check-target-vgkxp\" (UID: \"4505a0c0-1c04-42cd-b0ab-cc964485cef7\") " pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:42:20.798289 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:20.798264 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 16:42:20.798406 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:20.798338 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs podName:ab630523-7064-4dc5-a730-7b6b06551777 nodeName:}" failed. No retries permitted until 2026-06-02 16:43:24.798315339 +0000 UTC m=+129.254399588 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs") pod "network-metrics-daemon-5p7z4" (UID: "ab630523-7064-4dc5-a730-7b6b06551777") : secret "metrics-daemon-secret" not found Jun 02 16:42:20.877169 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:20.877138 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-729km\"" Jun 02 16:42:20.884186 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:20.884164 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:42:21.031503 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:21.031455 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vgkxp"] Jun 02 16:42:21.036067 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:42:21.036032 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4505a0c0_1c04_42cd_b0ab_cc964485cef7.slice/crio-7d23fcb09913599d32ce94a632aeb81334052b9e5b746be491dd2de66577bdb1 WatchSource:0}: Error finding container 7d23fcb09913599d32ce94a632aeb81334052b9e5b746be491dd2de66577bdb1: Status 404 returned error can't find the container with id 7d23fcb09913599d32ce94a632aeb81334052b9e5b746be491dd2de66577bdb1 Jun 02 16:42:21.369263 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:21.369166 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vgkxp" event={"ID":"4505a0c0-1c04-42cd-b0ab-cc964485cef7","Type":"ContainerStarted","Data":"90a731254b126a3f175e96be725ddf54af3ebaf5b1aa2b8808a1756ad3d46a15"} Jun 02 16:42:21.369263 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:21.369205 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vgkxp" event={"ID":"4505a0c0-1c04-42cd-b0ab-cc964485cef7","Type":"ContainerStarted","Data":"7d23fcb09913599d32ce94a632aeb81334052b9e5b746be491dd2de66577bdb1"} Jun 02 16:42:21.369454 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:21.369275 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:42:21.388953 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:21.388902 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vgkxp" podStartSLOduration=65.388889189 podStartE2EDuration="1m5.388889189s" podCreationTimestamp="2026-06-02 16:41:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:42:21.388318675 +0000 UTC m=+65.844402931" watchObservedRunningTime="2026-06-02 16:42:21.388889189 +0000 UTC m=+65.844973446" Jun 02 16:42:21.494962 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:21.494920 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/749a190a-f808-49fc-8cd2-81342e6da38b-original-pull-secret\") pod \"global-pull-secret-syncer-fbqmz\" (UID: \"749a190a-f808-49fc-8cd2-81342e6da38b\") " pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:42:21.497807 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:21.497785 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 16:42:21.508205 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:21.508173 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/749a190a-f808-49fc-8cd2-81342e6da38b-original-pull-secret\") pod \"global-pull-secret-syncer-fbqmz\" (UID: \"749a190a-f808-49fc-8cd2-81342e6da38b\") " pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:42:21.765252 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:21.765200 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fbqmz" Jun 02 16:42:21.902842 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:21.902810 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fbqmz"] Jun 02 16:42:21.906402 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:42:21.906371 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod749a190a_f808_49fc_8cd2_81342e6da38b.slice/crio-c58d9216949146a49cf2832bf89c637cfc2444fde64af265737ce814b4c52dc8 WatchSource:0}: Error finding container c58d9216949146a49cf2832bf89c637cfc2444fde64af265737ce814b4c52dc8: Status 404 returned error can't find the container with id c58d9216949146a49cf2832bf89c637cfc2444fde64af265737ce814b4c52dc8 Jun 02 16:42:22.302298 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:22.302256 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:42:22.302507 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:22.302340 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-mfzpt\" (UID: \"2eb49fdc-49ec-4844-a2ed-108e1ad6a300\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt" Jun 02 16:42:22.302507 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:22.302418 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 16:42:22.302507 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:22.302437 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 16:42:22.302507 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:22.302440 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dd754dc-vc928: secret "image-registry-tls" not found Jun 02 16:42:22.302633 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:22.302530 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls podName:83ffe287-d220-41cd-a102-77b8029422ea nodeName:}" failed. No retries permitted until 2026-06-02 16:42:54.302480729 +0000 UTC m=+98.758564967 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls") pod "image-registry-5dd754dc-vc928" (UID: "83ffe287-d220-41cd-a102-77b8029422ea") : secret "image-registry-tls" not found Jun 02 16:42:22.302633 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:22.302546 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert podName:2eb49fdc-49ec-4844-a2ed-108e1ad6a300 nodeName:}" failed. No retries permitted until 2026-06-02 16:42:54.302538455 +0000 UTC m=+98.758622693 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-mfzpt" (UID: "2eb49fdc-49ec-4844-a2ed-108e1ad6a300") : secret "networking-console-plugin-cert" not found Jun 02 16:42:22.372752 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:22.372711 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fbqmz" event={"ID":"749a190a-f808-49fc-8cd2-81342e6da38b","Type":"ContainerStarted","Data":"c58d9216949146a49cf2832bf89c637cfc2444fde64af265737ce814b4c52dc8"} Jun 02 16:42:22.403437 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:22.403404 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert\") pod \"ingress-canary-lgc2j\" (UID: \"70235929-1fb6-4b5d-bda3-f77b2899b79c\") " pod="openshift-ingress-canary/ingress-canary-lgc2j" Jun 02 16:42:22.403630 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:22.403479 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls\") pod \"dns-default-7n7dn\" (UID: \"6d6fcc1b-ce7e-4077-a070-269119a8e723\") " pod="openshift-dns/dns-default-7n7dn" Jun 02 16:42:22.403630 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:22.403606 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:42:22.403710 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:22.403661 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls podName:6d6fcc1b-ce7e-4077-a070-269119a8e723 nodeName:}" failed. No retries permitted until 2026-06-02 16:42:54.403647495 +0000 UTC m=+98.859731730 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls") pod "dns-default-7n7dn" (UID: "6d6fcc1b-ce7e-4077-a070-269119a8e723") : secret "dns-default-metrics-tls" not found Jun 02 16:42:22.403889 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:22.403860 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:42:22.404023 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:22.403925 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert podName:70235929-1fb6-4b5d-bda3-f77b2899b79c nodeName:}" failed. No retries permitted until 2026-06-02 16:42:54.403909838 +0000 UTC m=+98.859994073 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert") pod "ingress-canary-lgc2j" (UID: "70235929-1fb6-4b5d-bda3-f77b2899b79c") : secret "canary-serving-cert" not found Jun 02 16:42:27.383393 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:27.383356 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fbqmz" event={"ID":"749a190a-f808-49fc-8cd2-81342e6da38b","Type":"ContainerStarted","Data":"40a0f4e75fcb534ed7c3ae70adc888392f8ffb0c2a8389e5d9da5269311f1184"} Jun 02 16:42:27.400180 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:27.400135 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fbqmz" podStartSLOduration=65.272111854 podStartE2EDuration="1m10.400120943s" podCreationTimestamp="2026-06-02 16:41:17 +0000 UTC" firstStartedPulling="2026-06-02 16:42:21.908325633 +0000 UTC m=+66.364409875" lastFinishedPulling="2026-06-02 16:42:27.036334725 +0000 UTC m=+71.492418964" observedRunningTime="2026-06-02 16:42:27.399591973 +0000 UTC m=+71.855676230" watchObservedRunningTime="2026-06-02 16:42:27.400120943 +0000 UTC m=+71.856205197" Jun 02 16:42:52.375051 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:52.374917 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vgkxp" Jun 02 16:42:54.344466 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:54.344432 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-mfzpt\" (UID: \"2eb49fdc-49ec-4844-a2ed-108e1ad6a300\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt" Jun 02 16:42:54.344886 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:54.344492 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:42:54.344886 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:54.344583 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 16:42:54.344886 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:54.344622 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 16:42:54.344886 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:54.344637 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dd754dc-vc928: secret "image-registry-tls" not found Jun 02 16:42:54.344886 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:54.344646 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert podName:2eb49fdc-49ec-4844-a2ed-108e1ad6a300 nodeName:}" failed. No retries permitted until 2026-06-02 16:43:58.344631337 +0000 UTC m=+162.800715579 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-mfzpt" (UID: "2eb49fdc-49ec-4844-a2ed-108e1ad6a300") : secret "networking-console-plugin-cert" not found Jun 02 16:42:54.344886 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:54.344687 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls podName:83ffe287-d220-41cd-a102-77b8029422ea nodeName:}" failed. No retries permitted until 2026-06-02 16:43:58.344670136 +0000 UTC m=+162.800754385 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls") pod "image-registry-5dd754dc-vc928" (UID: "83ffe287-d220-41cd-a102-77b8029422ea") : secret "image-registry-tls" not found Jun 02 16:42:54.445369 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:54.445338 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls\") pod \"dns-default-7n7dn\" (UID: \"6d6fcc1b-ce7e-4077-a070-269119a8e723\") " pod="openshift-dns/dns-default-7n7dn" Jun 02 16:42:54.445523 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:42:54.445393 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert\") pod \"ingress-canary-lgc2j\" (UID: \"70235929-1fb6-4b5d-bda3-f77b2899b79c\") " pod="openshift-ingress-canary/ingress-canary-lgc2j" Jun 02 16:42:54.445523 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:54.445470 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:42:54.445523 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:54.445477 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:42:54.445523 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:54.445516 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert podName:70235929-1fb6-4b5d-bda3-f77b2899b79c nodeName:}" failed. No retries permitted until 2026-06-02 16:43:58.445503363 +0000 UTC m=+162.901587597 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert") pod "ingress-canary-lgc2j" (UID: "70235929-1fb6-4b5d-bda3-f77b2899b79c") : secret "canary-serving-cert" not found Jun 02 16:42:54.445676 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:42:54.445537 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls podName:6d6fcc1b-ce7e-4077-a070-269119a8e723 nodeName:}" failed. No retries permitted until 2026-06-02 16:43:58.445520734 +0000 UTC m=+162.901604968 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls") pod "dns-default-7n7dn" (UID: "6d6fcc1b-ce7e-4077-a070-269119a8e723") : secret "dns-default-metrics-tls" not found Jun 02 16:43:24.874870 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:24.874801 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs\") pod \"network-metrics-daemon-5p7z4\" (UID: \"ab630523-7064-4dc5-a730-7b6b06551777\") " pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:43:24.875426 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:43:24.874950 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 16:43:24.875426 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:43:24.875045 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs podName:ab630523-7064-4dc5-a730-7b6b06551777 nodeName:}" failed. No retries permitted until 2026-06-02 16:45:26.875027644 +0000 UTC m=+251.331111892 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs") pod "network-metrics-daemon-5p7z4" (UID: "ab630523-7064-4dc5-a730-7b6b06551777") : secret "metrics-daemon-secret" not found Jun 02 16:43:53.437077 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:43:53.437030 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5dd754dc-vc928" podUID="83ffe287-d220-41cd-a102-77b8029422ea" Jun 02 16:43:53.444194 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:43:53.444161 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt" podUID="2eb49fdc-49ec-4844-a2ed-108e1ad6a300" Jun 02 16:43:53.468348 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:43:53.468309 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7n7dn" podUID="6d6fcc1b-ce7e-4077-a070-269119a8e723" Jun 02 16:43:53.475449 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:43:53.475426 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-lgc2j" podUID="70235929-1fb6-4b5d-bda3-f77b2899b79c" Jun 02 16:43:53.551122 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:53.551096 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:43:53.551218 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:53.551119 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt" Jun 02 16:43:53.551218 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:53.551119 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7n7dn" Jun 02 16:43:53.551218 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:53.551105 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lgc2j" Jun 02 16:43:55.058935 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:43:55.058896 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5p7z4" podUID="ab630523-7064-4dc5-a730-7b6b06551777" Jun 02 16:43:58.416303 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:58.416260 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:43:58.416776 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:58.416365 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-mfzpt\" (UID: \"2eb49fdc-49ec-4844-a2ed-108e1ad6a300\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt" Jun 02 16:43:58.416776 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:43:58.416427 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 16:43:58.416776 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:43:58.416452 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 16:43:58.416776 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:43:58.416452 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dd754dc-vc928: secret "image-registry-tls" not found Jun 02 16:43:58.416776 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:43:58.416514 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert podName:2eb49fdc-49ec-4844-a2ed-108e1ad6a300 nodeName:}" failed. No retries permitted until 2026-06-02 16:46:00.416499603 +0000 UTC m=+284.872583838 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-mfzpt" (UID: "2eb49fdc-49ec-4844-a2ed-108e1ad6a300") : secret "networking-console-plugin-cert" not found Jun 02 16:43:58.416776 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:43:58.416527 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls podName:83ffe287-d220-41cd-a102-77b8029422ea nodeName:}" failed. No retries permitted until 2026-06-02 16:46:00.416520341 +0000 UTC m=+284.872604575 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls") pod "image-registry-5dd754dc-vc928" (UID: "83ffe287-d220-41cd-a102-77b8029422ea") : secret "image-registry-tls" not found Jun 02 16:43:58.516832 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:58.516782 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert\") pod \"ingress-canary-lgc2j\" (UID: \"70235929-1fb6-4b5d-bda3-f77b2899b79c\") " pod="openshift-ingress-canary/ingress-canary-lgc2j" Jun 02 16:43:58.517063 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:58.516883 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls\") pod \"dns-default-7n7dn\" (UID: \"6d6fcc1b-ce7e-4077-a070-269119a8e723\") " pod="openshift-dns/dns-default-7n7dn" Jun 02 16:43:58.517063 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:43:58.516933 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:43:58.517063 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:43:58.517029 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert podName:70235929-1fb6-4b5d-bda3-f77b2899b79c nodeName:}" failed. No retries permitted until 2026-06-02 16:46:00.516990758 +0000 UTC m=+284.973074993 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert") pod "ingress-canary-lgc2j" (UID: "70235929-1fb6-4b5d-bda3-f77b2899b79c") : secret "canary-serving-cert" not found Jun 02 16:43:58.517063 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:43:58.517037 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:43:58.517228 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:43:58.517089 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls podName:6d6fcc1b-ce7e-4077-a070-269119a8e723 nodeName:}" failed. No retries permitted until 2026-06-02 16:46:00.51707263 +0000 UTC m=+284.973156865 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls") pod "dns-default-7n7dn" (UID: "6d6fcc1b-ce7e-4077-a070-269119a8e723") : secret "dns-default-metrics-tls" not found Jun 02 16:43:58.957934 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:58.957902 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5dc97c89b5-hx4vl"] Jun 02 16:43:58.960257 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:58.960239 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-vlq2q"] Jun 02 16:43:58.960400 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:58.960380 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:43:58.962817 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:58.962798 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" Jun 02 16:43:58.963523 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:58.963474 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 02 16:43:58.963523 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:58.963498 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 02 16:43:58.963724 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:58.963712 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cztzr\"" Jun 02 16:43:58.963777 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:58.963746 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 02 16:43:58.963938 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:58.963926 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 02 16:43:58.964708 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:58.964692 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 16:43:58.965112 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:58.965094 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 16:43:58.965200 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:58.965143 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 02 16:43:58.965269 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:58.965252 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 02 16:43:58.965364 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:58.965348 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-8gfbc\"" Jun 02 16:43:58.965415 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:58.965355 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 02 16:43:58.965614 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:58.965596 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 02 16:43:58.985326 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:58.985305 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 02 16:43:58.989427 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:58.989403 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5dc97c89b5-hx4vl"] Jun 02 16:43:58.990068 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:58.990053 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-vlq2q"] Jun 02 16:43:59.053035 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.052994 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-svlz4"] Jun 02 16:43:59.055788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.055774 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-svlz4" Jun 02 16:43:59.058310 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.058284 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vkpjk\"" Jun 02 16:43:59.058310 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.058302 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 02 16:43:59.058457 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.058293 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 02 16:43:59.065230 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.065210 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-svlz4"] Jun 02 16:43:59.120349 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.120312 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtd4g\" (UniqueName: \"kubernetes.io/projected/f7b90812-e229-4aef-99c0-185f0d0f7d67-kube-api-access-xtd4g\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:43:59.120508 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.120403 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43709aef-aafc-4d89-b794-916480842d72-serving-cert\") pod \"console-operator-86d7c6cc77-vlq2q\" (UID: \"43709aef-aafc-4d89-b794-916480842d72\") " pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" Jun 02 16:43:59.120508 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.120422 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7b90812-e229-4aef-99c0-185f0d0f7d67-service-ca-bundle\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:43:59.120508 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.120440 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43709aef-aafc-4d89-b794-916480842d72-config\") pod \"console-operator-86d7c6cc77-vlq2q\" (UID: \"43709aef-aafc-4d89-b794-916480842d72\") " pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" Jun 02 16:43:59.120618 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.120604 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/43709aef-aafc-4d89-b794-916480842d72-trusted-ca\") pod \"console-operator-86d7c6cc77-vlq2q\" (UID: \"43709aef-aafc-4d89-b794-916480842d72\") " pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" Jun 02 16:43:59.120657 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.120642 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-metrics-certs\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:43:59.120721 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.120708 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-default-certificate\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:43:59.120763 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.120738 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw9zz\" (UniqueName: \"kubernetes.io/projected/43709aef-aafc-4d89-b794-916480842d72-kube-api-access-zw9zz\") pod \"console-operator-86d7c6cc77-vlq2q\" (UID: \"43709aef-aafc-4d89-b794-916480842d72\") " pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" Jun 02 16:43:59.120763 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.120757 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-stats-auth\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:43:59.221778 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.221679 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-default-certificate\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:43:59.221778 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.221716 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-stats-auth\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:43:59.221778 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.221739 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43709aef-aafc-4d89-b794-916480842d72-serving-cert\") pod \"console-operator-86d7c6cc77-vlq2q\" (UID: \"43709aef-aafc-4d89-b794-916480842d72\") " pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" Jun 02 16:43:59.221778 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.221770 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7b90812-e229-4aef-99c0-185f0d0f7d67-service-ca-bundle\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:43:59.222127 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.221790 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43709aef-aafc-4d89-b794-916480842d72-config\") pod \"console-operator-86d7c6cc77-vlq2q\" (UID: \"43709aef-aafc-4d89-b794-916480842d72\") " pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" Jun 02 16:43:59.222127 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.221809 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/43709aef-aafc-4d89-b794-916480842d72-trusted-ca\") pod \"console-operator-86d7c6cc77-vlq2q\" (UID: \"43709aef-aafc-4d89-b794-916480842d72\") " pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" Jun 02 16:43:59.222127 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.221827 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-metrics-certs\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:43:59.222127 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.221858 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xtd4g\" (UniqueName: \"kubernetes.io/projected/f7b90812-e229-4aef-99c0-185f0d0f7d67-kube-api-access-xtd4g\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:43:59.222127 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.221884 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fjdh\" (UniqueName: \"kubernetes.io/projected/a2da4cf1-b407-41f1-8bd9-1b99c2a66aab-kube-api-access-5fjdh\") pod \"volume-data-source-validator-7598fd5bd-svlz4\" (UID: \"a2da4cf1-b407-41f1-8bd9-1b99c2a66aab\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-svlz4" Jun 02 16:43:59.222127 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:43:59.221987 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7b90812-e229-4aef-99c0-185f0d0f7d67-service-ca-bundle podName:f7b90812-e229-4aef-99c0-185f0d0f7d67 nodeName:}" failed. No retries permitted until 2026-06-02 16:43:59.721963504 +0000 UTC m=+164.178047742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f7b90812-e229-4aef-99c0-185f0d0f7d67-service-ca-bundle") pod "router-default-5dc97c89b5-hx4vl" (UID: "f7b90812-e229-4aef-99c0-185f0d0f7d67") : configmap references non-existent config key: service-ca.crt Jun 02 16:43:59.222441 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.222142 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zw9zz\" (UniqueName: \"kubernetes.io/projected/43709aef-aafc-4d89-b794-916480842d72-kube-api-access-zw9zz\") pod \"console-operator-86d7c6cc77-vlq2q\" (UID: \"43709aef-aafc-4d89-b794-916480842d72\") " pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" Jun 02 16:43:59.222441 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:43:59.222184 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 16:43:59.222441 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:43:59.222323 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-metrics-certs podName:f7b90812-e229-4aef-99c0-185f0d0f7d67 nodeName:}" failed. No retries permitted until 2026-06-02 16:43:59.722231788 +0000 UTC m=+164.178316025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-metrics-certs") pod "router-default-5dc97c89b5-hx4vl" (UID: "f7b90812-e229-4aef-99c0-185f0d0f7d67") : secret "router-metrics-certs-default" not found Jun 02 16:43:59.222766 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.222750 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43709aef-aafc-4d89-b794-916480842d72-config\") pod \"console-operator-86d7c6cc77-vlq2q\" (UID: \"43709aef-aafc-4d89-b794-916480842d72\") " pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" Jun 02 16:43:59.223028 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.222988 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/43709aef-aafc-4d89-b794-916480842d72-trusted-ca\") pod \"console-operator-86d7c6cc77-vlq2q\" (UID: \"43709aef-aafc-4d89-b794-916480842d72\") " pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" Jun 02 16:43:59.224620 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.224593 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-default-certificate\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:43:59.224763 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.224746 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43709aef-aafc-4d89-b794-916480842d72-serving-cert\") pod \"console-operator-86d7c6cc77-vlq2q\" (UID: \"43709aef-aafc-4d89-b794-916480842d72\") " pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" Jun 02 16:43:59.224921 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.224903 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-stats-auth\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:43:59.230582 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.230556 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw9zz\" (UniqueName: \"kubernetes.io/projected/43709aef-aafc-4d89-b794-916480842d72-kube-api-access-zw9zz\") pod \"console-operator-86d7c6cc77-vlq2q\" (UID: \"43709aef-aafc-4d89-b794-916480842d72\") " pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" Jun 02 16:43:59.230677 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.230666 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtd4g\" (UniqueName: \"kubernetes.io/projected/f7b90812-e229-4aef-99c0-185f0d0f7d67-kube-api-access-xtd4g\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:43:59.275087 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.275048 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" Jun 02 16:43:59.322758 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.322723 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5fjdh\" (UniqueName: \"kubernetes.io/projected/a2da4cf1-b407-41f1-8bd9-1b99c2a66aab-kube-api-access-5fjdh\") pod \"volume-data-source-validator-7598fd5bd-svlz4\" (UID: \"a2da4cf1-b407-41f1-8bd9-1b99c2a66aab\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-svlz4" Jun 02 16:43:59.332171 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.332106 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fjdh\" (UniqueName: \"kubernetes.io/projected/a2da4cf1-b407-41f1-8bd9-1b99c2a66aab-kube-api-access-5fjdh\") pod \"volume-data-source-validator-7598fd5bd-svlz4\" (UID: \"a2da4cf1-b407-41f1-8bd9-1b99c2a66aab\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-svlz4" Jun 02 16:43:59.363399 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.363370 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-svlz4" Jun 02 16:43:59.400107 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.400075 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-vlq2q"] Jun 02 16:43:59.404220 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:43:59.404180 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43709aef_aafc_4d89_b794_916480842d72.slice/crio-d49baff71be7cab6b818ad3b1e22b36c6c622a6beac79e6a70195548da31a38c WatchSource:0}: Error finding container d49baff71be7cab6b818ad3b1e22b36c6c622a6beac79e6a70195548da31a38c: Status 404 returned error can't find the container with id d49baff71be7cab6b818ad3b1e22b36c6c622a6beac79e6a70195548da31a38c Jun 02 16:43:59.485744 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.485648 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-svlz4"] Jun 02 16:43:59.490439 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:43:59.490412 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2da4cf1_b407_41f1_8bd9_1b99c2a66aab.slice/crio-c3eb093447bc4f6fc3ee2fb91f9ee769acc8c5aa702f3aafc07ea84de09397e0 WatchSource:0}: Error finding container c3eb093447bc4f6fc3ee2fb91f9ee769acc8c5aa702f3aafc07ea84de09397e0: Status 404 returned error can't find the container with id c3eb093447bc4f6fc3ee2fb91f9ee769acc8c5aa702f3aafc07ea84de09397e0 Jun 02 16:43:59.562503 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.562463 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-svlz4" event={"ID":"a2da4cf1-b407-41f1-8bd9-1b99c2a66aab","Type":"ContainerStarted","Data":"c3eb093447bc4f6fc3ee2fb91f9ee769acc8c5aa702f3aafc07ea84de09397e0"} Jun 02 16:43:59.563442 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.563416 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" event={"ID":"43709aef-aafc-4d89-b794-916480842d72","Type":"ContainerStarted","Data":"d49baff71be7cab6b818ad3b1e22b36c6c622a6beac79e6a70195548da31a38c"} Jun 02 16:43:59.724914 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.724879 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-metrics-certs\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:43:59.725123 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:43:59.725059 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 16:43:59.725173 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:43:59.725065 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7b90812-e229-4aef-99c0-185f0d0f7d67-service-ca-bundle\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:43:59.725173 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:43:59.725138 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-metrics-certs podName:f7b90812-e229-4aef-99c0-185f0d0f7d67 nodeName:}" failed. No retries permitted until 2026-06-02 16:44:00.725122725 +0000 UTC m=+165.181206960 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-metrics-certs") pod "router-default-5dc97c89b5-hx4vl" (UID: "f7b90812-e229-4aef-99c0-185f0d0f7d67") : secret "router-metrics-certs-default" not found Jun 02 16:43:59.725261 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:43:59.725184 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7b90812-e229-4aef-99c0-185f0d0f7d67-service-ca-bundle podName:f7b90812-e229-4aef-99c0-185f0d0f7d67 nodeName:}" failed. No retries permitted until 2026-06-02 16:44:00.72516184 +0000 UTC m=+165.181246076 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f7b90812-e229-4aef-99c0-185f0d0f7d67-service-ca-bundle") pod "router-default-5dc97c89b5-hx4vl" (UID: "f7b90812-e229-4aef-99c0-185f0d0f7d67") : configmap references non-existent config key: service-ca.crt Jun 02 16:44:00.735416 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:00.735381 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7b90812-e229-4aef-99c0-185f0d0f7d67-service-ca-bundle\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:44:00.735802 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:00.735442 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-metrics-certs\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:44:00.735802 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:44:00.735565 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7b90812-e229-4aef-99c0-185f0d0f7d67-service-ca-bundle podName:f7b90812-e229-4aef-99c0-185f0d0f7d67 nodeName:}" failed. No retries permitted until 2026-06-02 16:44:02.735550211 +0000 UTC m=+167.191634446 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f7b90812-e229-4aef-99c0-185f0d0f7d67-service-ca-bundle") pod "router-default-5dc97c89b5-hx4vl" (UID: "f7b90812-e229-4aef-99c0-185f0d0f7d67") : configmap references non-existent config key: service-ca.crt Jun 02 16:44:00.735802 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:44:00.735625 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 16:44:00.735802 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:44:00.735700 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-metrics-certs podName:f7b90812-e229-4aef-99c0-185f0d0f7d67 nodeName:}" failed. No retries permitted until 2026-06-02 16:44:02.735680842 +0000 UTC m=+167.191765099 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-metrics-certs") pod "router-default-5dc97c89b5-hx4vl" (UID: "f7b90812-e229-4aef-99c0-185f0d0f7d67") : secret "router-metrics-certs-default" not found Jun 02 16:44:01.568960 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:01.568926 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-svlz4" event={"ID":"a2da4cf1-b407-41f1-8bd9-1b99c2a66aab","Type":"ContainerStarted","Data":"b81cf1c65f2052d7cea17391a971c8fe7ab4746df4bdd4038efe37ad9d9e0131"} Jun 02 16:44:01.585881 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:01.585837 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-svlz4" podStartSLOduration=1.021617201 podStartE2EDuration="2.585821314s" podCreationTimestamp="2026-06-02 16:43:59 +0000 UTC" firstStartedPulling="2026-06-02 16:43:59.492196714 +0000 UTC m=+163.948280949" lastFinishedPulling="2026-06-02 16:44:01.05640082 +0000 UTC m=+165.512485062" observedRunningTime="2026-06-02 16:44:01.584798297 +0000 UTC m=+166.040882566" watchObservedRunningTime="2026-06-02 16:44:01.585821314 +0000 UTC m=+166.041905587" Jun 02 16:44:02.574087 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:02.574052 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" event={"ID":"43709aef-aafc-4d89-b794-916480842d72","Type":"ContainerStarted","Data":"992be182506aa7ab2200b9d4c588542684ec189bc23854232de33011066a0824"} Jun 02 16:44:02.574521 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:02.574364 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" Jun 02 16:44:02.575764 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:02.575739 2565 patch_prober.go:28] interesting pod/console-operator-86d7c6cc77-vlq2q container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.12:8443/readyz\": dial tcp 10.132.0.12:8443: connect: connection refused" start-of-body= Jun 02 16:44:02.575871 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:02.575785 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" podUID="43709aef-aafc-4d89-b794-916480842d72" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.12:8443/readyz\": dial tcp 10.132.0.12:8443: connect: connection refused" Jun 02 16:44:02.591764 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:02.591721 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" podStartSLOduration=1.507183376 podStartE2EDuration="4.591708613s" podCreationTimestamp="2026-06-02 16:43:58 +0000 UTC" firstStartedPulling="2026-06-02 16:43:59.406141092 +0000 UTC m=+163.862225328" lastFinishedPulling="2026-06-02 16:44:02.490666329 +0000 UTC m=+166.946750565" observedRunningTime="2026-06-02 16:44:02.590949211 +0000 UTC m=+167.047033468" watchObservedRunningTime="2026-06-02 16:44:02.591708613 +0000 UTC m=+167.047792869" Jun 02 16:44:02.752607 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:02.752499 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-metrics-certs\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:44:02.752777 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:44:02.752681 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 16:44:02.752863 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:02.752840 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7b90812-e229-4aef-99c0-185f0d0f7d67-service-ca-bundle\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:44:02.752917 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:44:02.752874 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-metrics-certs podName:f7b90812-e229-4aef-99c0-185f0d0f7d67 nodeName:}" failed. No retries permitted until 2026-06-02 16:44:06.75282988 +0000 UTC m=+171.208914120 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-metrics-certs") pod "router-default-5dc97c89b5-hx4vl" (UID: "f7b90812-e229-4aef-99c0-185f0d0f7d67") : secret "router-metrics-certs-default" not found Jun 02 16:44:02.752978 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:44:02.752935 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7b90812-e229-4aef-99c0-185f0d0f7d67-service-ca-bundle podName:f7b90812-e229-4aef-99c0-185f0d0f7d67 nodeName:}" failed. No retries permitted until 2026-06-02 16:44:06.752923428 +0000 UTC m=+171.209007663 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f7b90812-e229-4aef-99c0-185f0d0f7d67-service-ca-bundle") pod "router-default-5dc97c89b5-hx4vl" (UID: "f7b90812-e229-4aef-99c0-185f0d0f7d67") : configmap references non-existent config key: service-ca.crt Jun 02 16:44:03.578000 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:03.577973 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vlq2q_43709aef-aafc-4d89-b794-916480842d72/console-operator/0.log" Jun 02 16:44:03.578384 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:03.578028 2565 generic.go:358] "Generic (PLEG): container finished" podID="43709aef-aafc-4d89-b794-916480842d72" containerID="992be182506aa7ab2200b9d4c588542684ec189bc23854232de33011066a0824" exitCode=255 Jun 02 16:44:03.578384 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:03.578067 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" event={"ID":"43709aef-aafc-4d89-b794-916480842d72","Type":"ContainerDied","Data":"992be182506aa7ab2200b9d4c588542684ec189bc23854232de33011066a0824"} Jun 02 16:44:03.578384 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:03.578314 2565 scope.go:117] "RemoveContainer" containerID="992be182506aa7ab2200b9d4c588542684ec189bc23854232de33011066a0824" Jun 02 16:44:04.581507 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:04.581480 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vlq2q_43709aef-aafc-4d89-b794-916480842d72/console-operator/1.log" Jun 02 16:44:04.581971 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:04.581854 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vlq2q_43709aef-aafc-4d89-b794-916480842d72/console-operator/0.log" Jun 02 16:44:04.581971 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:04.581890 2565 generic.go:358] "Generic (PLEG): container finished" podID="43709aef-aafc-4d89-b794-916480842d72" containerID="023f314f3f1e1f1734f4b90a19ebcb0ef17110b8a835198f8e6b02542395398c" exitCode=255 Jun 02 16:44:04.581971 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:04.581924 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" event={"ID":"43709aef-aafc-4d89-b794-916480842d72","Type":"ContainerDied","Data":"023f314f3f1e1f1734f4b90a19ebcb0ef17110b8a835198f8e6b02542395398c"} Jun 02 16:44:04.581971 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:04.581969 2565 scope.go:117] "RemoveContainer" containerID="992be182506aa7ab2200b9d4c588542684ec189bc23854232de33011066a0824" Jun 02 16:44:04.582251 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:04.582217 2565 scope.go:117] "RemoveContainer" containerID="023f314f3f1e1f1734f4b90a19ebcb0ef17110b8a835198f8e6b02542395398c" Jun 02 16:44:04.582414 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:44:04.582395 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-vlq2q_openshift-console-operator(43709aef-aafc-4d89-b794-916480842d72)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" podUID="43709aef-aafc-4d89-b794-916480842d72" Jun 02 16:44:05.585974 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:05.585946 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vlq2q_43709aef-aafc-4d89-b794-916480842d72/console-operator/1.log" Jun 02 16:44:05.586360 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:05.586327 2565 scope.go:117] "RemoveContainer" containerID="023f314f3f1e1f1734f4b90a19ebcb0ef17110b8a835198f8e6b02542395398c" Jun 02 16:44:05.586519 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:44:05.586501 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-vlq2q_openshift-console-operator(43709aef-aafc-4d89-b794-916480842d72)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" podUID="43709aef-aafc-4d89-b794-916480842d72" Jun 02 16:44:06.283919 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:06.283890 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xzbtx_7e662b53-0cfd-4ec3-94ee-554c1450e245/dns-node-resolver/0.log" Jun 02 16:44:06.784955 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:06.784910 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7b90812-e229-4aef-99c0-185f0d0f7d67-service-ca-bundle\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:44:06.785409 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:06.784968 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-metrics-certs\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:44:06.785409 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:44:06.785107 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7b90812-e229-4aef-99c0-185f0d0f7d67-service-ca-bundle podName:f7b90812-e229-4aef-99c0-185f0d0f7d67 nodeName:}" failed. No retries permitted until 2026-06-02 16:44:14.785088093 +0000 UTC m=+179.241172330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f7b90812-e229-4aef-99c0-185f0d0f7d67-service-ca-bundle") pod "router-default-5dc97c89b5-hx4vl" (UID: "f7b90812-e229-4aef-99c0-185f0d0f7d67") : configmap references non-existent config key: service-ca.crt Jun 02 16:44:06.785409 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:44:06.785113 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 16:44:06.785409 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:44:06.785214 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-metrics-certs podName:f7b90812-e229-4aef-99c0-185f0d0f7d67 nodeName:}" failed. No retries permitted until 2026-06-02 16:44:14.785162274 +0000 UTC m=+179.241246510 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-metrics-certs") pod "router-default-5dc97c89b5-hx4vl" (UID: "f7b90812-e229-4aef-99c0-185f0d0f7d67") : secret "router-metrics-certs-default" not found Jun 02 16:44:07.084093 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:07.084028 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hhv9c_c231d988-ab86-41d3-be47-375ab32a84c2/node-ca/0.log" Jun 02 16:44:07.312206 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:07.312173 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-hr92z"] Jun 02 16:44:07.316192 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:07.316177 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-hr92z" Jun 02 16:44:07.318209 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:07.318180 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 02 16:44:07.318209 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:07.318188 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 02 16:44:07.318360 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:07.318242 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 02 16:44:07.318360 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:07.318258 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 02 16:44:07.318835 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:07.318819 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-dkfrt\"" Jun 02 16:44:07.323406 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:07.323297 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-hr92z"] Jun 02 16:44:07.490773 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:07.490740 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/17fbf1e8-84ee-4f1f-a505-ca562cd79b91-signing-key\") pod \"service-ca-685df94d57-hr92z\" (UID: \"17fbf1e8-84ee-4f1f-a505-ca562cd79b91\") " pod="openshift-service-ca/service-ca-685df94d57-hr92z" Jun 02 16:44:07.490951 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:07.490793 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/17fbf1e8-84ee-4f1f-a505-ca562cd79b91-signing-cabundle\") pod \"service-ca-685df94d57-hr92z\" (UID: \"17fbf1e8-84ee-4f1f-a505-ca562cd79b91\") " pod="openshift-service-ca/service-ca-685df94d57-hr92z" Jun 02 16:44:07.490951 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:07.490857 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ln77\" (UniqueName: \"kubernetes.io/projected/17fbf1e8-84ee-4f1f-a505-ca562cd79b91-kube-api-access-9ln77\") pod \"service-ca-685df94d57-hr92z\" (UID: \"17fbf1e8-84ee-4f1f-a505-ca562cd79b91\") " pod="openshift-service-ca/service-ca-685df94d57-hr92z" Jun 02 16:44:07.591525 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:07.591487 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/17fbf1e8-84ee-4f1f-a505-ca562cd79b91-signing-key\") pod \"service-ca-685df94d57-hr92z\" (UID: \"17fbf1e8-84ee-4f1f-a505-ca562cd79b91\") " pod="openshift-service-ca/service-ca-685df94d57-hr92z" Jun 02 16:44:07.591700 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:07.591565 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/17fbf1e8-84ee-4f1f-a505-ca562cd79b91-signing-cabundle\") pod \"service-ca-685df94d57-hr92z\" (UID: \"17fbf1e8-84ee-4f1f-a505-ca562cd79b91\") " pod="openshift-service-ca/service-ca-685df94d57-hr92z" Jun 02 16:44:07.591700 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:07.591592 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9ln77\" (UniqueName: \"kubernetes.io/projected/17fbf1e8-84ee-4f1f-a505-ca562cd79b91-kube-api-access-9ln77\") pod \"service-ca-685df94d57-hr92z\" (UID: \"17fbf1e8-84ee-4f1f-a505-ca562cd79b91\") " pod="openshift-service-ca/service-ca-685df94d57-hr92z" Jun 02 16:44:07.592240 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:07.592219 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/17fbf1e8-84ee-4f1f-a505-ca562cd79b91-signing-cabundle\") pod \"service-ca-685df94d57-hr92z\" (UID: \"17fbf1e8-84ee-4f1f-a505-ca562cd79b91\") " pod="openshift-service-ca/service-ca-685df94d57-hr92z" Jun 02 16:44:07.594125 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:07.594093 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/17fbf1e8-84ee-4f1f-a505-ca562cd79b91-signing-key\") pod \"service-ca-685df94d57-hr92z\" (UID: \"17fbf1e8-84ee-4f1f-a505-ca562cd79b91\") " pod="openshift-service-ca/service-ca-685df94d57-hr92z" Jun 02 16:44:07.600445 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:07.600426 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ln77\" (UniqueName: \"kubernetes.io/projected/17fbf1e8-84ee-4f1f-a505-ca562cd79b91-kube-api-access-9ln77\") pod \"service-ca-685df94d57-hr92z\" (UID: \"17fbf1e8-84ee-4f1f-a505-ca562cd79b91\") " pod="openshift-service-ca/service-ca-685df94d57-hr92z" Jun 02 16:44:07.626325 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:07.626298 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-hr92z" Jun 02 16:44:07.746461 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:07.746388 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-hr92z"] Jun 02 16:44:07.750367 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:44:07.750340 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17fbf1e8_84ee_4f1f_a505_ca562cd79b91.slice/crio-6aa9216195c45b3f030b9e72194fb0e3556ea8d0d0d8f6651bc16b9e35e3859e WatchSource:0}: Error finding container 6aa9216195c45b3f030b9e72194fb0e3556ea8d0d0d8f6651bc16b9e35e3859e: Status 404 returned error can't find the container with id 6aa9216195c45b3f030b9e72194fb0e3556ea8d0d0d8f6651bc16b9e35e3859e Jun 02 16:44:08.594331 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:08.594296 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-hr92z" event={"ID":"17fbf1e8-84ee-4f1f-a505-ca562cd79b91","Type":"ContainerStarted","Data":"6aa9216195c45b3f030b9e72194fb0e3556ea8d0d0d8f6651bc16b9e35e3859e"} Jun 02 16:44:09.276195 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:09.276147 2565 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" Jun 02 16:44:09.276581 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:09.276566 2565 scope.go:117] "RemoveContainer" containerID="023f314f3f1e1f1734f4b90a19ebcb0ef17110b8a835198f8e6b02542395398c" Jun 02 16:44:09.276756 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:44:09.276740 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-vlq2q_openshift-console-operator(43709aef-aafc-4d89-b794-916480842d72)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" podUID="43709aef-aafc-4d89-b794-916480842d72" Jun 02 16:44:10.041814 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:10.041776 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:44:10.600476 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:10.600441 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-hr92z" event={"ID":"17fbf1e8-84ee-4f1f-a505-ca562cd79b91","Type":"ContainerStarted","Data":"788addb42251fae5068905644071df273102b695d97654849b9f640aa2cc5486"} Jun 02 16:44:10.620738 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:10.620681 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-hr92z" podStartSLOduration=1.1948194 podStartE2EDuration="3.620666538s" podCreationTimestamp="2026-06-02 16:44:07 +0000 UTC" firstStartedPulling="2026-06-02 16:44:07.752143819 +0000 UTC m=+172.208228058" lastFinishedPulling="2026-06-02 16:44:10.177990957 +0000 UTC m=+174.634075196" observedRunningTime="2026-06-02 16:44:10.619706868 +0000 UTC m=+175.075791125" watchObservedRunningTime="2026-06-02 16:44:10.620666538 +0000 UTC m=+175.076750849" Jun 02 16:44:12.574744 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:12.574707 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" Jun 02 16:44:12.575144 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:12.575105 2565 scope.go:117] "RemoveContainer" containerID="023f314f3f1e1f1734f4b90a19ebcb0ef17110b8a835198f8e6b02542395398c" Jun 02 16:44:12.575292 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:44:12.575274 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-vlq2q_openshift-console-operator(43709aef-aafc-4d89-b794-916480842d72)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" podUID="43709aef-aafc-4d89-b794-916480842d72" Jun 02 16:44:14.848755 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:14.848716 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7b90812-e229-4aef-99c0-185f0d0f7d67-service-ca-bundle\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:44:14.849192 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:14.848767 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-metrics-certs\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:44:14.849192 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:44:14.848873 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 16:44:14.849192 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:44:14.848905 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7b90812-e229-4aef-99c0-185f0d0f7d67-service-ca-bundle podName:f7b90812-e229-4aef-99c0-185f0d0f7d67 nodeName:}" failed. No retries permitted until 2026-06-02 16:44:30.84888338 +0000 UTC m=+195.304967615 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f7b90812-e229-4aef-99c0-185f0d0f7d67-service-ca-bundle") pod "router-default-5dc97c89b5-hx4vl" (UID: "f7b90812-e229-4aef-99c0-185f0d0f7d67") : configmap references non-existent config key: service-ca.crt Jun 02 16:44:14.849192 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:44:14.848927 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-metrics-certs podName:f7b90812-e229-4aef-99c0-185f0d0f7d67 nodeName:}" failed. No retries permitted until 2026-06-02 16:44:30.848917293 +0000 UTC m=+195.305001528 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-metrics-certs") pod "router-default-5dc97c89b5-hx4vl" (UID: "f7b90812-e229-4aef-99c0-185f0d0f7d67") : secret "router-metrics-certs-default" not found Jun 02 16:44:27.041568 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.041535 2565 scope.go:117] "RemoveContainer" containerID="023f314f3f1e1f1734f4b90a19ebcb0ef17110b8a835198f8e6b02542395398c" Jun 02 16:44:27.238708 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.238670 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ncs5x"] Jun 02 16:44:27.242444 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.242428 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ncs5x" Jun 02 16:44:27.245310 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.245286 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 16:44:27.245436 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.245289 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 16:44:27.245436 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.245345 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 16:44:27.245436 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.245344 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 16:44:27.245436 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.245344 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8m8cx\"" Jun 02 16:44:27.258895 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.258874 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ncs5x"] Jun 02 16:44:27.348778 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.348692 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjtn4\" (UniqueName: \"kubernetes.io/projected/db5c22b8-bea8-4f56-856a-2319a51a896f-kube-api-access-qjtn4\") pod \"insights-runtime-extractor-ncs5x\" (UID: \"db5c22b8-bea8-4f56-856a-2319a51a896f\") " pod="openshift-insights/insights-runtime-extractor-ncs5x" Jun 02 16:44:27.348778 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.348734 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/db5c22b8-bea8-4f56-856a-2319a51a896f-data-volume\") pod \"insights-runtime-extractor-ncs5x\" (UID: \"db5c22b8-bea8-4f56-856a-2319a51a896f\") " pod="openshift-insights/insights-runtime-extractor-ncs5x" Jun 02 16:44:27.348778 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.348766 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/db5c22b8-bea8-4f56-856a-2319a51a896f-crio-socket\") pod \"insights-runtime-extractor-ncs5x\" (UID: \"db5c22b8-bea8-4f56-856a-2319a51a896f\") " pod="openshift-insights/insights-runtime-extractor-ncs5x" Jun 02 16:44:27.349005 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.348837 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db5c22b8-bea8-4f56-856a-2319a51a896f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ncs5x\" (UID: \"db5c22b8-bea8-4f56-856a-2319a51a896f\") " pod="openshift-insights/insights-runtime-extractor-ncs5x" Jun 02 16:44:27.349005 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.348954 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db5c22b8-bea8-4f56-856a-2319a51a896f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ncs5x\" (UID: \"db5c22b8-bea8-4f56-856a-2319a51a896f\") " pod="openshift-insights/insights-runtime-extractor-ncs5x" Jun 02 16:44:27.449901 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.449864 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjtn4\" (UniqueName: \"kubernetes.io/projected/db5c22b8-bea8-4f56-856a-2319a51a896f-kube-api-access-qjtn4\") pod \"insights-runtime-extractor-ncs5x\" (UID: \"db5c22b8-bea8-4f56-856a-2319a51a896f\") " pod="openshift-insights/insights-runtime-extractor-ncs5x" Jun 02 16:44:27.449901 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.449909 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/db5c22b8-bea8-4f56-856a-2319a51a896f-data-volume\") pod \"insights-runtime-extractor-ncs5x\" (UID: \"db5c22b8-bea8-4f56-856a-2319a51a896f\") " pod="openshift-insights/insights-runtime-extractor-ncs5x" Jun 02 16:44:27.450195 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.450045 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/db5c22b8-bea8-4f56-856a-2319a51a896f-crio-socket\") pod \"insights-runtime-extractor-ncs5x\" (UID: \"db5c22b8-bea8-4f56-856a-2319a51a896f\") " pod="openshift-insights/insights-runtime-extractor-ncs5x" Jun 02 16:44:27.450195 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.450134 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db5c22b8-bea8-4f56-856a-2319a51a896f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ncs5x\" (UID: \"db5c22b8-bea8-4f56-856a-2319a51a896f\") " pod="openshift-insights/insights-runtime-extractor-ncs5x" Jun 02 16:44:27.450195 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.450165 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/db5c22b8-bea8-4f56-856a-2319a51a896f-crio-socket\") pod \"insights-runtime-extractor-ncs5x\" (UID: \"db5c22b8-bea8-4f56-856a-2319a51a896f\") " pod="openshift-insights/insights-runtime-extractor-ncs5x" Jun 02 16:44:27.450307 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.450173 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db5c22b8-bea8-4f56-856a-2319a51a896f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ncs5x\" (UID: \"db5c22b8-bea8-4f56-856a-2319a51a896f\") " pod="openshift-insights/insights-runtime-extractor-ncs5x" Jun 02 16:44:27.450307 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.450294 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/db5c22b8-bea8-4f56-856a-2319a51a896f-data-volume\") pod \"insights-runtime-extractor-ncs5x\" (UID: \"db5c22b8-bea8-4f56-856a-2319a51a896f\") " pod="openshift-insights/insights-runtime-extractor-ncs5x" Jun 02 16:44:27.450742 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.450707 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db5c22b8-bea8-4f56-856a-2319a51a896f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ncs5x\" (UID: \"db5c22b8-bea8-4f56-856a-2319a51a896f\") " pod="openshift-insights/insights-runtime-extractor-ncs5x" Jun 02 16:44:27.452580 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.452555 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db5c22b8-bea8-4f56-856a-2319a51a896f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ncs5x\" (UID: \"db5c22b8-bea8-4f56-856a-2319a51a896f\") " pod="openshift-insights/insights-runtime-extractor-ncs5x" Jun 02 16:44:27.462723 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.462696 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjtn4\" (UniqueName: \"kubernetes.io/projected/db5c22b8-bea8-4f56-856a-2319a51a896f-kube-api-access-qjtn4\") pod \"insights-runtime-extractor-ncs5x\" (UID: \"db5c22b8-bea8-4f56-856a-2319a51a896f\") " pod="openshift-insights/insights-runtime-extractor-ncs5x" Jun 02 16:44:27.550816 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.550784 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ncs5x" Jun 02 16:44:27.648887 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.648863 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vlq2q_43709aef-aafc-4d89-b794-916480842d72/console-operator/2.log" Jun 02 16:44:27.649303 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.649285 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vlq2q_43709aef-aafc-4d89-b794-916480842d72/console-operator/1.log" Jun 02 16:44:27.649431 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.649326 2565 generic.go:358] "Generic (PLEG): container finished" podID="43709aef-aafc-4d89-b794-916480842d72" containerID="604a598e22766eb4a066e708760dda716a466d1739ea76a958839c2f284f41bc" exitCode=255 Jun 02 16:44:27.649431 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.649372 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" event={"ID":"43709aef-aafc-4d89-b794-916480842d72","Type":"ContainerDied","Data":"604a598e22766eb4a066e708760dda716a466d1739ea76a958839c2f284f41bc"} Jun 02 16:44:27.649431 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.649414 2565 scope.go:117] "RemoveContainer" containerID="023f314f3f1e1f1734f4b90a19ebcb0ef17110b8a835198f8e6b02542395398c" Jun 02 16:44:27.649785 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.649768 2565 scope.go:117] "RemoveContainer" containerID="604a598e22766eb4a066e708760dda716a466d1739ea76a958839c2f284f41bc" Jun 02 16:44:27.649982 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:44:27.649961 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-vlq2q_openshift-console-operator(43709aef-aafc-4d89-b794-916480842d72)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" podUID="43709aef-aafc-4d89-b794-916480842d72" Jun 02 16:44:27.684961 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:27.684934 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ncs5x"] Jun 02 16:44:27.688280 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:44:27.688250 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb5c22b8_bea8_4f56_856a_2319a51a896f.slice/crio-ac55fe12d38cd2c0b730221575da8b1caf7a437e74d3b4ef18a5403e260bac2a WatchSource:0}: Error finding container ac55fe12d38cd2c0b730221575da8b1caf7a437e74d3b4ef18a5403e260bac2a: Status 404 returned error can't find the container with id ac55fe12d38cd2c0b730221575da8b1caf7a437e74d3b4ef18a5403e260bac2a Jun 02 16:44:28.653692 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:28.653663 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vlq2q_43709aef-aafc-4d89-b794-916480842d72/console-operator/2.log" Jun 02 16:44:28.655374 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:28.655347 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ncs5x" event={"ID":"db5c22b8-bea8-4f56-856a-2319a51a896f","Type":"ContainerStarted","Data":"44a6d621173680cdc22f171f85403cc90cd98d7fd79accfca891e4bf93f422c7"} Jun 02 16:44:28.655374 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:28.655383 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ncs5x" event={"ID":"db5c22b8-bea8-4f56-856a-2319a51a896f","Type":"ContainerStarted","Data":"c45618f26e3cbdfe29ca19d57a5717e9ff712f9df3cb9e1043310d66a5b341a1"} Jun 02 16:44:28.655535 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:28.655394 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ncs5x" event={"ID":"db5c22b8-bea8-4f56-856a-2319a51a896f","Type":"ContainerStarted","Data":"ac55fe12d38cd2c0b730221575da8b1caf7a437e74d3b4ef18a5403e260bac2a"} Jun 02 16:44:29.275506 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:29.275461 2565 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" Jun 02 16:44:29.275984 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:29.275940 2565 scope.go:117] "RemoveContainer" containerID="604a598e22766eb4a066e708760dda716a466d1739ea76a958839c2f284f41bc" Jun 02 16:44:29.276199 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:44:29.276180 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-vlq2q_openshift-console-operator(43709aef-aafc-4d89-b794-916480842d72)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" podUID="43709aef-aafc-4d89-b794-916480842d72" Jun 02 16:44:30.662225 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:30.662184 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ncs5x" event={"ID":"db5c22b8-bea8-4f56-856a-2319a51a896f","Type":"ContainerStarted","Data":"ecd0188862c2f26368317a379b88791d0e82526c33f9f203549633de2734f945"} Jun 02 16:44:30.678435 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:30.678378 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ncs5x" podStartSLOduration=1.226618202 podStartE2EDuration="3.678355838s" podCreationTimestamp="2026-06-02 16:44:27 +0000 UTC" firstStartedPulling="2026-06-02 16:44:27.741224586 +0000 UTC m=+192.197308822" lastFinishedPulling="2026-06-02 16:44:30.192962217 +0000 UTC m=+194.649046458" observedRunningTime="2026-06-02 16:44:30.677425257 +0000 UTC m=+195.133509514" watchObservedRunningTime="2026-06-02 16:44:30.678355838 +0000 UTC m=+195.134440096" Jun 02 16:44:30.880569 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:30.880517 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-metrics-certs\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:44:30.880737 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:30.880648 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7b90812-e229-4aef-99c0-185f0d0f7d67-service-ca-bundle\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:44:30.881231 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:30.881211 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7b90812-e229-4aef-99c0-185f0d0f7d67-service-ca-bundle\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:44:30.883062 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:30.883037 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7b90812-e229-4aef-99c0-185f0d0f7d67-metrics-certs\") pod \"router-default-5dc97c89b5-hx4vl\" (UID: \"f7b90812-e229-4aef-99c0-185f0d0f7d67\") " pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:44:31.072801 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:31.072717 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cztzr\"" Jun 02 16:44:31.080320 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:31.080287 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:44:31.216791 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:31.216744 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5dc97c89b5-hx4vl"] Jun 02 16:44:31.221293 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:44:31.221257 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b90812_e229_4aef_99c0_185f0d0f7d67.slice/crio-ff17e311ef315c64c075b233060084f677d3dcd6b4c4e734313b0700feb53130 WatchSource:0}: Error finding container ff17e311ef315c64c075b233060084f677d3dcd6b4c4e734313b0700feb53130: Status 404 returned error can't find the container with id ff17e311ef315c64c075b233060084f677d3dcd6b4c4e734313b0700feb53130 Jun 02 16:44:31.666451 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:31.666410 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" event={"ID":"f7b90812-e229-4aef-99c0-185f0d0f7d67","Type":"ContainerStarted","Data":"cfb9a4fc22889463cf78a97b706989fda7c866175663b79619b9e48e14f734a7"} Jun 02 16:44:31.666451 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:31.666452 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" event={"ID":"f7b90812-e229-4aef-99c0-185f0d0f7d67","Type":"ContainerStarted","Data":"ff17e311ef315c64c075b233060084f677d3dcd6b4c4e734313b0700feb53130"} Jun 02 16:44:31.684617 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:31.684557 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" podStartSLOduration=33.684529627 podStartE2EDuration="33.684529627s" podCreationTimestamp="2026-06-02 16:43:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:44:31.683181137 +0000 UTC m=+196.139265393" watchObservedRunningTime="2026-06-02 16:44:31.684529627 +0000 UTC m=+196.140613883" Jun 02 16:44:32.081259 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:32.081155 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:44:32.083884 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:32.083857 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:44:32.574981 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:32.574912 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" Jun 02 16:44:32.575481 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:32.575459 2565 scope.go:117] "RemoveContainer" containerID="604a598e22766eb4a066e708760dda716a466d1739ea76a958839c2f284f41bc" Jun 02 16:44:32.575706 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:44:32.575684 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-vlq2q_openshift-console-operator(43709aef-aafc-4d89-b794-916480842d72)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" podUID="43709aef-aafc-4d89-b794-916480842d72" Jun 02 16:44:32.668834 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:32.668802 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:44:32.670243 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:32.670221 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5dc97c89b5-hx4vl" Jun 02 16:44:37.152808 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:37.152769 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-p8vjh"] Jun 02 16:44:37.156083 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:37.156065 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-p8vjh" Jun 02 16:44:37.158914 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:37.158886 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 02 16:44:37.159099 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:37.158889 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 02 16:44:37.159099 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:37.159044 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 16:44:37.159228 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:37.158974 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-t4n6c\"" Jun 02 16:44:37.159228 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:37.158977 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 16:44:37.159228 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:37.158919 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 16:44:37.165552 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:37.165519 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-p8vjh"] Jun 02 16:44:37.244206 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:37.244156 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6sjj\" (UniqueName: \"kubernetes.io/projected/98efe448-8a8d-4480-8405-210dcd7b124b-kube-api-access-k6sjj\") pod \"prometheus-operator-658bcd8bdf-p8vjh\" (UID: \"98efe448-8a8d-4480-8405-210dcd7b124b\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-p8vjh" Jun 02 16:44:37.244206 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:37.244222 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98efe448-8a8d-4480-8405-210dcd7b124b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-p8vjh\" (UID: \"98efe448-8a8d-4480-8405-210dcd7b124b\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-p8vjh" Jun 02 16:44:37.244497 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:37.244267 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98efe448-8a8d-4480-8405-210dcd7b124b-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-p8vjh\" (UID: \"98efe448-8a8d-4480-8405-210dcd7b124b\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-p8vjh" Jun 02 16:44:37.244497 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:37.244308 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/98efe448-8a8d-4480-8405-210dcd7b124b-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-p8vjh\" (UID: \"98efe448-8a8d-4480-8405-210dcd7b124b\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-p8vjh" Jun 02 16:44:37.345516 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:37.345464 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k6sjj\" (UniqueName: \"kubernetes.io/projected/98efe448-8a8d-4480-8405-210dcd7b124b-kube-api-access-k6sjj\") pod \"prometheus-operator-658bcd8bdf-p8vjh\" (UID: \"98efe448-8a8d-4480-8405-210dcd7b124b\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-p8vjh" Jun 02 16:44:37.345516 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:37.345518 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98efe448-8a8d-4480-8405-210dcd7b124b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-p8vjh\" (UID: \"98efe448-8a8d-4480-8405-210dcd7b124b\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-p8vjh" Jun 02 16:44:37.345796 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:37.345677 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98efe448-8a8d-4480-8405-210dcd7b124b-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-p8vjh\" (UID: \"98efe448-8a8d-4480-8405-210dcd7b124b\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-p8vjh" Jun 02 16:44:37.345796 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:37.345721 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/98efe448-8a8d-4480-8405-210dcd7b124b-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-p8vjh\" (UID: \"98efe448-8a8d-4480-8405-210dcd7b124b\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-p8vjh" Jun 02 16:44:37.346417 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:37.346315 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98efe448-8a8d-4480-8405-210dcd7b124b-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-p8vjh\" (UID: \"98efe448-8a8d-4480-8405-210dcd7b124b\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-p8vjh" Jun 02 16:44:37.348503 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:37.348471 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/98efe448-8a8d-4480-8405-210dcd7b124b-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-p8vjh\" (UID: \"98efe448-8a8d-4480-8405-210dcd7b124b\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-p8vjh" Jun 02 16:44:37.348503 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:37.348489 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98efe448-8a8d-4480-8405-210dcd7b124b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-p8vjh\" (UID: \"98efe448-8a8d-4480-8405-210dcd7b124b\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-p8vjh" Jun 02 16:44:37.356329 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:37.356308 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6sjj\" (UniqueName: \"kubernetes.io/projected/98efe448-8a8d-4480-8405-210dcd7b124b-kube-api-access-k6sjj\") pod \"prometheus-operator-658bcd8bdf-p8vjh\" (UID: \"98efe448-8a8d-4480-8405-210dcd7b124b\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-p8vjh" Jun 02 16:44:37.467132 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:37.467032 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-p8vjh" Jun 02 16:44:37.601295 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:37.601247 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-p8vjh"] Jun 02 16:44:37.605288 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:44:37.605258 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98efe448_8a8d_4480_8405_210dcd7b124b.slice/crio-5e22c54d773393b602af98ecb7195ed5d420dd0f47e1053b86b3a2bdf888f613 WatchSource:0}: Error finding container 5e22c54d773393b602af98ecb7195ed5d420dd0f47e1053b86b3a2bdf888f613: Status 404 returned error can't find the container with id 5e22c54d773393b602af98ecb7195ed5d420dd0f47e1053b86b3a2bdf888f613 Jun 02 16:44:37.684190 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:37.684149 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-p8vjh" event={"ID":"98efe448-8a8d-4480-8405-210dcd7b124b","Type":"ContainerStarted","Data":"5e22c54d773393b602af98ecb7195ed5d420dd0f47e1053b86b3a2bdf888f613"} Jun 02 16:44:39.690603 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:39.690566 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-p8vjh" event={"ID":"98efe448-8a8d-4480-8405-210dcd7b124b","Type":"ContainerStarted","Data":"acbc53a2986e582d37949125ee7362d093339c390d4ef5a01cc29d323f0870a7"} Jun 02 16:44:39.690603 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:39.690606 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-p8vjh" event={"ID":"98efe448-8a8d-4480-8405-210dcd7b124b","Type":"ContainerStarted","Data":"0bbbbbd794c4c643de3567fa7ce2c3d26d93ef24584cc149df2f280f935bd99e"} Jun 02 16:44:39.724220 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:39.724158 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-p8vjh" podStartSLOduration=1.4613341100000001 podStartE2EDuration="2.724143652s" podCreationTimestamp="2026-06-02 16:44:37 +0000 UTC" firstStartedPulling="2026-06-02 16:44:37.607139784 +0000 UTC m=+202.063224019" lastFinishedPulling="2026-06-02 16:44:38.869949325 +0000 UTC m=+203.326033561" observedRunningTime="2026-06-02 16:44:39.723422099 +0000 UTC m=+204.179506356" watchObservedRunningTime="2026-06-02 16:44:39.724143652 +0000 UTC m=+204.180227909" Jun 02 16:44:41.522338 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.522295 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj"] Jun 02 16:44:41.526157 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.526131 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj" Jun 02 16:44:41.528337 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.528307 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 02 16:44:41.528337 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.528326 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 02 16:44:41.528853 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.528833 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-hgwg2\"" Jun 02 16:44:41.528960 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.528857 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 02 16:44:41.537230 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.537154 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jknmq"] Jun 02 16:44:41.540727 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.540703 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj"] Jun 02 16:44:41.540854 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.540844 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.542902 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.542878 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 16:44:41.543160 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.542881 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 16:44:41.543259 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.542969 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 16:44:41.543314 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.543020 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sx4bp\"" Jun 02 16:44:41.684845 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.684800 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bce4c8bc-52a2-4000-a821-cae9e41948cb-node-exporter-textfile\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.685063 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.684852 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmbk8\" (UniqueName: \"kubernetes.io/projected/bce4c8bc-52a2-4000-a821-cae9e41948cb-kube-api-access-cmbk8\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.685063 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.684928 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bce4c8bc-52a2-4000-a821-cae9e41948cb-metrics-client-ca\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.685063 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.685032 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bce4c8bc-52a2-4000-a821-cae9e41948cb-node-exporter-tls\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.685214 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.685070 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bce4c8bc-52a2-4000-a821-cae9e41948cb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.685214 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.685123 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f51b2e31-5ac0-4792-b344-04def6c849e4-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-hhbnj\" (UID: \"f51b2e31-5ac0-4792-b344-04def6c849e4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj" Jun 02 16:44:41.685214 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.685174 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79cbx\" (UniqueName: \"kubernetes.io/projected/f51b2e31-5ac0-4792-b344-04def6c849e4-kube-api-access-79cbx\") pod \"kube-state-metrics-8469c486bb-hhbnj\" (UID: \"f51b2e31-5ac0-4792-b344-04def6c849e4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj" Jun 02 16:44:41.685214 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.685210 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bce4c8bc-52a2-4000-a821-cae9e41948cb-root\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.685369 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.685240 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f51b2e31-5ac0-4792-b344-04def6c849e4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-hhbnj\" (UID: \"f51b2e31-5ac0-4792-b344-04def6c849e4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj" Jun 02 16:44:41.685369 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.685309 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bce4c8bc-52a2-4000-a821-cae9e41948cb-node-exporter-wtmp\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.685369 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.685350 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f51b2e31-5ac0-4792-b344-04def6c849e4-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-hhbnj\" (UID: \"f51b2e31-5ac0-4792-b344-04def6c849e4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj" Jun 02 16:44:41.685478 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.685389 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f51b2e31-5ac0-4792-b344-04def6c849e4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-hhbnj\" (UID: \"f51b2e31-5ac0-4792-b344-04def6c849e4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj" Jun 02 16:44:41.685478 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.685413 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bce4c8bc-52a2-4000-a821-cae9e41948cb-sys\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.685478 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.685466 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f51b2e31-5ac0-4792-b344-04def6c849e4-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-hhbnj\" (UID: \"f51b2e31-5ac0-4792-b344-04def6c849e4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj" Jun 02 16:44:41.685572 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.685493 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bce4c8bc-52a2-4000-a821-cae9e41948cb-node-exporter-accelerators-collector-config\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.786743 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.786617 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79cbx\" (UniqueName: \"kubernetes.io/projected/f51b2e31-5ac0-4792-b344-04def6c849e4-kube-api-access-79cbx\") pod \"kube-state-metrics-8469c486bb-hhbnj\" (UID: \"f51b2e31-5ac0-4792-b344-04def6c849e4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj" Jun 02 16:44:41.786743 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.786676 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bce4c8bc-52a2-4000-a821-cae9e41948cb-root\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.786743 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.786699 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f51b2e31-5ac0-4792-b344-04def6c849e4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-hhbnj\" (UID: \"f51b2e31-5ac0-4792-b344-04def6c849e4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj" Jun 02 16:44:41.786743 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.786731 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bce4c8bc-52a2-4000-a821-cae9e41948cb-node-exporter-wtmp\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.787151 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.786767 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f51b2e31-5ac0-4792-b344-04def6c849e4-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-hhbnj\" (UID: \"f51b2e31-5ac0-4792-b344-04def6c849e4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj" Jun 02 16:44:41.787151 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.786793 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f51b2e31-5ac0-4792-b344-04def6c849e4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-hhbnj\" (UID: \"f51b2e31-5ac0-4792-b344-04def6c849e4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj" Jun 02 16:44:41.787151 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.786791 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bce4c8bc-52a2-4000-a821-cae9e41948cb-root\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.787151 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.786812 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bce4c8bc-52a2-4000-a821-cae9e41948cb-sys\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.787151 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.786843 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f51b2e31-5ac0-4792-b344-04def6c849e4-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-hhbnj\" (UID: \"f51b2e31-5ac0-4792-b344-04def6c849e4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj" Jun 02 16:44:41.787151 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.786927 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bce4c8bc-52a2-4000-a821-cae9e41948cb-sys\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.787151 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.786964 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bce4c8bc-52a2-4000-a821-cae9e41948cb-node-exporter-accelerators-collector-config\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.787151 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.787004 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bce4c8bc-52a2-4000-a821-cae9e41948cb-node-exporter-wtmp\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.787151 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.787070 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bce4c8bc-52a2-4000-a821-cae9e41948cb-node-exporter-textfile\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.787151 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.787102 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cmbk8\" (UniqueName: \"kubernetes.io/projected/bce4c8bc-52a2-4000-a821-cae9e41948cb-kube-api-access-cmbk8\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.787151 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.787147 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bce4c8bc-52a2-4000-a821-cae9e41948cb-metrics-client-ca\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.787676 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.787215 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bce4c8bc-52a2-4000-a821-cae9e41948cb-node-exporter-tls\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.787676 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.787253 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bce4c8bc-52a2-4000-a821-cae9e41948cb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.787676 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.787284 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f51b2e31-5ac0-4792-b344-04def6c849e4-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-hhbnj\" (UID: \"f51b2e31-5ac0-4792-b344-04def6c849e4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj" Jun 02 16:44:41.787826 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.787678 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f51b2e31-5ac0-4792-b344-04def6c849e4-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-hhbnj\" (UID: \"f51b2e31-5ac0-4792-b344-04def6c849e4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj" Jun 02 16:44:41.787876 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.787844 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bce4c8bc-52a2-4000-a821-cae9e41948cb-node-exporter-accelerators-collector-config\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.787970 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.787946 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f51b2e31-5ac0-4792-b344-04def6c849e4-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-hhbnj\" (UID: \"f51b2e31-5ac0-4792-b344-04def6c849e4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj" Jun 02 16:44:41.788075 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.787973 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bce4c8bc-52a2-4000-a821-cae9e41948cb-metrics-client-ca\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.788175 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.788152 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bce4c8bc-52a2-4000-a821-cae9e41948cb-node-exporter-textfile\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.788383 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.788355 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f51b2e31-5ac0-4792-b344-04def6c849e4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-hhbnj\" (UID: \"f51b2e31-5ac0-4792-b344-04def6c849e4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj" Jun 02 16:44:41.789882 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.789850 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f51b2e31-5ac0-4792-b344-04def6c849e4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-hhbnj\" (UID: \"f51b2e31-5ac0-4792-b344-04def6c849e4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj" Jun 02 16:44:41.790211 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.790190 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bce4c8bc-52a2-4000-a821-cae9e41948cb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.790349 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.790329 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bce4c8bc-52a2-4000-a821-cae9e41948cb-node-exporter-tls\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.790403 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.790336 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f51b2e31-5ac0-4792-b344-04def6c849e4-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-hhbnj\" (UID: \"f51b2e31-5ac0-4792-b344-04def6c849e4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj" Jun 02 16:44:41.794975 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.794948 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmbk8\" (UniqueName: \"kubernetes.io/projected/bce4c8bc-52a2-4000-a821-cae9e41948cb-kube-api-access-cmbk8\") pod \"node-exporter-jknmq\" (UID: \"bce4c8bc-52a2-4000-a821-cae9e41948cb\") " pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.795102 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.794993 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79cbx\" (UniqueName: \"kubernetes.io/projected/f51b2e31-5ac0-4792-b344-04def6c849e4-kube-api-access-79cbx\") pod \"kube-state-metrics-8469c486bb-hhbnj\" (UID: \"f51b2e31-5ac0-4792-b344-04def6c849e4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj" Jun 02 16:44:41.838991 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.838955 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj" Jun 02 16:44:41.852321 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.852292 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jknmq" Jun 02 16:44:41.862198 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:44:41.862163 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbce4c8bc_52a2_4000_a821_cae9e41948cb.slice/crio-f66c525de321162978932b391cd1349e0d678217a910575bac81f8a66e27d4a1 WatchSource:0}: Error finding container f66c525de321162978932b391cd1349e0d678217a910575bac81f8a66e27d4a1: Status 404 returned error can't find the container with id f66c525de321162978932b391cd1349e0d678217a910575bac81f8a66e27d4a1 Jun 02 16:44:41.982690 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:41.982653 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj"] Jun 02 16:44:41.985643 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:44:41.985612 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf51b2e31_5ac0_4792_b344_04def6c849e4.slice/crio-3c52dcad1b2680b310c30f8e3e1c0cbe8f649ec025c3b9b29fa50187fe657943 WatchSource:0}: Error finding container 3c52dcad1b2680b310c30f8e3e1c0cbe8f649ec025c3b9b29fa50187fe657943: Status 404 returned error can't find the container with id 3c52dcad1b2680b310c30f8e3e1c0cbe8f649ec025c3b9b29fa50187fe657943 Jun 02 16:44:42.601636 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.601261 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 16:44:42.605487 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.605456 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.611245 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.611212 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 16:44:42.611506 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.611456 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 16:44:42.611636 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.611566 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-thcw9\"" Jun 02 16:44:42.611636 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.611591 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 16:44:42.611636 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.611572 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 16:44:42.611636 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.611633 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 16:44:42.611890 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.611669 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 16:44:42.611890 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.611599 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 16:44:42.611890 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.611887 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 16:44:42.612140 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.611999 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 16:44:42.624199 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.624119 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 16:44:42.694973 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.694918 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e852bfea-2740-4d24-887d-7699aca72a7f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.694973 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.694977 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.695248 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.695030 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e852bfea-2740-4d24-887d-7699aca72a7f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.695248 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.695064 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e852bfea-2740-4d24-887d-7699aca72a7f-config-out\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.695248 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.695092 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.695248 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.695154 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw5p9\" (UniqueName: \"kubernetes.io/projected/e852bfea-2740-4d24-887d-7699aca72a7f-kube-api-access-jw5p9\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.695248 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.695191 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-config-volume\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.695248 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.695223 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-web-config\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.695554 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.695283 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.695554 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.695313 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e852bfea-2740-4d24-887d-7699aca72a7f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.695554 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.695387 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e852bfea-2740-4d24-887d-7699aca72a7f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.695554 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.695425 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.695554 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.695478 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.706244 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.706202 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jknmq" event={"ID":"bce4c8bc-52a2-4000-a821-cae9e41948cb","Type":"ContainerStarted","Data":"f66c525de321162978932b391cd1349e0d678217a910575bac81f8a66e27d4a1"} Jun 02 16:44:42.707391 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.707356 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj" event={"ID":"f51b2e31-5ac0-4792-b344-04def6c849e4","Type":"ContainerStarted","Data":"3c52dcad1b2680b310c30f8e3e1c0cbe8f649ec025c3b9b29fa50187fe657943"} Jun 02 16:44:42.796899 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.796862 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e852bfea-2740-4d24-887d-7699aca72a7f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.797128 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.796922 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.797128 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.796979 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.797128 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.797042 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e852bfea-2740-4d24-887d-7699aca72a7f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.797128 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.797088 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.797128 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.797114 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e852bfea-2740-4d24-887d-7699aca72a7f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.797386 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.797140 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e852bfea-2740-4d24-887d-7699aca72a7f-config-out\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.797386 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.797177 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.797386 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.797230 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jw5p9\" (UniqueName: \"kubernetes.io/projected/e852bfea-2740-4d24-887d-7699aca72a7f-kube-api-access-jw5p9\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.797386 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.797266 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-config-volume\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.797386 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.797295 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-web-config\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.797386 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.797353 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.797386 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.797380 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e852bfea-2740-4d24-887d-7699aca72a7f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.797730 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:44:42.797570 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e852bfea-2740-4d24-887d-7699aca72a7f-alertmanager-trusted-ca-bundle podName:e852bfea-2740-4d24-887d-7699aca72a7f nodeName:}" failed. No retries permitted until 2026-06-02 16:44:43.297536851 +0000 UTC m=+207.753621096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/e852bfea-2740-4d24-887d-7699aca72a7f-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "e852bfea-2740-4d24-887d-7699aca72a7f") : configmap references non-existent config key: ca-bundle.crt Jun 02 16:44:42.797730 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.797708 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e852bfea-2740-4d24-887d-7699aca72a7f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.798145 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:44:42.797966 2565 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 02 16:44:42.798145 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:44:42.798062 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-main-tls podName:e852bfea-2740-4d24-887d-7699aca72a7f nodeName:}" failed. No retries permitted until 2026-06-02 16:44:43.298041412 +0000 UTC m=+207.754125647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "e852bfea-2740-4d24-887d-7699aca72a7f") : secret "alertmanager-main-tls" not found Jun 02 16:44:42.799002 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.798675 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e852bfea-2740-4d24-887d-7699aca72a7f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.800619 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.800535 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e852bfea-2740-4d24-887d-7699aca72a7f-config-out\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.801372 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.801346 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.801680 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.801652 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.801892 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.801871 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e852bfea-2740-4d24-887d-7699aca72a7f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.802226 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.802202 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-config-volume\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.802304 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.802287 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.803962 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.803936 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.805534 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.805511 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-web-config\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:42.806557 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:42.806495 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw5p9\" (UniqueName: \"kubernetes.io/projected/e852bfea-2740-4d24-887d-7699aca72a7f-kube-api-access-jw5p9\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:43.303727 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:43.303632 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e852bfea-2740-4d24-887d-7699aca72a7f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:43.303911 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:43.303764 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:43.304743 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:43.304712 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e852bfea-2740-4d24-887d-7699aca72a7f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:43.306884 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:43.306859 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:43.520325 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:43.520214 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:44:43.712547 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:43.712507 2565 generic.go:358] "Generic (PLEG): container finished" podID="bce4c8bc-52a2-4000-a821-cae9e41948cb" containerID="9578764894c84ccc706206ef2dd5603e39f30fedef89848cb7d35a66c938c97f" exitCode=0 Jun 02 16:44:43.713039 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:43.712601 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jknmq" event={"ID":"bce4c8bc-52a2-4000-a821-cae9e41948cb","Type":"ContainerDied","Data":"9578764894c84ccc706206ef2dd5603e39f30fedef89848cb7d35a66c938c97f"} Jun 02 16:44:43.714716 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:43.714660 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj" event={"ID":"f51b2e31-5ac0-4792-b344-04def6c849e4","Type":"ContainerStarted","Data":"67882c554d4444af69f19341ed68759d9b7ab461284d9f949c388f3fdcf509b3"} Jun 02 16:44:43.714716 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:43.714691 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj" event={"ID":"f51b2e31-5ac0-4792-b344-04def6c849e4","Type":"ContainerStarted","Data":"2082e5dc495de7597a7eea2044e07b06013c0d292d0c2602cccd6b5ed04e0c5b"} Jun 02 16:44:43.714716 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:43.714702 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj" event={"ID":"f51b2e31-5ac0-4792-b344-04def6c849e4","Type":"ContainerStarted","Data":"ae627c7f6c79cb8b240ced4cc466475aa0a53f6f3c82d943f57cc9fb2cc5bdc3"} Jun 02 16:44:43.724032 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:43.720371 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 16:44:43.730703 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:44:43.730650 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode852bfea_2740_4d24_887d_7699aca72a7f.slice/crio-5a53cd70cf3609f41db8e5eb3bf921640e7debe469a0d59d900581c2e6276bcc WatchSource:0}: Error finding container 5a53cd70cf3609f41db8e5eb3bf921640e7debe469a0d59d900581c2e6276bcc: Status 404 returned error can't find the container with id 5a53cd70cf3609f41db8e5eb3bf921640e7debe469a0d59d900581c2e6276bcc Jun 02 16:44:43.749521 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:43.749460 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-hhbnj" podStartSLOduration=1.273215871 podStartE2EDuration="2.74943906s" podCreationTimestamp="2026-06-02 16:44:41 +0000 UTC" firstStartedPulling="2026-06-02 16:44:41.987624948 +0000 UTC m=+206.443709189" lastFinishedPulling="2026-06-02 16:44:43.463848137 +0000 UTC m=+207.919932378" observedRunningTime="2026-06-02 16:44:43.747724062 +0000 UTC m=+208.203808336" watchObservedRunningTime="2026-06-02 16:44:43.74943906 +0000 UTC m=+208.205523320" Jun 02 16:44:44.722829 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:44.722788 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jknmq" event={"ID":"bce4c8bc-52a2-4000-a821-cae9e41948cb","Type":"ContainerStarted","Data":"0f825932577706185839b2eaff7b1ade9a3a41a256c8c2466f81937eb631561f"} Jun 02 16:44:44.723329 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:44.722840 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jknmq" event={"ID":"bce4c8bc-52a2-4000-a821-cae9e41948cb","Type":"ContainerStarted","Data":"5d70abd3980d6a5057376402e080a6b8e33004ee6869f84ce87c1afcf52ec5fb"} Jun 02 16:44:44.724309 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:44.724274 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e852bfea-2740-4d24-887d-7699aca72a7f","Type":"ContainerStarted","Data":"5a53cd70cf3609f41db8e5eb3bf921640e7debe469a0d59d900581c2e6276bcc"} Jun 02 16:44:45.728644 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:45.728598 2565 generic.go:358] "Generic (PLEG): container finished" podID="e852bfea-2740-4d24-887d-7699aca72a7f" containerID="f1ab9533be0e4ffdae7b3bab2df285057c3d399c0f3afb0ee6b87fc11b787d42" exitCode=0 Jun 02 16:44:45.729062 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:45.728690 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e852bfea-2740-4d24-887d-7699aca72a7f","Type":"ContainerDied","Data":"f1ab9533be0e4ffdae7b3bab2df285057c3d399c0f3afb0ee6b87fc11b787d42"} Jun 02 16:44:45.755859 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:45.755802 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jknmq" podStartSLOduration=3.814034657 podStartE2EDuration="4.755784038s" podCreationTimestamp="2026-06-02 16:44:41 +0000 UTC" firstStartedPulling="2026-06-02 16:44:41.86522755 +0000 UTC m=+206.321311788" lastFinishedPulling="2026-06-02 16:44:42.80697693 +0000 UTC m=+207.263061169" observedRunningTime="2026-06-02 16:44:44.741307895 +0000 UTC m=+209.197392153" watchObservedRunningTime="2026-06-02 16:44:45.755784038 +0000 UTC m=+210.211868295" Jun 02 16:44:45.929219 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:45.929183 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-68bc859cc9-ct72d"] Jun 02 16:44:45.932355 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:45.932335 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:44:45.934523 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:45.934483 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 02 16:44:45.934724 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:45.934578 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 02 16:44:45.934724 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:45.934622 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 16:44:45.934978 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:45.934945 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 02 16:44:45.935105 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:45.934982 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2iv894d501m20\"" Jun 02 16:44:45.935105 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:45.934997 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nk6fk\"" Jun 02 16:44:45.940683 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:45.940661 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-68bc859cc9-ct72d"] Jun 02 16:44:46.033221 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:46.033127 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hpv6\" (UniqueName: \"kubernetes.io/projected/33600001-cc09-4762-bd2c-88a85d533531-kube-api-access-7hpv6\") pod \"metrics-server-68bc859cc9-ct72d\" (UID: \"33600001-cc09-4762-bd2c-88a85d533531\") " pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:44:46.033221 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:46.033188 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/33600001-cc09-4762-bd2c-88a85d533531-secret-metrics-server-tls\") pod \"metrics-server-68bc859cc9-ct72d\" (UID: \"33600001-cc09-4762-bd2c-88a85d533531\") " pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:44:46.033417 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:46.033313 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33600001-cc09-4762-bd2c-88a85d533531-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68bc859cc9-ct72d\" (UID: \"33600001-cc09-4762-bd2c-88a85d533531\") " pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:44:46.033417 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:46.033345 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/33600001-cc09-4762-bd2c-88a85d533531-secret-metrics-server-client-certs\") pod \"metrics-server-68bc859cc9-ct72d\" (UID: \"33600001-cc09-4762-bd2c-88a85d533531\") " pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:44:46.033417 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:46.033367 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/33600001-cc09-4762-bd2c-88a85d533531-metrics-server-audit-profiles\") pod \"metrics-server-68bc859cc9-ct72d\" (UID: \"33600001-cc09-4762-bd2c-88a85d533531\") " pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:44:46.033529 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:46.033438 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/33600001-cc09-4762-bd2c-88a85d533531-audit-log\") pod \"metrics-server-68bc859cc9-ct72d\" (UID: \"33600001-cc09-4762-bd2c-88a85d533531\") " pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:44:46.033529 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:46.033465 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/33600001-cc09-4762-bd2c-88a85d533531-client-ca-bundle\") pod \"metrics-server-68bc859cc9-ct72d\" (UID: \"33600001-cc09-4762-bd2c-88a85d533531\") " pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:44:46.043842 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:46.043821 2565 scope.go:117] "RemoveContainer" containerID="604a598e22766eb4a066e708760dda716a466d1739ea76a958839c2f284f41bc" Jun 02 16:44:46.044061 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:44:46.044040 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-vlq2q_openshift-console-operator(43709aef-aafc-4d89-b794-916480842d72)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" podUID="43709aef-aafc-4d89-b794-916480842d72" Jun 02 16:44:46.134249 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:46.134218 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33600001-cc09-4762-bd2c-88a85d533531-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68bc859cc9-ct72d\" (UID: \"33600001-cc09-4762-bd2c-88a85d533531\") " pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:44:46.134435 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:46.134257 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/33600001-cc09-4762-bd2c-88a85d533531-secret-metrics-server-client-certs\") pod \"metrics-server-68bc859cc9-ct72d\" (UID: \"33600001-cc09-4762-bd2c-88a85d533531\") " pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:44:46.134435 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:46.134290 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/33600001-cc09-4762-bd2c-88a85d533531-metrics-server-audit-profiles\") pod \"metrics-server-68bc859cc9-ct72d\" (UID: \"33600001-cc09-4762-bd2c-88a85d533531\") " pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:44:46.134435 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:46.134400 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/33600001-cc09-4762-bd2c-88a85d533531-audit-log\") pod \"metrics-server-68bc859cc9-ct72d\" (UID: \"33600001-cc09-4762-bd2c-88a85d533531\") " pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:44:46.134435 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:46.134431 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/33600001-cc09-4762-bd2c-88a85d533531-client-ca-bundle\") pod \"metrics-server-68bc859cc9-ct72d\" (UID: \"33600001-cc09-4762-bd2c-88a85d533531\") " pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:44:46.134645 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:46.134480 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hpv6\" (UniqueName: \"kubernetes.io/projected/33600001-cc09-4762-bd2c-88a85d533531-kube-api-access-7hpv6\") pod \"metrics-server-68bc859cc9-ct72d\" (UID: \"33600001-cc09-4762-bd2c-88a85d533531\") " pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:44:46.134645 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:46.134585 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/33600001-cc09-4762-bd2c-88a85d533531-secret-metrics-server-tls\") pod \"metrics-server-68bc859cc9-ct72d\" (UID: \"33600001-cc09-4762-bd2c-88a85d533531\") " pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:44:46.135371 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:46.135209 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/33600001-cc09-4762-bd2c-88a85d533531-audit-log\") pod \"metrics-server-68bc859cc9-ct72d\" (UID: \"33600001-cc09-4762-bd2c-88a85d533531\") " pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:44:46.135522 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:46.135496 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33600001-cc09-4762-bd2c-88a85d533531-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68bc859cc9-ct72d\" (UID: \"33600001-cc09-4762-bd2c-88a85d533531\") " pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:44:46.140281 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:46.135936 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/33600001-cc09-4762-bd2c-88a85d533531-metrics-server-audit-profiles\") pod \"metrics-server-68bc859cc9-ct72d\" (UID: \"33600001-cc09-4762-bd2c-88a85d533531\") " pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:44:46.140281 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:46.138426 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/33600001-cc09-4762-bd2c-88a85d533531-client-ca-bundle\") pod \"metrics-server-68bc859cc9-ct72d\" (UID: \"33600001-cc09-4762-bd2c-88a85d533531\") " pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:44:46.142168 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:46.142143 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/33600001-cc09-4762-bd2c-88a85d533531-secret-metrics-server-tls\") pod \"metrics-server-68bc859cc9-ct72d\" (UID: \"33600001-cc09-4762-bd2c-88a85d533531\") " pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:44:46.142266 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:46.142189 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/33600001-cc09-4762-bd2c-88a85d533531-secret-metrics-server-client-certs\") pod \"metrics-server-68bc859cc9-ct72d\" (UID: \"33600001-cc09-4762-bd2c-88a85d533531\") " pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:44:46.143768 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:46.143750 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hpv6\" (UniqueName: \"kubernetes.io/projected/33600001-cc09-4762-bd2c-88a85d533531-kube-api-access-7hpv6\") pod \"metrics-server-68bc859cc9-ct72d\" (UID: \"33600001-cc09-4762-bd2c-88a85d533531\") " pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:44:46.244936 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:46.244898 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:44:46.390668 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:46.390631 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-68bc859cc9-ct72d"] Jun 02 16:44:46.733832 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:46.733769 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" event={"ID":"33600001-cc09-4762-bd2c-88a85d533531","Type":"ContainerStarted","Data":"f8ffa96c38cf2c70e74c7a7d78d01a46000cce64586588ecc036c8b60c24a9db"} Jun 02 16:44:47.738243 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.738108 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 16:44:47.742921 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.742891 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.746120 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.746075 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 16:44:47.746120 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.746107 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 16:44:47.746322 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.746202 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 16:44:47.746375 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.746362 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 16:44:47.746429 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.746360 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 16:44:47.746465 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.746422 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8cmw8\"" Jun 02 16:44:47.747072 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.746944 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2cr02ebug53an\"" Jun 02 16:44:47.749582 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.747897 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 16:44:47.749582 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.747998 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 16:44:47.749582 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.748233 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 16:44:47.749582 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.748470 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 16:44:47.749582 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.748699 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 16:44:47.749582 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.749190 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 16:44:47.749582 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.749412 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 16:44:47.761407 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.761322 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 16:44:47.855664 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.855627 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.855863 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.855696 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.855863 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.855725 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.855863 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.855749 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.855863 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.855781 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.855863 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.855804 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7knft\" (UniqueName: \"kubernetes.io/projected/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-kube-api-access-7knft\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.856122 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.855897 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.856122 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.855933 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.856122 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.855962 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-config\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.856122 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.856048 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.856287 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.856263 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-config-out\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.856329 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.856305 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.856373 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.856326 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.856373 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.856359 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.856458 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.856382 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.856458 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.856435 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.856571 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.856462 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-web-config\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.856571 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.856495 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.958369 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.957277 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.958369 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.957340 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.958369 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.957368 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-config\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.958369 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.957395 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.958369 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.957433 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-config-out\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.958369 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.957464 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.958369 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.957486 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.958369 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.957518 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.958369 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.957551 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.958369 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.957580 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.958369 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.957603 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-web-config\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.958369 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.957636 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.958369 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.957722 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.958369 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.957773 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.958369 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.957798 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.958369 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.957825 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.958369 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.957857 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.959647 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.957883 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7knft\" (UniqueName: \"kubernetes.io/projected/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-kube-api-access-7knft\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.959647 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.958964 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.959647 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.958982 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.961419 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.960912 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.962585 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.962557 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.964373 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.964317 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.964814 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.964784 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.966043 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.965920 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.966813 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.966275 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.966813 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.966301 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-config-out\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.966813 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.966747 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.967471 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.967188 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-web-config\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.967471 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.967411 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.967632 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.967608 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.968778 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.968257 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-config\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.968778 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.968467 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.968778 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.968738 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.971920 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.971865 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:47.971920 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:47.971868 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7knft\" (UniqueName: \"kubernetes.io/projected/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-kube-api-access-7knft\") pod \"prometheus-k8s-0\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:48.062615 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:48.062520 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:44:48.321062 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:48.321003 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 16:44:48.741945 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:48.741898 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" event={"ID":"33600001-cc09-4762-bd2c-88a85d533531","Type":"ContainerStarted","Data":"9178a18bce6676dd3aafd069d6a85eb9b82358fdcf40cb42d3bfb781f548be53"} Jun 02 16:44:48.743481 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:48.743451 2565 generic.go:358] "Generic (PLEG): container finished" podID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerID="046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9" exitCode=0 Jun 02 16:44:48.743625 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:48.743538 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"315b95e4-6c8d-41bc-b2ef-748e8bac61e8","Type":"ContainerDied","Data":"046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9"} Jun 02 16:44:48.743625 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:48.743578 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"315b95e4-6c8d-41bc-b2ef-748e8bac61e8","Type":"ContainerStarted","Data":"278f700285d79839b490cbb6a565f797234c4189e25229db83f8c8844f65f53c"} Jun 02 16:44:48.746522 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:48.746482 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e852bfea-2740-4d24-887d-7699aca72a7f","Type":"ContainerStarted","Data":"0e6f1c54e34adeedcdec3bd7585b093da223190bae0e4e25088b52cf81b683a5"} Jun 02 16:44:48.746522 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:48.746518 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e852bfea-2740-4d24-887d-7699aca72a7f","Type":"ContainerStarted","Data":"15dbd4d2608b3cc009cedf39566a3fded76ec04ecafea29304e8b7ef18ff383a"} Jun 02 16:44:48.746689 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:48.746531 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e852bfea-2740-4d24-887d-7699aca72a7f","Type":"ContainerStarted","Data":"fbaa32660e1013b124da8bb277354b77f2077b475c4cab6a691096c6a6f4d4c7"} Jun 02 16:44:48.746689 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:48.746544 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e852bfea-2740-4d24-887d-7699aca72a7f","Type":"ContainerStarted","Data":"3c6757ade193d778c35ef9a88cc9bbd4a04dcf91a65e735e912bc8a402ffce67"} Jun 02 16:44:48.746689 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:48.746556 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e852bfea-2740-4d24-887d-7699aca72a7f","Type":"ContainerStarted","Data":"4747dfecadac4054b2502f2cf9c307673d88867deaf073b47fdd0f6cda76b5d6"} Jun 02 16:44:48.762440 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:48.762387 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" podStartSLOduration=2.025793243 podStartE2EDuration="3.762369865s" podCreationTimestamp="2026-06-02 16:44:45 +0000 UTC" firstStartedPulling="2026-06-02 16:44:46.397338008 +0000 UTC m=+210.853422260" lastFinishedPulling="2026-06-02 16:44:48.133914639 +0000 UTC m=+212.589998882" observedRunningTime="2026-06-02 16:44:48.761371869 +0000 UTC m=+213.217456128" watchObservedRunningTime="2026-06-02 16:44:48.762369865 +0000 UTC m=+213.218454121" Jun 02 16:44:49.755070 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:49.755032 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e852bfea-2740-4d24-887d-7699aca72a7f","Type":"ContainerStarted","Data":"85bf4cab6641967a666d1196b1930e74f36837c9b0938ffba16b0b1cb2cbddd7"} Jun 02 16:44:49.788455 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:49.787416 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.383807096 podStartE2EDuration="7.787393695s" podCreationTimestamp="2026-06-02 16:44:42 +0000 UTC" firstStartedPulling="2026-06-02 16:44:43.735632381 +0000 UTC m=+208.191716616" lastFinishedPulling="2026-06-02 16:44:49.139218979 +0000 UTC m=+213.595303215" observedRunningTime="2026-06-02 16:44:49.786274514 +0000 UTC m=+214.242358768" watchObservedRunningTime="2026-06-02 16:44:49.787393695 +0000 UTC m=+214.243477957" Jun 02 16:44:51.767845 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:51.767807 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"315b95e4-6c8d-41bc-b2ef-748e8bac61e8","Type":"ContainerStarted","Data":"3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8"} Jun 02 16:44:51.767845 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:51.767848 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"315b95e4-6c8d-41bc-b2ef-748e8bac61e8","Type":"ContainerStarted","Data":"4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51"} Jun 02 16:44:54.790051 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:54.789986 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"315b95e4-6c8d-41bc-b2ef-748e8bac61e8","Type":"ContainerStarted","Data":"e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae"} Jun 02 16:44:54.790051 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:54.790053 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"315b95e4-6c8d-41bc-b2ef-748e8bac61e8","Type":"ContainerStarted","Data":"3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda"} Jun 02 16:44:54.790614 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:54.790064 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"315b95e4-6c8d-41bc-b2ef-748e8bac61e8","Type":"ContainerStarted","Data":"337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0"} Jun 02 16:44:54.790614 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:54.790073 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"315b95e4-6c8d-41bc-b2ef-748e8bac61e8","Type":"ContainerStarted","Data":"22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c"} Jun 02 16:44:54.823143 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:54.823066 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.817795722 podStartE2EDuration="7.823050831s" podCreationTimestamp="2026-06-02 16:44:47 +0000 UTC" firstStartedPulling="2026-06-02 16:44:48.744919026 +0000 UTC m=+213.201003262" lastFinishedPulling="2026-06-02 16:44:53.750174134 +0000 UTC m=+218.206258371" observedRunningTime="2026-06-02 16:44:54.821264135 +0000 UTC m=+219.277348433" watchObservedRunningTime="2026-06-02 16:44:54.823050831 +0000 UTC m=+219.279135138" Jun 02 16:44:58.063064 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:44:58.062986 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:45:01.041962 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:45:01.041920 2565 scope.go:117] "RemoveContainer" containerID="604a598e22766eb4a066e708760dda716a466d1739ea76a958839c2f284f41bc" Jun 02 16:45:01.814710 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:45:01.814678 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vlq2q_43709aef-aafc-4d89-b794-916480842d72/console-operator/2.log" Jun 02 16:45:01.814876 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:45:01.814757 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" event={"ID":"43709aef-aafc-4d89-b794-916480842d72","Type":"ContainerStarted","Data":"314c04bcd1f1b86fae591a3e774b8b58c960e36d7d065166daff481581096b74"} Jun 02 16:45:01.815084 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:45:01.815056 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" Jun 02 16:45:01.819775 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:45:01.819747 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-vlq2q" Jun 02 16:45:06.245665 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:45:06.245627 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:45:06.245665 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:45:06.245669 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:45:26.250711 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:45:26.250683 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:45:26.254517 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:45:26.254496 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-68bc859cc9-ct72d" Jun 02 16:45:26.926584 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:45:26.926546 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs\") pod \"network-metrics-daemon-5p7z4\" (UID: \"ab630523-7064-4dc5-a730-7b6b06551777\") " pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:45:26.929582 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:45:26.929556 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab630523-7064-4dc5-a730-7b6b06551777-metrics-certs\") pod \"network-metrics-daemon-5p7z4\" (UID: \"ab630523-7064-4dc5-a730-7b6b06551777\") " pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:45:27.144551 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:45:27.144517 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f4pj7\"" Jun 02 16:45:27.153283 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:45:27.153256 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5p7z4" Jun 02 16:45:27.290366 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:45:27.290328 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5p7z4"] Jun 02 16:45:27.294342 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:45:27.294314 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab630523_7064_4dc5_a730_7b6b06551777.slice/crio-83c8ddc5deafe3b032835524ea626dd2c46d52d9d9e01ebbb6c17969697b02ab WatchSource:0}: Error finding container 83c8ddc5deafe3b032835524ea626dd2c46d52d9d9e01ebbb6c17969697b02ab: Status 404 returned error can't find the container with id 83c8ddc5deafe3b032835524ea626dd2c46d52d9d9e01ebbb6c17969697b02ab Jun 02 16:45:27.892213 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:45:27.892180 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5p7z4" event={"ID":"ab630523-7064-4dc5-a730-7b6b06551777","Type":"ContainerStarted","Data":"83c8ddc5deafe3b032835524ea626dd2c46d52d9d9e01ebbb6c17969697b02ab"} Jun 02 16:45:28.898513 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:45:28.898481 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5p7z4" event={"ID":"ab630523-7064-4dc5-a730-7b6b06551777","Type":"ContainerStarted","Data":"d7ae8a07f82d91cfaa63a1b72049b1038ef1e930373c8e1faa8d93e6263c24d5"} Jun 02 16:45:29.902562 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:45:29.902524 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5p7z4" event={"ID":"ab630523-7064-4dc5-a730-7b6b06551777","Type":"ContainerStarted","Data":"a7e12632bbff51e99e3a521b23cc9bb5dbf14188dfd48438f4e6475afdf1b9d5"} Jun 02 16:45:29.918501 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:45:29.918450 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5p7z4" podStartSLOduration=252.428253726 podStartE2EDuration="4m13.918435657s" podCreationTimestamp="2026-06-02 16:41:16 +0000 UTC" firstStartedPulling="2026-06-02 16:45:27.296189473 +0000 UTC m=+251.752273709" lastFinishedPulling="2026-06-02 16:45:28.786371405 +0000 UTC m=+253.242455640" observedRunningTime="2026-06-02 16:45:29.917511267 +0000 UTC m=+254.373595525" watchObservedRunningTime="2026-06-02 16:45:29.918435657 +0000 UTC m=+254.374519913" Jun 02 16:45:48.063676 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:45:48.063586 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:45:48.080957 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:45:48.080927 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:45:48.976443 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:45:48.972236 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:45:56.551677 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:45:56.551637 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt" podUID="2eb49fdc-49ec-4844-a2ed-108e1ad6a300" Jun 02 16:45:56.551677 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:45:56.551673 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-lgc2j" podUID="70235929-1fb6-4b5d-bda3-f77b2899b79c" Jun 02 16:45:56.551677 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:45:56.551637 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5dd754dc-vc928" podUID="83ffe287-d220-41cd-a102-77b8029422ea" Jun 02 16:45:56.552228 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:45:56.551774 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7n7dn" podUID="6d6fcc1b-ce7e-4077-a070-269119a8e723" Jun 02 16:45:56.978123 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:45:56.978085 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lgc2j" Jun 02 16:45:56.978316 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:45:56.978202 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7n7dn" Jun 02 16:45:56.978316 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:45:56.978221 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:45:56.978411 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:45:56.978379 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt" Jun 02 16:46:00.445381 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:00.445325 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-mfzpt\" (UID: \"2eb49fdc-49ec-4844-a2ed-108e1ad6a300\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt" Jun 02 16:46:00.445381 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:00.445386 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:46:00.448274 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:00.448250 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls\") pod \"image-registry-5dd754dc-vc928\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:46:00.448377 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:00.448311 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2eb49fdc-49ec-4844-a2ed-108e1ad6a300-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-mfzpt\" (UID: \"2eb49fdc-49ec-4844-a2ed-108e1ad6a300\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt" Jun 02 16:46:00.546211 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:00.546168 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert\") pod \"ingress-canary-lgc2j\" (UID: \"70235929-1fb6-4b5d-bda3-f77b2899b79c\") " pod="openshift-ingress-canary/ingress-canary-lgc2j" Jun 02 16:46:00.546426 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:00.546270 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls\") pod \"dns-default-7n7dn\" (UID: \"6d6fcc1b-ce7e-4077-a070-269119a8e723\") " pod="openshift-dns/dns-default-7n7dn" Jun 02 16:46:00.548957 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:00.548920 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d6fcc1b-ce7e-4077-a070-269119a8e723-metrics-tls\") pod \"dns-default-7n7dn\" (UID: \"6d6fcc1b-ce7e-4077-a070-269119a8e723\") " pod="openshift-dns/dns-default-7n7dn" Jun 02 16:46:00.549128 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:00.549073 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70235929-1fb6-4b5d-bda3-f77b2899b79c-cert\") pod \"ingress-canary-lgc2j\" (UID: \"70235929-1fb6-4b5d-bda3-f77b2899b79c\") " pod="openshift-ingress-canary/ingress-canary-lgc2j" Jun 02 16:46:00.582126 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:00.582093 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2fzdf\"" Jun 02 16:46:00.582126 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:00.582093 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vq24k\"" Jun 02 16:46:00.582345 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:00.582094 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mnl2n\"" Jun 02 16:46:00.582345 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:00.582093 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qcz2w\"" Jun 02 16:46:00.589595 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:00.589555 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt" Jun 02 16:46:00.589595 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:00.589594 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:46:00.589803 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:00.589570 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7n7dn" Jun 02 16:46:00.589803 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:00.589622 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lgc2j" Jun 02 16:46:00.819762 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:00.819349 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lgc2j"] Jun 02 16:46:00.823727 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:46:00.823679 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70235929_1fb6_4b5d_bda3_f77b2899b79c.slice/crio-78af114d220ea1d96e6270378fd8f756ababe011aa4a8db33b0fc0c7f19356ed WatchSource:0}: Error finding container 78af114d220ea1d96e6270378fd8f756ababe011aa4a8db33b0fc0c7f19356ed: Status 404 returned error can't find the container with id 78af114d220ea1d96e6270378fd8f756ababe011aa4a8db33b0fc0c7f19356ed Jun 02 16:46:00.991038 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:00.990927 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lgc2j" event={"ID":"70235929-1fb6-4b5d-bda3-f77b2899b79c","Type":"ContainerStarted","Data":"78af114d220ea1d96e6270378fd8f756ababe011aa4a8db33b0fc0c7f19356ed"} Jun 02 16:46:01.050739 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:01.050702 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7n7dn"] Jun 02 16:46:01.057850 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:01.057749 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt"] Jun 02 16:46:01.059373 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:01.059345 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5dd754dc-vc928"] Jun 02 16:46:01.060196 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:46:01.060079 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83ffe287_d220_41cd_a102_77b8029422ea.slice/crio-92a6f94773b664d2f6d27eea04d9a577db86d98f35b109ecbe6c483b9e3301d2 WatchSource:0}: Error finding container 92a6f94773b664d2f6d27eea04d9a577db86d98f35b109ecbe6c483b9e3301d2: Status 404 returned error can't find the container with id 92a6f94773b664d2f6d27eea04d9a577db86d98f35b109ecbe6c483b9e3301d2 Jun 02 16:46:01.061751 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:46:01.061719 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eb49fdc_49ec_4844_a2ed_108e1ad6a300.slice/crio-a71e84ef66aa4ffcb2e8f2e55f80315fde6f3c3c26c4e64e2d75ab751152b1da WatchSource:0}: Error finding container a71e84ef66aa4ffcb2e8f2e55f80315fde6f3c3c26c4e64e2d75ab751152b1da: Status 404 returned error can't find the container with id a71e84ef66aa4ffcb2e8f2e55f80315fde6f3c3c26c4e64e2d75ab751152b1da Jun 02 16:46:01.847570 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:01.847503 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 16:46:01.849296 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:01.848230 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="alertmanager" containerID="cri-o://4747dfecadac4054b2502f2cf9c307673d88867deaf073b47fdd0f6cda76b5d6" gracePeriod=120 Jun 02 16:46:01.849296 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:01.848727 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="prom-label-proxy" containerID="cri-o://85bf4cab6641967a666d1196b1930e74f36837c9b0938ffba16b0b1cb2cbddd7" gracePeriod=120 Jun 02 16:46:01.849296 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:01.848831 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="kube-rbac-proxy-metric" containerID="cri-o://0e6f1c54e34adeedcdec3bd7585b093da223190bae0e4e25088b52cf81b683a5" gracePeriod=120 Jun 02 16:46:01.849296 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:01.848894 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="kube-rbac-proxy" containerID="cri-o://15dbd4d2608b3cc009cedf39566a3fded76ec04ecafea29304e8b7ef18ff383a" gracePeriod=120 Jun 02 16:46:01.849296 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:01.848950 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="kube-rbac-proxy-web" containerID="cri-o://fbaa32660e1013b124da8bb277354b77f2077b475c4cab6a691096c6a6f4d4c7" gracePeriod=120 Jun 02 16:46:01.849296 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:01.849001 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="config-reloader" containerID="cri-o://3c6757ade193d778c35ef9a88cc9bbd4a04dcf91a65e735e912bc8a402ffce67" gracePeriod=120 Jun 02 16:46:01.996655 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:01.996591 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7n7dn" event={"ID":"6d6fcc1b-ce7e-4077-a070-269119a8e723","Type":"ContainerStarted","Data":"83f81d170043c6cb373f34059fda0342266f02e38152be0480a3ab2e16e9b19c"} Jun 02 16:46:02.001823 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:02.001783 2565 generic.go:358] "Generic (PLEG): container finished" podID="e852bfea-2740-4d24-887d-7699aca72a7f" containerID="85bf4cab6641967a666d1196b1930e74f36837c9b0938ffba16b0b1cb2cbddd7" exitCode=0 Jun 02 16:46:02.001823 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:02.001820 2565 generic.go:358] "Generic (PLEG): container finished" podID="e852bfea-2740-4d24-887d-7699aca72a7f" containerID="0e6f1c54e34adeedcdec3bd7585b093da223190bae0e4e25088b52cf81b683a5" exitCode=0 Jun 02 16:46:02.001823 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:02.001829 2565 generic.go:358] "Generic (PLEG): container finished" podID="e852bfea-2740-4d24-887d-7699aca72a7f" containerID="15dbd4d2608b3cc009cedf39566a3fded76ec04ecafea29304e8b7ef18ff383a" exitCode=0 Jun 02 16:46:02.001823 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:02.001834 2565 generic.go:358] "Generic (PLEG): container finished" podID="e852bfea-2740-4d24-887d-7699aca72a7f" containerID="3c6757ade193d778c35ef9a88cc9bbd4a04dcf91a65e735e912bc8a402ffce67" exitCode=0 Jun 02 16:46:02.002199 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:02.001841 2565 generic.go:358] "Generic (PLEG): container finished" podID="e852bfea-2740-4d24-887d-7699aca72a7f" containerID="4747dfecadac4054b2502f2cf9c307673d88867deaf073b47fdd0f6cda76b5d6" exitCode=0 Jun 02 16:46:02.002199 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:02.001934 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e852bfea-2740-4d24-887d-7699aca72a7f","Type":"ContainerDied","Data":"85bf4cab6641967a666d1196b1930e74f36837c9b0938ffba16b0b1cb2cbddd7"} Jun 02 16:46:02.002199 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:02.001970 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e852bfea-2740-4d24-887d-7699aca72a7f","Type":"ContainerDied","Data":"0e6f1c54e34adeedcdec3bd7585b093da223190bae0e4e25088b52cf81b683a5"} Jun 02 16:46:02.002199 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:02.001987 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e852bfea-2740-4d24-887d-7699aca72a7f","Type":"ContainerDied","Data":"15dbd4d2608b3cc009cedf39566a3fded76ec04ecafea29304e8b7ef18ff383a"} Jun 02 16:46:02.002199 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:02.002001 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e852bfea-2740-4d24-887d-7699aca72a7f","Type":"ContainerDied","Data":"3c6757ade193d778c35ef9a88cc9bbd4a04dcf91a65e735e912bc8a402ffce67"} Jun 02 16:46:02.002199 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:02.002046 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e852bfea-2740-4d24-887d-7699aca72a7f","Type":"ContainerDied","Data":"4747dfecadac4054b2502f2cf9c307673d88867deaf073b47fdd0f6cda76b5d6"} Jun 02 16:46:02.003597 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:02.003547 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt" event={"ID":"2eb49fdc-49ec-4844-a2ed-108e1ad6a300","Type":"ContainerStarted","Data":"a71e84ef66aa4ffcb2e8f2e55f80315fde6f3c3c26c4e64e2d75ab751152b1da"} Jun 02 16:46:02.006066 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:02.005991 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dd754dc-vc928" event={"ID":"83ffe287-d220-41cd-a102-77b8029422ea","Type":"ContainerStarted","Data":"4503544da9a1f38a752b9357140e99107c12990b177f47a9ae15e38beb0f76c5"} Jun 02 16:46:02.006188 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:02.006070 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dd754dc-vc928" event={"ID":"83ffe287-d220-41cd-a102-77b8029422ea","Type":"ContainerStarted","Data":"92a6f94773b664d2f6d27eea04d9a577db86d98f35b109ecbe6c483b9e3301d2"} Jun 02 16:46:02.006376 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:02.006329 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:46:02.032031 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:02.031958 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5dd754dc-vc928" podStartSLOduration=286.031940195 podStartE2EDuration="4m46.031940195s" podCreationTimestamp="2026-06-02 16:41:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:46:02.030805994 +0000 UTC m=+286.486890251" watchObservedRunningTime="2026-06-02 16:46:02.031940195 +0000 UTC m=+286.488024451" Jun 02 16:46:03.012302 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.012259 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt" event={"ID":"2eb49fdc-49ec-4844-a2ed-108e1ad6a300","Type":"ContainerStarted","Data":"c772a7e8f0a12aff7b863c3cc465aad1500ec3ad83d5a1b0681b507ce26b2e74"} Jun 02 16:46:03.037708 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.037646 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mfzpt" podStartSLOduration=253.743701968 podStartE2EDuration="4m15.037622192s" podCreationTimestamp="2026-06-02 16:41:48 +0000 UTC" firstStartedPulling="2026-06-02 16:46:01.06685671 +0000 UTC m=+285.522940945" lastFinishedPulling="2026-06-02 16:46:02.360776934 +0000 UTC m=+286.816861169" observedRunningTime="2026-06-02 16:46:03.034737049 +0000 UTC m=+287.490821306" watchObservedRunningTime="2026-06-02 16:46:03.037622192 +0000 UTC m=+287.493706450" Jun 02 16:46:03.565388 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.564980 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:03.678787 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.678680 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e852bfea-2740-4d24-887d-7699aca72a7f\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " Jun 02 16:46:03.678787 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.678764 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e852bfea-2740-4d24-887d-7699aca72a7f-tls-assets\") pod \"e852bfea-2740-4d24-887d-7699aca72a7f\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " Jun 02 16:46:03.679044 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.678792 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-kube-rbac-proxy\") pod \"e852bfea-2740-4d24-887d-7699aca72a7f\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " Jun 02 16:46:03.679044 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.678818 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-cluster-tls-config\") pod \"e852bfea-2740-4d24-887d-7699aca72a7f\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " Jun 02 16:46:03.679044 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.678842 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jw5p9\" (UniqueName: \"kubernetes.io/projected/e852bfea-2740-4d24-887d-7699aca72a7f-kube-api-access-jw5p9\") pod \"e852bfea-2740-4d24-887d-7699aca72a7f\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " Jun 02 16:46:03.679044 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.678868 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-main-tls\") pod \"e852bfea-2740-4d24-887d-7699aca72a7f\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " Jun 02 16:46:03.679044 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.678916 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-web-config\") pod \"e852bfea-2740-4d24-887d-7699aca72a7f\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " Jun 02 16:46:03.679044 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.678945 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-config-volume\") pod \"e852bfea-2740-4d24-887d-7699aca72a7f\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " Jun 02 16:46:03.679044 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.678985 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e852bfea-2740-4d24-887d-7699aca72a7f-config-out\") pod \"e852bfea-2740-4d24-887d-7699aca72a7f\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " Jun 02 16:46:03.679044 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.679040 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e852bfea-2740-4d24-887d-7699aca72a7f-alertmanager-trusted-ca-bundle\") pod \"e852bfea-2740-4d24-887d-7699aca72a7f\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " Jun 02 16:46:03.679419 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.679074 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e852bfea-2740-4d24-887d-7699aca72a7f-alertmanager-main-db\") pod \"e852bfea-2740-4d24-887d-7699aca72a7f\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " Jun 02 16:46:03.679419 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.679126 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e852bfea-2740-4d24-887d-7699aca72a7f-metrics-client-ca\") pod \"e852bfea-2740-4d24-887d-7699aca72a7f\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " Jun 02 16:46:03.679419 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.679162 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-kube-rbac-proxy-web\") pod \"e852bfea-2740-4d24-887d-7699aca72a7f\" (UID: \"e852bfea-2740-4d24-887d-7699aca72a7f\") " Jun 02 16:46:03.679557 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.679485 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e852bfea-2740-4d24-887d-7699aca72a7f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e852bfea-2740-4d24-887d-7699aca72a7f" (UID: "e852bfea-2740-4d24-887d-7699aca72a7f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:46:03.680039 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.679928 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e852bfea-2740-4d24-887d-7699aca72a7f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e852bfea-2740-4d24-887d-7699aca72a7f" (UID: "e852bfea-2740-4d24-887d-7699aca72a7f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:46:03.680713 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.680666 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e852bfea-2740-4d24-887d-7699aca72a7f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e852bfea-2740-4d24-887d-7699aca72a7f" (UID: "e852bfea-2740-4d24-887d-7699aca72a7f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:46:03.683532 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.683413 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e852bfea-2740-4d24-887d-7699aca72a7f" (UID: "e852bfea-2740-4d24-887d-7699aca72a7f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:46:03.683532 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.683463 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e852bfea-2740-4d24-887d-7699aca72a7f" (UID: "e852bfea-2740-4d24-887d-7699aca72a7f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:46:03.683532 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.683485 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e852bfea-2740-4d24-887d-7699aca72a7f" (UID: "e852bfea-2740-4d24-887d-7699aca72a7f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:46:03.683532 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.683494 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-config-volume" (OuterVolumeSpecName: "config-volume") pod "e852bfea-2740-4d24-887d-7699aca72a7f" (UID: "e852bfea-2740-4d24-887d-7699aca72a7f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:46:03.683992 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.683962 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e852bfea-2740-4d24-887d-7699aca72a7f" (UID: "e852bfea-2740-4d24-887d-7699aca72a7f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:46:03.684324 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.684299 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e852bfea-2740-4d24-887d-7699aca72a7f-kube-api-access-jw5p9" (OuterVolumeSpecName: "kube-api-access-jw5p9") pod "e852bfea-2740-4d24-887d-7699aca72a7f" (UID: "e852bfea-2740-4d24-887d-7699aca72a7f"). InnerVolumeSpecName "kube-api-access-jw5p9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:46:03.684539 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.684518 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e852bfea-2740-4d24-887d-7699aca72a7f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e852bfea-2740-4d24-887d-7699aca72a7f" (UID: "e852bfea-2740-4d24-887d-7699aca72a7f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:46:03.684835 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.684811 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e852bfea-2740-4d24-887d-7699aca72a7f-config-out" (OuterVolumeSpecName: "config-out") pod "e852bfea-2740-4d24-887d-7699aca72a7f" (UID: "e852bfea-2740-4d24-887d-7699aca72a7f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:46:03.688902 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.688877 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e852bfea-2740-4d24-887d-7699aca72a7f" (UID: "e852bfea-2740-4d24-887d-7699aca72a7f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:46:03.698456 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.698422 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-web-config" (OuterVolumeSpecName: "web-config") pod "e852bfea-2740-4d24-887d-7699aca72a7f" (UID: "e852bfea-2740-4d24-887d-7699aca72a7f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:46:03.780114 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.780071 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:03.780114 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.780107 2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e852bfea-2740-4d24-887d-7699aca72a7f-tls-assets\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:03.780114 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.780117 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:03.780114 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.780128 2565 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-cluster-tls-config\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:03.780545 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.780140 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jw5p9\" (UniqueName: \"kubernetes.io/projected/e852bfea-2740-4d24-887d-7699aca72a7f-kube-api-access-jw5p9\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:03.780545 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.780150 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-main-tls\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:03.780545 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.780159 2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-web-config\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:03.780545 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.780167 2565 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-config-volume\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:03.780545 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.780175 2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e852bfea-2740-4d24-887d-7699aca72a7f-config-out\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:03.780545 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.780182 2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e852bfea-2740-4d24-887d-7699aca72a7f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:03.780545 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.780193 2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e852bfea-2740-4d24-887d-7699aca72a7f-alertmanager-main-db\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:03.780545 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.780203 2565 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e852bfea-2740-4d24-887d-7699aca72a7f-metrics-client-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:03.780545 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:03.780213 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e852bfea-2740-4d24-887d-7699aca72a7f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:04.016599 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.016471 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lgc2j" event={"ID":"70235929-1fb6-4b5d-bda3-f77b2899b79c","Type":"ContainerStarted","Data":"df1f233491f62537e45c73a9c4f20e763e4ffbfeba84c4070cb9c071bf8775b1"} Jun 02 16:46:04.018188 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.018164 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7n7dn" event={"ID":"6d6fcc1b-ce7e-4077-a070-269119a8e723","Type":"ContainerStarted","Data":"0117e6479f231ccf09700d6c6561c11e15e24cb5efd9fcb486fb4bf29efffd2e"} Jun 02 16:46:04.018278 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.018197 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7n7dn" event={"ID":"6d6fcc1b-ce7e-4077-a070-269119a8e723","Type":"ContainerStarted","Data":"4f3339b0735c39645d7712e41967ed5e3b891b0e13529baf418ef72d8462640a"} Jun 02 16:46:04.018342 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.018282 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7n7dn" Jun 02 16:46:04.021232 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.021206 2565 generic.go:358] "Generic (PLEG): container finished" podID="e852bfea-2740-4d24-887d-7699aca72a7f" containerID="fbaa32660e1013b124da8bb277354b77f2077b475c4cab6a691096c6a6f4d4c7" exitCode=0 Jun 02 16:46:04.021358 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.021326 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e852bfea-2740-4d24-887d-7699aca72a7f","Type":"ContainerDied","Data":"fbaa32660e1013b124da8bb277354b77f2077b475c4cab6a691096c6a6f4d4c7"} Jun 02 16:46:04.021404 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.021370 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e852bfea-2740-4d24-887d-7699aca72a7f","Type":"ContainerDied","Data":"5a53cd70cf3609f41db8e5eb3bf921640e7debe469a0d59d900581c2e6276bcc"} Jun 02 16:46:04.021404 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.021389 2565 scope.go:117] "RemoveContainer" containerID="85bf4cab6641967a666d1196b1930e74f36837c9b0938ffba16b0b1cb2cbddd7" Jun 02 16:46:04.021480 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.021410 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.029707 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.029684 2565 scope.go:117] "RemoveContainer" containerID="0e6f1c54e34adeedcdec3bd7585b093da223190bae0e4e25088b52cf81b683a5" Jun 02 16:46:04.037231 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.037209 2565 scope.go:117] "RemoveContainer" containerID="15dbd4d2608b3cc009cedf39566a3fded76ec04ecafea29304e8b7ef18ff383a" Jun 02 16:46:04.044950 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.044930 2565 scope.go:117] "RemoveContainer" containerID="fbaa32660e1013b124da8bb277354b77f2077b475c4cab6a691096c6a6f4d4c7" Jun 02 16:46:04.052545 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.052522 2565 scope.go:117] "RemoveContainer" containerID="3c6757ade193d778c35ef9a88cc9bbd4a04dcf91a65e735e912bc8a402ffce67" Jun 02 16:46:04.057145 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.057082 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lgc2j" podStartSLOduration=251.470753868 podStartE2EDuration="4m14.057059484s" podCreationTimestamp="2026-06-02 16:41:50 +0000 UTC" firstStartedPulling="2026-06-02 16:46:00.827202635 +0000 UTC m=+285.283286870" lastFinishedPulling="2026-06-02 16:46:03.413508251 +0000 UTC m=+287.869592486" observedRunningTime="2026-06-02 16:46:04.054309533 +0000 UTC m=+288.510393816" watchObservedRunningTime="2026-06-02 16:46:04.057059484 +0000 UTC m=+288.513143743" Jun 02 16:46:04.060674 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.060654 2565 scope.go:117] "RemoveContainer" containerID="4747dfecadac4054b2502f2cf9c307673d88867deaf073b47fdd0f6cda76b5d6" Jun 02 16:46:04.068747 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.068729 2565 scope.go:117] "RemoveContainer" containerID="f1ab9533be0e4ffdae7b3bab2df285057c3d399c0f3afb0ee6b87fc11b787d42" Jun 02 16:46:04.076697 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.076677 2565 scope.go:117] "RemoveContainer" containerID="85bf4cab6641967a666d1196b1930e74f36837c9b0938ffba16b0b1cb2cbddd7" Jun 02 16:46:04.077064 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:46:04.077036 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85bf4cab6641967a666d1196b1930e74f36837c9b0938ffba16b0b1cb2cbddd7\": container with ID starting with 85bf4cab6641967a666d1196b1930e74f36837c9b0938ffba16b0b1cb2cbddd7 not found: ID does not exist" containerID="85bf4cab6641967a666d1196b1930e74f36837c9b0938ffba16b0b1cb2cbddd7" Jun 02 16:46:04.077125 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.077077 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85bf4cab6641967a666d1196b1930e74f36837c9b0938ffba16b0b1cb2cbddd7"} err="failed to get container status \"85bf4cab6641967a666d1196b1930e74f36837c9b0938ffba16b0b1cb2cbddd7\": rpc error: code = NotFound desc = could not find container \"85bf4cab6641967a666d1196b1930e74f36837c9b0938ffba16b0b1cb2cbddd7\": container with ID starting with 85bf4cab6641967a666d1196b1930e74f36837c9b0938ffba16b0b1cb2cbddd7 not found: ID does not exist" Jun 02 16:46:04.077125 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.077114 2565 scope.go:117] "RemoveContainer" containerID="0e6f1c54e34adeedcdec3bd7585b093da223190bae0e4e25088b52cf81b683a5" Jun 02 16:46:04.077396 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:46:04.077377 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e6f1c54e34adeedcdec3bd7585b093da223190bae0e4e25088b52cf81b683a5\": container with ID starting with 0e6f1c54e34adeedcdec3bd7585b093da223190bae0e4e25088b52cf81b683a5 not found: ID does not exist" containerID="0e6f1c54e34adeedcdec3bd7585b093da223190bae0e4e25088b52cf81b683a5" Jun 02 16:46:04.077465 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.077401 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e6f1c54e34adeedcdec3bd7585b093da223190bae0e4e25088b52cf81b683a5"} err="failed to get container status \"0e6f1c54e34adeedcdec3bd7585b093da223190bae0e4e25088b52cf81b683a5\": rpc error: code = NotFound desc = could not find container \"0e6f1c54e34adeedcdec3bd7585b093da223190bae0e4e25088b52cf81b683a5\": container with ID starting with 0e6f1c54e34adeedcdec3bd7585b093da223190bae0e4e25088b52cf81b683a5 not found: ID does not exist" Jun 02 16:46:04.077465 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.077414 2565 scope.go:117] "RemoveContainer" containerID="15dbd4d2608b3cc009cedf39566a3fded76ec04ecafea29304e8b7ef18ff383a" Jun 02 16:46:04.077705 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:46:04.077683 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15dbd4d2608b3cc009cedf39566a3fded76ec04ecafea29304e8b7ef18ff383a\": container with ID starting with 15dbd4d2608b3cc009cedf39566a3fded76ec04ecafea29304e8b7ef18ff383a not found: ID does not exist" containerID="15dbd4d2608b3cc009cedf39566a3fded76ec04ecafea29304e8b7ef18ff383a" Jun 02 16:46:04.077755 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.077711 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15dbd4d2608b3cc009cedf39566a3fded76ec04ecafea29304e8b7ef18ff383a"} err="failed to get container status \"15dbd4d2608b3cc009cedf39566a3fded76ec04ecafea29304e8b7ef18ff383a\": rpc error: code = NotFound desc = could not find container \"15dbd4d2608b3cc009cedf39566a3fded76ec04ecafea29304e8b7ef18ff383a\": container with ID starting with 15dbd4d2608b3cc009cedf39566a3fded76ec04ecafea29304e8b7ef18ff383a not found: ID does not exist" Jun 02 16:46:04.077755 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.077725 2565 scope.go:117] "RemoveContainer" containerID="fbaa32660e1013b124da8bb277354b77f2077b475c4cab6a691096c6a6f4d4c7" Jun 02 16:46:04.077999 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:46:04.077984 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbaa32660e1013b124da8bb277354b77f2077b475c4cab6a691096c6a6f4d4c7\": container with ID starting with fbaa32660e1013b124da8bb277354b77f2077b475c4cab6a691096c6a6f4d4c7 not found: ID does not exist" containerID="fbaa32660e1013b124da8bb277354b77f2077b475c4cab6a691096c6a6f4d4c7" Jun 02 16:46:04.077999 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.078001 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbaa32660e1013b124da8bb277354b77f2077b475c4cab6a691096c6a6f4d4c7"} err="failed to get container status \"fbaa32660e1013b124da8bb277354b77f2077b475c4cab6a691096c6a6f4d4c7\": rpc error: code = NotFound desc = could not find container \"fbaa32660e1013b124da8bb277354b77f2077b475c4cab6a691096c6a6f4d4c7\": container with ID starting with fbaa32660e1013b124da8bb277354b77f2077b475c4cab6a691096c6a6f4d4c7 not found: ID does not exist" Jun 02 16:46:04.078146 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.078037 2565 scope.go:117] "RemoveContainer" containerID="3c6757ade193d778c35ef9a88cc9bbd4a04dcf91a65e735e912bc8a402ffce67" Jun 02 16:46:04.078942 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:46:04.078919 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c6757ade193d778c35ef9a88cc9bbd4a04dcf91a65e735e912bc8a402ffce67\": container with ID starting with 3c6757ade193d778c35ef9a88cc9bbd4a04dcf91a65e735e912bc8a402ffce67 not found: ID does not exist" containerID="3c6757ade193d778c35ef9a88cc9bbd4a04dcf91a65e735e912bc8a402ffce67" Jun 02 16:46:04.079075 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.078949 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c6757ade193d778c35ef9a88cc9bbd4a04dcf91a65e735e912bc8a402ffce67"} err="failed to get container status \"3c6757ade193d778c35ef9a88cc9bbd4a04dcf91a65e735e912bc8a402ffce67\": rpc error: code = NotFound desc = could not find container \"3c6757ade193d778c35ef9a88cc9bbd4a04dcf91a65e735e912bc8a402ffce67\": container with ID starting with 3c6757ade193d778c35ef9a88cc9bbd4a04dcf91a65e735e912bc8a402ffce67 not found: ID does not exist" Jun 02 16:46:04.079075 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.078971 2565 scope.go:117] "RemoveContainer" containerID="4747dfecadac4054b2502f2cf9c307673d88867deaf073b47fdd0f6cda76b5d6" Jun 02 16:46:04.079307 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:46:04.079285 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4747dfecadac4054b2502f2cf9c307673d88867deaf073b47fdd0f6cda76b5d6\": container with ID starting with 4747dfecadac4054b2502f2cf9c307673d88867deaf073b47fdd0f6cda76b5d6 not found: ID does not exist" containerID="4747dfecadac4054b2502f2cf9c307673d88867deaf073b47fdd0f6cda76b5d6" Jun 02 16:46:04.079385 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.079313 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4747dfecadac4054b2502f2cf9c307673d88867deaf073b47fdd0f6cda76b5d6"} err="failed to get container status \"4747dfecadac4054b2502f2cf9c307673d88867deaf073b47fdd0f6cda76b5d6\": rpc error: code = NotFound desc = could not find container \"4747dfecadac4054b2502f2cf9c307673d88867deaf073b47fdd0f6cda76b5d6\": container with ID starting with 4747dfecadac4054b2502f2cf9c307673d88867deaf073b47fdd0f6cda76b5d6 not found: ID does not exist" Jun 02 16:46:04.079385 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.079333 2565 scope.go:117] "RemoveContainer" containerID="f1ab9533be0e4ffdae7b3bab2df285057c3d399c0f3afb0ee6b87fc11b787d42" Jun 02 16:46:04.079669 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:46:04.079647 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1ab9533be0e4ffdae7b3bab2df285057c3d399c0f3afb0ee6b87fc11b787d42\": container with ID starting with f1ab9533be0e4ffdae7b3bab2df285057c3d399c0f3afb0ee6b87fc11b787d42 not found: ID does not exist" containerID="f1ab9533be0e4ffdae7b3bab2df285057c3d399c0f3afb0ee6b87fc11b787d42" Jun 02 16:46:04.079723 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.079678 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1ab9533be0e4ffdae7b3bab2df285057c3d399c0f3afb0ee6b87fc11b787d42"} err="failed to get container status \"f1ab9533be0e4ffdae7b3bab2df285057c3d399c0f3afb0ee6b87fc11b787d42\": rpc error: code = NotFound desc = could not find container \"f1ab9533be0e4ffdae7b3bab2df285057c3d399c0f3afb0ee6b87fc11b787d42\": container with ID starting with f1ab9533be0e4ffdae7b3bab2df285057c3d399c0f3afb0ee6b87fc11b787d42 not found: ID does not exist" Jun 02 16:46:04.096630 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.096543 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-7n7dn" podStartSLOduration=251.745570522 podStartE2EDuration="4m14.096526992s" podCreationTimestamp="2026-06-02 16:41:50 +0000 UTC" firstStartedPulling="2026-06-02 16:46:01.058374126 +0000 UTC m=+285.514458360" lastFinishedPulling="2026-06-02 16:46:03.40933059 +0000 UTC m=+287.865414830" observedRunningTime="2026-06-02 16:46:04.093692702 +0000 UTC m=+288.549776959" watchObservedRunningTime="2026-06-02 16:46:04.096526992 +0000 UTC m=+288.552611248" Jun 02 16:46:04.148129 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.148085 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 16:46:04.160143 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.160099 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 16:46:04.222964 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.222920 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 16:46:04.223357 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.223337 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="config-reloader" Jun 02 16:46:04.223357 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.223358 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="config-reloader" Jun 02 16:46:04.223491 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.223372 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="kube-rbac-proxy-web" Jun 02 16:46:04.223491 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.223378 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="kube-rbac-proxy-web" Jun 02 16:46:04.223491 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.223389 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="kube-rbac-proxy" Jun 02 16:46:04.223491 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.223398 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="kube-rbac-proxy" Jun 02 16:46:04.223491 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.223407 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="init-config-reloader" Jun 02 16:46:04.223491 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.223412 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="init-config-reloader" Jun 02 16:46:04.223491 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.223426 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="prom-label-proxy" Jun 02 16:46:04.223491 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.223434 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="prom-label-proxy" Jun 02 16:46:04.223491 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.223447 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="alertmanager" Jun 02 16:46:04.223491 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.223454 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="alertmanager" Jun 02 16:46:04.223491 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.223459 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="kube-rbac-proxy-metric" Jun 02 16:46:04.223491 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.223466 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="kube-rbac-proxy-metric" Jun 02 16:46:04.224108 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.223541 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="kube-rbac-proxy-metric" Jun 02 16:46:04.224108 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.223548 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="prom-label-proxy" Jun 02 16:46:04.224108 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.223559 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="kube-rbac-proxy-web" Jun 02 16:46:04.224108 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.223566 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="config-reloader" Jun 02 16:46:04.224108 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.223573 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="kube-rbac-proxy" Jun 02 16:46:04.224108 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.223583 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" containerName="alertmanager" Jun 02 16:46:04.228965 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.228938 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.232956 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.232919 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 16:46:04.232956 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.232936 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 16:46:04.233203 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.232978 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 16:46:04.233263 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.233221 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 16:46:04.233481 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.233462 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 16:46:04.233586 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.233507 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 16:46:04.233586 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.233563 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 16:46:04.233700 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.233627 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-thcw9\"" Jun 02 16:46:04.236962 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.236945 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 16:46:04.240099 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.240079 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 16:46:04.254745 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.254712 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 16:46:04.284983 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.284892 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cd00d6a-46a8-44e1-82ee-b46ac5169985-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.284983 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.284933 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cd00d6a-46a8-44e1-82ee-b46ac5169985-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.284983 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.284966 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cd00d6a-46a8-44e1-82ee-b46ac5169985-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.285264 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.284994 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cd00d6a-46a8-44e1-82ee-b46ac5169985-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.285264 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.285033 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cd00d6a-46a8-44e1-82ee-b46ac5169985-web-config\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.285264 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.285071 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cd00d6a-46a8-44e1-82ee-b46ac5169985-config-volume\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.285264 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.285111 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cd00d6a-46a8-44e1-82ee-b46ac5169985-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.285264 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.285156 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cd00d6a-46a8-44e1-82ee-b46ac5169985-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.285264 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.285212 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z5fl\" (UniqueName: \"kubernetes.io/projected/3cd00d6a-46a8-44e1-82ee-b46ac5169985-kube-api-access-2z5fl\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.285264 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.285242 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cd00d6a-46a8-44e1-82ee-b46ac5169985-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.285484 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.285276 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cd00d6a-46a8-44e1-82ee-b46ac5169985-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.285484 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.285295 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cd00d6a-46a8-44e1-82ee-b46ac5169985-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.285484 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.285319 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cd00d6a-46a8-44e1-82ee-b46ac5169985-config-out\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.386203 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.386152 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cd00d6a-46a8-44e1-82ee-b46ac5169985-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.386203 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.386193 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cd00d6a-46a8-44e1-82ee-b46ac5169985-web-config\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.386203 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.386212 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cd00d6a-46a8-44e1-82ee-b46ac5169985-config-volume\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.386499 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.386341 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cd00d6a-46a8-44e1-82ee-b46ac5169985-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.386499 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.386419 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cd00d6a-46a8-44e1-82ee-b46ac5169985-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.386499 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.386493 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2z5fl\" (UniqueName: \"kubernetes.io/projected/3cd00d6a-46a8-44e1-82ee-b46ac5169985-kube-api-access-2z5fl\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.386639 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.386533 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cd00d6a-46a8-44e1-82ee-b46ac5169985-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.386639 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.386590 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cd00d6a-46a8-44e1-82ee-b46ac5169985-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.386639 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.386622 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cd00d6a-46a8-44e1-82ee-b46ac5169985-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.386793 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.386658 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cd00d6a-46a8-44e1-82ee-b46ac5169985-config-out\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.386793 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.386696 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cd00d6a-46a8-44e1-82ee-b46ac5169985-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.386793 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.386737 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cd00d6a-46a8-44e1-82ee-b46ac5169985-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.386793 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.386774 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cd00d6a-46a8-44e1-82ee-b46ac5169985-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.387153 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.387082 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cd00d6a-46a8-44e1-82ee-b46ac5169985-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.388348 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.388312 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cd00d6a-46a8-44e1-82ee-b46ac5169985-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.389618 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.389489 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cd00d6a-46a8-44e1-82ee-b46ac5169985-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.389831 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.389698 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cd00d6a-46a8-44e1-82ee-b46ac5169985-config-volume\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.389949 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.389817 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cd00d6a-46a8-44e1-82ee-b46ac5169985-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.390115 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.390051 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cd00d6a-46a8-44e1-82ee-b46ac5169985-config-out\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.390115 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.389847 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cd00d6a-46a8-44e1-82ee-b46ac5169985-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.390279 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.390187 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cd00d6a-46a8-44e1-82ee-b46ac5169985-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.390335 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.390287 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cd00d6a-46a8-44e1-82ee-b46ac5169985-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.390654 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.390634 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cd00d6a-46a8-44e1-82ee-b46ac5169985-web-config\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.391280 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.391263 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cd00d6a-46a8-44e1-82ee-b46ac5169985-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.391701 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.391684 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cd00d6a-46a8-44e1-82ee-b46ac5169985-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.396180 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.396159 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z5fl\" (UniqueName: \"kubernetes.io/projected/3cd00d6a-46a8-44e1-82ee-b46ac5169985-kube-api-access-2z5fl\") pod \"alertmanager-main-0\" (UID: \"3cd00d6a-46a8-44e1-82ee-b46ac5169985\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.544105 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.544069 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:46:04.690926 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:04.690876 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 16:46:04.694904 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:46:04.694871 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cd00d6a_46a8_44e1_82ee_b46ac5169985.slice/crio-4a6f73631ab9d1de6b0b4a18f9339806f4afd8e2b86ee8409b6c16a23a524703 WatchSource:0}: Error finding container 4a6f73631ab9d1de6b0b4a18f9339806f4afd8e2b86ee8409b6c16a23a524703: Status 404 returned error can't find the container with id 4a6f73631ab9d1de6b0b4a18f9339806f4afd8e2b86ee8409b6c16a23a524703 Jun 02 16:46:05.027291 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:05.027249 2565 generic.go:358] "Generic (PLEG): container finished" podID="3cd00d6a-46a8-44e1-82ee-b46ac5169985" containerID="7523506084e16851338ebf1c7bf987bc5de7da4690aad05f67f0cd9657e5f83a" exitCode=0 Jun 02 16:46:05.027801 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:05.027331 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cd00d6a-46a8-44e1-82ee-b46ac5169985","Type":"ContainerDied","Data":"7523506084e16851338ebf1c7bf987bc5de7da4690aad05f67f0cd9657e5f83a"} Jun 02 16:46:05.027801 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:05.027371 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cd00d6a-46a8-44e1-82ee-b46ac5169985","Type":"ContainerStarted","Data":"4a6f73631ab9d1de6b0b4a18f9339806f4afd8e2b86ee8409b6c16a23a524703"} Jun 02 16:46:06.036130 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.036081 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cd00d6a-46a8-44e1-82ee-b46ac5169985","Type":"ContainerStarted","Data":"16504f29507106c0931990e0d0acaa575f2007e22dbc95b4221dc83a7e842ca4"} Jun 02 16:46:06.036130 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.036138 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cd00d6a-46a8-44e1-82ee-b46ac5169985","Type":"ContainerStarted","Data":"e0c07916183f7ca8e0844e84d246fd2cd2951d20ba813c655ddb81b38d8e1941"} Jun 02 16:46:06.036824 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.036151 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cd00d6a-46a8-44e1-82ee-b46ac5169985","Type":"ContainerStarted","Data":"04331b16eedb992532e8c80d2c346e179da56609ef0303c840c88cb654924c5e"} Jun 02 16:46:06.036824 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.036163 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cd00d6a-46a8-44e1-82ee-b46ac5169985","Type":"ContainerStarted","Data":"879ea92fe4915a7efa934c05c02e1b4a6bc99d2e6fce52f421cc42ef1bc64894"} Jun 02 16:46:06.036824 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.036174 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cd00d6a-46a8-44e1-82ee-b46ac5169985","Type":"ContainerStarted","Data":"a0920d39ad37abe3d3f0a7351f7e1371ef3f1b95f055e75ab2024113076cd550"} Jun 02 16:46:06.036824 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.036186 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cd00d6a-46a8-44e1-82ee-b46ac5169985","Type":"ContainerStarted","Data":"d3bb77f6b363438998eb3ec86afde93ec5801169340df48271ad62331155cab5"} Jun 02 16:46:06.048160 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.048124 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e852bfea-2740-4d24-887d-7699aca72a7f" path="/var/lib/kubelet/pods/e852bfea-2740-4d24-887d-7699aca72a7f/volumes" Jun 02 16:46:06.099427 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.099366 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.09934556 podStartE2EDuration="2.09934556s" podCreationTimestamp="2026-06-02 16:46:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:46:06.097712351 +0000 UTC m=+290.553796609" watchObservedRunningTime="2026-06-02 16:46:06.09934556 +0000 UTC m=+290.555429817" Jun 02 16:46:06.285460 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.285417 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 16:46:06.285953 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.285908 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="prometheus" containerID="cri-o://4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51" gracePeriod=600 Jun 02 16:46:06.286072 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.285940 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="thanos-sidecar" containerID="cri-o://22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c" gracePeriod=600 Jun 02 16:46:06.286072 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.285992 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="kube-rbac-proxy-web" containerID="cri-o://337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0" gracePeriod=600 Jun 02 16:46:06.286072 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.286045 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="kube-rbac-proxy-thanos" containerID="cri-o://e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae" gracePeriod=600 Jun 02 16:46:06.286273 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.286076 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="config-reloader" containerID="cri-o://3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8" gracePeriod=600 Jun 02 16:46:06.286273 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.285969 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="kube-rbac-proxy" containerID="cri-o://3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda" gracePeriod=600 Jun 02 16:46:06.541734 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.541662 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:06.608876 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.608455 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-prometheus-trusted-ca-bundle\") pod \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " Jun 02 16:46:06.608876 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.608526 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-configmap-kubelet-serving-ca-bundle\") pod \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " Jun 02 16:46:06.608876 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.608558 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-config\") pod \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " Jun 02 16:46:06.608876 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.608605 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-prometheus-k8s-db\") pod \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " Jun 02 16:46:06.608876 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.608631 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " Jun 02 16:46:06.608876 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.608657 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-configmap-serving-certs-ca-bundle\") pod \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " Jun 02 16:46:06.608876 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.608685 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-metrics-client-certs\") pod \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " Jun 02 16:46:06.608876 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.608712 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7knft\" (UniqueName: \"kubernetes.io/projected/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-kube-api-access-7knft\") pod \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " Jun 02 16:46:06.608876 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.608741 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-thanos-prometheus-http-client-file\") pod \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " Jun 02 16:46:06.608876 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.608776 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-configmap-metrics-client-ca\") pod \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " Jun 02 16:46:06.608876 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.608808 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " Jun 02 16:46:06.608876 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.608834 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-grpc-tls\") pod \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " Jun 02 16:46:06.609618 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.608904 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-config-out\") pod \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " Jun 02 16:46:06.609618 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.608929 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-prometheus-k8s-rulefiles-0\") pod \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " Jun 02 16:46:06.609618 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.608951 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-web-config\") pod \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " Jun 02 16:46:06.609618 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.608994 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-prometheus-k8s-tls\") pod \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " Jun 02 16:46:06.609618 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.609042 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-tls-assets\") pod \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " Jun 02 16:46:06.609618 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.609070 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-kube-rbac-proxy\") pod \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\" (UID: \"315b95e4-6c8d-41bc-b2ef-748e8bac61e8\") " Jun 02 16:46:06.609960 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.609618 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "315b95e4-6c8d-41bc-b2ef-748e8bac61e8" (UID: "315b95e4-6c8d-41bc-b2ef-748e8bac61e8"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:46:06.609960 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.609646 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "315b95e4-6c8d-41bc-b2ef-748e8bac61e8" (UID: "315b95e4-6c8d-41bc-b2ef-748e8bac61e8"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:46:06.609960 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.609908 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "315b95e4-6c8d-41bc-b2ef-748e8bac61e8" (UID: "315b95e4-6c8d-41bc-b2ef-748e8bac61e8"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:46:06.610134 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.610114 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "315b95e4-6c8d-41bc-b2ef-748e8bac61e8" (UID: "315b95e4-6c8d-41bc-b2ef-748e8bac61e8"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:46:06.610515 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.610471 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "315b95e4-6c8d-41bc-b2ef-748e8bac61e8" (UID: "315b95e4-6c8d-41bc-b2ef-748e8bac61e8"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:46:06.614124 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.614092 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "315b95e4-6c8d-41bc-b2ef-748e8bac61e8" (UID: "315b95e4-6c8d-41bc-b2ef-748e8bac61e8"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:46:06.614868 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.614555 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "315b95e4-6c8d-41bc-b2ef-748e8bac61e8" (UID: "315b95e4-6c8d-41bc-b2ef-748e8bac61e8"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:46:06.615327 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.615298 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "315b95e4-6c8d-41bc-b2ef-748e8bac61e8" (UID: "315b95e4-6c8d-41bc-b2ef-748e8bac61e8"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:46:06.615426 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.615377 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-config" (OuterVolumeSpecName: "config") pod "315b95e4-6c8d-41bc-b2ef-748e8bac61e8" (UID: "315b95e4-6c8d-41bc-b2ef-748e8bac61e8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:46:06.615489 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.615421 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-config-out" (OuterVolumeSpecName: "config-out") pod "315b95e4-6c8d-41bc-b2ef-748e8bac61e8" (UID: "315b95e4-6c8d-41bc-b2ef-748e8bac61e8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:46:06.615966 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.615700 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "315b95e4-6c8d-41bc-b2ef-748e8bac61e8" (UID: "315b95e4-6c8d-41bc-b2ef-748e8bac61e8"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:46:06.615966 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.615918 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "315b95e4-6c8d-41bc-b2ef-748e8bac61e8" (UID: "315b95e4-6c8d-41bc-b2ef-748e8bac61e8"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:46:06.616475 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.616445 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "315b95e4-6c8d-41bc-b2ef-748e8bac61e8" (UID: "315b95e4-6c8d-41bc-b2ef-748e8bac61e8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:46:06.617361 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.617328 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-kube-api-access-7knft" (OuterVolumeSpecName: "kube-api-access-7knft") pod "315b95e4-6c8d-41bc-b2ef-748e8bac61e8" (UID: "315b95e4-6c8d-41bc-b2ef-748e8bac61e8"). InnerVolumeSpecName "kube-api-access-7knft". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:46:06.617953 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.617861 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "315b95e4-6c8d-41bc-b2ef-748e8bac61e8" (UID: "315b95e4-6c8d-41bc-b2ef-748e8bac61e8"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:46:06.617953 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.617913 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "315b95e4-6c8d-41bc-b2ef-748e8bac61e8" (UID: "315b95e4-6c8d-41bc-b2ef-748e8bac61e8"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:46:06.618314 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.618173 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "315b95e4-6c8d-41bc-b2ef-748e8bac61e8" (UID: "315b95e4-6c8d-41bc-b2ef-748e8bac61e8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:46:06.630243 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.630209 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-web-config" (OuterVolumeSpecName: "web-config") pod "315b95e4-6c8d-41bc-b2ef-748e8bac61e8" (UID: "315b95e4-6c8d-41bc-b2ef-748e8bac61e8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:46:06.710782 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.710741 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-configmap-metrics-client-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:06.710782 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.710777 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:06.710782 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.710789 2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-grpc-tls\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:06.711055 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.710799 2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-config-out\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:06.711055 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.710809 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:06.711055 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.710818 2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-web-config\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:06.711055 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.710828 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:06.711055 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.710836 2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-tls-assets\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:06.711055 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.710845 2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-kube-rbac-proxy\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:06.711055 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.710854 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:06.711055 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.710863 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:06.711055 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.710871 2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-config\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:06.711055 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.710879 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-prometheus-k8s-db\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:06.711055 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.710889 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:06.711055 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.710899 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:06.711055 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.710908 2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-secret-metrics-client-certs\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:06.711055 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.710917 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7knft\" (UniqueName: \"kubernetes.io/projected/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-kube-api-access-7knft\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:06.711055 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:06.710925 2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/315b95e4-6c8d-41bc-b2ef-748e8bac61e8-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:07.045627 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.045594 2565 generic.go:358] "Generic (PLEG): container finished" podID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerID="e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae" exitCode=0 Jun 02 16:46:07.045627 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.045622 2565 generic.go:358] "Generic (PLEG): container finished" podID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerID="3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda" exitCode=0 Jun 02 16:46:07.045627 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.045629 2565 generic.go:358] "Generic (PLEG): container finished" podID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerID="337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0" exitCode=0 Jun 02 16:46:07.045627 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.045635 2565 generic.go:358] "Generic (PLEG): container finished" podID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerID="22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c" exitCode=0 Jun 02 16:46:07.045627 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.045640 2565 generic.go:358] "Generic (PLEG): container finished" podID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerID="3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8" exitCode=0 Jun 02 16:46:07.046253 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.045645 2565 generic.go:358] "Generic (PLEG): container finished" podID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerID="4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51" exitCode=0 Jun 02 16:46:07.046253 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.045684 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"315b95e4-6c8d-41bc-b2ef-748e8bac61e8","Type":"ContainerDied","Data":"e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae"} Jun 02 16:46:07.046253 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.045715 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.046253 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.045722 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"315b95e4-6c8d-41bc-b2ef-748e8bac61e8","Type":"ContainerDied","Data":"3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda"} Jun 02 16:46:07.046253 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.045739 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"315b95e4-6c8d-41bc-b2ef-748e8bac61e8","Type":"ContainerDied","Data":"337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0"} Jun 02 16:46:07.046253 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.045752 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"315b95e4-6c8d-41bc-b2ef-748e8bac61e8","Type":"ContainerDied","Data":"22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c"} Jun 02 16:46:07.046253 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.045766 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"315b95e4-6c8d-41bc-b2ef-748e8bac61e8","Type":"ContainerDied","Data":"3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8"} Jun 02 16:46:07.046253 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.045776 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"315b95e4-6c8d-41bc-b2ef-748e8bac61e8","Type":"ContainerDied","Data":"4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51"} Jun 02 16:46:07.046253 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.045784 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"315b95e4-6c8d-41bc-b2ef-748e8bac61e8","Type":"ContainerDied","Data":"278f700285d79839b490cbb6a565f797234c4189e25229db83f8c8844f65f53c"} Jun 02 16:46:07.046253 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.045799 2565 scope.go:117] "RemoveContainer" containerID="e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae" Jun 02 16:46:07.055003 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.054983 2565 scope.go:117] "RemoveContainer" containerID="3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda" Jun 02 16:46:07.062802 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.062771 2565 scope.go:117] "RemoveContainer" containerID="337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0" Jun 02 16:46:07.070348 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.070317 2565 scope.go:117] "RemoveContainer" containerID="22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c" Jun 02 16:46:07.072499 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.072473 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 16:46:07.077345 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.077318 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 16:46:07.079444 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.079425 2565 scope.go:117] "RemoveContainer" containerID="3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8" Jun 02 16:46:07.086950 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.086930 2565 scope.go:117] "RemoveContainer" containerID="4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51" Jun 02 16:46:07.094571 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.094550 2565 scope.go:117] "RemoveContainer" containerID="046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9" Jun 02 16:46:07.102618 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.102599 2565 scope.go:117] "RemoveContainer" containerID="e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae" Jun 02 16:46:07.102915 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:46:07.102886 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae\": container with ID starting with e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae not found: ID does not exist" containerID="e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae" Jun 02 16:46:07.102994 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.102922 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae"} err="failed to get container status \"e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae\": rpc error: code = NotFound desc = could not find container \"e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae\": container with ID starting with e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae not found: ID does not exist" Jun 02 16:46:07.102994 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.102945 2565 scope.go:117] "RemoveContainer" containerID="3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda" Jun 02 16:46:07.103227 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:46:07.103211 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda\": container with ID starting with 3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda not found: ID does not exist" containerID="3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda" Jun 02 16:46:07.103279 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.103233 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda"} err="failed to get container status \"3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda\": rpc error: code = NotFound desc = could not find container \"3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda\": container with ID starting with 3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda not found: ID does not exist" Jun 02 16:46:07.103279 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.103248 2565 scope.go:117] "RemoveContainer" containerID="337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0" Jun 02 16:46:07.103456 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:46:07.103439 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0\": container with ID starting with 337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0 not found: ID does not exist" containerID="337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0" Jun 02 16:46:07.103502 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.103458 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0"} err="failed to get container status \"337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0\": rpc error: code = NotFound desc = could not find container \"337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0\": container with ID starting with 337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0 not found: ID does not exist" Jun 02 16:46:07.103502 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.103472 2565 scope.go:117] "RemoveContainer" containerID="22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c" Jun 02 16:46:07.103724 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:46:07.103706 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c\": container with ID starting with 22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c not found: ID does not exist" containerID="22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c" Jun 02 16:46:07.103761 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.103729 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c"} err="failed to get container status \"22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c\": rpc error: code = NotFound desc = could not find container \"22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c\": container with ID starting with 22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c not found: ID does not exist" Jun 02 16:46:07.103761 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.103744 2565 scope.go:117] "RemoveContainer" containerID="3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8" Jun 02 16:46:07.103968 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:46:07.103949 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8\": container with ID starting with 3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8 not found: ID does not exist" containerID="3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8" Jun 02 16:46:07.104036 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.103972 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8"} err="failed to get container status \"3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8\": rpc error: code = NotFound desc = could not find container \"3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8\": container with ID starting with 3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8 not found: ID does not exist" Jun 02 16:46:07.104036 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.103983 2565 scope.go:117] "RemoveContainer" containerID="4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51" Jun 02 16:46:07.104299 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:46:07.104286 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51\": container with ID starting with 4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51 not found: ID does not exist" containerID="4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51" Jun 02 16:46:07.104358 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.104302 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51"} err="failed to get container status \"4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51\": rpc error: code = NotFound desc = could not find container \"4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51\": container with ID starting with 4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51 not found: ID does not exist" Jun 02 16:46:07.104358 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.104314 2565 scope.go:117] "RemoveContainer" containerID="046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9" Jun 02 16:46:07.104547 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:46:07.104531 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9\": container with ID starting with 046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9 not found: ID does not exist" containerID="046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9" Jun 02 16:46:07.104604 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.104549 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9"} err="failed to get container status \"046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9\": rpc error: code = NotFound desc = could not find container \"046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9\": container with ID starting with 046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9 not found: ID does not exist" Jun 02 16:46:07.104604 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.104562 2565 scope.go:117] "RemoveContainer" containerID="e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae" Jun 02 16:46:07.104779 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.104759 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae"} err="failed to get container status \"e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae\": rpc error: code = NotFound desc = could not find container \"e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae\": container with ID starting with e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae not found: ID does not exist" Jun 02 16:46:07.104821 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.104781 2565 scope.go:117] "RemoveContainer" containerID="3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda" Jun 02 16:46:07.104999 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.104982 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda"} err="failed to get container status \"3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda\": rpc error: code = NotFound desc = could not find container \"3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda\": container with ID starting with 3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda not found: ID does not exist" Jun 02 16:46:07.104999 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.104999 2565 scope.go:117] "RemoveContainer" containerID="337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0" Jun 02 16:46:07.105320 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.105295 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0"} err="failed to get container status \"337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0\": rpc error: code = NotFound desc = could not find container \"337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0\": container with ID starting with 337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0 not found: ID does not exist" Jun 02 16:46:07.105320 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.105319 2565 scope.go:117] "RemoveContainer" containerID="22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c" Jun 02 16:46:07.105551 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.105533 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c"} err="failed to get container status \"22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c\": rpc error: code = NotFound desc = could not find container \"22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c\": container with ID starting with 22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c not found: ID does not exist" Jun 02 16:46:07.105617 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.105551 2565 scope.go:117] "RemoveContainer" containerID="3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8" Jun 02 16:46:07.105787 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.105770 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8"} err="failed to get container status \"3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8\": rpc error: code = NotFound desc = could not find container \"3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8\": container with ID starting with 3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8 not found: ID does not exist" Jun 02 16:46:07.105853 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.105794 2565 scope.go:117] "RemoveContainer" containerID="4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51" Jun 02 16:46:07.106373 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.106312 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51"} err="failed to get container status \"4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51\": rpc error: code = NotFound desc = could not find container \"4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51\": container with ID starting with 4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51 not found: ID does not exist" Jun 02 16:46:07.106487 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.106375 2565 scope.go:117] "RemoveContainer" containerID="046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9" Jun 02 16:46:07.106911 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.106882 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9"} err="failed to get container status \"046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9\": rpc error: code = NotFound desc = could not find container \"046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9\": container with ID starting with 046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9 not found: ID does not exist" Jun 02 16:46:07.107021 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.106912 2565 scope.go:117] "RemoveContainer" containerID="e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae" Jun 02 16:46:07.107210 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.107190 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae"} err="failed to get container status \"e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae\": rpc error: code = NotFound desc = could not find container \"e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae\": container with ID starting with e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae not found: ID does not exist" Jun 02 16:46:07.107313 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.107211 2565 scope.go:117] "RemoveContainer" containerID="3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda" Jun 02 16:46:07.107445 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.107422 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda"} err="failed to get container status \"3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda\": rpc error: code = NotFound desc = could not find container \"3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda\": container with ID starting with 3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda not found: ID does not exist" Jun 02 16:46:07.107530 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.107448 2565 scope.go:117] "RemoveContainer" containerID="337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0" Jun 02 16:46:07.107657 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.107638 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0"} err="failed to get container status \"337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0\": rpc error: code = NotFound desc = could not find container \"337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0\": container with ID starting with 337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0 not found: ID does not exist" Jun 02 16:46:07.107657 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.107656 2565 scope.go:117] "RemoveContainer" containerID="22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c" Jun 02 16:46:07.107892 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.107871 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c"} err="failed to get container status \"22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c\": rpc error: code = NotFound desc = could not find container \"22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c\": container with ID starting with 22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c not found: ID does not exist" Jun 02 16:46:07.107982 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.107894 2565 scope.go:117] "RemoveContainer" containerID="3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8" Jun 02 16:46:07.108154 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.108131 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8"} err="failed to get container status \"3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8\": rpc error: code = NotFound desc = could not find container \"3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8\": container with ID starting with 3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8 not found: ID does not exist" Jun 02 16:46:07.108230 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.108157 2565 scope.go:117] "RemoveContainer" containerID="4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51" Jun 02 16:46:07.108419 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.108401 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51"} err="failed to get container status \"4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51\": rpc error: code = NotFound desc = could not find container \"4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51\": container with ID starting with 4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51 not found: ID does not exist" Jun 02 16:46:07.108419 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.108421 2565 scope.go:117] "RemoveContainer" containerID="046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9" Jun 02 16:46:07.108682 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.108658 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9"} err="failed to get container status \"046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9\": rpc error: code = NotFound desc = could not find container \"046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9\": container with ID starting with 046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9 not found: ID does not exist" Jun 02 16:46:07.108682 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.108678 2565 scope.go:117] "RemoveContainer" containerID="e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae" Jun 02 16:46:07.108891 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.108868 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 16:46:07.108951 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.108881 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae"} err="failed to get container status \"e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae\": rpc error: code = NotFound desc = could not find container \"e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae\": container with ID starting with e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae not found: ID does not exist" Jun 02 16:46:07.108951 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.108939 2565 scope.go:117] "RemoveContainer" containerID="3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda" Jun 02 16:46:07.109212 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109193 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda"} err="failed to get container status \"3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda\": rpc error: code = NotFound desc = could not find container \"3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda\": container with ID starting with 3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda not found: ID does not exist" Jun 02 16:46:07.109212 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109211 2565 scope.go:117] "RemoveContainer" containerID="337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0" Jun 02 16:46:07.109342 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109322 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="thanos-sidecar" Jun 02 16:46:07.109397 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109345 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="thanos-sidecar" Jun 02 16:46:07.109397 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109366 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="prometheus" Jun 02 16:46:07.109397 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109375 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="prometheus" Jun 02 16:46:07.109397 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109392 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="kube-rbac-proxy" Jun 02 16:46:07.109535 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109403 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="kube-rbac-proxy" Jun 02 16:46:07.109535 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109419 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="config-reloader" Jun 02 16:46:07.109535 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109427 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="config-reloader" Jun 02 16:46:07.109535 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109438 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="kube-rbac-proxy-web" Jun 02 16:46:07.109535 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109446 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="kube-rbac-proxy-web" Jun 02 16:46:07.109535 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109457 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="kube-rbac-proxy-thanos" Jun 02 16:46:07.109535 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109466 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="kube-rbac-proxy-thanos" Jun 02 16:46:07.109535 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109486 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="init-config-reloader" Jun 02 16:46:07.109535 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109494 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="init-config-reloader" Jun 02 16:46:07.109535 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109444 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0"} err="failed to get container status \"337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0\": rpc error: code = NotFound desc = could not find container \"337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0\": container with ID starting with 337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0 not found: ID does not exist" Jun 02 16:46:07.109535 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109526 2565 scope.go:117] "RemoveContainer" containerID="22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c" Jun 02 16:46:07.109895 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109570 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="prometheus" Jun 02 16:46:07.109895 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109583 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="thanos-sidecar" Jun 02 16:46:07.109895 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109592 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="kube-rbac-proxy-thanos" Jun 02 16:46:07.109895 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109601 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="kube-rbac-proxy" Jun 02 16:46:07.109895 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109613 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="config-reloader" Jun 02 16:46:07.109895 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109621 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" containerName="kube-rbac-proxy-web" Jun 02 16:46:07.109895 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109737 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c"} err="failed to get container status \"22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c\": rpc error: code = NotFound desc = could not find container \"22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c\": container with ID starting with 22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c not found: ID does not exist" Jun 02 16:46:07.109895 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109753 2565 scope.go:117] "RemoveContainer" containerID="3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8" Jun 02 16:46:07.110228 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109966 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8"} err="failed to get container status \"3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8\": rpc error: code = NotFound desc = could not find container \"3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8\": container with ID starting with 3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8 not found: ID does not exist" Jun 02 16:46:07.110228 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.109980 2565 scope.go:117] "RemoveContainer" containerID="4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51" Jun 02 16:46:07.110228 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.110201 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51"} err="failed to get container status \"4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51\": rpc error: code = NotFound desc = could not find container \"4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51\": container with ID starting with 4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51 not found: ID does not exist" Jun 02 16:46:07.110228 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.110217 2565 scope.go:117] "RemoveContainer" containerID="046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9" Jun 02 16:46:07.110426 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.110407 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9"} err="failed to get container status \"046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9\": rpc error: code = NotFound desc = could not find container \"046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9\": container with ID starting with 046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9 not found: ID does not exist" Jun 02 16:46:07.110473 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.110428 2565 scope.go:117] "RemoveContainer" containerID="e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae" Jun 02 16:46:07.110632 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.110616 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae"} err="failed to get container status \"e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae\": rpc error: code = NotFound desc = could not find container \"e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae\": container with ID starting with e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae not found: ID does not exist" Jun 02 16:46:07.110678 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.110632 2565 scope.go:117] "RemoveContainer" containerID="3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda" Jun 02 16:46:07.110843 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.110824 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda"} err="failed to get container status \"3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda\": rpc error: code = NotFound desc = could not find container \"3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda\": container with ID starting with 3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda not found: ID does not exist" Jun 02 16:46:07.110904 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.110845 2565 scope.go:117] "RemoveContainer" containerID="337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0" Jun 02 16:46:07.111077 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.111046 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0"} err="failed to get container status \"337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0\": rpc error: code = NotFound desc = could not find container \"337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0\": container with ID starting with 337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0 not found: ID does not exist" Jun 02 16:46:07.111077 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.111077 2565 scope.go:117] "RemoveContainer" containerID="22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c" Jun 02 16:46:07.111295 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.111277 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c"} err="failed to get container status \"22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c\": rpc error: code = NotFound desc = could not find container \"22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c\": container with ID starting with 22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c not found: ID does not exist" Jun 02 16:46:07.111361 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.111297 2565 scope.go:117] "RemoveContainer" containerID="3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8" Jun 02 16:46:07.111511 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.111490 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8"} err="failed to get container status \"3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8\": rpc error: code = NotFound desc = could not find container \"3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8\": container with ID starting with 3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8 not found: ID does not exist" Jun 02 16:46:07.111557 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.111512 2565 scope.go:117] "RemoveContainer" containerID="4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51" Jun 02 16:46:07.111745 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.111726 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51"} err="failed to get container status \"4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51\": rpc error: code = NotFound desc = could not find container \"4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51\": container with ID starting with 4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51 not found: ID does not exist" Jun 02 16:46:07.111822 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.111746 2565 scope.go:117] "RemoveContainer" containerID="046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9" Jun 02 16:46:07.111973 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.111953 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9"} err="failed to get container status \"046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9\": rpc error: code = NotFound desc = could not find container \"046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9\": container with ID starting with 046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9 not found: ID does not exist" Jun 02 16:46:07.112052 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.111974 2565 scope.go:117] "RemoveContainer" containerID="e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae" Jun 02 16:46:07.112236 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.112213 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae"} err="failed to get container status \"e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae\": rpc error: code = NotFound desc = could not find container \"e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae\": container with ID starting with e71971ea2a711469bf692da3663cd5f716e35fdec52ebb82bc89afdb7609e8ae not found: ID does not exist" Jun 02 16:46:07.112236 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.112234 2565 scope.go:117] "RemoveContainer" containerID="3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda" Jun 02 16:46:07.112463 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.112442 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda"} err="failed to get container status \"3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda\": rpc error: code = NotFound desc = could not find container \"3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda\": container with ID starting with 3a9fff967b8c20dfd5e7e87f44bf7f3142d53b62ae6301c1179eb2d16afd6fda not found: ID does not exist" Jun 02 16:46:07.112523 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.112465 2565 scope.go:117] "RemoveContainer" containerID="337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0" Jun 02 16:46:07.112685 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.112664 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0"} err="failed to get container status \"337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0\": rpc error: code = NotFound desc = could not find container \"337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0\": container with ID starting with 337164673d733e2bb2b8688d3e21ac421a76c6567ee1ad7b99a3d11d9b405fc0 not found: ID does not exist" Jun 02 16:46:07.112769 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.112687 2565 scope.go:117] "RemoveContainer" containerID="22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c" Jun 02 16:46:07.112945 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.112922 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c"} err="failed to get container status \"22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c\": rpc error: code = NotFound desc = could not find container \"22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c\": container with ID starting with 22e9ca0c2793a1df01c70103595f98e7d166390d08a289684687315b73653e5c not found: ID does not exist" Jun 02 16:46:07.112945 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.112943 2565 scope.go:117] "RemoveContainer" containerID="3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8" Jun 02 16:46:07.113221 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.113200 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8"} err="failed to get container status \"3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8\": rpc error: code = NotFound desc = could not find container \"3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8\": container with ID starting with 3ab08166cf539ef0d9be1d3d0b230285162235030f5437e1f2a5bf19e5d7e2d8 not found: ID does not exist" Jun 02 16:46:07.113299 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.113222 2565 scope.go:117] "RemoveContainer" containerID="4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51" Jun 02 16:46:07.113464 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.113430 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51"} err="failed to get container status \"4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51\": rpc error: code = NotFound desc = could not find container \"4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51\": container with ID starting with 4dd688259e38d438a23554c183ecf93794106e664dd351a1ade7c2c5c358ef51 not found: ID does not exist" Jun 02 16:46:07.113464 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.113464 2565 scope.go:117] "RemoveContainer" containerID="046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9" Jun 02 16:46:07.113862 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.113820 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9"} err="failed to get container status \"046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9\": rpc error: code = NotFound desc = could not find container \"046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9\": container with ID starting with 046c9bd14f198f2e5d09ac477dc6f158d684a941c742f4b7e640b8bb817e19e9 not found: ID does not exist" Jun 02 16:46:07.115230 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.115213 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.120979 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.117980 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 16:46:07.120979 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.118352 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 16:46:07.120979 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.118691 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2cr02ebug53an\"" Jun 02 16:46:07.120979 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.118774 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 16:46:07.120979 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.118694 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 16:46:07.120979 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.119130 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 16:46:07.120979 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.120617 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 16:46:07.121418 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.121042 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 16:46:07.122330 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.122044 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 16:46:07.122330 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.122203 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8cmw8\"" Jun 02 16:46:07.122953 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.122604 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 16:46:07.122953 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.122816 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 16:46:07.125750 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.125686 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 16:46:07.128620 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.128125 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 16:46:07.128620 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.128174 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 16:46:07.215247 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.215183 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.215247 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.215246 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.215478 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.215287 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.215478 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.215306 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-config\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.215478 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.215329 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.215478 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.215426 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.215478 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.215459 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.215633 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.215486 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-web-config\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.215633 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.215522 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbfnb\" (UniqueName: \"kubernetes.io/projected/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-kube-api-access-pbfnb\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.215633 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.215542 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.215633 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.215561 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.215633 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.215609 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.215633 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.215624 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.215796 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.215647 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.215796 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.215698 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.215796 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.215741 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.215796 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.215765 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.215908 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.215802 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-config-out\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.316650 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.316533 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.316650 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.316618 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.316650 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.316649 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.316939 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.316688 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-config-out\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.317433 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.317400 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.317545 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.317481 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.317545 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.317532 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.317759 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.317732 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.317881 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.317773 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-config\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.317881 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.317809 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.317881 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.317862 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.318077 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.317993 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.318077 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.318060 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-web-config\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.318186 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.318093 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pbfnb\" (UniqueName: \"kubernetes.io/projected/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-kube-api-access-pbfnb\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.318186 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.318123 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.318186 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.318152 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.318385 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.318195 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.318385 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.318222 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.318385 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.318246 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.318634 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.318611 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.318782 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.318755 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.319610 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.319574 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.320350 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.319792 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.320350 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.319954 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-config-out\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.320350 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.320106 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.320350 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.320153 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.322827 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.321111 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-web-config\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.322827 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.322581 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.322827 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.322587 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.322827 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.322748 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-config\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.323184 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.323162 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.323231 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.323215 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.323315 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.323285 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.324328 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.324303 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.324657 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.324641 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.330132 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.330107 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbfnb\" (UniqueName: \"kubernetes.io/projected/acc6bdf8-a252-481d-a198-9c6cdd5df7b2-kube-api-access-pbfnb\") pod \"prometheus-k8s-0\" (UID: \"acc6bdf8-a252-481d-a198-9c6cdd5df7b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.431851 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.431791 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:07.586596 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:07.586505 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 16:46:07.590179 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:46:07.590143 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc6bdf8_a252_481d_a198_9c6cdd5df7b2.slice/crio-7a1e7955aed839f11a508ff5553118647928b98c9fb5e7195ce0e0298c074db2 WatchSource:0}: Error finding container 7a1e7955aed839f11a508ff5553118647928b98c9fb5e7195ce0e0298c074db2: Status 404 returned error can't find the container with id 7a1e7955aed839f11a508ff5553118647928b98c9fb5e7195ce0e0298c074db2 Jun 02 16:46:08.046545 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:08.046504 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="315b95e4-6c8d-41bc-b2ef-748e8bac61e8" path="/var/lib/kubelet/pods/315b95e4-6c8d-41bc-b2ef-748e8bac61e8/volumes" Jun 02 16:46:08.051476 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:08.051446 2565 generic.go:358] "Generic (PLEG): container finished" podID="acc6bdf8-a252-481d-a198-9c6cdd5df7b2" containerID="d922b51cdc5645734a12d4155b28f6a4f9e1fe2757fb326cb92fb9276fd287d5" exitCode=0 Jun 02 16:46:08.051608 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:08.051529 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"acc6bdf8-a252-481d-a198-9c6cdd5df7b2","Type":"ContainerDied","Data":"d922b51cdc5645734a12d4155b28f6a4f9e1fe2757fb326cb92fb9276fd287d5"} Jun 02 16:46:08.051608 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:08.051563 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"acc6bdf8-a252-481d-a198-9c6cdd5df7b2","Type":"ContainerStarted","Data":"7a1e7955aed839f11a508ff5553118647928b98c9fb5e7195ce0e0298c074db2"} Jun 02 16:46:09.057917 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:09.057878 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"acc6bdf8-a252-481d-a198-9c6cdd5df7b2","Type":"ContainerStarted","Data":"78703afb7a0ab9e9031d777fb801d5f77a6cd728fa152d74db5d2ae7c6dc9bdd"} Jun 02 16:46:09.057917 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:09.057920 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"acc6bdf8-a252-481d-a198-9c6cdd5df7b2","Type":"ContainerStarted","Data":"2883c01e8e9df40ede23080ad955b0fae0dfba6f9fd955be99a5ec3defc0343b"} Jun 02 16:46:09.058454 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:09.057938 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"acc6bdf8-a252-481d-a198-9c6cdd5df7b2","Type":"ContainerStarted","Data":"fc544fad7a8877de8a57f2f6d67f2d29a1b288b379887cc82bf69ca308453ba7"} Jun 02 16:46:09.058454 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:09.057951 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"acc6bdf8-a252-481d-a198-9c6cdd5df7b2","Type":"ContainerStarted","Data":"00d4744c6026b8a7822b0f5b7825c38d28913a5c9f47a1ee6608474dc0015d9d"} Jun 02 16:46:09.058454 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:09.057962 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"acc6bdf8-a252-481d-a198-9c6cdd5df7b2","Type":"ContainerStarted","Data":"22ecfe932a68846c79bfb5daaaf56d4664b9398214e9c9eec42e9397bb1f87ea"} Jun 02 16:46:09.058454 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:09.057972 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"acc6bdf8-a252-481d-a198-9c6cdd5df7b2","Type":"ContainerStarted","Data":"fcbf81cd5f6b36cc656474e92d7e451b838ac48f8bb94e152bff5bc0624bd846"} Jun 02 16:46:12.432742 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:12.432687 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:46:14.029948 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:14.029910 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7n7dn" Jun 02 16:46:14.059207 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:14.059152 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=7.059134979 podStartE2EDuration="7.059134979s" podCreationTimestamp="2026-06-02 16:46:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:46:09.111531022 +0000 UTC m=+293.567615290" watchObservedRunningTime="2026-06-02 16:46:14.059134979 +0000 UTC m=+298.515219302" Jun 02 16:46:15.966433 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:15.966409 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vlq2q_43709aef-aafc-4d89-b794-916480842d72/console-operator/2.log" Jun 02 16:46:15.966845 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:15.966563 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vlq2q_43709aef-aafc-4d89-b794-916480842d72/console-operator/2.log" Jun 02 16:46:15.973734 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:15.973712 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sjt8_a9902c57-5190-456a-83a9-948e46bec4a0/ovn-acl-logging/0.log" Jun 02 16:46:15.973864 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:15.973712 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sjt8_a9902c57-5190-456a-83a9-948e46bec4a0/ovn-acl-logging/0.log" Jun 02 16:46:17.672331 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:17.672289 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5dd754dc-vc928"] Jun 02 16:46:17.676965 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:17.676932 2565 patch_prober.go:28] interesting pod/image-registry-5dd754dc-vc928 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 16:46:17.677137 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:17.676995 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5dd754dc-vc928" podUID="83ffe287-d220-41cd-a102-77b8029422ea" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 16:46:27.676779 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:27.676748 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:46:42.693429 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:42.693372 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5dd754dc-vc928" podUID="83ffe287-d220-41cd-a102-77b8029422ea" containerName="registry" containerID="cri-o://4503544da9a1f38a752b9357140e99107c12990b177f47a9ae15e38beb0f76c5" gracePeriod=30 Jun 02 16:46:42.945143 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:42.945091 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:46:43.034154 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.034121 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-bound-sa-token\") pod \"83ffe287-d220-41cd-a102-77b8029422ea\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " Jun 02 16:46:43.034331 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.034173 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/83ffe287-d220-41cd-a102-77b8029422ea-registry-certificates\") pod \"83ffe287-d220-41cd-a102-77b8029422ea\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " Jun 02 16:46:43.034331 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.034200 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls\") pod \"83ffe287-d220-41cd-a102-77b8029422ea\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " Jun 02 16:46:43.034331 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.034234 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/83ffe287-d220-41cd-a102-77b8029422ea-ca-trust-extracted\") pod \"83ffe287-d220-41cd-a102-77b8029422ea\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " Jun 02 16:46:43.034331 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.034262 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mr7qx\" (UniqueName: \"kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-kube-api-access-mr7qx\") pod \"83ffe287-d220-41cd-a102-77b8029422ea\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " Jun 02 16:46:43.034543 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.034511 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/83ffe287-d220-41cd-a102-77b8029422ea-image-registry-private-configuration\") pod \"83ffe287-d220-41cd-a102-77b8029422ea\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " Jun 02 16:46:43.034610 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.034560 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/83ffe287-d220-41cd-a102-77b8029422ea-trusted-ca\") pod \"83ffe287-d220-41cd-a102-77b8029422ea\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " Jun 02 16:46:43.034610 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.034597 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/83ffe287-d220-41cd-a102-77b8029422ea-installation-pull-secrets\") pod \"83ffe287-d220-41cd-a102-77b8029422ea\" (UID: \"83ffe287-d220-41cd-a102-77b8029422ea\") " Jun 02 16:46:43.034714 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.034670 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83ffe287-d220-41cd-a102-77b8029422ea-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "83ffe287-d220-41cd-a102-77b8029422ea" (UID: "83ffe287-d220-41cd-a102-77b8029422ea"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:46:43.034932 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.034913 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/83ffe287-d220-41cd-a102-77b8029422ea-registry-certificates\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:43.035221 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.035195 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83ffe287-d220-41cd-a102-77b8029422ea-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "83ffe287-d220-41cd-a102-77b8029422ea" (UID: "83ffe287-d220-41cd-a102-77b8029422ea"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:46:43.037487 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.037423 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "83ffe287-d220-41cd-a102-77b8029422ea" (UID: "83ffe287-d220-41cd-a102-77b8029422ea"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:46:43.037487 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.037451 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "83ffe287-d220-41cd-a102-77b8029422ea" (UID: "83ffe287-d220-41cd-a102-77b8029422ea"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:46:43.037676 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.037648 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83ffe287-d220-41cd-a102-77b8029422ea-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "83ffe287-d220-41cd-a102-77b8029422ea" (UID: "83ffe287-d220-41cd-a102-77b8029422ea"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:46:43.037825 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.037806 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83ffe287-d220-41cd-a102-77b8029422ea-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "83ffe287-d220-41cd-a102-77b8029422ea" (UID: "83ffe287-d220-41cd-a102-77b8029422ea"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:46:43.038492 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.038466 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-kube-api-access-mr7qx" (OuterVolumeSpecName: "kube-api-access-mr7qx") pod "83ffe287-d220-41cd-a102-77b8029422ea" (UID: "83ffe287-d220-41cd-a102-77b8029422ea"). InnerVolumeSpecName "kube-api-access-mr7qx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:46:43.043623 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.043593 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83ffe287-d220-41cd-a102-77b8029422ea-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "83ffe287-d220-41cd-a102-77b8029422ea" (UID: "83ffe287-d220-41cd-a102-77b8029422ea"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:46:43.135877 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.135850 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-bound-sa-token\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:43.135877 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.135875 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-registry-tls\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:43.136052 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.135884 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/83ffe287-d220-41cd-a102-77b8029422ea-ca-trust-extracted\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:43.136052 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.135894 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mr7qx\" (UniqueName: \"kubernetes.io/projected/83ffe287-d220-41cd-a102-77b8029422ea-kube-api-access-mr7qx\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:43.136052 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.135904 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/83ffe287-d220-41cd-a102-77b8029422ea-image-registry-private-configuration\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:43.136052 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.135914 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/83ffe287-d220-41cd-a102-77b8029422ea-trusted-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:43.136052 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.135923 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/83ffe287-d220-41cd-a102-77b8029422ea-installation-pull-secrets\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:46:43.165115 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.165082 2565 generic.go:358] "Generic (PLEG): container finished" podID="83ffe287-d220-41cd-a102-77b8029422ea" containerID="4503544da9a1f38a752b9357140e99107c12990b177f47a9ae15e38beb0f76c5" exitCode=0 Jun 02 16:46:43.165214 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.165145 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dd754dc-vc928" Jun 02 16:46:43.165214 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.165176 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dd754dc-vc928" event={"ID":"83ffe287-d220-41cd-a102-77b8029422ea","Type":"ContainerDied","Data":"4503544da9a1f38a752b9357140e99107c12990b177f47a9ae15e38beb0f76c5"} Jun 02 16:46:43.165214 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.165209 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dd754dc-vc928" event={"ID":"83ffe287-d220-41cd-a102-77b8029422ea","Type":"ContainerDied","Data":"92a6f94773b664d2f6d27eea04d9a577db86d98f35b109ecbe6c483b9e3301d2"} Jun 02 16:46:43.165321 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.165224 2565 scope.go:117] "RemoveContainer" containerID="4503544da9a1f38a752b9357140e99107c12990b177f47a9ae15e38beb0f76c5" Jun 02 16:46:43.173540 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.173526 2565 scope.go:117] "RemoveContainer" containerID="4503544da9a1f38a752b9357140e99107c12990b177f47a9ae15e38beb0f76c5" Jun 02 16:46:43.173794 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:46:43.173773 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4503544da9a1f38a752b9357140e99107c12990b177f47a9ae15e38beb0f76c5\": container with ID starting with 4503544da9a1f38a752b9357140e99107c12990b177f47a9ae15e38beb0f76c5 not found: ID does not exist" containerID="4503544da9a1f38a752b9357140e99107c12990b177f47a9ae15e38beb0f76c5" Jun 02 16:46:43.173840 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.173803 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4503544da9a1f38a752b9357140e99107c12990b177f47a9ae15e38beb0f76c5"} err="failed to get container status \"4503544da9a1f38a752b9357140e99107c12990b177f47a9ae15e38beb0f76c5\": rpc error: code = NotFound desc = could not find container \"4503544da9a1f38a752b9357140e99107c12990b177f47a9ae15e38beb0f76c5\": container with ID starting with 4503544da9a1f38a752b9357140e99107c12990b177f47a9ae15e38beb0f76c5 not found: ID does not exist" Jun 02 16:46:43.187148 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.187109 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5dd754dc-vc928"] Jun 02 16:46:43.189071 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:43.189046 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5dd754dc-vc928"] Jun 02 16:46:44.045170 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:46:44.045140 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83ffe287-d220-41cd-a102-77b8029422ea" path="/var/lib/kubelet/pods/83ffe287-d220-41cd-a102-77b8029422ea/volumes" Jun 02 16:47:07.432091 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:47:07.431949 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:47:07.449359 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:47:07.449321 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:47:08.257390 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:47:08.257358 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 16:49:16.623428 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:16.623390 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-644f4f4cf6-mpclg"] Jun 02 16:49:16.623997 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:16.623873 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83ffe287-d220-41cd-a102-77b8029422ea" containerName="registry" Jun 02 16:49:16.623997 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:16.623891 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="83ffe287-d220-41cd-a102-77b8029422ea" containerName="registry" Jun 02 16:49:16.624160 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:16.623997 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="83ffe287-d220-41cd-a102-77b8029422ea" containerName="registry" Jun 02 16:49:16.627077 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:16.627051 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mpclg" Jun 02 16:49:16.629268 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:16.629242 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 02 16:49:16.629402 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:16.629353 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 02 16:49:16.629608 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:16.629586 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 16:49:16.629717 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:16.629626 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-sbkcv\"" Jun 02 16:49:16.629778 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:16.629756 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 02 16:49:16.629888 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:16.629871 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 16:49:16.639589 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:16.639114 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-644f4f4cf6-mpclg"] Jun 02 16:49:16.657777 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:16.657754 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bb77a77-801d-41c5-91be-d4b300ede29d-cert\") pod \"lws-controller-manager-644f4f4cf6-mpclg\" (UID: \"0bb77a77-801d-41c5-91be-d4b300ede29d\") " pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mpclg" Jun 02 16:49:16.657925 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:16.657809 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kc2l\" (UniqueName: \"kubernetes.io/projected/0bb77a77-801d-41c5-91be-d4b300ede29d-kube-api-access-6kc2l\") pod \"lws-controller-manager-644f4f4cf6-mpclg\" (UID: \"0bb77a77-801d-41c5-91be-d4b300ede29d\") " pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mpclg" Jun 02 16:49:16.657925 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:16.657874 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0bb77a77-801d-41c5-91be-d4b300ede29d-manager-config\") pod \"lws-controller-manager-644f4f4cf6-mpclg\" (UID: \"0bb77a77-801d-41c5-91be-d4b300ede29d\") " pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mpclg" Jun 02 16:49:16.657925 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:16.657906 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0bb77a77-801d-41c5-91be-d4b300ede29d-metrics-cert\") pod \"lws-controller-manager-644f4f4cf6-mpclg\" (UID: \"0bb77a77-801d-41c5-91be-d4b300ede29d\") " pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mpclg" Jun 02 16:49:16.759458 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:16.759415 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bb77a77-801d-41c5-91be-d4b300ede29d-cert\") pod \"lws-controller-manager-644f4f4cf6-mpclg\" (UID: \"0bb77a77-801d-41c5-91be-d4b300ede29d\") " pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mpclg" Jun 02 16:49:16.759668 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:16.759479 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6kc2l\" (UniqueName: \"kubernetes.io/projected/0bb77a77-801d-41c5-91be-d4b300ede29d-kube-api-access-6kc2l\") pod \"lws-controller-manager-644f4f4cf6-mpclg\" (UID: \"0bb77a77-801d-41c5-91be-d4b300ede29d\") " pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mpclg" Jun 02 16:49:16.759668 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:16.759516 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0bb77a77-801d-41c5-91be-d4b300ede29d-manager-config\") pod \"lws-controller-manager-644f4f4cf6-mpclg\" (UID: \"0bb77a77-801d-41c5-91be-d4b300ede29d\") " pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mpclg" Jun 02 16:49:16.759668 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:16.759545 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0bb77a77-801d-41c5-91be-d4b300ede29d-metrics-cert\") pod \"lws-controller-manager-644f4f4cf6-mpclg\" (UID: \"0bb77a77-801d-41c5-91be-d4b300ede29d\") " pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mpclg" Jun 02 16:49:16.760311 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:16.760290 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0bb77a77-801d-41c5-91be-d4b300ede29d-manager-config\") pod \"lws-controller-manager-644f4f4cf6-mpclg\" (UID: \"0bb77a77-801d-41c5-91be-d4b300ede29d\") " pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mpclg" Jun 02 16:49:16.762068 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:16.762047 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0bb77a77-801d-41c5-91be-d4b300ede29d-metrics-cert\") pod \"lws-controller-manager-644f4f4cf6-mpclg\" (UID: \"0bb77a77-801d-41c5-91be-d4b300ede29d\") " pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mpclg" Jun 02 16:49:16.762272 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:16.762243 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bb77a77-801d-41c5-91be-d4b300ede29d-cert\") pod \"lws-controller-manager-644f4f4cf6-mpclg\" (UID: \"0bb77a77-801d-41c5-91be-d4b300ede29d\") " pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mpclg" Jun 02 16:49:16.779552 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:16.779531 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kc2l\" (UniqueName: \"kubernetes.io/projected/0bb77a77-801d-41c5-91be-d4b300ede29d-kube-api-access-6kc2l\") pod \"lws-controller-manager-644f4f4cf6-mpclg\" (UID: \"0bb77a77-801d-41c5-91be-d4b300ede29d\") " pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mpclg" Jun 02 16:49:16.939933 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:16.939844 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mpclg" Jun 02 16:49:17.083842 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:17.083816 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-644f4f4cf6-mpclg"] Jun 02 16:49:17.086112 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:49:17.086086 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bb77a77_801d_41c5_91be_d4b300ede29d.slice/crio-1454475a22ba7c01dc827c08bc69f18906aec5babaedc297b48995a7f94dd143 WatchSource:0}: Error finding container 1454475a22ba7c01dc827c08bc69f18906aec5babaedc297b48995a7f94dd143: Status 404 returned error can't find the container with id 1454475a22ba7c01dc827c08bc69f18906aec5babaedc297b48995a7f94dd143 Jun 02 16:49:17.087792 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:17.087774 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 16:49:17.619832 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:17.619791 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mpclg" event={"ID":"0bb77a77-801d-41c5-91be-d4b300ede29d","Type":"ContainerStarted","Data":"1454475a22ba7c01dc827c08bc69f18906aec5babaedc297b48995a7f94dd143"} Jun 02 16:49:19.730478 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:19.730442 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9"] Jun 02 16:49:19.734731 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:19.734706 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9" Jun 02 16:49:19.737944 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:19.737902 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 16:49:19.738102 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:19.738043 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 16:49:19.738102 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:19.738058 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 16:49:19.738192 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:19.738109 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 16:49:19.738532 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:19.738510 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-h4z8v\"" Jun 02 16:49:19.758221 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:19.758161 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9"] Jun 02 16:49:19.789220 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:19.789185 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7ab74b54-c323-480f-9048-e90782215e64-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58857ff9f-qrkf9\" (UID: \"7ab74b54-c323-480f-9048-e90782215e64\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9" Jun 02 16:49:19.789426 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:19.789257 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdsqb\" (UniqueName: \"kubernetes.io/projected/7ab74b54-c323-480f-9048-e90782215e64-kube-api-access-jdsqb\") pod \"opendatahub-operator-controller-manager-58857ff9f-qrkf9\" (UID: \"7ab74b54-c323-480f-9048-e90782215e64\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9" Jun 02 16:49:19.789426 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:19.789287 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ab74b54-c323-480f-9048-e90782215e64-webhook-cert\") pod \"opendatahub-operator-controller-manager-58857ff9f-qrkf9\" (UID: \"7ab74b54-c323-480f-9048-e90782215e64\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9" Jun 02 16:49:19.789426 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:19.789365 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ab74b54-c323-480f-9048-e90782215e64-tmp\") pod \"opendatahub-operator-controller-manager-58857ff9f-qrkf9\" (UID: \"7ab74b54-c323-480f-9048-e90782215e64\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9" Jun 02 16:49:19.789426 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:19.789422 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7ab74b54-c323-480f-9048-e90782215e64-manifests\") pod \"opendatahub-operator-controller-manager-58857ff9f-qrkf9\" (UID: \"7ab74b54-c323-480f-9048-e90782215e64\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9" Jun 02 16:49:19.890462 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:19.890420 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ab74b54-c323-480f-9048-e90782215e64-tmp\") pod \"opendatahub-operator-controller-manager-58857ff9f-qrkf9\" (UID: \"7ab74b54-c323-480f-9048-e90782215e64\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9" Jun 02 16:49:19.890621 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:19.890472 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7ab74b54-c323-480f-9048-e90782215e64-manifests\") pod \"opendatahub-operator-controller-manager-58857ff9f-qrkf9\" (UID: \"7ab74b54-c323-480f-9048-e90782215e64\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9" Jun 02 16:49:19.890621 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:19.890547 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7ab74b54-c323-480f-9048-e90782215e64-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58857ff9f-qrkf9\" (UID: \"7ab74b54-c323-480f-9048-e90782215e64\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9" Jun 02 16:49:19.890621 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:19.890578 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jdsqb\" (UniqueName: \"kubernetes.io/projected/7ab74b54-c323-480f-9048-e90782215e64-kube-api-access-jdsqb\") pod \"opendatahub-operator-controller-manager-58857ff9f-qrkf9\" (UID: \"7ab74b54-c323-480f-9048-e90782215e64\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9" Jun 02 16:49:19.890621 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:19.890596 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ab74b54-c323-480f-9048-e90782215e64-webhook-cert\") pod \"opendatahub-operator-controller-manager-58857ff9f-qrkf9\" (UID: \"7ab74b54-c323-480f-9048-e90782215e64\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9" Jun 02 16:49:19.890931 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:19.890909 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7ab74b54-c323-480f-9048-e90782215e64-manifests\") pod \"opendatahub-operator-controller-manager-58857ff9f-qrkf9\" (UID: \"7ab74b54-c323-480f-9048-e90782215e64\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9" Jun 02 16:49:19.893188 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:19.893160 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ab74b54-c323-480f-9048-e90782215e64-tmp\") pod \"opendatahub-operator-controller-manager-58857ff9f-qrkf9\" (UID: \"7ab74b54-c323-480f-9048-e90782215e64\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9" Jun 02 16:49:19.893333 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:19.893166 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ab74b54-c323-480f-9048-e90782215e64-webhook-cert\") pod \"opendatahub-operator-controller-manager-58857ff9f-qrkf9\" (UID: \"7ab74b54-c323-480f-9048-e90782215e64\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9" Jun 02 16:49:19.893333 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:19.893174 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7ab74b54-c323-480f-9048-e90782215e64-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58857ff9f-qrkf9\" (UID: \"7ab74b54-c323-480f-9048-e90782215e64\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9" Jun 02 16:49:19.917844 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:19.917810 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdsqb\" (UniqueName: \"kubernetes.io/projected/7ab74b54-c323-480f-9048-e90782215e64-kube-api-access-jdsqb\") pod \"opendatahub-operator-controller-manager-58857ff9f-qrkf9\" (UID: \"7ab74b54-c323-480f-9048-e90782215e64\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9" Jun 02 16:49:20.048379 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:20.048345 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9" Jun 02 16:49:20.197269 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:20.196683 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9"] Jun 02 16:49:20.199303 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:49:20.199275 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ab74b54_c323_480f_9048_e90782215e64.slice/crio-48dc711b640f7a99437cb7c8616c250ad538d94d8230b6379b30c71e1190345b WatchSource:0}: Error finding container 48dc711b640f7a99437cb7c8616c250ad538d94d8230b6379b30c71e1190345b: Status 404 returned error can't find the container with id 48dc711b640f7a99437cb7c8616c250ad538d94d8230b6379b30c71e1190345b Jun 02 16:49:20.631701 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:20.631661 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9" event={"ID":"7ab74b54-c323-480f-9048-e90782215e64","Type":"ContainerStarted","Data":"48dc711b640f7a99437cb7c8616c250ad538d94d8230b6379b30c71e1190345b"} Jun 02 16:49:20.632977 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:20.632952 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mpclg" event={"ID":"0bb77a77-801d-41c5-91be-d4b300ede29d","Type":"ContainerStarted","Data":"e51b50e3df156d26dae24e002e5e20cb5057319daf8d024607f852055a299d2e"} Jun 02 16:49:20.633146 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:20.633131 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mpclg" Jun 02 16:49:20.660292 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:20.660231 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mpclg" podStartSLOduration=1.792114077 podStartE2EDuration="4.660210383s" podCreationTimestamp="2026-06-02 16:49:16 +0000 UTC" firstStartedPulling="2026-06-02 16:49:17.087927806 +0000 UTC m=+481.544012041" lastFinishedPulling="2026-06-02 16:49:19.956024107 +0000 UTC m=+484.412108347" observedRunningTime="2026-06-02 16:49:20.657277415 +0000 UTC m=+485.113361671" watchObservedRunningTime="2026-06-02 16:49:20.660210383 +0000 UTC m=+485.116294642" Jun 02 16:49:23.644194 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:23.644164 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9" event={"ID":"7ab74b54-c323-480f-9048-e90782215e64","Type":"ContainerStarted","Data":"5042a3f67143fd6ebf7c1e5757bc5440759715fbe3aab7f025c171ab68891ddc"} Jun 02 16:49:24.648653 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:24.648611 2565 generic.go:358] "Generic (PLEG): container finished" podID="7ab74b54-c323-480f-9048-e90782215e64" containerID="5042a3f67143fd6ebf7c1e5757bc5440759715fbe3aab7f025c171ab68891ddc" exitCode=0 Jun 02 16:49:24.649055 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:24.648666 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9" event={"ID":"7ab74b54-c323-480f-9048-e90782215e64","Type":"ContainerDied","Data":"5042a3f67143fd6ebf7c1e5757bc5440759715fbe3aab7f025c171ab68891ddc"} Jun 02 16:49:25.654859 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:25.654820 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9" event={"ID":"7ab74b54-c323-480f-9048-e90782215e64","Type":"ContainerStarted","Data":"c68969a9e7f95867ab2dc910ad4e1f5b98c0828f24c1e445234c6da889dfeb3f"} Jun 02 16:49:25.655372 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:25.654988 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9" Jun 02 16:49:25.674742 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:25.674690 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9" podStartSLOduration=1.789973501 podStartE2EDuration="6.674671921s" podCreationTimestamp="2026-06-02 16:49:19 +0000 UTC" firstStartedPulling="2026-06-02 16:49:20.201300767 +0000 UTC m=+484.657385002" lastFinishedPulling="2026-06-02 16:49:25.085999177 +0000 UTC m=+489.542083422" observedRunningTime="2026-06-02 16:49:25.673272978 +0000 UTC m=+490.129357234" watchObservedRunningTime="2026-06-02 16:49:25.674671921 +0000 UTC m=+490.130756177" Jun 02 16:49:31.639375 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:31.639346 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mpclg" Jun 02 16:49:36.661301 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:36.661272 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-qrkf9" Jun 02 16:49:40.112315 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:40.112281 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8dc448d-mbt7p"] Jun 02 16:49:40.119647 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:40.119622 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8dc448d-mbt7p" Jun 02 16:49:40.121876 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:40.121850 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-ls92g\"" Jun 02 16:49:40.122045 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:40.121885 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 16:49:40.122362 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:40.122342 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 16:49:40.126878 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:40.126851 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8dc448d-mbt7p"] Jun 02 16:49:40.262231 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:40.262195 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjcnv\" (UniqueName: \"kubernetes.io/projected/4b092314-5a0e-4719-9fad-e971fe9e8311-kube-api-access-wjcnv\") pod \"kube-auth-proxy-8dc448d-mbt7p\" (UID: \"4b092314-5a0e-4719-9fad-e971fe9e8311\") " pod="openshift-ingress/kube-auth-proxy-8dc448d-mbt7p" Jun 02 16:49:40.262420 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:40.262243 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b092314-5a0e-4719-9fad-e971fe9e8311-tls-certs\") pod \"kube-auth-proxy-8dc448d-mbt7p\" (UID: \"4b092314-5a0e-4719-9fad-e971fe9e8311\") " pod="openshift-ingress/kube-auth-proxy-8dc448d-mbt7p" Jun 02 16:49:40.262420 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:40.262367 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b092314-5a0e-4719-9fad-e971fe9e8311-tmp\") pod \"kube-auth-proxy-8dc448d-mbt7p\" (UID: \"4b092314-5a0e-4719-9fad-e971fe9e8311\") " pod="openshift-ingress/kube-auth-proxy-8dc448d-mbt7p" Jun 02 16:49:40.362977 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:40.362892 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b092314-5a0e-4719-9fad-e971fe9e8311-tls-certs\") pod \"kube-auth-proxy-8dc448d-mbt7p\" (UID: \"4b092314-5a0e-4719-9fad-e971fe9e8311\") " pod="openshift-ingress/kube-auth-proxy-8dc448d-mbt7p" Jun 02 16:49:40.363177 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:40.363099 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b092314-5a0e-4719-9fad-e971fe9e8311-tmp\") pod \"kube-auth-proxy-8dc448d-mbt7p\" (UID: \"4b092314-5a0e-4719-9fad-e971fe9e8311\") " pod="openshift-ingress/kube-auth-proxy-8dc448d-mbt7p" Jun 02 16:49:40.363177 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:40.363161 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wjcnv\" (UniqueName: \"kubernetes.io/projected/4b092314-5a0e-4719-9fad-e971fe9e8311-kube-api-access-wjcnv\") pod \"kube-auth-proxy-8dc448d-mbt7p\" (UID: \"4b092314-5a0e-4719-9fad-e971fe9e8311\") " pod="openshift-ingress/kube-auth-proxy-8dc448d-mbt7p" Jun 02 16:49:40.365765 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:40.365741 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b092314-5a0e-4719-9fad-e971fe9e8311-tmp\") pod \"kube-auth-proxy-8dc448d-mbt7p\" (UID: \"4b092314-5a0e-4719-9fad-e971fe9e8311\") " pod="openshift-ingress/kube-auth-proxy-8dc448d-mbt7p" Jun 02 16:49:40.366042 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:40.365996 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b092314-5a0e-4719-9fad-e971fe9e8311-tls-certs\") pod \"kube-auth-proxy-8dc448d-mbt7p\" (UID: \"4b092314-5a0e-4719-9fad-e971fe9e8311\") " pod="openshift-ingress/kube-auth-proxy-8dc448d-mbt7p" Jun 02 16:49:40.370800 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:40.370776 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjcnv\" (UniqueName: \"kubernetes.io/projected/4b092314-5a0e-4719-9fad-e971fe9e8311-kube-api-access-wjcnv\") pod \"kube-auth-proxy-8dc448d-mbt7p\" (UID: \"4b092314-5a0e-4719-9fad-e971fe9e8311\") " pod="openshift-ingress/kube-auth-proxy-8dc448d-mbt7p" Jun 02 16:49:40.432139 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:40.432098 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8dc448d-mbt7p" Jun 02 16:49:40.567829 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:40.567789 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8dc448d-mbt7p"] Jun 02 16:49:40.570951 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:49:40.570920 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b092314_5a0e_4719_9fad_e971fe9e8311.slice/crio-9fbd0c532c3b1620c8db59b4024bd219bf8ba9a46619a88685279d3ece83a823 WatchSource:0}: Error finding container 9fbd0c532c3b1620c8db59b4024bd219bf8ba9a46619a88685279d3ece83a823: Status 404 returned error can't find the container with id 9fbd0c532c3b1620c8db59b4024bd219bf8ba9a46619a88685279d3ece83a823 Jun 02 16:49:40.706827 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:40.706761 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8dc448d-mbt7p" event={"ID":"4b092314-5a0e-4719-9fad-e971fe9e8311","Type":"ContainerStarted","Data":"9fbd0c532c3b1620c8db59b4024bd219bf8ba9a46619a88685279d3ece83a823"} Jun 02 16:49:44.722364 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:44.722322 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8dc448d-mbt7p" event={"ID":"4b092314-5a0e-4719-9fad-e971fe9e8311","Type":"ContainerStarted","Data":"378428f53f0f0a72d9bdd7c5b49caca953ef15d395a2e129ebbb6625b7e91091"} Jun 02 16:49:44.739718 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:49:44.739675 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8dc448d-mbt7p" podStartSLOduration=1.635027752 podStartE2EDuration="4.739662356s" podCreationTimestamp="2026-06-02 16:49:40 +0000 UTC" firstStartedPulling="2026-06-02 16:49:40.573186818 +0000 UTC m=+505.029271060" lastFinishedPulling="2026-06-02 16:49:43.677821429 +0000 UTC m=+508.133905664" observedRunningTime="2026-06-02 16:49:44.737331585 +0000 UTC m=+509.193415854" watchObservedRunningTime="2026-06-02 16:49:44.739662356 +0000 UTC m=+509.195746613" Jun 02 16:51:15.989558 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:15.989526 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vlq2q_43709aef-aafc-4d89-b794-916480842d72/console-operator/2.log" Jun 02 16:51:15.992122 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:15.992089 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vlq2q_43709aef-aafc-4d89-b794-916480842d72/console-operator/2.log" Jun 02 16:51:15.996418 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:15.996394 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sjt8_a9902c57-5190-456a-83a9-948e46bec4a0/ovn-acl-logging/0.log" Jun 02 16:51:15.998229 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:15.998210 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sjt8_a9902c57-5190-456a-83a9-948e46bec4a0/ovn-acl-logging/0.log" Jun 02 16:51:35.575568 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:35.575483 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz"] Jun 02 16:51:35.577732 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:35.577716 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz" Jun 02 16:51:35.579883 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:35.579862 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 16:51:35.579997 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:35.579892 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7md7w\"" Jun 02 16:51:35.579997 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:35.579900 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 16:51:35.591849 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:35.591825 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz"] Jun 02 16:51:35.601058 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:35.601036 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrrwh\" (UniqueName: \"kubernetes.io/projected/2f7a7077-4838-4e11-ad5b-853d4803b570-kube-api-access-vrrwh\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-57cqz\" (UID: \"2f7a7077-4838-4e11-ad5b-853d4803b570\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz" Jun 02 16:51:35.601169 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:35.601093 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f7a7077-4838-4e11-ad5b-853d4803b570-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-57cqz\" (UID: \"2f7a7077-4838-4e11-ad5b-853d4803b570\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz" Jun 02 16:51:35.702374 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:35.702341 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrrwh\" (UniqueName: \"kubernetes.io/projected/2f7a7077-4838-4e11-ad5b-853d4803b570-kube-api-access-vrrwh\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-57cqz\" (UID: \"2f7a7077-4838-4e11-ad5b-853d4803b570\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz" Jun 02 16:51:35.702560 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:35.702386 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f7a7077-4838-4e11-ad5b-853d4803b570-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-57cqz\" (UID: \"2f7a7077-4838-4e11-ad5b-853d4803b570\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz" Jun 02 16:51:35.702707 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:35.702690 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f7a7077-4838-4e11-ad5b-853d4803b570-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-57cqz\" (UID: \"2f7a7077-4838-4e11-ad5b-853d4803b570\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz" Jun 02 16:51:35.716495 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:35.716466 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrrwh\" (UniqueName: \"kubernetes.io/projected/2f7a7077-4838-4e11-ad5b-853d4803b570-kube-api-access-vrrwh\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-57cqz\" (UID: \"2f7a7077-4838-4e11-ad5b-853d4803b570\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz" Jun 02 16:51:35.888634 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:35.888598 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz" Jun 02 16:51:36.022054 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:36.021967 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz"] Jun 02 16:51:36.025632 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:51:36.025604 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f7a7077_4838_4e11_ad5b_853d4803b570.slice/crio-daa8e1fcac5972116cb955090f7419f6630816e05600b4da5d6bc3761eb2a745 WatchSource:0}: Error finding container daa8e1fcac5972116cb955090f7419f6630816e05600b4da5d6bc3761eb2a745: Status 404 returned error can't find the container with id daa8e1fcac5972116cb955090f7419f6630816e05600b4da5d6bc3761eb2a745 Jun 02 16:51:36.096742 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:36.096682 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz" event={"ID":"2f7a7077-4838-4e11-ad5b-853d4803b570","Type":"ContainerStarted","Data":"daa8e1fcac5972116cb955090f7419f6630816e05600b4da5d6bc3761eb2a745"} Jun 02 16:51:43.120599 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:43.120565 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz" event={"ID":"2f7a7077-4838-4e11-ad5b-853d4803b570","Type":"ContainerStarted","Data":"4d9124151a728f0c5da43a76f90d59d19048164684de2ecf22ad2e21ed663bc6"} Jun 02 16:51:43.121128 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:43.120699 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz" Jun 02 16:51:43.140080 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:43.140026 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz" podStartSLOduration=1.372652206 podStartE2EDuration="8.139987063s" podCreationTimestamp="2026-06-02 16:51:35 +0000 UTC" firstStartedPulling="2026-06-02 16:51:36.027814267 +0000 UTC m=+620.483898505" lastFinishedPulling="2026-06-02 16:51:42.795149127 +0000 UTC m=+627.251233362" observedRunningTime="2026-06-02 16:51:43.138107724 +0000 UTC m=+627.594191983" watchObservedRunningTime="2026-06-02 16:51:43.139987063 +0000 UTC m=+627.596071322" Jun 02 16:51:45.803380 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:45.803343 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bmmd4"] Jun 02 16:51:45.805614 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:45.805594 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bmmd4" Jun 02 16:51:45.807793 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:45.807768 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 02 16:51:45.807793 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:45.807785 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 02 16:51:45.808370 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:45.808354 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6g5tq\"" Jun 02 16:51:45.817331 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:45.817306 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bmmd4"] Jun 02 16:51:45.899577 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:45.899537 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/01b7e369-22d1-478f-bd65-e1fabc55119f-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-bmmd4\" (UID: \"01b7e369-22d1-478f-bd65-e1fabc55119f\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bmmd4" Jun 02 16:51:45.899756 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:45.899601 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xs46\" (UniqueName: \"kubernetes.io/projected/01b7e369-22d1-478f-bd65-e1fabc55119f-kube-api-access-4xs46\") pod \"kuadrant-console-plugin-6cb54b5c86-bmmd4\" (UID: \"01b7e369-22d1-478f-bd65-e1fabc55119f\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bmmd4" Jun 02 16:51:45.899756 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:45.899722 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/01b7e369-22d1-478f-bd65-e1fabc55119f-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-bmmd4\" (UID: \"01b7e369-22d1-478f-bd65-e1fabc55119f\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bmmd4" Jun 02 16:51:46.000777 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:46.000735 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/01b7e369-22d1-478f-bd65-e1fabc55119f-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-bmmd4\" (UID: \"01b7e369-22d1-478f-bd65-e1fabc55119f\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bmmd4" Jun 02 16:51:46.000948 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:46.000789 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xs46\" (UniqueName: \"kubernetes.io/projected/01b7e369-22d1-478f-bd65-e1fabc55119f-kube-api-access-4xs46\") pod \"kuadrant-console-plugin-6cb54b5c86-bmmd4\" (UID: \"01b7e369-22d1-478f-bd65-e1fabc55119f\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bmmd4" Jun 02 16:51:46.000948 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:46.000837 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/01b7e369-22d1-478f-bd65-e1fabc55119f-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-bmmd4\" (UID: \"01b7e369-22d1-478f-bd65-e1fabc55119f\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bmmd4" Jun 02 16:51:46.001470 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:46.001447 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/01b7e369-22d1-478f-bd65-e1fabc55119f-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-bmmd4\" (UID: \"01b7e369-22d1-478f-bd65-e1fabc55119f\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bmmd4" Jun 02 16:51:46.003367 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:46.003340 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/01b7e369-22d1-478f-bd65-e1fabc55119f-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-bmmd4\" (UID: \"01b7e369-22d1-478f-bd65-e1fabc55119f\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bmmd4" Jun 02 16:51:46.019622 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:46.019600 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xs46\" (UniqueName: \"kubernetes.io/projected/01b7e369-22d1-478f-bd65-e1fabc55119f-kube-api-access-4xs46\") pod \"kuadrant-console-plugin-6cb54b5c86-bmmd4\" (UID: \"01b7e369-22d1-478f-bd65-e1fabc55119f\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bmmd4" Jun 02 16:51:46.127262 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:46.127235 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bmmd4" Jun 02 16:51:46.262956 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:46.262927 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bmmd4"] Jun 02 16:51:46.266983 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:51:46.266955 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01b7e369_22d1_478f_bd65_e1fabc55119f.slice/crio-2b935aac7ba5e1988b3551a2de9fba79098134283b9bdb61ce65c56ad94bb3bd WatchSource:0}: Error finding container 2b935aac7ba5e1988b3551a2de9fba79098134283b9bdb61ce65c56ad94bb3bd: Status 404 returned error can't find the container with id 2b935aac7ba5e1988b3551a2de9fba79098134283b9bdb61ce65c56ad94bb3bd Jun 02 16:51:47.136146 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:47.136110 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bmmd4" event={"ID":"01b7e369-22d1-478f-bd65-e1fabc55119f","Type":"ContainerStarted","Data":"2b935aac7ba5e1988b3551a2de9fba79098134283b9bdb61ce65c56ad94bb3bd"} Jun 02 16:51:54.126128 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:54.126100 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz" Jun 02 16:51:55.068892 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.068856 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-skq5f"] Jun 02 16:51:55.073822 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.073799 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-skq5f" Jun 02 16:51:55.085214 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.085189 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-skq5f"] Jun 02 16:51:55.191861 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.191543 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1fd394d-fc8e-4ae7-a915-150ff6af558c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-skq5f\" (UID: \"b1fd394d-fc8e-4ae7-a915-150ff6af558c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-skq5f" Jun 02 16:51:55.191861 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.191642 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5v5s\" (UniqueName: \"kubernetes.io/projected/b1fd394d-fc8e-4ae7-a915-150ff6af558c-kube-api-access-v5v5s\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-skq5f\" (UID: \"b1fd394d-fc8e-4ae7-a915-150ff6af558c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-skq5f" Jun 02 16:51:55.292979 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.292945 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v5v5s\" (UniqueName: \"kubernetes.io/projected/b1fd394d-fc8e-4ae7-a915-150ff6af558c-kube-api-access-v5v5s\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-skq5f\" (UID: \"b1fd394d-fc8e-4ae7-a915-150ff6af558c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-skq5f" Jun 02 16:51:55.293188 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.293059 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1fd394d-fc8e-4ae7-a915-150ff6af558c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-skq5f\" (UID: \"b1fd394d-fc8e-4ae7-a915-150ff6af558c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-skq5f" Jun 02 16:51:55.293523 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.293489 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1fd394d-fc8e-4ae7-a915-150ff6af558c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-skq5f\" (UID: \"b1fd394d-fc8e-4ae7-a915-150ff6af558c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-skq5f" Jun 02 16:51:55.307363 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.307330 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5v5s\" (UniqueName: \"kubernetes.io/projected/b1fd394d-fc8e-4ae7-a915-150ff6af558c-kube-api-access-v5v5s\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-skq5f\" (UID: \"b1fd394d-fc8e-4ae7-a915-150ff6af558c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-skq5f" Jun 02 16:51:55.388339 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.388305 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-skq5f" Jun 02 16:51:55.791164 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.791087 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz"] Jun 02 16:51:55.791342 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.791316 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz" podUID="2f7a7077-4838-4e11-ad5b-853d4803b570" containerName="manager" containerID="cri-o://4d9124151a728f0c5da43a76f90d59d19048164684de2ecf22ad2e21ed663bc6" gracePeriod=2 Jun 02 16:51:55.796442 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.796408 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz"] Jun 02 16:51:55.806860 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.806831 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-skq5f"] Jun 02 16:51:55.814144 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.814116 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lfq7l"] Jun 02 16:51:55.814768 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.814633 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f7a7077-4838-4e11-ad5b-853d4803b570" containerName="manager" Jun 02 16:51:55.814768 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.814660 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f7a7077-4838-4e11-ad5b-853d4803b570" containerName="manager" Jun 02 16:51:55.814931 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.814800 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="2f7a7077-4838-4e11-ad5b-853d4803b570" containerName="manager" Jun 02 16:51:55.819330 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.819306 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-skq5f"] Jun 02 16:51:55.819486 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.819447 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lfq7l" Jun 02 16:51:55.821274 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.821236 2565 status_manager.go:895] "Failed to get status for pod" podUID="2f7a7077-4838-4e11-ad5b-853d4803b570" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-57cqz\" is forbidden: User \"system:node:ip-10-0-132-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-45.ec2.internal' and this object" Jun 02 16:51:55.826938 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.826912 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lfq7l"] Jun 02 16:51:55.829818 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.829793 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-78pw2"] Jun 02 16:51:55.833498 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.833477 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-78pw2" Jun 02 16:51:55.848340 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.848310 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-78pw2"] Jun 02 16:51:55.899386 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.899359 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2dqr\" (UniqueName: \"kubernetes.io/projected/067caba4-9677-44f0-85dd-77a5859c5f8a-kube-api-access-n2dqr\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-78pw2\" (UID: \"067caba4-9677-44f0-85dd-77a5859c5f8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-78pw2" Jun 02 16:51:55.899530 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.899497 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f73da05f-95b3-48a4-99fb-3cec0d51a4a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lfq7l\" (UID: \"f73da05f-95b3-48a4-99fb-3cec0d51a4a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lfq7l" Jun 02 16:51:55.899598 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.899568 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nngg6\" (UniqueName: \"kubernetes.io/projected/f73da05f-95b3-48a4-99fb-3cec0d51a4a7-kube-api-access-nngg6\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lfq7l\" (UID: \"f73da05f-95b3-48a4-99fb-3cec0d51a4a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lfq7l" Jun 02 16:51:55.899681 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.899615 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/067caba4-9677-44f0-85dd-77a5859c5f8a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-78pw2\" (UID: \"067caba4-9677-44f0-85dd-77a5859c5f8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-78pw2" Jun 02 16:51:55.902956 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:55.902920 2565 status_manager.go:895] "Failed to get status for pod" podUID="2f7a7077-4838-4e11-ad5b-853d4803b570" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-57cqz\" is forbidden: User \"system:node:ip-10-0-132-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-45.ec2.internal' and this object" Jun 02 16:51:56.000337 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:56.000296 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f73da05f-95b3-48a4-99fb-3cec0d51a4a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lfq7l\" (UID: \"f73da05f-95b3-48a4-99fb-3cec0d51a4a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lfq7l" Jun 02 16:51:56.000337 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:56.000341 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nngg6\" (UniqueName: \"kubernetes.io/projected/f73da05f-95b3-48a4-99fb-3cec0d51a4a7-kube-api-access-nngg6\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lfq7l\" (UID: \"f73da05f-95b3-48a4-99fb-3cec0d51a4a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lfq7l" Jun 02 16:51:56.000577 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:56.000372 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/067caba4-9677-44f0-85dd-77a5859c5f8a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-78pw2\" (UID: \"067caba4-9677-44f0-85dd-77a5859c5f8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-78pw2" Jun 02 16:51:56.000577 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:56.000399 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2dqr\" (UniqueName: \"kubernetes.io/projected/067caba4-9677-44f0-85dd-77a5859c5f8a-kube-api-access-n2dqr\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-78pw2\" (UID: \"067caba4-9677-44f0-85dd-77a5859c5f8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-78pw2" Jun 02 16:51:56.000764 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:56.000739 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f73da05f-95b3-48a4-99fb-3cec0d51a4a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lfq7l\" (UID: \"f73da05f-95b3-48a4-99fb-3cec0d51a4a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lfq7l" Jun 02 16:51:56.000831 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:56.000758 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/067caba4-9677-44f0-85dd-77a5859c5f8a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-78pw2\" (UID: \"067caba4-9677-44f0-85dd-77a5859c5f8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-78pw2" Jun 02 16:51:56.010397 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:56.010370 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nngg6\" (UniqueName: \"kubernetes.io/projected/f73da05f-95b3-48a4-99fb-3cec0d51a4a7-kube-api-access-nngg6\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lfq7l\" (UID: \"f73da05f-95b3-48a4-99fb-3cec0d51a4a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lfq7l" Jun 02 16:51:56.010514 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:56.010460 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2dqr\" (UniqueName: \"kubernetes.io/projected/067caba4-9677-44f0-85dd-77a5859c5f8a-kube-api-access-n2dqr\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-78pw2\" (UID: \"067caba4-9677-44f0-85dd-77a5859c5f8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-78pw2" Jun 02 16:51:56.062981 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:56.062900 2565 status_manager.go:895] "Failed to get status for pod" podUID="2f7a7077-4838-4e11-ad5b-853d4803b570" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-57cqz\" is forbidden: User \"system:node:ip-10-0-132-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-45.ec2.internal' and this object" Jun 02 16:51:56.178850 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:56.178811 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lfq7l" Jun 02 16:51:56.185756 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:51:56.185736 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-78pw2" Jun 02 16:52:09.590285 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:09.590256 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz" Jun 02 16:52:09.592200 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:09.592162 2565 status_manager.go:895] "Failed to get status for pod" podUID="2f7a7077-4838-4e11-ad5b-853d4803b570" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-57cqz\" is forbidden: User \"system:node:ip-10-0-132-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-45.ec2.internal' and this object" Jun 02 16:52:09.615354 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:09.615316 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-78pw2"] Jun 02 16:52:09.618868 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:52:09.618828 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod067caba4_9677_44f0_85dd_77a5859c5f8a.slice/crio-e2a05caa559a64c155ba4c710860a862320ef2106e83fb963a8fccfb9a661237 WatchSource:0}: Error finding container e2a05caa559a64c155ba4c710860a862320ef2106e83fb963a8fccfb9a661237: Status 404 returned error can't find the container with id e2a05caa559a64c155ba4c710860a862320ef2106e83fb963a8fccfb9a661237 Jun 02 16:52:09.630877 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:09.630841 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lfq7l"] Jun 02 16:52:09.633718 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:52:09.633677 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf73da05f_95b3_48a4_99fb_3cec0d51a4a7.slice/crio-e538ec24fd2db4e3c3cc6639aaffa134672e4a3d184ec138410a7c88cafd7d32 WatchSource:0}: Error finding container e538ec24fd2db4e3c3cc6639aaffa134672e4a3d184ec138410a7c88cafd7d32: Status 404 returned error can't find the container with id e538ec24fd2db4e3c3cc6639aaffa134672e4a3d184ec138410a7c88cafd7d32 Jun 02 16:52:09.751686 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:09.751594 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrrwh\" (UniqueName: \"kubernetes.io/projected/2f7a7077-4838-4e11-ad5b-853d4803b570-kube-api-access-vrrwh\") pod \"2f7a7077-4838-4e11-ad5b-853d4803b570\" (UID: \"2f7a7077-4838-4e11-ad5b-853d4803b570\") " Jun 02 16:52:09.752110 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:09.751742 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f7a7077-4838-4e11-ad5b-853d4803b570-extensions-socket-volume\") pod \"2f7a7077-4838-4e11-ad5b-853d4803b570\" (UID: \"2f7a7077-4838-4e11-ad5b-853d4803b570\") " Jun 02 16:52:09.752688 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:09.752631 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f7a7077-4838-4e11-ad5b-853d4803b570-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2f7a7077-4838-4e11-ad5b-853d4803b570" (UID: "2f7a7077-4838-4e11-ad5b-853d4803b570"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:52:09.756459 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:09.756385 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f7a7077-4838-4e11-ad5b-853d4803b570-kube-api-access-vrrwh" (OuterVolumeSpecName: "kube-api-access-vrrwh") pod "2f7a7077-4838-4e11-ad5b-853d4803b570" (UID: "2f7a7077-4838-4e11-ad5b-853d4803b570"). InnerVolumeSpecName "kube-api-access-vrrwh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:52:09.852956 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:09.852905 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrrwh\" (UniqueName: \"kubernetes.io/projected/2f7a7077-4838-4e11-ad5b-853d4803b570-kube-api-access-vrrwh\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:52:09.852956 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:09.852947 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f7a7077-4838-4e11-ad5b-853d4803b570-extensions-socket-volume\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:52:10.047754 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:10.047646 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f7a7077-4838-4e11-ad5b-853d4803b570" path="/var/lib/kubelet/pods/2f7a7077-4838-4e11-ad5b-853d4803b570/volumes" Jun 02 16:52:10.219415 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:10.219358 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lfq7l" event={"ID":"f73da05f-95b3-48a4-99fb-3cec0d51a4a7","Type":"ContainerStarted","Data":"fbf9d6b4ad604733e05d93a9c3d2f71bae670d44aaeb6c9feb34bbfb277e9994"} Jun 02 16:52:10.219415 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:10.219420 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lfq7l" event={"ID":"f73da05f-95b3-48a4-99fb-3cec0d51a4a7","Type":"ContainerStarted","Data":"e538ec24fd2db4e3c3cc6639aaffa134672e4a3d184ec138410a7c88cafd7d32"} Jun 02 16:52:10.219752 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:10.219490 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lfq7l" Jun 02 16:52:10.221047 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:10.220994 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-78pw2" event={"ID":"067caba4-9677-44f0-85dd-77a5859c5f8a","Type":"ContainerStarted","Data":"bc26729d9c19d1233ac346ae13f542db707e0af7e3f5c399848e6fcad9ab8278"} Jun 02 16:52:10.221047 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:10.221048 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-78pw2" event={"ID":"067caba4-9677-44f0-85dd-77a5859c5f8a","Type":"ContainerStarted","Data":"e2a05caa559a64c155ba4c710860a862320ef2106e83fb963a8fccfb9a661237"} Jun 02 16:52:10.221225 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:10.221065 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-78pw2" Jun 02 16:52:10.222303 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:10.222271 2565 generic.go:358] "Generic (PLEG): container finished" podID="2f7a7077-4838-4e11-ad5b-853d4803b570" containerID="4d9124151a728f0c5da43a76f90d59d19048164684de2ecf22ad2e21ed663bc6" exitCode=0 Jun 02 16:52:10.222439 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:10.222326 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz" Jun 02 16:52:10.222439 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:10.222318 2565 scope.go:117] "RemoveContainer" containerID="4d9124151a728f0c5da43a76f90d59d19048164684de2ecf22ad2e21ed663bc6" Jun 02 16:52:10.223903 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:10.223877 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bmmd4" event={"ID":"01b7e369-22d1-478f-bd65-e1fabc55119f","Type":"ContainerStarted","Data":"dfbada213db4b3f6141e5e792b3cea5d41a52c372db572552830992bc1bb6b87"} Jun 02 16:52:10.231690 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:10.231665 2565 scope.go:117] "RemoveContainer" containerID="4d9124151a728f0c5da43a76f90d59d19048164684de2ecf22ad2e21ed663bc6" Jun 02 16:52:10.232053 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:52:10.232028 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d9124151a728f0c5da43a76f90d59d19048164684de2ecf22ad2e21ed663bc6\": container with ID starting with 4d9124151a728f0c5da43a76f90d59d19048164684de2ecf22ad2e21ed663bc6 not found: ID does not exist" containerID="4d9124151a728f0c5da43a76f90d59d19048164684de2ecf22ad2e21ed663bc6" Jun 02 16:52:10.232126 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:10.232067 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d9124151a728f0c5da43a76f90d59d19048164684de2ecf22ad2e21ed663bc6"} err="failed to get container status \"4d9124151a728f0c5da43a76f90d59d19048164684de2ecf22ad2e21ed663bc6\": rpc error: code = NotFound desc = could not find container \"4d9124151a728f0c5da43a76f90d59d19048164684de2ecf22ad2e21ed663bc6\": container with ID starting with 4d9124151a728f0c5da43a76f90d59d19048164684de2ecf22ad2e21ed663bc6 not found: ID does not exist" Jun 02 16:52:10.236889 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:10.236818 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lfq7l" podStartSLOduration=15.23679822 podStartE2EDuration="15.23679822s" podCreationTimestamp="2026-06-02 16:51:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:52:10.236107502 +0000 UTC m=+654.692191760" watchObservedRunningTime="2026-06-02 16:52:10.23679822 +0000 UTC m=+654.692882477" Jun 02 16:52:10.251754 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:10.251685 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bmmd4" podStartSLOduration=2.006506597 podStartE2EDuration="25.251665962s" podCreationTimestamp="2026-06-02 16:51:45 +0000 UTC" firstStartedPulling="2026-06-02 16:51:46.268327955 +0000 UTC m=+630.724412193" lastFinishedPulling="2026-06-02 16:52:09.513487244 +0000 UTC m=+653.969571558" observedRunningTime="2026-06-02 16:52:10.249735389 +0000 UTC m=+654.705819647" watchObservedRunningTime="2026-06-02 16:52:10.251665962 +0000 UTC m=+654.707750217" Jun 02 16:52:10.266470 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:10.266418 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-78pw2" podStartSLOduration=15.266400645 podStartE2EDuration="15.266400645s" podCreationTimestamp="2026-06-02 16:51:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:52:10.264920892 +0000 UTC m=+654.721005148" watchObservedRunningTime="2026-06-02 16:52:10.266400645 +0000 UTC m=+654.722484903" Jun 02 16:52:10.266897 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:10.266852 2565 status_manager.go:895] "Failed to get status for pod" podUID="2f7a7077-4838-4e11-ad5b-853d4803b570" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-57cqz" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-57cqz\" is forbidden: User \"system:node:ip-10-0-132-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-45.ec2.internal' and this object" Jun 02 16:52:11.957931 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:52:11.957892 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1fd394d_fc8e_4ae7_a915_150ff6af558c.slice/crio-fec20ddedc3d8514f36dcf263047876ac69d5d5cfd4a55e1c49d4161665f9718 WatchSource:0}: Error finding container fec20ddedc3d8514f36dcf263047876ac69d5d5cfd4a55e1c49d4161665f9718: Status 404 returned error can't find the container with id fec20ddedc3d8514f36dcf263047876ac69d5d5cfd4a55e1c49d4161665f9718 Jun 02 16:52:12.235123 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:12.234987 2565 generic.go:358] "Generic (PLEG): container finished" podID="b1fd394d-fc8e-4ae7-a915-150ff6af558c" containerID="5954bfb274de91363bfc9af5c4ceb5f4d43df3f16eaa9d8bf375ad24a0d096b3" exitCode=1 Jun 02 16:52:12.237058 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:12.237002 2565 status_manager.go:895] "Failed to get status for pod" podUID="b1fd394d-fc8e-4ae7-a915-150ff6af558c" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-skq5f" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-skq5f\" is forbidden: User \"system:node:ip-10-0-132-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-45.ec2.internal' and this object" Jun 02 16:52:12.270770 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:12.270741 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-skq5f" Jun 02 16:52:12.272579 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:12.272550 2565 status_manager.go:895] "Failed to get status for pod" podUID="b1fd394d-fc8e-4ae7-a915-150ff6af558c" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-skq5f" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-skq5f\" is forbidden: User \"system:node:ip-10-0-132-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-45.ec2.internal' and this object" Jun 02 16:52:12.378314 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:12.378275 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5v5s\" (UniqueName: \"kubernetes.io/projected/b1fd394d-fc8e-4ae7-a915-150ff6af558c-kube-api-access-v5v5s\") pod \"b1fd394d-fc8e-4ae7-a915-150ff6af558c\" (UID: \"b1fd394d-fc8e-4ae7-a915-150ff6af558c\") " Jun 02 16:52:12.378510 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:12.378325 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1fd394d-fc8e-4ae7-a915-150ff6af558c-extensions-socket-volume\") pod \"b1fd394d-fc8e-4ae7-a915-150ff6af558c\" (UID: \"b1fd394d-fc8e-4ae7-a915-150ff6af558c\") " Jun 02 16:52:12.378628 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:12.378603 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1fd394d-fc8e-4ae7-a915-150ff6af558c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b1fd394d-fc8e-4ae7-a915-150ff6af558c" (UID: "b1fd394d-fc8e-4ae7-a915-150ff6af558c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:52:12.380737 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:12.380712 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1fd394d-fc8e-4ae7-a915-150ff6af558c-kube-api-access-v5v5s" (OuterVolumeSpecName: "kube-api-access-v5v5s") pod "b1fd394d-fc8e-4ae7-a915-150ff6af558c" (UID: "b1fd394d-fc8e-4ae7-a915-150ff6af558c"). InnerVolumeSpecName "kube-api-access-v5v5s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:52:12.479906 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:12.479859 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5v5s\" (UniqueName: \"kubernetes.io/projected/b1fd394d-fc8e-4ae7-a915-150ff6af558c-kube-api-access-v5v5s\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:52:12.479906 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:12.479900 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1fd394d-fc8e-4ae7-a915-150ff6af558c-extensions-socket-volume\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:52:13.240956 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:13.240859 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-skq5f" Jun 02 16:52:13.240956 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:13.240886 2565 scope.go:117] "RemoveContainer" containerID="5954bfb274de91363bfc9af5c4ceb5f4d43df3f16eaa9d8bf375ad24a0d096b3" Jun 02 16:52:13.243183 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:13.243144 2565 status_manager.go:895] "Failed to get status for pod" podUID="b1fd394d-fc8e-4ae7-a915-150ff6af558c" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-skq5f" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-skq5f\" is forbidden: User \"system:node:ip-10-0-132-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-45.ec2.internal' and this object" Jun 02 16:52:13.252735 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:13.252701 2565 status_manager.go:895] "Failed to get status for pod" podUID="b1fd394d-fc8e-4ae7-a915-150ff6af558c" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-skq5f" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-skq5f\" is forbidden: User \"system:node:ip-10-0-132-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-45.ec2.internal' and this object" Jun 02 16:52:14.048972 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:14.048915 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1fd394d-fc8e-4ae7-a915-150ff6af558c" path="/var/lib/kubelet/pods/b1fd394d-fc8e-4ae7-a915-150ff6af558c/volumes" Jun 02 16:52:21.232377 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:21.232343 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lfq7l" Jun 02 16:52:21.232823 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:21.232402 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-78pw2" Jun 02 16:52:21.299542 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:21.299495 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lfq7l"] Jun 02 16:52:21.299789 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:21.299763 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lfq7l" podUID="f73da05f-95b3-48a4-99fb-3cec0d51a4a7" containerName="manager" containerID="cri-o://fbf9d6b4ad604733e05d93a9c3d2f71bae670d44aaeb6c9feb34bbfb277e9994" gracePeriod=10 Jun 02 16:52:21.518549 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:21.518510 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m4nnp"] Jun 02 16:52:21.518928 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:21.518909 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1fd394d-fc8e-4ae7-a915-150ff6af558c" containerName="manager" Jun 02 16:52:21.518928 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:21.518927 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1fd394d-fc8e-4ae7-a915-150ff6af558c" containerName="manager" Jun 02 16:52:21.519150 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:21.519002 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="b1fd394d-fc8e-4ae7-a915-150ff6af558c" containerName="manager" Jun 02 16:52:21.522115 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:21.522091 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m4nnp" Jun 02 16:52:21.531953 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:21.531921 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m4nnp"] Jun 02 16:52:21.546366 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:21.546338 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6rb4\" (UniqueName: \"kubernetes.io/projected/735a2123-85f8-4196-96e4-ce84c17ada3f-kube-api-access-z6rb4\") pod \"kuadrant-operator-controller-manager-55c7f4c975-m4nnp\" (UID: \"735a2123-85f8-4196-96e4-ce84c17ada3f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m4nnp" Jun 02 16:52:21.546431 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:21.546380 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/735a2123-85f8-4196-96e4-ce84c17ada3f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-m4nnp\" (UID: \"735a2123-85f8-4196-96e4-ce84c17ada3f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m4nnp" Jun 02 16:52:21.563517 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:21.563486 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lfq7l" Jun 02 16:52:21.647221 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:21.647186 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f73da05f-95b3-48a4-99fb-3cec0d51a4a7-extensions-socket-volume\") pod \"f73da05f-95b3-48a4-99fb-3cec0d51a4a7\" (UID: \"f73da05f-95b3-48a4-99fb-3cec0d51a4a7\") " Jun 02 16:52:21.647381 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:21.647243 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nngg6\" (UniqueName: \"kubernetes.io/projected/f73da05f-95b3-48a4-99fb-3cec0d51a4a7-kube-api-access-nngg6\") pod \"f73da05f-95b3-48a4-99fb-3cec0d51a4a7\" (UID: \"f73da05f-95b3-48a4-99fb-3cec0d51a4a7\") " Jun 02 16:52:21.647451 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:21.647409 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6rb4\" (UniqueName: \"kubernetes.io/projected/735a2123-85f8-4196-96e4-ce84c17ada3f-kube-api-access-z6rb4\") pod \"kuadrant-operator-controller-manager-55c7f4c975-m4nnp\" (UID: \"735a2123-85f8-4196-96e4-ce84c17ada3f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m4nnp" Jun 02 16:52:21.647489 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:21.647446 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/735a2123-85f8-4196-96e4-ce84c17ada3f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-m4nnp\" (UID: \"735a2123-85f8-4196-96e4-ce84c17ada3f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m4nnp" Jun 02 16:52:21.647642 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:21.647621 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f73da05f-95b3-48a4-99fb-3cec0d51a4a7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f73da05f-95b3-48a4-99fb-3cec0d51a4a7" (UID: "f73da05f-95b3-48a4-99fb-3cec0d51a4a7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:52:21.647875 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:21.647850 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/735a2123-85f8-4196-96e4-ce84c17ada3f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-m4nnp\" (UID: \"735a2123-85f8-4196-96e4-ce84c17ada3f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m4nnp" Jun 02 16:52:21.649610 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:21.649586 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f73da05f-95b3-48a4-99fb-3cec0d51a4a7-kube-api-access-nngg6" (OuterVolumeSpecName: "kube-api-access-nngg6") pod "f73da05f-95b3-48a4-99fb-3cec0d51a4a7" (UID: "f73da05f-95b3-48a4-99fb-3cec0d51a4a7"). InnerVolumeSpecName "kube-api-access-nngg6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:52:21.655711 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:21.655687 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6rb4\" (UniqueName: \"kubernetes.io/projected/735a2123-85f8-4196-96e4-ce84c17ada3f-kube-api-access-z6rb4\") pod \"kuadrant-operator-controller-manager-55c7f4c975-m4nnp\" (UID: \"735a2123-85f8-4196-96e4-ce84c17ada3f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m4nnp" Jun 02 16:52:21.749087 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:21.749048 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f73da05f-95b3-48a4-99fb-3cec0d51a4a7-extensions-socket-volume\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:52:21.749087 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:21.749081 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nngg6\" (UniqueName: \"kubernetes.io/projected/f73da05f-95b3-48a4-99fb-3cec0d51a4a7-kube-api-access-nngg6\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:52:21.836267 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:21.836165 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m4nnp" Jun 02 16:52:21.987208 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:21.987171 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m4nnp"] Jun 02 16:52:21.990295 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:52:21.990266 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod735a2123_85f8_4196_96e4_ce84c17ada3f.slice/crio-13c241f45fe40f8e032dcc366179b7bfa62293c5a58b7d67946272ca9bda1646 WatchSource:0}: Error finding container 13c241f45fe40f8e032dcc366179b7bfa62293c5a58b7d67946272ca9bda1646: Status 404 returned error can't find the container with id 13c241f45fe40f8e032dcc366179b7bfa62293c5a58b7d67946272ca9bda1646 Jun 02 16:52:22.277897 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:22.277854 2565 generic.go:358] "Generic (PLEG): container finished" podID="f73da05f-95b3-48a4-99fb-3cec0d51a4a7" containerID="fbf9d6b4ad604733e05d93a9c3d2f71bae670d44aaeb6c9feb34bbfb277e9994" exitCode=0 Jun 02 16:52:22.278406 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:22.277935 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lfq7l" Jun 02 16:52:22.278406 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:22.277945 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lfq7l" event={"ID":"f73da05f-95b3-48a4-99fb-3cec0d51a4a7","Type":"ContainerDied","Data":"fbf9d6b4ad604733e05d93a9c3d2f71bae670d44aaeb6c9feb34bbfb277e9994"} Jun 02 16:52:22.278406 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:22.277986 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lfq7l" event={"ID":"f73da05f-95b3-48a4-99fb-3cec0d51a4a7","Type":"ContainerDied","Data":"e538ec24fd2db4e3c3cc6639aaffa134672e4a3d184ec138410a7c88cafd7d32"} Jun 02 16:52:22.278406 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:22.278021 2565 scope.go:117] "RemoveContainer" containerID="fbf9d6b4ad604733e05d93a9c3d2f71bae670d44aaeb6c9feb34bbfb277e9994" Jun 02 16:52:22.279800 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:22.279773 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m4nnp" event={"ID":"735a2123-85f8-4196-96e4-ce84c17ada3f","Type":"ContainerStarted","Data":"622d6add06126baa7b59b9f0eb04dca0096f00712684a6df054ccb590eac03c7"} Jun 02 16:52:22.279929 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:22.279809 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m4nnp" event={"ID":"735a2123-85f8-4196-96e4-ce84c17ada3f","Type":"ContainerStarted","Data":"13c241f45fe40f8e032dcc366179b7bfa62293c5a58b7d67946272ca9bda1646"} Jun 02 16:52:22.279993 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:22.279964 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m4nnp" Jun 02 16:52:22.291002 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:22.290978 2565 scope.go:117] "RemoveContainer" containerID="fbf9d6b4ad604733e05d93a9c3d2f71bae670d44aaeb6c9feb34bbfb277e9994" Jun 02 16:52:22.291401 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:52:22.291368 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbf9d6b4ad604733e05d93a9c3d2f71bae670d44aaeb6c9feb34bbfb277e9994\": container with ID starting with fbf9d6b4ad604733e05d93a9c3d2f71bae670d44aaeb6c9feb34bbfb277e9994 not found: ID does not exist" containerID="fbf9d6b4ad604733e05d93a9c3d2f71bae670d44aaeb6c9feb34bbfb277e9994" Jun 02 16:52:22.291488 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:22.291406 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbf9d6b4ad604733e05d93a9c3d2f71bae670d44aaeb6c9feb34bbfb277e9994"} err="failed to get container status \"fbf9d6b4ad604733e05d93a9c3d2f71bae670d44aaeb6c9feb34bbfb277e9994\": rpc error: code = NotFound desc = could not find container \"fbf9d6b4ad604733e05d93a9c3d2f71bae670d44aaeb6c9feb34bbfb277e9994\": container with ID starting with fbf9d6b4ad604733e05d93a9c3d2f71bae670d44aaeb6c9feb34bbfb277e9994 not found: ID does not exist" Jun 02 16:52:22.300847 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:22.300808 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lfq7l"] Jun 02 16:52:22.304314 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:22.304281 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lfq7l"] Jun 02 16:52:22.320757 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:22.320702 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m4nnp" podStartSLOduration=1.320684994 podStartE2EDuration="1.320684994s" podCreationTimestamp="2026-06-02 16:52:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:52:22.318688357 +0000 UTC m=+666.774772613" watchObservedRunningTime="2026-06-02 16:52:22.320684994 +0000 UTC m=+666.776769355" Jun 02 16:52:24.047034 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:24.046984 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f73da05f-95b3-48a4-99fb-3cec0d51a4a7" path="/var/lib/kubelet/pods/f73da05f-95b3-48a4-99fb-3cec0d51a4a7/volumes" Jun 02 16:52:33.287171 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:33.287140 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m4nnp" Jun 02 16:52:33.338969 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:33.338915 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-78pw2"] Jun 02 16:52:33.339320 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:33.339257 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-78pw2" podUID="067caba4-9677-44f0-85dd-77a5859c5f8a" containerName="manager" containerID="cri-o://bc26729d9c19d1233ac346ae13f542db707e0af7e3f5c399848e6fcad9ab8278" gracePeriod=10 Jun 02 16:52:34.130958 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:34.130924 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-78pw2" Jun 02 16:52:34.267214 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:34.267111 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2dqr\" (UniqueName: \"kubernetes.io/projected/067caba4-9677-44f0-85dd-77a5859c5f8a-kube-api-access-n2dqr\") pod \"067caba4-9677-44f0-85dd-77a5859c5f8a\" (UID: \"067caba4-9677-44f0-85dd-77a5859c5f8a\") " Jun 02 16:52:34.267214 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:34.267184 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/067caba4-9677-44f0-85dd-77a5859c5f8a-extensions-socket-volume\") pod \"067caba4-9677-44f0-85dd-77a5859c5f8a\" (UID: \"067caba4-9677-44f0-85dd-77a5859c5f8a\") " Jun 02 16:52:34.267568 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:34.267544 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/067caba4-9677-44f0-85dd-77a5859c5f8a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "067caba4-9677-44f0-85dd-77a5859c5f8a" (UID: "067caba4-9677-44f0-85dd-77a5859c5f8a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:52:34.269563 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:34.269535 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/067caba4-9677-44f0-85dd-77a5859c5f8a-kube-api-access-n2dqr" (OuterVolumeSpecName: "kube-api-access-n2dqr") pod "067caba4-9677-44f0-85dd-77a5859c5f8a" (UID: "067caba4-9677-44f0-85dd-77a5859c5f8a"). InnerVolumeSpecName "kube-api-access-n2dqr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:52:34.326746 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:34.326710 2565 generic.go:358] "Generic (PLEG): container finished" podID="067caba4-9677-44f0-85dd-77a5859c5f8a" containerID="bc26729d9c19d1233ac346ae13f542db707e0af7e3f5c399848e6fcad9ab8278" exitCode=0 Jun 02 16:52:34.327284 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:34.326791 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-78pw2" event={"ID":"067caba4-9677-44f0-85dd-77a5859c5f8a","Type":"ContainerDied","Data":"bc26729d9c19d1233ac346ae13f542db707e0af7e3f5c399848e6fcad9ab8278"} Jun 02 16:52:34.327284 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:34.326814 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-78pw2" Jun 02 16:52:34.327284 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:34.326833 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-78pw2" event={"ID":"067caba4-9677-44f0-85dd-77a5859c5f8a","Type":"ContainerDied","Data":"e2a05caa559a64c155ba4c710860a862320ef2106e83fb963a8fccfb9a661237"} Jun 02 16:52:34.327284 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:34.326852 2565 scope.go:117] "RemoveContainer" containerID="bc26729d9c19d1233ac346ae13f542db707e0af7e3f5c399848e6fcad9ab8278" Jun 02 16:52:34.337073 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:34.337052 2565 scope.go:117] "RemoveContainer" containerID="bc26729d9c19d1233ac346ae13f542db707e0af7e3f5c399848e6fcad9ab8278" Jun 02 16:52:34.337390 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:52:34.337370 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc26729d9c19d1233ac346ae13f542db707e0af7e3f5c399848e6fcad9ab8278\": container with ID starting with bc26729d9c19d1233ac346ae13f542db707e0af7e3f5c399848e6fcad9ab8278 not found: ID does not exist" containerID="bc26729d9c19d1233ac346ae13f542db707e0af7e3f5c399848e6fcad9ab8278" Jun 02 16:52:34.337450 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:34.337402 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc26729d9c19d1233ac346ae13f542db707e0af7e3f5c399848e6fcad9ab8278"} err="failed to get container status \"bc26729d9c19d1233ac346ae13f542db707e0af7e3f5c399848e6fcad9ab8278\": rpc error: code = NotFound desc = could not find container \"bc26729d9c19d1233ac346ae13f542db707e0af7e3f5c399848e6fcad9ab8278\": container with ID starting with bc26729d9c19d1233ac346ae13f542db707e0af7e3f5c399848e6fcad9ab8278 not found: ID does not exist" Jun 02 16:52:34.349203 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:34.349164 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-78pw2"] Jun 02 16:52:34.356095 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:34.356060 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-78pw2"] Jun 02 16:52:34.368888 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:34.368859 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/067caba4-9677-44f0-85dd-77a5859c5f8a-extensions-socket-volume\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:52:34.368888 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:34.368887 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2dqr\" (UniqueName: \"kubernetes.io/projected/067caba4-9677-44f0-85dd-77a5859c5f8a-kube-api-access-n2dqr\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:52:36.047184 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:36.047151 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="067caba4-9677-44f0-85dd-77a5859c5f8a" path="/var/lib/kubelet/pods/067caba4-9677-44f0-85dd-77a5859c5f8a/volumes" Jun 02 16:52:52.814224 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:52.814181 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mnl7f"] Jun 02 16:52:52.814662 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:52.814535 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="067caba4-9677-44f0-85dd-77a5859c5f8a" containerName="manager" Jun 02 16:52:52.814662 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:52.814546 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="067caba4-9677-44f0-85dd-77a5859c5f8a" containerName="manager" Jun 02 16:52:52.814662 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:52.814567 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f73da05f-95b3-48a4-99fb-3cec0d51a4a7" containerName="manager" Jun 02 16:52:52.814662 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:52.814573 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f73da05f-95b3-48a4-99fb-3cec0d51a4a7" containerName="manager" Jun 02 16:52:52.814662 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:52.814625 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="067caba4-9677-44f0-85dd-77a5859c5f8a" containerName="manager" Jun 02 16:52:52.814662 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:52.814634 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="f73da05f-95b3-48a4-99fb-3cec0d51a4a7" containerName="manager" Jun 02 16:52:52.882226 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:52.882174 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mnl7f"] Jun 02 16:52:52.882398 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:52.882335 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-mnl7f" Jun 02 16:52:52.884344 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:52.884323 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ntpr9\"" Jun 02 16:52:52.944129 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:52.944087 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-jbgjd"] Jun 02 16:52:52.947672 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:52.947648 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-jbgjd" Jun 02 16:52:52.957845 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:52.957816 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-jbgjd"] Jun 02 16:52:53.040317 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:53.040268 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jw6n\" (UniqueName: \"kubernetes.io/projected/cf64ea70-4b7c-43bc-a4a5-0925a177d212-kube-api-access-9jw6n\") pod \"authorino-7498df8756-jbgjd\" (UID: \"cf64ea70-4b7c-43bc-a4a5-0925a177d212\") " pod="kuadrant-system/authorino-7498df8756-jbgjd" Jun 02 16:52:53.040317 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:53.040322 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsfff\" (UniqueName: \"kubernetes.io/projected/66710d55-2a0c-4839-9e74-c4210fa698fd-kube-api-access-rsfff\") pod \"authorino-f99f4b5cd-mnl7f\" (UID: \"66710d55-2a0c-4839-9e74-c4210fa698fd\") " pod="kuadrant-system/authorino-f99f4b5cd-mnl7f" Jun 02 16:52:53.141918 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:53.141879 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9jw6n\" (UniqueName: \"kubernetes.io/projected/cf64ea70-4b7c-43bc-a4a5-0925a177d212-kube-api-access-9jw6n\") pod \"authorino-7498df8756-jbgjd\" (UID: \"cf64ea70-4b7c-43bc-a4a5-0925a177d212\") " pod="kuadrant-system/authorino-7498df8756-jbgjd" Jun 02 16:52:53.141918 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:53.141930 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rsfff\" (UniqueName: \"kubernetes.io/projected/66710d55-2a0c-4839-9e74-c4210fa698fd-kube-api-access-rsfff\") pod \"authorino-f99f4b5cd-mnl7f\" (UID: \"66710d55-2a0c-4839-9e74-c4210fa698fd\") " pod="kuadrant-system/authorino-f99f4b5cd-mnl7f" Jun 02 16:52:53.150320 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:53.150288 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsfff\" (UniqueName: \"kubernetes.io/projected/66710d55-2a0c-4839-9e74-c4210fa698fd-kube-api-access-rsfff\") pod \"authorino-f99f4b5cd-mnl7f\" (UID: \"66710d55-2a0c-4839-9e74-c4210fa698fd\") " pod="kuadrant-system/authorino-f99f4b5cd-mnl7f" Jun 02 16:52:53.150528 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:53.150509 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jw6n\" (UniqueName: \"kubernetes.io/projected/cf64ea70-4b7c-43bc-a4a5-0925a177d212-kube-api-access-9jw6n\") pod \"authorino-7498df8756-jbgjd\" (UID: \"cf64ea70-4b7c-43bc-a4a5-0925a177d212\") " pod="kuadrant-system/authorino-7498df8756-jbgjd" Jun 02 16:52:53.192377 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:53.192335 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-mnl7f" Jun 02 16:52:53.257194 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:53.257104 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-jbgjd" Jun 02 16:52:53.345874 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:53.345838 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mnl7f"] Jun 02 16:52:53.349297 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:52:53.349269 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66710d55_2a0c_4839_9e74_c4210fa698fd.slice/crio-933b3b0942bb150fe1cf3ec2a8f16eb257f22729595e6b2e38fbb1e008445137 WatchSource:0}: Error finding container 933b3b0942bb150fe1cf3ec2a8f16eb257f22729595e6b2e38fbb1e008445137: Status 404 returned error can't find the container with id 933b3b0942bb150fe1cf3ec2a8f16eb257f22729595e6b2e38fbb1e008445137 Jun 02 16:52:53.396346 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:53.396242 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-mnl7f" event={"ID":"66710d55-2a0c-4839-9e74-c4210fa698fd","Type":"ContainerStarted","Data":"933b3b0942bb150fe1cf3ec2a8f16eb257f22729595e6b2e38fbb1e008445137"} Jun 02 16:52:53.416988 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:53.416811 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-jbgjd"] Jun 02 16:52:53.419765 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:52:53.419720 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf64ea70_4b7c_43bc_a4a5_0925a177d212.slice/crio-431e9156c01b3e9cad60e3981f843f95306fe8907ec8c1249cb01f296a090354 WatchSource:0}: Error finding container 431e9156c01b3e9cad60e3981f843f95306fe8907ec8c1249cb01f296a090354: Status 404 returned error can't find the container with id 431e9156c01b3e9cad60e3981f843f95306fe8907ec8c1249cb01f296a090354 Jun 02 16:52:54.408243 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:54.408201 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-jbgjd" event={"ID":"cf64ea70-4b7c-43bc-a4a5-0925a177d212","Type":"ContainerStarted","Data":"431e9156c01b3e9cad60e3981f843f95306fe8907ec8c1249cb01f296a090354"} Jun 02 16:52:57.420924 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:57.420876 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-mnl7f" event={"ID":"66710d55-2a0c-4839-9e74-c4210fa698fd","Type":"ContainerStarted","Data":"a66d429910ca57d433cdfc6a3d4025941f7acfcf0194ea60adb5c7f4b692b2a3"} Jun 02 16:52:57.422389 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:57.422366 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-jbgjd" event={"ID":"cf64ea70-4b7c-43bc-a4a5-0925a177d212","Type":"ContainerStarted","Data":"b8f4a6edadba30d0586bc9da9cdadda0a486305fc42efdeff447a9c82564387f"} Jun 02 16:52:57.435787 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:57.435732 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-mnl7f" podStartSLOduration=1.842090063 podStartE2EDuration="5.435717383s" podCreationTimestamp="2026-06-02 16:52:52 +0000 UTC" firstStartedPulling="2026-06-02 16:52:53.350652693 +0000 UTC m=+697.806736928" lastFinishedPulling="2026-06-02 16:52:56.944279999 +0000 UTC m=+701.400364248" observedRunningTime="2026-06-02 16:52:57.434293612 +0000 UTC m=+701.890377884" watchObservedRunningTime="2026-06-02 16:52:57.435717383 +0000 UTC m=+701.891801641" Jun 02 16:52:57.448489 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:57.448417 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-jbgjd" podStartSLOduration=1.913873202 podStartE2EDuration="5.448394586s" podCreationTimestamp="2026-06-02 16:52:52 +0000 UTC" firstStartedPulling="2026-06-02 16:52:53.421281213 +0000 UTC m=+697.877365448" lastFinishedPulling="2026-06-02 16:52:56.955802598 +0000 UTC m=+701.411886832" observedRunningTime="2026-06-02 16:52:57.446771466 +0000 UTC m=+701.902855724" watchObservedRunningTime="2026-06-02 16:52:57.448394586 +0000 UTC m=+701.904478843" Jun 02 16:52:57.472291 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:57.472248 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mnl7f"] Jun 02 16:52:59.431060 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:59.430992 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-mnl7f" podUID="66710d55-2a0c-4839-9e74-c4210fa698fd" containerName="authorino" containerID="cri-o://a66d429910ca57d433cdfc6a3d4025941f7acfcf0194ea60adb5c7f4b692b2a3" gracePeriod=30 Jun 02 16:52:59.682976 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:59.682902 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-mnl7f" Jun 02 16:52:59.803495 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:59.803450 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsfff\" (UniqueName: \"kubernetes.io/projected/66710d55-2a0c-4839-9e74-c4210fa698fd-kube-api-access-rsfff\") pod \"66710d55-2a0c-4839-9e74-c4210fa698fd\" (UID: \"66710d55-2a0c-4839-9e74-c4210fa698fd\") " Jun 02 16:52:59.805741 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:59.805708 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66710d55-2a0c-4839-9e74-c4210fa698fd-kube-api-access-rsfff" (OuterVolumeSpecName: "kube-api-access-rsfff") pod "66710d55-2a0c-4839-9e74-c4210fa698fd" (UID: "66710d55-2a0c-4839-9e74-c4210fa698fd"). InnerVolumeSpecName "kube-api-access-rsfff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:52:59.904653 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:52:59.904585 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsfff\" (UniqueName: \"kubernetes.io/projected/66710d55-2a0c-4839-9e74-c4210fa698fd-kube-api-access-rsfff\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:53:00.435763 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:00.435724 2565 generic.go:358] "Generic (PLEG): container finished" podID="66710d55-2a0c-4839-9e74-c4210fa698fd" containerID="a66d429910ca57d433cdfc6a3d4025941f7acfcf0194ea60adb5c7f4b692b2a3" exitCode=0 Jun 02 16:53:00.436224 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:00.435797 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-mnl7f" Jun 02 16:53:00.436224 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:00.435814 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-mnl7f" event={"ID":"66710d55-2a0c-4839-9e74-c4210fa698fd","Type":"ContainerDied","Data":"a66d429910ca57d433cdfc6a3d4025941f7acfcf0194ea60adb5c7f4b692b2a3"} Jun 02 16:53:00.436224 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:00.435856 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-mnl7f" event={"ID":"66710d55-2a0c-4839-9e74-c4210fa698fd","Type":"ContainerDied","Data":"933b3b0942bb150fe1cf3ec2a8f16eb257f22729595e6b2e38fbb1e008445137"} Jun 02 16:53:00.436224 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:00.435875 2565 scope.go:117] "RemoveContainer" containerID="a66d429910ca57d433cdfc6a3d4025941f7acfcf0194ea60adb5c7f4b692b2a3" Jun 02 16:53:00.447151 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:00.447128 2565 scope.go:117] "RemoveContainer" containerID="a66d429910ca57d433cdfc6a3d4025941f7acfcf0194ea60adb5c7f4b692b2a3" Jun 02 16:53:00.447689 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:53:00.447668 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a66d429910ca57d433cdfc6a3d4025941f7acfcf0194ea60adb5c7f4b692b2a3\": container with ID starting with a66d429910ca57d433cdfc6a3d4025941f7acfcf0194ea60adb5c7f4b692b2a3 not found: ID does not exist" containerID="a66d429910ca57d433cdfc6a3d4025941f7acfcf0194ea60adb5c7f4b692b2a3" Jun 02 16:53:00.447751 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:00.447697 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a66d429910ca57d433cdfc6a3d4025941f7acfcf0194ea60adb5c7f4b692b2a3"} err="failed to get container status \"a66d429910ca57d433cdfc6a3d4025941f7acfcf0194ea60adb5c7f4b692b2a3\": rpc error: code = NotFound desc = could not find container \"a66d429910ca57d433cdfc6a3d4025941f7acfcf0194ea60adb5c7f4b692b2a3\": container with ID starting with a66d429910ca57d433cdfc6a3d4025941f7acfcf0194ea60adb5c7f4b692b2a3 not found: ID does not exist" Jun 02 16:53:00.451748 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:00.451723 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mnl7f"] Jun 02 16:53:00.455273 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:00.455249 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mnl7f"] Jun 02 16:53:02.046579 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:02.046543 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66710d55-2a0c-4839-9e74-c4210fa698fd" path="/var/lib/kubelet/pods/66710d55-2a0c-4839-9e74-c4210fa698fd/volumes" Jun 02 16:53:42.239704 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:42.239662 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 16:53:42.240233 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:42.240173 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66710d55-2a0c-4839-9e74-c4210fa698fd" containerName="authorino" Jun 02 16:53:42.240233 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:42.240206 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="66710d55-2a0c-4839-9e74-c4210fa698fd" containerName="authorino" Jun 02 16:53:42.240350 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:42.240320 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="66710d55-2a0c-4839-9e74-c4210fa698fd" containerName="authorino" Jun 02 16:53:42.243082 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:42.243064 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 16:53:42.245242 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:42.245219 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 02 16:53:42.245342 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:42.245226 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 16:53:42.245342 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:42.245223 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-scp8b\"" Jun 02 16:53:42.245792 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:42.245778 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 16:53:42.250243 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:42.250222 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 16:53:42.376367 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:42.376334 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5hpw\" (UniqueName: \"kubernetes.io/projected/c82f4172-a8a8-4a0e-9c8e-e8258848d303-kube-api-access-l5hpw\") pod \"maas-keycloak-0\" (UID: \"c82f4172-a8a8-4a0e-9c8e-e8258848d303\") " pod="keycloak-system/maas-keycloak-0" Jun 02 16:53:42.477149 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:42.477123 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5hpw\" (UniqueName: \"kubernetes.io/projected/c82f4172-a8a8-4a0e-9c8e-e8258848d303-kube-api-access-l5hpw\") pod \"maas-keycloak-0\" (UID: \"c82f4172-a8a8-4a0e-9c8e-e8258848d303\") " pod="keycloak-system/maas-keycloak-0" Jun 02 16:53:42.485189 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:42.485170 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5hpw\" (UniqueName: \"kubernetes.io/projected/c82f4172-a8a8-4a0e-9c8e-e8258848d303-kube-api-access-l5hpw\") pod \"maas-keycloak-0\" (UID: \"c82f4172-a8a8-4a0e-9c8e-e8258848d303\") " pod="keycloak-system/maas-keycloak-0" Jun 02 16:53:42.554543 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:42.554479 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 16:53:42.683379 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:42.683188 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 16:53:42.686194 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:53:42.686165 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc82f4172_a8a8_4a0e_9c8e_e8258848d303.slice/crio-110ec23d00c5800714e776270ca8872fe5853ec3b54a19ab3969ea29c668b818 WatchSource:0}: Error finding container 110ec23d00c5800714e776270ca8872fe5853ec3b54a19ab3969ea29c668b818: Status 404 returned error can't find the container with id 110ec23d00c5800714e776270ca8872fe5853ec3b54a19ab3969ea29c668b818 Jun 02 16:53:43.602066 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:43.602028 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c82f4172-a8a8-4a0e-9c8e-e8258848d303","Type":"ContainerStarted","Data":"110ec23d00c5800714e776270ca8872fe5853ec3b54a19ab3969ea29c668b818"} Jun 02 16:53:48.624671 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:48.624611 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c82f4172-a8a8-4a0e-9c8e-e8258848d303","Type":"ContainerStarted","Data":"dcb4414dca1298fde624f7e3e2e3ab6efadd2dc8a7b5ef02b53e79404d0f82a6"} Jun 02 16:53:48.643204 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:48.642802 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.6872140039999999 podStartE2EDuration="6.642784241s" podCreationTimestamp="2026-06-02 16:53:42 +0000 UTC" firstStartedPulling="2026-06-02 16:53:42.68760186 +0000 UTC m=+747.143686100" lastFinishedPulling="2026-06-02 16:53:47.643172102 +0000 UTC m=+752.099256337" observedRunningTime="2026-06-02 16:53:48.641081255 +0000 UTC m=+753.097165511" watchObservedRunningTime="2026-06-02 16:53:48.642784241 +0000 UTC m=+753.098868501" Jun 02 16:53:49.554869 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:49.554823 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 02 16:53:49.556758 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:49.556718 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c82f4172-a8a8-4a0e-9c8e-e8258848d303" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 02 16:53:50.555669 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:50.555604 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c82f4172-a8a8-4a0e-9c8e-e8258848d303" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 02 16:53:51.555730 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:51.555679 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c82f4172-a8a8-4a0e-9c8e-e8258848d303" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 02 16:53:52.555335 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:52.555293 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 02 16:53:52.555665 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:52.555626 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c82f4172-a8a8-4a0e-9c8e-e8258848d303" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 02 16:53:53.555617 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:53.555567 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c82f4172-a8a8-4a0e-9c8e-e8258848d303" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 02 16:53:54.555985 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:54.555925 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c82f4172-a8a8-4a0e-9c8e-e8258848d303" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 02 16:53:55.555339 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:55.555286 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c82f4172-a8a8-4a0e-9c8e-e8258848d303" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 02 16:53:56.555199 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:56.555143 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c82f4172-a8a8-4a0e-9c8e-e8258848d303" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 02 16:53:57.555247 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:57.555184 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c82f4172-a8a8-4a0e-9c8e-e8258848d303" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 02 16:53:58.555818 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:58.555763 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c82f4172-a8a8-4a0e-9c8e-e8258848d303" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 02 16:53:59.555793 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:53:59.555725 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c82f4172-a8a8-4a0e-9c8e-e8258848d303" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 02 16:54:00.555091 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:00.554996 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c82f4172-a8a8-4a0e-9c8e-e8258848d303" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 02 16:54:01.698782 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:01.698664 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 02 16:54:01.721531 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:01.721462 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="c82f4172-a8a8-4a0e-9c8e-e8258848d303" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 16:54:11.707075 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:11.707033 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 02 16:54:12.560245 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:12.560204 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-b2xhz"] Jun 02 16:54:12.567924 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:12.567895 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-b2xhz" Jun 02 16:54:12.571866 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:12.571834 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-b2xhz"] Jun 02 16:54:12.677844 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:12.677803 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4jc8\" (UniqueName: \"kubernetes.io/projected/e8f91823-9eae-4702-8ea4-90af4de0dfd5-kube-api-access-k4jc8\") pod \"authorino-8b475cf9f-b2xhz\" (UID: \"e8f91823-9eae-4702-8ea4-90af4de0dfd5\") " pod="kuadrant-system/authorino-8b475cf9f-b2xhz" Jun 02 16:54:12.778436 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:12.778392 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k4jc8\" (UniqueName: \"kubernetes.io/projected/e8f91823-9eae-4702-8ea4-90af4de0dfd5-kube-api-access-k4jc8\") pod \"authorino-8b475cf9f-b2xhz\" (UID: \"e8f91823-9eae-4702-8ea4-90af4de0dfd5\") " pod="kuadrant-system/authorino-8b475cf9f-b2xhz" Jun 02 16:54:12.787719 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:12.787688 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4jc8\" (UniqueName: \"kubernetes.io/projected/e8f91823-9eae-4702-8ea4-90af4de0dfd5-kube-api-access-k4jc8\") pod \"authorino-8b475cf9f-b2xhz\" (UID: \"e8f91823-9eae-4702-8ea4-90af4de0dfd5\") " pod="kuadrant-system/authorino-8b475cf9f-b2xhz" Jun 02 16:54:12.799497 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:12.799457 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-b2xhz"] Jun 02 16:54:12.799816 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:12.799802 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-b2xhz" Jun 02 16:54:12.826222 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:12.826189 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6488dbb57f-hm89c"] Jun 02 16:54:12.829104 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:12.829081 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6488dbb57f-hm89c" Jun 02 16:54:12.838049 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:12.837729 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6488dbb57f-hm89c"] Jun 02 16:54:12.879370 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:12.879338 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnk4v\" (UniqueName: \"kubernetes.io/projected/4513dd67-7bb0-477e-9464-fd5bd9a74ebc-kube-api-access-bnk4v\") pod \"authorino-6488dbb57f-hm89c\" (UID: \"4513dd67-7bb0-477e-9464-fd5bd9a74ebc\") " pod="kuadrant-system/authorino-6488dbb57f-hm89c" Jun 02 16:54:12.953044 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:12.952985 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-b2xhz"] Jun 02 16:54:12.957268 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:54:12.957228 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8f91823_9eae_4702_8ea4_90af4de0dfd5.slice/crio-5f9c04d294d11efcde2d2840dce95907c01196a31add621586379022c77511e6 WatchSource:0}: Error finding container 5f9c04d294d11efcde2d2840dce95907c01196a31add621586379022c77511e6: Status 404 returned error can't find the container with id 5f9c04d294d11efcde2d2840dce95907c01196a31add621586379022c77511e6 Jun 02 16:54:12.980130 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:12.980095 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bnk4v\" (UniqueName: \"kubernetes.io/projected/4513dd67-7bb0-477e-9464-fd5bd9a74ebc-kube-api-access-bnk4v\") pod \"authorino-6488dbb57f-hm89c\" (UID: \"4513dd67-7bb0-477e-9464-fd5bd9a74ebc\") " pod="kuadrant-system/authorino-6488dbb57f-hm89c" Jun 02 16:54:12.985954 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:12.985916 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6488dbb57f-hm89c"] Jun 02 16:54:12.986232 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:54:12.986207 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-bnk4v], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6488dbb57f-hm89c" podUID="4513dd67-7bb0-477e-9464-fd5bd9a74ebc" Jun 02 16:54:12.988886 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:12.988864 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnk4v\" (UniqueName: \"kubernetes.io/projected/4513dd67-7bb0-477e-9464-fd5bd9a74ebc-kube-api-access-bnk4v\") pod \"authorino-6488dbb57f-hm89c\" (UID: \"4513dd67-7bb0-477e-9464-fd5bd9a74ebc\") " pod="kuadrant-system/authorino-6488dbb57f-hm89c" Jun 02 16:54:13.013143 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:13.013092 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bc8b6bb79-q5xdw"] Jun 02 16:54:13.015946 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:13.015919 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bc8b6bb79-q5xdw" Jun 02 16:54:13.017868 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:13.017841 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 02 16:54:13.024736 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:13.024703 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bc8b6bb79-q5xdw"] Jun 02 16:54:13.080914 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:13.080805 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/54c83dc4-ba84-4297-8200-02662ad466a2-tls-cert\") pod \"authorino-7bc8b6bb79-q5xdw\" (UID: \"54c83dc4-ba84-4297-8200-02662ad466a2\") " pod="kuadrant-system/authorino-7bc8b6bb79-q5xdw" Jun 02 16:54:13.080914 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:13.080849 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5jhx\" (UniqueName: \"kubernetes.io/projected/54c83dc4-ba84-4297-8200-02662ad466a2-kube-api-access-r5jhx\") pod \"authorino-7bc8b6bb79-q5xdw\" (UID: \"54c83dc4-ba84-4297-8200-02662ad466a2\") " pod="kuadrant-system/authorino-7bc8b6bb79-q5xdw" Jun 02 16:54:13.181997 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:13.181953 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/54c83dc4-ba84-4297-8200-02662ad466a2-tls-cert\") pod \"authorino-7bc8b6bb79-q5xdw\" (UID: \"54c83dc4-ba84-4297-8200-02662ad466a2\") " pod="kuadrant-system/authorino-7bc8b6bb79-q5xdw" Jun 02 16:54:13.181997 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:13.181996 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5jhx\" (UniqueName: \"kubernetes.io/projected/54c83dc4-ba84-4297-8200-02662ad466a2-kube-api-access-r5jhx\") pod \"authorino-7bc8b6bb79-q5xdw\" (UID: \"54c83dc4-ba84-4297-8200-02662ad466a2\") " pod="kuadrant-system/authorino-7bc8b6bb79-q5xdw" Jun 02 16:54:13.184752 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:13.184724 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/54c83dc4-ba84-4297-8200-02662ad466a2-tls-cert\") pod \"authorino-7bc8b6bb79-q5xdw\" (UID: \"54c83dc4-ba84-4297-8200-02662ad466a2\") " pod="kuadrant-system/authorino-7bc8b6bb79-q5xdw" Jun 02 16:54:13.190640 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:13.190609 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5jhx\" (UniqueName: \"kubernetes.io/projected/54c83dc4-ba84-4297-8200-02662ad466a2-kube-api-access-r5jhx\") pod \"authorino-7bc8b6bb79-q5xdw\" (UID: \"54c83dc4-ba84-4297-8200-02662ad466a2\") " pod="kuadrant-system/authorino-7bc8b6bb79-q5xdw" Jun 02 16:54:13.328850 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:13.328799 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bc8b6bb79-q5xdw" Jun 02 16:54:13.481778 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:13.481741 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bc8b6bb79-q5xdw"] Jun 02 16:54:13.485389 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:54:13.485356 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54c83dc4_ba84_4297_8200_02662ad466a2.slice/crio-55f36b9376f94776ab99ec2a357f3cdf93fee8b054c200f5d526e8930b7c9a5c WatchSource:0}: Error finding container 55f36b9376f94776ab99ec2a357f3cdf93fee8b054c200f5d526e8930b7c9a5c: Status 404 returned error can't find the container with id 55f36b9376f94776ab99ec2a357f3cdf93fee8b054c200f5d526e8930b7c9a5c Jun 02 16:54:13.735281 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:13.735238 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-b2xhz" event={"ID":"e8f91823-9eae-4702-8ea4-90af4de0dfd5","Type":"ContainerStarted","Data":"1bafd69d92e5fb9e051833574f82f933f46aaa6c7718d00ce81420124cb3886b"} Jun 02 16:54:13.735281 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:13.735268 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-b2xhz" podUID="e8f91823-9eae-4702-8ea4-90af4de0dfd5" containerName="authorino" containerID="cri-o://1bafd69d92e5fb9e051833574f82f933f46aaa6c7718d00ce81420124cb3886b" gracePeriod=30 Jun 02 16:54:13.735281 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:13.735288 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-b2xhz" event={"ID":"e8f91823-9eae-4702-8ea4-90af4de0dfd5","Type":"ContainerStarted","Data":"5f9c04d294d11efcde2d2840dce95907c01196a31add621586379022c77511e6"} Jun 02 16:54:13.736637 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:13.736614 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6488dbb57f-hm89c" Jun 02 16:54:13.736777 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:13.736617 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bc8b6bb79-q5xdw" event={"ID":"54c83dc4-ba84-4297-8200-02662ad466a2","Type":"ContainerStarted","Data":"55f36b9376f94776ab99ec2a357f3cdf93fee8b054c200f5d526e8930b7c9a5c"} Jun 02 16:54:13.741954 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:13.741926 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6488dbb57f-hm89c" Jun 02 16:54:13.751359 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:13.751315 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-b2xhz" podStartSLOduration=1.414605131 podStartE2EDuration="1.751300215s" podCreationTimestamp="2026-06-02 16:54:12 +0000 UTC" firstStartedPulling="2026-06-02 16:54:12.9586196 +0000 UTC m=+777.414703835" lastFinishedPulling="2026-06-02 16:54:13.295314681 +0000 UTC m=+777.751398919" observedRunningTime="2026-06-02 16:54:13.749265404 +0000 UTC m=+778.205349661" watchObservedRunningTime="2026-06-02 16:54:13.751300215 +0000 UTC m=+778.207384471" Jun 02 16:54:13.888868 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:13.888816 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnk4v\" (UniqueName: \"kubernetes.io/projected/4513dd67-7bb0-477e-9464-fd5bd9a74ebc-kube-api-access-bnk4v\") pod \"4513dd67-7bb0-477e-9464-fd5bd9a74ebc\" (UID: \"4513dd67-7bb0-477e-9464-fd5bd9a74ebc\") " Jun 02 16:54:13.891261 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:13.891225 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4513dd67-7bb0-477e-9464-fd5bd9a74ebc-kube-api-access-bnk4v" (OuterVolumeSpecName: "kube-api-access-bnk4v") pod "4513dd67-7bb0-477e-9464-fd5bd9a74ebc" (UID: "4513dd67-7bb0-477e-9464-fd5bd9a74ebc"). InnerVolumeSpecName "kube-api-access-bnk4v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:54:13.976988 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:13.976965 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-b2xhz" Jun 02 16:54:13.989686 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:13.989630 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnk4v\" (UniqueName: \"kubernetes.io/projected/4513dd67-7bb0-477e-9464-fd5bd9a74ebc-kube-api-access-bnk4v\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:54:14.090445 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:14.090407 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4jc8\" (UniqueName: \"kubernetes.io/projected/e8f91823-9eae-4702-8ea4-90af4de0dfd5-kube-api-access-k4jc8\") pod \"e8f91823-9eae-4702-8ea4-90af4de0dfd5\" (UID: \"e8f91823-9eae-4702-8ea4-90af4de0dfd5\") " Jun 02 16:54:14.092752 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:14.092726 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8f91823-9eae-4702-8ea4-90af4de0dfd5-kube-api-access-k4jc8" (OuterVolumeSpecName: "kube-api-access-k4jc8") pod "e8f91823-9eae-4702-8ea4-90af4de0dfd5" (UID: "e8f91823-9eae-4702-8ea4-90af4de0dfd5"). InnerVolumeSpecName "kube-api-access-k4jc8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:54:14.191467 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:14.191430 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4jc8\" (UniqueName: \"kubernetes.io/projected/e8f91823-9eae-4702-8ea4-90af4de0dfd5-kube-api-access-k4jc8\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:54:14.741368 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:14.741329 2565 generic.go:358] "Generic (PLEG): container finished" podID="e8f91823-9eae-4702-8ea4-90af4de0dfd5" containerID="1bafd69d92e5fb9e051833574f82f933f46aaa6c7718d00ce81420124cb3886b" exitCode=0 Jun 02 16:54:14.741583 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:14.741375 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-b2xhz" Jun 02 16:54:14.741583 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:14.741413 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-b2xhz" event={"ID":"e8f91823-9eae-4702-8ea4-90af4de0dfd5","Type":"ContainerDied","Data":"1bafd69d92e5fb9e051833574f82f933f46aaa6c7718d00ce81420124cb3886b"} Jun 02 16:54:14.741583 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:14.741450 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-b2xhz" event={"ID":"e8f91823-9eae-4702-8ea4-90af4de0dfd5","Type":"ContainerDied","Data":"5f9c04d294d11efcde2d2840dce95907c01196a31add621586379022c77511e6"} Jun 02 16:54:14.741583 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:14.741467 2565 scope.go:117] "RemoveContainer" containerID="1bafd69d92e5fb9e051833574f82f933f46aaa6c7718d00ce81420124cb3886b" Jun 02 16:54:14.742970 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:14.742905 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6488dbb57f-hm89c" Jun 02 16:54:14.742970 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:14.742915 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bc8b6bb79-q5xdw" event={"ID":"54c83dc4-ba84-4297-8200-02662ad466a2","Type":"ContainerStarted","Data":"c20230a66fb628a71c4445e3d9d2083ad686bb8f9a21353914f57a0fc215fe72"} Jun 02 16:54:14.751076 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:14.751059 2565 scope.go:117] "RemoveContainer" containerID="1bafd69d92e5fb9e051833574f82f933f46aaa6c7718d00ce81420124cb3886b" Jun 02 16:54:14.751395 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:54:14.751374 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bafd69d92e5fb9e051833574f82f933f46aaa6c7718d00ce81420124cb3886b\": container with ID starting with 1bafd69d92e5fb9e051833574f82f933f46aaa6c7718d00ce81420124cb3886b not found: ID does not exist" containerID="1bafd69d92e5fb9e051833574f82f933f46aaa6c7718d00ce81420124cb3886b" Jun 02 16:54:14.751446 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:14.751405 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bafd69d92e5fb9e051833574f82f933f46aaa6c7718d00ce81420124cb3886b"} err="failed to get container status \"1bafd69d92e5fb9e051833574f82f933f46aaa6c7718d00ce81420124cb3886b\": rpc error: code = NotFound desc = could not find container \"1bafd69d92e5fb9e051833574f82f933f46aaa6c7718d00ce81420124cb3886b\": container with ID starting with 1bafd69d92e5fb9e051833574f82f933f46aaa6c7718d00ce81420124cb3886b not found: ID does not exist" Jun 02 16:54:14.760711 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:14.760663 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7bc8b6bb79-q5xdw" podStartSLOduration=2.350954455 podStartE2EDuration="2.760647942s" podCreationTimestamp="2026-06-02 16:54:12 +0000 UTC" firstStartedPulling="2026-06-02 16:54:13.486873469 +0000 UTC m=+777.942957708" lastFinishedPulling="2026-06-02 16:54:13.896566959 +0000 UTC m=+778.352651195" observedRunningTime="2026-06-02 16:54:14.758626 +0000 UTC m=+779.214710256" watchObservedRunningTime="2026-06-02 16:54:14.760647942 +0000 UTC m=+779.216732198" Jun 02 16:54:14.782912 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:14.782874 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6488dbb57f-hm89c"] Jun 02 16:54:14.786672 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:14.786630 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-jbgjd"] Jun 02 16:54:14.786886 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:14.786859 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-jbgjd" podUID="cf64ea70-4b7c-43bc-a4a5-0925a177d212" containerName="authorino" containerID="cri-o://b8f4a6edadba30d0586bc9da9cdadda0a486305fc42efdeff447a9c82564387f" gracePeriod=30 Jun 02 16:54:14.797734 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:14.797702 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6488dbb57f-hm89c"] Jun 02 16:54:14.807254 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:14.807207 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-b2xhz"] Jun 02 16:54:14.811039 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:14.810993 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-b2xhz"] Jun 02 16:54:15.045408 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:15.045377 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-jbgjd" Jun 02 16:54:15.204037 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:15.201046 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jw6n\" (UniqueName: \"kubernetes.io/projected/cf64ea70-4b7c-43bc-a4a5-0925a177d212-kube-api-access-9jw6n\") pod \"cf64ea70-4b7c-43bc-a4a5-0925a177d212\" (UID: \"cf64ea70-4b7c-43bc-a4a5-0925a177d212\") " Jun 02 16:54:15.206029 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:15.204456 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf64ea70-4b7c-43bc-a4a5-0925a177d212-kube-api-access-9jw6n" (OuterVolumeSpecName: "kube-api-access-9jw6n") pod "cf64ea70-4b7c-43bc-a4a5-0925a177d212" (UID: "cf64ea70-4b7c-43bc-a4a5-0925a177d212"). InnerVolumeSpecName "kube-api-access-9jw6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:54:15.302945 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:15.302822 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jw6n\" (UniqueName: \"kubernetes.io/projected/cf64ea70-4b7c-43bc-a4a5-0925a177d212-kube-api-access-9jw6n\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:54:15.748915 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:15.748871 2565 generic.go:358] "Generic (PLEG): container finished" podID="cf64ea70-4b7c-43bc-a4a5-0925a177d212" containerID="b8f4a6edadba30d0586bc9da9cdadda0a486305fc42efdeff447a9c82564387f" exitCode=0 Jun 02 16:54:15.749124 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:15.748957 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-jbgjd" Jun 02 16:54:15.749124 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:15.748957 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-jbgjd" event={"ID":"cf64ea70-4b7c-43bc-a4a5-0925a177d212","Type":"ContainerDied","Data":"b8f4a6edadba30d0586bc9da9cdadda0a486305fc42efdeff447a9c82564387f"} Jun 02 16:54:15.749124 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:15.748998 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-jbgjd" event={"ID":"cf64ea70-4b7c-43bc-a4a5-0925a177d212","Type":"ContainerDied","Data":"431e9156c01b3e9cad60e3981f843f95306fe8907ec8c1249cb01f296a090354"} Jun 02 16:54:15.749124 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:15.749037 2565 scope.go:117] "RemoveContainer" containerID="b8f4a6edadba30d0586bc9da9cdadda0a486305fc42efdeff447a9c82564387f" Jun 02 16:54:15.758493 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:15.758476 2565 scope.go:117] "RemoveContainer" containerID="b8f4a6edadba30d0586bc9da9cdadda0a486305fc42efdeff447a9c82564387f" Jun 02 16:54:15.758807 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:54:15.758785 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8f4a6edadba30d0586bc9da9cdadda0a486305fc42efdeff447a9c82564387f\": container with ID starting with b8f4a6edadba30d0586bc9da9cdadda0a486305fc42efdeff447a9c82564387f not found: ID does not exist" containerID="b8f4a6edadba30d0586bc9da9cdadda0a486305fc42efdeff447a9c82564387f" Jun 02 16:54:15.758866 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:15.758817 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8f4a6edadba30d0586bc9da9cdadda0a486305fc42efdeff447a9c82564387f"} err="failed to get container status \"b8f4a6edadba30d0586bc9da9cdadda0a486305fc42efdeff447a9c82564387f\": rpc error: code = NotFound desc = could not find container \"b8f4a6edadba30d0586bc9da9cdadda0a486305fc42efdeff447a9c82564387f\": container with ID starting with b8f4a6edadba30d0586bc9da9cdadda0a486305fc42efdeff447a9c82564387f not found: ID does not exist" Jun 02 16:54:15.768925 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:15.768898 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-jbgjd"] Jun 02 16:54:15.772734 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:15.772708 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-jbgjd"] Jun 02 16:54:16.046872 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:16.046834 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4513dd67-7bb0-477e-9464-fd5bd9a74ebc" path="/var/lib/kubelet/pods/4513dd67-7bb0-477e-9464-fd5bd9a74ebc/volumes" Jun 02 16:54:16.047321 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:16.047228 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf64ea70-4b7c-43bc-a4a5-0925a177d212" path="/var/lib/kubelet/pods/cf64ea70-4b7c-43bc-a4a5-0925a177d212/volumes" Jun 02 16:54:16.047607 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:16.047587 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8f91823-9eae-4702-8ea4-90af4de0dfd5" path="/var/lib/kubelet/pods/e8f91823-9eae-4702-8ea4-90af4de0dfd5/volumes" Jun 02 16:54:18.189551 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.189511 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d6cbcf875-lx4dc"] Jun 02 16:54:18.190071 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.189887 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8f91823-9eae-4702-8ea4-90af4de0dfd5" containerName="authorino" Jun 02 16:54:18.190071 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.189900 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8f91823-9eae-4702-8ea4-90af4de0dfd5" containerName="authorino" Jun 02 16:54:18.190071 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.189930 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf64ea70-4b7c-43bc-a4a5-0925a177d212" containerName="authorino" Jun 02 16:54:18.190071 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.189937 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf64ea70-4b7c-43bc-a4a5-0925a177d212" containerName="authorino" Jun 02 16:54:18.190071 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.189991 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="cf64ea70-4b7c-43bc-a4a5-0925a177d212" containerName="authorino" Jun 02 16:54:18.190071 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.190003 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="e8f91823-9eae-4702-8ea4-90af4de0dfd5" containerName="authorino" Jun 02 16:54:18.193138 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.193114 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d6cbcf875-lx4dc" Jun 02 16:54:18.195558 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.195536 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kd8gh\"" Jun 02 16:54:18.195677 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.195537 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 02 16:54:18.204682 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.204648 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d6cbcf875-lx4dc"] Jun 02 16:54:18.333082 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.333042 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7phf\" (UniqueName: \"kubernetes.io/projected/c14fdc59-8987-46d3-b202-3534e0ef3426-kube-api-access-g7phf\") pod \"maas-controller-d6cbcf875-lx4dc\" (UID: \"c14fdc59-8987-46d3-b202-3534e0ef3426\") " pod="opendatahub/maas-controller-d6cbcf875-lx4dc" Jun 02 16:54:18.355731 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.355694 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7847646b5-l5xr8"] Jun 02 16:54:18.358186 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.358162 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7847646b5-l5xr8" Jun 02 16:54:18.371553 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.371513 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7847646b5-l5xr8"] Jun 02 16:54:18.433971 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.433922 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g7phf\" (UniqueName: \"kubernetes.io/projected/c14fdc59-8987-46d3-b202-3534e0ef3426-kube-api-access-g7phf\") pod \"maas-controller-d6cbcf875-lx4dc\" (UID: \"c14fdc59-8987-46d3-b202-3534e0ef3426\") " pod="opendatahub/maas-controller-d6cbcf875-lx4dc" Jun 02 16:54:18.434298 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.434060 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gv6z\" (UniqueName: \"kubernetes.io/projected/2870ad52-9f7f-4bda-a9f4-d0c05a1df465-kube-api-access-4gv6z\") pod \"maas-controller-7847646b5-l5xr8\" (UID: \"2870ad52-9f7f-4bda-a9f4-d0c05a1df465\") " pod="opendatahub/maas-controller-7847646b5-l5xr8" Jun 02 16:54:18.442608 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.442525 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7phf\" (UniqueName: \"kubernetes.io/projected/c14fdc59-8987-46d3-b202-3534e0ef3426-kube-api-access-g7phf\") pod \"maas-controller-d6cbcf875-lx4dc\" (UID: \"c14fdc59-8987-46d3-b202-3534e0ef3426\") " pod="opendatahub/maas-controller-d6cbcf875-lx4dc" Jun 02 16:54:18.504390 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.504341 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d6cbcf875-lx4dc" Jun 02 16:54:18.534809 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.534768 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4gv6z\" (UniqueName: \"kubernetes.io/projected/2870ad52-9f7f-4bda-a9f4-d0c05a1df465-kube-api-access-4gv6z\") pod \"maas-controller-7847646b5-l5xr8\" (UID: \"2870ad52-9f7f-4bda-a9f4-d0c05a1df465\") " pod="opendatahub/maas-controller-7847646b5-l5xr8" Jun 02 16:54:18.545233 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.545158 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gv6z\" (UniqueName: \"kubernetes.io/projected/2870ad52-9f7f-4bda-a9f4-d0c05a1df465-kube-api-access-4gv6z\") pod \"maas-controller-7847646b5-l5xr8\" (UID: \"2870ad52-9f7f-4bda-a9f4-d0c05a1df465\") " pod="opendatahub/maas-controller-7847646b5-l5xr8" Jun 02 16:54:18.645175 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.645134 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d6cbcf875-lx4dc"] Jun 02 16:54:18.650069 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:54:18.650033 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc14fdc59_8987_46d3_b202_3534e0ef3426.slice/crio-1d005b5973becb53e5e2353311a6abe901019a91e227f25d4a134b8e15b00d83 WatchSource:0}: Error finding container 1d005b5973becb53e5e2353311a6abe901019a91e227f25d4a134b8e15b00d83: Status 404 returned error can't find the container with id 1d005b5973becb53e5e2353311a6abe901019a91e227f25d4a134b8e15b00d83 Jun 02 16:54:18.651435 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.651418 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 16:54:18.677097 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.677054 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7847646b5-l5xr8" Jun 02 16:54:18.762396 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.762347 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d6cbcf875-lx4dc" event={"ID":"c14fdc59-8987-46d3-b202-3534e0ef3426","Type":"ContainerStarted","Data":"1d005b5973becb53e5e2353311a6abe901019a91e227f25d4a134b8e15b00d83"} Jun 02 16:54:18.818215 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:18.818151 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7847646b5-l5xr8"] Jun 02 16:54:18.821772 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:54:18.821745 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2870ad52_9f7f_4bda_a9f4_d0c05a1df465.slice/crio-a48f5e846bc0b013714b33de67de9ee638574a93359777d797c5559efe0a0426 WatchSource:0}: Error finding container a48f5e846bc0b013714b33de67de9ee638574a93359777d797c5559efe0a0426: Status 404 returned error can't find the container with id a48f5e846bc0b013714b33de67de9ee638574a93359777d797c5559efe0a0426 Jun 02 16:54:19.770429 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:19.770382 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7847646b5-l5xr8" event={"ID":"2870ad52-9f7f-4bda-a9f4-d0c05a1df465","Type":"ContainerStarted","Data":"a48f5e846bc0b013714b33de67de9ee638574a93359777d797c5559efe0a0426"} Jun 02 16:54:21.780074 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:21.779929 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7847646b5-l5xr8" event={"ID":"2870ad52-9f7f-4bda-a9f4-d0c05a1df465","Type":"ContainerStarted","Data":"fffc01e63e870269b4577bffbbabfd59571b2257e66ff3194de4bf39a0116d3c"} Jun 02 16:54:21.780074 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:21.780029 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7847646b5-l5xr8" Jun 02 16:54:21.781438 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:21.781409 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d6cbcf875-lx4dc" event={"ID":"c14fdc59-8987-46d3-b202-3534e0ef3426","Type":"ContainerStarted","Data":"3f6f057903e1d2bfef211a8869152d76ef6fd24cd74efe0c571d551f2bd94351"} Jun 02 16:54:21.781557 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:21.781526 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d6cbcf875-lx4dc" Jun 02 16:54:21.801589 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:21.801520 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7847646b5-l5xr8" podStartSLOduration=1.218561641 podStartE2EDuration="3.801501541s" podCreationTimestamp="2026-06-02 16:54:18 +0000 UTC" firstStartedPulling="2026-06-02 16:54:18.82317203 +0000 UTC m=+783.279256268" lastFinishedPulling="2026-06-02 16:54:21.406111933 +0000 UTC m=+785.862196168" observedRunningTime="2026-06-02 16:54:21.798567588 +0000 UTC m=+786.254651847" watchObservedRunningTime="2026-06-02 16:54:21.801501541 +0000 UTC m=+786.257585801" Jun 02 16:54:21.816736 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:21.816671 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-d6cbcf875-lx4dc" podStartSLOduration=1.072955128 podStartE2EDuration="3.816654292s" podCreationTimestamp="2026-06-02 16:54:18 +0000 UTC" firstStartedPulling="2026-06-02 16:54:18.651558427 +0000 UTC m=+783.107642662" lastFinishedPulling="2026-06-02 16:54:21.395257591 +0000 UTC m=+785.851341826" observedRunningTime="2026-06-02 16:54:21.815832962 +0000 UTC m=+786.271917223" watchObservedRunningTime="2026-06-02 16:54:21.816654292 +0000 UTC m=+786.272738551" Jun 02 16:54:32.790649 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:32.790613 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d6cbcf875-lx4dc" Jun 02 16:54:32.791070 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:32.790678 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7847646b5-l5xr8" Jun 02 16:54:32.845906 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:32.845874 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d6cbcf875-lx4dc"] Jun 02 16:54:32.846106 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:32.846084 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-d6cbcf875-lx4dc" podUID="c14fdc59-8987-46d3-b202-3534e0ef3426" containerName="manager" containerID="cri-o://3f6f057903e1d2bfef211a8869152d76ef6fd24cd74efe0c571d551f2bd94351" gracePeriod=30 Jun 02 16:54:33.094299 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:33.094279 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d6cbcf875-lx4dc" Jun 02 16:54:33.179829 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:33.179802 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7phf\" (UniqueName: \"kubernetes.io/projected/c14fdc59-8987-46d3-b202-3534e0ef3426-kube-api-access-g7phf\") pod \"c14fdc59-8987-46d3-b202-3534e0ef3426\" (UID: \"c14fdc59-8987-46d3-b202-3534e0ef3426\") " Jun 02 16:54:33.182077 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:33.182050 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c14fdc59-8987-46d3-b202-3534e0ef3426-kube-api-access-g7phf" (OuterVolumeSpecName: "kube-api-access-g7phf") pod "c14fdc59-8987-46d3-b202-3534e0ef3426" (UID: "c14fdc59-8987-46d3-b202-3534e0ef3426"). InnerVolumeSpecName "kube-api-access-g7phf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:54:33.280648 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:33.280623 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7phf\" (UniqueName: \"kubernetes.io/projected/c14fdc59-8987-46d3-b202-3534e0ef3426-kube-api-access-g7phf\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:54:33.822884 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:33.822847 2565 generic.go:358] "Generic (PLEG): container finished" podID="c14fdc59-8987-46d3-b202-3534e0ef3426" containerID="3f6f057903e1d2bfef211a8869152d76ef6fd24cd74efe0c571d551f2bd94351" exitCode=0 Jun 02 16:54:33.823337 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:33.822908 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d6cbcf875-lx4dc" Jun 02 16:54:33.823337 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:33.822917 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d6cbcf875-lx4dc" event={"ID":"c14fdc59-8987-46d3-b202-3534e0ef3426","Type":"ContainerDied","Data":"3f6f057903e1d2bfef211a8869152d76ef6fd24cd74efe0c571d551f2bd94351"} Jun 02 16:54:33.823337 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:33.822946 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d6cbcf875-lx4dc" event={"ID":"c14fdc59-8987-46d3-b202-3534e0ef3426","Type":"ContainerDied","Data":"1d005b5973becb53e5e2353311a6abe901019a91e227f25d4a134b8e15b00d83"} Jun 02 16:54:33.823337 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:33.822960 2565 scope.go:117] "RemoveContainer" containerID="3f6f057903e1d2bfef211a8869152d76ef6fd24cd74efe0c571d551f2bd94351" Jun 02 16:54:33.832134 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:33.832118 2565 scope.go:117] "RemoveContainer" containerID="3f6f057903e1d2bfef211a8869152d76ef6fd24cd74efe0c571d551f2bd94351" Jun 02 16:54:33.832365 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:54:33.832348 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f6f057903e1d2bfef211a8869152d76ef6fd24cd74efe0c571d551f2bd94351\": container with ID starting with 3f6f057903e1d2bfef211a8869152d76ef6fd24cd74efe0c571d551f2bd94351 not found: ID does not exist" containerID="3f6f057903e1d2bfef211a8869152d76ef6fd24cd74efe0c571d551f2bd94351" Jun 02 16:54:33.832412 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:33.832373 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f6f057903e1d2bfef211a8869152d76ef6fd24cd74efe0c571d551f2bd94351"} err="failed to get container status \"3f6f057903e1d2bfef211a8869152d76ef6fd24cd74efe0c571d551f2bd94351\": rpc error: code = NotFound desc = could not find container \"3f6f057903e1d2bfef211a8869152d76ef6fd24cd74efe0c571d551f2bd94351\": container with ID starting with 3f6f057903e1d2bfef211a8869152d76ef6fd24cd74efe0c571d551f2bd94351 not found: ID does not exist" Jun 02 16:54:33.843826 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:33.843795 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d6cbcf875-lx4dc"] Jun 02 16:54:33.845353 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:33.845329 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d6cbcf875-lx4dc"] Jun 02 16:54:34.046293 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:34.046264 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c14fdc59-8987-46d3-b202-3534e0ef3426" path="/var/lib/kubelet/pods/c14fdc59-8987-46d3-b202-3534e0ef3426/volumes" Jun 02 16:54:52.710712 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:52.710674 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6dc766977c-gsrr7"] Jun 02 16:54:52.711443 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:52.711208 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c14fdc59-8987-46d3-b202-3534e0ef3426" containerName="manager" Jun 02 16:54:52.711443 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:52.711227 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c14fdc59-8987-46d3-b202-3534e0ef3426" containerName="manager" Jun 02 16:54:52.711443 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:52.711331 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="c14fdc59-8987-46d3-b202-3534e0ef3426" containerName="manager" Jun 02 16:54:52.714691 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:52.714670 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6dc766977c-gsrr7" Jun 02 16:54:52.716659 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:52.716635 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 02 16:54:52.716825 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:52.716796 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bnddw\"" Jun 02 16:54:52.729029 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:52.728982 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6dc766977c-gsrr7"] Jun 02 16:54:52.858832 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:52.858792 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wv2b\" (UniqueName: \"kubernetes.io/projected/6e133171-4ce6-4940-9fbc-eca28466aa06-kube-api-access-6wv2b\") pod \"maas-api-6dc766977c-gsrr7\" (UID: \"6e133171-4ce6-4940-9fbc-eca28466aa06\") " pod="opendatahub/maas-api-6dc766977c-gsrr7" Jun 02 16:54:52.859035 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:52.858852 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e133171-4ce6-4940-9fbc-eca28466aa06-maas-api-tls\") pod \"maas-api-6dc766977c-gsrr7\" (UID: \"6e133171-4ce6-4940-9fbc-eca28466aa06\") " pod="opendatahub/maas-api-6dc766977c-gsrr7" Jun 02 16:54:52.960221 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:52.960191 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6wv2b\" (UniqueName: \"kubernetes.io/projected/6e133171-4ce6-4940-9fbc-eca28466aa06-kube-api-access-6wv2b\") pod \"maas-api-6dc766977c-gsrr7\" (UID: \"6e133171-4ce6-4940-9fbc-eca28466aa06\") " pod="opendatahub/maas-api-6dc766977c-gsrr7" Jun 02 16:54:52.960408 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:52.960268 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e133171-4ce6-4940-9fbc-eca28466aa06-maas-api-tls\") pod \"maas-api-6dc766977c-gsrr7\" (UID: \"6e133171-4ce6-4940-9fbc-eca28466aa06\") " pod="opendatahub/maas-api-6dc766977c-gsrr7" Jun 02 16:54:52.960480 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:54:52.960436 2565 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 02 16:54:52.960550 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:54:52.960515 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e133171-4ce6-4940-9fbc-eca28466aa06-maas-api-tls podName:6e133171-4ce6-4940-9fbc-eca28466aa06 nodeName:}" failed. No retries permitted until 2026-06-02 16:54:53.460493415 +0000 UTC m=+817.916577656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6e133171-4ce6-4940-9fbc-eca28466aa06-maas-api-tls") pod "maas-api-6dc766977c-gsrr7" (UID: "6e133171-4ce6-4940-9fbc-eca28466aa06") : secret "maas-api-serving-cert" not found Jun 02 16:54:52.968627 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:52.968561 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wv2b\" (UniqueName: \"kubernetes.io/projected/6e133171-4ce6-4940-9fbc-eca28466aa06-kube-api-access-6wv2b\") pod \"maas-api-6dc766977c-gsrr7\" (UID: \"6e133171-4ce6-4940-9fbc-eca28466aa06\") " pod="opendatahub/maas-api-6dc766977c-gsrr7" Jun 02 16:54:53.466066 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:53.465998 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e133171-4ce6-4940-9fbc-eca28466aa06-maas-api-tls\") pod \"maas-api-6dc766977c-gsrr7\" (UID: \"6e133171-4ce6-4940-9fbc-eca28466aa06\") " pod="opendatahub/maas-api-6dc766977c-gsrr7" Jun 02 16:54:53.468730 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:53.468705 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e133171-4ce6-4940-9fbc-eca28466aa06-maas-api-tls\") pod \"maas-api-6dc766977c-gsrr7\" (UID: \"6e133171-4ce6-4940-9fbc-eca28466aa06\") " pod="opendatahub/maas-api-6dc766977c-gsrr7" Jun 02 16:54:53.625178 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:53.625135 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6dc766977c-gsrr7" Jun 02 16:54:53.765753 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:53.765724 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6dc766977c-gsrr7"] Jun 02 16:54:53.768602 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:54:53.768552 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e133171_4ce6_4940_9fbc_eca28466aa06.slice/crio-c4518f70b9167c8279728e62520d3e54409d74f92c4f249bee0c946cbddb47c0 WatchSource:0}: Error finding container c4518f70b9167c8279728e62520d3e54409d74f92c4f249bee0c946cbddb47c0: Status 404 returned error can't find the container with id c4518f70b9167c8279728e62520d3e54409d74f92c4f249bee0c946cbddb47c0 Jun 02 16:54:53.893184 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:53.893147 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6dc766977c-gsrr7" event={"ID":"6e133171-4ce6-4940-9fbc-eca28466aa06","Type":"ContainerStarted","Data":"c4518f70b9167c8279728e62520d3e54409d74f92c4f249bee0c946cbddb47c0"} Jun 02 16:54:55.901790 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:55.901755 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6dc766977c-gsrr7" event={"ID":"6e133171-4ce6-4940-9fbc-eca28466aa06","Type":"ContainerStarted","Data":"36957e5b9558d5584fea8e554bc190b0647cc9f011ef7e25e23d2bc3e91387c9"} Jun 02 16:54:55.902179 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:55.901834 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6dc766977c-gsrr7" Jun 02 16:54:55.917514 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:54:55.917469 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-6dc766977c-gsrr7" podStartSLOduration=2.5276912510000002 podStartE2EDuration="3.917454395s" podCreationTimestamp="2026-06-02 16:54:52 +0000 UTC" firstStartedPulling="2026-06-02 16:54:53.769881674 +0000 UTC m=+818.225965909" lastFinishedPulling="2026-06-02 16:54:55.159644819 +0000 UTC m=+819.615729053" observedRunningTime="2026-06-02 16:54:55.915406958 +0000 UTC m=+820.371491216" watchObservedRunningTime="2026-06-02 16:54:55.917454395 +0000 UTC m=+820.373538653" Jun 02 16:55:01.911646 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:01.911615 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6dc766977c-gsrr7" Jun 02 16:55:03.630129 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:03.630096 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 16:55:03.630743 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:03.630390 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="c82f4172-a8a8-4a0e-9c8e-e8258848d303" containerName="keycloak" containerID="cri-o://dcb4414dca1298fde624f7e3e2e3ab6efadd2dc8a7b5ef02b53e79404d0f82a6" gracePeriod=30 Jun 02 16:55:05.675805 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:05.675774 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 16:55:05.784882 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:05.784846 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5hpw\" (UniqueName: \"kubernetes.io/projected/c82f4172-a8a8-4a0e-9c8e-e8258848d303-kube-api-access-l5hpw\") pod \"c82f4172-a8a8-4a0e-9c8e-e8258848d303\" (UID: \"c82f4172-a8a8-4a0e-9c8e-e8258848d303\") " Jun 02 16:55:05.787295 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:05.787264 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c82f4172-a8a8-4a0e-9c8e-e8258848d303-kube-api-access-l5hpw" (OuterVolumeSpecName: "kube-api-access-l5hpw") pod "c82f4172-a8a8-4a0e-9c8e-e8258848d303" (UID: "c82f4172-a8a8-4a0e-9c8e-e8258848d303"). InnerVolumeSpecName "kube-api-access-l5hpw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:55:05.886094 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:05.886062 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5hpw\" (UniqueName: \"kubernetes.io/projected/c82f4172-a8a8-4a0e-9c8e-e8258848d303-kube-api-access-l5hpw\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:55:05.946319 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:05.946286 2565 generic.go:358] "Generic (PLEG): container finished" podID="c82f4172-a8a8-4a0e-9c8e-e8258848d303" containerID="dcb4414dca1298fde624f7e3e2e3ab6efadd2dc8a7b5ef02b53e79404d0f82a6" exitCode=143 Jun 02 16:55:05.946500 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:05.946343 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c82f4172-a8a8-4a0e-9c8e-e8258848d303","Type":"ContainerDied","Data":"dcb4414dca1298fde624f7e3e2e3ab6efadd2dc8a7b5ef02b53e79404d0f82a6"} Jun 02 16:55:05.946500 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:05.946355 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 16:55:05.946500 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:05.946371 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c82f4172-a8a8-4a0e-9c8e-e8258848d303","Type":"ContainerDied","Data":"110ec23d00c5800714e776270ca8872fe5853ec3b54a19ab3969ea29c668b818"} Jun 02 16:55:05.946500 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:05.946387 2565 scope.go:117] "RemoveContainer" containerID="dcb4414dca1298fde624f7e3e2e3ab6efadd2dc8a7b5ef02b53e79404d0f82a6" Jun 02 16:55:05.955761 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:05.955738 2565 scope.go:117] "RemoveContainer" containerID="dcb4414dca1298fde624f7e3e2e3ab6efadd2dc8a7b5ef02b53e79404d0f82a6" Jun 02 16:55:05.956048 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:55:05.956003 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcb4414dca1298fde624f7e3e2e3ab6efadd2dc8a7b5ef02b53e79404d0f82a6\": container with ID starting with dcb4414dca1298fde624f7e3e2e3ab6efadd2dc8a7b5ef02b53e79404d0f82a6 not found: ID does not exist" containerID="dcb4414dca1298fde624f7e3e2e3ab6efadd2dc8a7b5ef02b53e79404d0f82a6" Jun 02 16:55:05.956106 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:05.956061 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcb4414dca1298fde624f7e3e2e3ab6efadd2dc8a7b5ef02b53e79404d0f82a6"} err="failed to get container status \"dcb4414dca1298fde624f7e3e2e3ab6efadd2dc8a7b5ef02b53e79404d0f82a6\": rpc error: code = NotFound desc = could not find container \"dcb4414dca1298fde624f7e3e2e3ab6efadd2dc8a7b5ef02b53e79404d0f82a6\": container with ID starting with dcb4414dca1298fde624f7e3e2e3ab6efadd2dc8a7b5ef02b53e79404d0f82a6 not found: ID does not exist" Jun 02 16:55:05.966750 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:05.966727 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 16:55:05.970309 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:05.970287 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 16:55:05.991766 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:05.991733 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 16:55:05.992138 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:05.992125 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c82f4172-a8a8-4a0e-9c8e-e8258848d303" containerName="keycloak" Jun 02 16:55:05.992191 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:05.992140 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c82f4172-a8a8-4a0e-9c8e-e8258848d303" containerName="keycloak" Jun 02 16:55:05.992230 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:05.992200 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="c82f4172-a8a8-4a0e-9c8e-e8258848d303" containerName="keycloak" Jun 02 16:55:05.996755 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:05.996735 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 16:55:05.998996 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:05.998973 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 02 16:55:05.999132 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:05.998982 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-scp8b\"" Jun 02 16:55:05.999132 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:05.999031 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 02 16:55:05.999132 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:05.999126 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 16:55:05.999367 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:05.999353 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 16:55:06.003472 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:06.003447 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 16:55:06.047475 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:06.047441 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c82f4172-a8a8-4a0e-9c8e-e8258848d303" path="/var/lib/kubelet/pods/c82f4172-a8a8-4a0e-9c8e-e8258848d303/volumes" Jun 02 16:55:06.088224 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:06.088190 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/8a30cfb8-0807-458f-afff-8b3d35bbb913-test-realms\") pod \"maas-keycloak-0\" (UID: \"8a30cfb8-0807-458f-afff-8b3d35bbb913\") " pod="keycloak-system/maas-keycloak-0" Jun 02 16:55:06.088362 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:06.088274 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75sfn\" (UniqueName: \"kubernetes.io/projected/8a30cfb8-0807-458f-afff-8b3d35bbb913-kube-api-access-75sfn\") pod \"maas-keycloak-0\" (UID: \"8a30cfb8-0807-458f-afff-8b3d35bbb913\") " pod="keycloak-system/maas-keycloak-0" Jun 02 16:55:06.189822 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:06.189743 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/8a30cfb8-0807-458f-afff-8b3d35bbb913-test-realms\") pod \"maas-keycloak-0\" (UID: \"8a30cfb8-0807-458f-afff-8b3d35bbb913\") " pod="keycloak-system/maas-keycloak-0" Jun 02 16:55:06.189822 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:06.189814 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-75sfn\" (UniqueName: \"kubernetes.io/projected/8a30cfb8-0807-458f-afff-8b3d35bbb913-kube-api-access-75sfn\") pod \"maas-keycloak-0\" (UID: \"8a30cfb8-0807-458f-afff-8b3d35bbb913\") " pod="keycloak-system/maas-keycloak-0" Jun 02 16:55:06.190410 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:06.190392 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/8a30cfb8-0807-458f-afff-8b3d35bbb913-test-realms\") pod \"maas-keycloak-0\" (UID: \"8a30cfb8-0807-458f-afff-8b3d35bbb913\") " pod="keycloak-system/maas-keycloak-0" Jun 02 16:55:06.197996 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:06.197966 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75sfn\" (UniqueName: \"kubernetes.io/projected/8a30cfb8-0807-458f-afff-8b3d35bbb913-kube-api-access-75sfn\") pod \"maas-keycloak-0\" (UID: \"8a30cfb8-0807-458f-afff-8b3d35bbb913\") " pod="keycloak-system/maas-keycloak-0" Jun 02 16:55:06.307820 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:06.307790 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 16:55:06.435750 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:06.435725 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 16:55:06.438418 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:55:06.438391 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a30cfb8_0807_458f_afff_8b3d35bbb913.slice/crio-0cf762b9ee605e8858516e39565f317c1a8f05001255281bdf6172da6918001d WatchSource:0}: Error finding container 0cf762b9ee605e8858516e39565f317c1a8f05001255281bdf6172da6918001d: Status 404 returned error can't find the container with id 0cf762b9ee605e8858516e39565f317c1a8f05001255281bdf6172da6918001d Jun 02 16:55:06.952109 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:06.952054 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8a30cfb8-0807-458f-afff-8b3d35bbb913","Type":"ContainerStarted","Data":"2f45bd16ea278f101f911729686de53f7a2a86e2899609faa1c3ea425af3a836"} Jun 02 16:55:06.952109 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:06.952103 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8a30cfb8-0807-458f-afff-8b3d35bbb913","Type":"ContainerStarted","Data":"0cf762b9ee605e8858516e39565f317c1a8f05001255281bdf6172da6918001d"} Jun 02 16:55:06.970811 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:06.970685 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.701839052 podStartE2EDuration="1.970666158s" podCreationTimestamp="2026-06-02 16:55:05 +0000 UTC" firstStartedPulling="2026-06-02 16:55:06.439708523 +0000 UTC m=+830.895792758" lastFinishedPulling="2026-06-02 16:55:06.708535628 +0000 UTC m=+831.164619864" observedRunningTime="2026-06-02 16:55:06.968034907 +0000 UTC m=+831.424119165" watchObservedRunningTime="2026-06-02 16:55:06.970666158 +0000 UTC m=+831.426750416" Jun 02 16:55:07.308810 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:07.308710 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 02 16:55:07.310373 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:07.310336 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8a30cfb8-0807-458f-afff-8b3d35bbb913" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 16:55:08.308890 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:08.308832 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8a30cfb8-0807-458f-afff-8b3d35bbb913" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 16:55:09.308801 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:09.308748 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8a30cfb8-0807-458f-afff-8b3d35bbb913" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 16:55:10.308860 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:10.308808 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8a30cfb8-0807-458f-afff-8b3d35bbb913" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 16:55:11.308908 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:11.308849 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8a30cfb8-0807-458f-afff-8b3d35bbb913" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 16:55:12.308595 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:12.308524 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8a30cfb8-0807-458f-afff-8b3d35bbb913" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 16:55:13.309468 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:13.308974 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8a30cfb8-0807-458f-afff-8b3d35bbb913" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 16:55:14.308434 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:14.308385 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8a30cfb8-0807-458f-afff-8b3d35bbb913" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 16:55:15.308900 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:15.308852 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8a30cfb8-0807-458f-afff-8b3d35bbb913" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 16:55:16.308552 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:16.308431 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 02 16:55:16.308896 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:16.308846 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8a30cfb8-0807-458f-afff-8b3d35bbb913" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 16:55:17.308612 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:17.308536 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8a30cfb8-0807-458f-afff-8b3d35bbb913" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 16:55:18.309355 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:18.309222 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8a30cfb8-0807-458f-afff-8b3d35bbb913" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 16:55:19.308671 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:19.308620 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8a30cfb8-0807-458f-afff-8b3d35bbb913" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 16:55:20.308446 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:20.308397 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8a30cfb8-0807-458f-afff-8b3d35bbb913" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 16:55:21.446441 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:21.446392 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 02 16:55:21.462055 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:21.461965 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="8a30cfb8-0807-458f-afff-8b3d35bbb913" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 16:55:31.453026 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:31.452972 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 02 16:55:42.123894 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:42.123849 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d7d8db8b5-w4cp6"] Jun 02 16:55:42.127335 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:42.127314 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d7d8db8b5-w4cp6" Jun 02 16:55:42.129447 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:42.129414 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 02 16:55:42.133731 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:42.133702 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d7d8db8b5-w4cp6"] Jun 02 16:55:42.170980 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:42.170937 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6eefd826-6780-436b-af5f-e4f7b5aedfc3-tls-cert\") pod \"authorino-7d7d8db8b5-w4cp6\" (UID: \"6eefd826-6780-436b-af5f-e4f7b5aedfc3\") " pod="kuadrant-system/authorino-7d7d8db8b5-w4cp6" Jun 02 16:55:42.171201 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:42.170985 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7szkx\" (UniqueName: \"kubernetes.io/projected/6eefd826-6780-436b-af5f-e4f7b5aedfc3-kube-api-access-7szkx\") pod \"authorino-7d7d8db8b5-w4cp6\" (UID: \"6eefd826-6780-436b-af5f-e4f7b5aedfc3\") " pod="kuadrant-system/authorino-7d7d8db8b5-w4cp6" Jun 02 16:55:42.171201 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:42.171071 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6eefd826-6780-436b-af5f-e4f7b5aedfc3-oidc-ca\") pod \"authorino-7d7d8db8b5-w4cp6\" (UID: \"6eefd826-6780-436b-af5f-e4f7b5aedfc3\") " pod="kuadrant-system/authorino-7d7d8db8b5-w4cp6" Jun 02 16:55:42.272362 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:42.272320 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6eefd826-6780-436b-af5f-e4f7b5aedfc3-tls-cert\") pod \"authorino-7d7d8db8b5-w4cp6\" (UID: \"6eefd826-6780-436b-af5f-e4f7b5aedfc3\") " pod="kuadrant-system/authorino-7d7d8db8b5-w4cp6" Jun 02 16:55:42.272362 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:42.272365 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7szkx\" (UniqueName: \"kubernetes.io/projected/6eefd826-6780-436b-af5f-e4f7b5aedfc3-kube-api-access-7szkx\") pod \"authorino-7d7d8db8b5-w4cp6\" (UID: \"6eefd826-6780-436b-af5f-e4f7b5aedfc3\") " pod="kuadrant-system/authorino-7d7d8db8b5-w4cp6" Jun 02 16:55:42.272604 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:42.272399 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6eefd826-6780-436b-af5f-e4f7b5aedfc3-oidc-ca\") pod \"authorino-7d7d8db8b5-w4cp6\" (UID: \"6eefd826-6780-436b-af5f-e4f7b5aedfc3\") " pod="kuadrant-system/authorino-7d7d8db8b5-w4cp6" Jun 02 16:55:42.273182 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:42.273162 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6eefd826-6780-436b-af5f-e4f7b5aedfc3-oidc-ca\") pod \"authorino-7d7d8db8b5-w4cp6\" (UID: \"6eefd826-6780-436b-af5f-e4f7b5aedfc3\") " pod="kuadrant-system/authorino-7d7d8db8b5-w4cp6" Jun 02 16:55:42.274989 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:42.274970 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6eefd826-6780-436b-af5f-e4f7b5aedfc3-tls-cert\") pod \"authorino-7d7d8db8b5-w4cp6\" (UID: \"6eefd826-6780-436b-af5f-e4f7b5aedfc3\") " pod="kuadrant-system/authorino-7d7d8db8b5-w4cp6" Jun 02 16:55:42.280118 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:42.280087 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7szkx\" (UniqueName: \"kubernetes.io/projected/6eefd826-6780-436b-af5f-e4f7b5aedfc3-kube-api-access-7szkx\") pod \"authorino-7d7d8db8b5-w4cp6\" (UID: \"6eefd826-6780-436b-af5f-e4f7b5aedfc3\") " pod="kuadrant-system/authorino-7d7d8db8b5-w4cp6" Jun 02 16:55:42.438713 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:42.438616 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d7d8db8b5-w4cp6" Jun 02 16:55:42.587466 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:42.587381 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d7d8db8b5-w4cp6"] Jun 02 16:55:42.591547 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:55:42.591515 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6eefd826_6780_436b_af5f_e4f7b5aedfc3.slice/crio-bedfa4c4cae89d7ba239f44386bcba633fd6c8c8852c9e4275b9f23648cfdd02 WatchSource:0}: Error finding container bedfa4c4cae89d7ba239f44386bcba633fd6c8c8852c9e4275b9f23648cfdd02: Status 404 returned error can't find the container with id bedfa4c4cae89d7ba239f44386bcba633fd6c8c8852c9e4275b9f23648cfdd02 Jun 02 16:55:43.105868 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:43.105827 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d7d8db8b5-w4cp6" event={"ID":"6eefd826-6780-436b-af5f-e4f7b5aedfc3","Type":"ContainerStarted","Data":"bedfa4c4cae89d7ba239f44386bcba633fd6c8c8852c9e4275b9f23648cfdd02"} Jun 02 16:55:44.110889 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:44.110851 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d7d8db8b5-w4cp6" event={"ID":"6eefd826-6780-436b-af5f-e4f7b5aedfc3","Type":"ContainerStarted","Data":"bb5a2851b7c8b11ad09635ccf4afc11efaf0393b2363db21c9bf3571afe3403a"} Jun 02 16:55:44.125659 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:44.125583 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7d7d8db8b5-w4cp6" podStartSLOduration=1.582625441 podStartE2EDuration="2.125565209s" podCreationTimestamp="2026-06-02 16:55:42 +0000 UTC" firstStartedPulling="2026-06-02 16:55:42.592956832 +0000 UTC m=+867.049041074" lastFinishedPulling="2026-06-02 16:55:43.135896607 +0000 UTC m=+867.591980842" observedRunningTime="2026-06-02 16:55:44.123403416 +0000 UTC m=+868.579487673" watchObservedRunningTime="2026-06-02 16:55:44.125565209 +0000 UTC m=+868.581649467" Jun 02 16:55:44.152755 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:44.152710 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bc8b6bb79-q5xdw"] Jun 02 16:55:44.152993 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:44.152945 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7bc8b6bb79-q5xdw" podUID="54c83dc4-ba84-4297-8200-02662ad466a2" containerName="authorino" containerID="cri-o://c20230a66fb628a71c4445e3d9d2083ad686bb8f9a21353914f57a0fc215fe72" gracePeriod=30 Jun 02 16:55:44.447347 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:44.447321 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bc8b6bb79-q5xdw" Jun 02 16:55:44.496727 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:44.496677 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/54c83dc4-ba84-4297-8200-02662ad466a2-tls-cert\") pod \"54c83dc4-ba84-4297-8200-02662ad466a2\" (UID: \"54c83dc4-ba84-4297-8200-02662ad466a2\") " Jun 02 16:55:44.496926 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:44.496780 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5jhx\" (UniqueName: \"kubernetes.io/projected/54c83dc4-ba84-4297-8200-02662ad466a2-kube-api-access-r5jhx\") pod \"54c83dc4-ba84-4297-8200-02662ad466a2\" (UID: \"54c83dc4-ba84-4297-8200-02662ad466a2\") " Jun 02 16:55:44.499442 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:44.499367 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54c83dc4-ba84-4297-8200-02662ad466a2-kube-api-access-r5jhx" (OuterVolumeSpecName: "kube-api-access-r5jhx") pod "54c83dc4-ba84-4297-8200-02662ad466a2" (UID: "54c83dc4-ba84-4297-8200-02662ad466a2"). InnerVolumeSpecName "kube-api-access-r5jhx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:55:44.509420 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:44.509382 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54c83dc4-ba84-4297-8200-02662ad466a2-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "54c83dc4-ba84-4297-8200-02662ad466a2" (UID: "54c83dc4-ba84-4297-8200-02662ad466a2"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:55:44.598193 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:44.598148 2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/54c83dc4-ba84-4297-8200-02662ad466a2-tls-cert\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:55:44.598193 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:44.598184 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5jhx\" (UniqueName: \"kubernetes.io/projected/54c83dc4-ba84-4297-8200-02662ad466a2-kube-api-access-r5jhx\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\"" Jun 02 16:55:45.115877 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:45.115834 2565 generic.go:358] "Generic (PLEG): container finished" podID="54c83dc4-ba84-4297-8200-02662ad466a2" containerID="c20230a66fb628a71c4445e3d9d2083ad686bb8f9a21353914f57a0fc215fe72" exitCode=0 Jun 02 16:55:45.116397 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:45.115915 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bc8b6bb79-q5xdw" Jun 02 16:55:45.116397 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:45.115930 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bc8b6bb79-q5xdw" event={"ID":"54c83dc4-ba84-4297-8200-02662ad466a2","Type":"ContainerDied","Data":"c20230a66fb628a71c4445e3d9d2083ad686bb8f9a21353914f57a0fc215fe72"} Jun 02 16:55:45.116397 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:45.115974 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bc8b6bb79-q5xdw" event={"ID":"54c83dc4-ba84-4297-8200-02662ad466a2","Type":"ContainerDied","Data":"55f36b9376f94776ab99ec2a357f3cdf93fee8b054c200f5d526e8930b7c9a5c"} Jun 02 16:55:45.116397 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:45.115991 2565 scope.go:117] "RemoveContainer" containerID="c20230a66fb628a71c4445e3d9d2083ad686bb8f9a21353914f57a0fc215fe72" Jun 02 16:55:45.125551 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:45.125529 2565 scope.go:117] "RemoveContainer" containerID="c20230a66fb628a71c4445e3d9d2083ad686bb8f9a21353914f57a0fc215fe72" Jun 02 16:55:45.125903 ip-10-0-132-45 kubenswrapper[2565]: E0602 16:55:45.125886 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c20230a66fb628a71c4445e3d9d2083ad686bb8f9a21353914f57a0fc215fe72\": container with ID starting with c20230a66fb628a71c4445e3d9d2083ad686bb8f9a21353914f57a0fc215fe72 not found: ID does not exist" containerID="c20230a66fb628a71c4445e3d9d2083ad686bb8f9a21353914f57a0fc215fe72" Jun 02 16:55:45.125953 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:45.125914 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c20230a66fb628a71c4445e3d9d2083ad686bb8f9a21353914f57a0fc215fe72"} err="failed to get container status \"c20230a66fb628a71c4445e3d9d2083ad686bb8f9a21353914f57a0fc215fe72\": rpc error: code = NotFound desc = could not find container \"c20230a66fb628a71c4445e3d9d2083ad686bb8f9a21353914f57a0fc215fe72\": container with ID starting with c20230a66fb628a71c4445e3d9d2083ad686bb8f9a21353914f57a0fc215fe72 not found: ID does not exist" Jun 02 16:55:45.136537 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:45.136502 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bc8b6bb79-q5xdw"] Jun 02 16:55:45.140645 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:45.140613 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bc8b6bb79-q5xdw"] Jun 02 16:55:46.047241 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:46.047201 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54c83dc4-ba84-4297-8200-02662ad466a2" path="/var/lib/kubelet/pods/54c83dc4-ba84-4297-8200-02662ad466a2/volumes" Jun 02 16:55:49.739724 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.739682 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf"] Jun 02 16:55:49.740215 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.740133 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54c83dc4-ba84-4297-8200-02662ad466a2" containerName="authorino" Jun 02 16:55:49.740215 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.740147 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="54c83dc4-ba84-4297-8200-02662ad466a2" containerName="authorino" Jun 02 16:55:49.740354 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.740242 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="54c83dc4-ba84-4297-8200-02662ad466a2" containerName="authorino" Jun 02 16:55:49.746401 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.746365 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" Jun 02 16:55:49.752039 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.750254 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gplcp\"" Jun 02 16:55:49.752039 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.750615 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 02 16:55:49.752039 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.752001 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 16:55:49.752327 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.752029 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 16:55:49.754509 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.754479 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf"] Jun 02 16:55:49.853528 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.853473 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76670041-cbed-442f-931b-f902da23bef8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf\" (UID: \"76670041-cbed-442f-931b-f902da23bef8\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" Jun 02 16:55:49.853770 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.853546 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76670041-cbed-442f-931b-f902da23bef8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf\" (UID: \"76670041-cbed-442f-931b-f902da23bef8\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" Jun 02 16:55:49.853770 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.853594 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76670041-cbed-442f-931b-f902da23bef8-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf\" (UID: \"76670041-cbed-442f-931b-f902da23bef8\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" Jun 02 16:55:49.853770 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.853637 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttdt8\" (UniqueName: \"kubernetes.io/projected/76670041-cbed-442f-931b-f902da23bef8-kube-api-access-ttdt8\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf\" (UID: \"76670041-cbed-442f-931b-f902da23bef8\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" Jun 02 16:55:49.853979 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.853782 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76670041-cbed-442f-931b-f902da23bef8-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf\" (UID: \"76670041-cbed-442f-931b-f902da23bef8\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" Jun 02 16:55:49.853979 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.853860 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/76670041-cbed-442f-931b-f902da23bef8-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf\" (UID: \"76670041-cbed-442f-931b-f902da23bef8\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" Jun 02 16:55:49.955283 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.955233 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76670041-cbed-442f-931b-f902da23bef8-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf\" (UID: \"76670041-cbed-442f-931b-f902da23bef8\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" Jun 02 16:55:49.955283 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.955285 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/76670041-cbed-442f-931b-f902da23bef8-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf\" (UID: \"76670041-cbed-442f-931b-f902da23bef8\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" Jun 02 16:55:49.955567 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.955313 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76670041-cbed-442f-931b-f902da23bef8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf\" (UID: \"76670041-cbed-442f-931b-f902da23bef8\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" Jun 02 16:55:49.955567 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.955378 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76670041-cbed-442f-931b-f902da23bef8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf\" (UID: \"76670041-cbed-442f-931b-f902da23bef8\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" Jun 02 16:55:49.955567 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.955435 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76670041-cbed-442f-931b-f902da23bef8-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf\" (UID: \"76670041-cbed-442f-931b-f902da23bef8\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" Jun 02 16:55:49.955567 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.955493 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ttdt8\" (UniqueName: \"kubernetes.io/projected/76670041-cbed-442f-931b-f902da23bef8-kube-api-access-ttdt8\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf\" (UID: \"76670041-cbed-442f-931b-f902da23bef8\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" Jun 02 16:55:49.955788 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.955770 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/76670041-cbed-442f-931b-f902da23bef8-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf\" (UID: \"76670041-cbed-442f-931b-f902da23bef8\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" Jun 02 16:55:49.955854 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.955803 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76670041-cbed-442f-931b-f902da23bef8-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf\" (UID: \"76670041-cbed-442f-931b-f902da23bef8\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" Jun 02 16:55:49.955919 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.955894 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76670041-cbed-442f-931b-f902da23bef8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf\" (UID: \"76670041-cbed-442f-931b-f902da23bef8\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" Jun 02 16:55:49.958056 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.958030 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76670041-cbed-442f-931b-f902da23bef8-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf\" (UID: \"76670041-cbed-442f-931b-f902da23bef8\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" Jun 02 16:55:49.958315 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.958295 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76670041-cbed-442f-931b-f902da23bef8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf\" (UID: \"76670041-cbed-442f-931b-f902da23bef8\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" Jun 02 16:55:49.963534 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:49.963504 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttdt8\" (UniqueName: \"kubernetes.io/projected/76670041-cbed-442f-931b-f902da23bef8-kube-api-access-ttdt8\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf\" (UID: \"76670041-cbed-442f-931b-f902da23bef8\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" Jun 02 16:55:50.063955 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:50.063857 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" Jun 02 16:55:50.215181 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:50.215138 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf"] Jun 02 16:55:50.218680 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:55:50.218636 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76670041_cbed_442f_931b_f902da23bef8.slice/crio-88c87f8b89b6fa64d532437cb00a8380da1d79f6c032f0a9a00d7f88025021e4 WatchSource:0}: Error finding container 88c87f8b89b6fa64d532437cb00a8380da1d79f6c032f0a9a00d7f88025021e4: Status 404 returned error can't find the container with id 88c87f8b89b6fa64d532437cb00a8380da1d79f6c032f0a9a00d7f88025021e4 Jun 02 16:55:51.143275 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:51.143228 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" event={"ID":"76670041-cbed-442f-931b-f902da23bef8","Type":"ContainerStarted","Data":"88c87f8b89b6fa64d532437cb00a8380da1d79f6c032f0a9a00d7f88025021e4"} Jun 02 16:55:54.158197 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:54.158158 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" event={"ID":"76670041-cbed-442f-931b-f902da23bef8","Type":"ContainerStarted","Data":"e54b8165e561f38fab6d83210519fa6b20af60dedce53a10ae67951ea25f8c9e"} Jun 02 16:55:55.165069 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:55.165001 2565 generic.go:358] "Generic (PLEG): container finished" podID="76670041-cbed-442f-931b-f902da23bef8" containerID="e54b8165e561f38fab6d83210519fa6b20af60dedce53a10ae67951ea25f8c9e" exitCode=0 Jun 02 16:55:55.165510 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:55.165085 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" event={"ID":"76670041-cbed-442f-931b-f902da23bef8","Type":"ContainerDied","Data":"e54b8165e561f38fab6d83210519fa6b20af60dedce53a10ae67951ea25f8c9e"} Jun 02 16:55:57.174362 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:57.174324 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" event={"ID":"76670041-cbed-442f-931b-f902da23bef8","Type":"ContainerStarted","Data":"dc2c22b04f9f1f82c87c18aa722fe1e1b6b61d5495425cdc2e840b6dc9a0d99f"} Jun 02 16:55:57.192810 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:55:57.192747 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" podStartSLOduration=1.848009273 podStartE2EDuration="8.192729299s" podCreationTimestamp="2026-06-02 16:55:49 +0000 UTC" firstStartedPulling="2026-06-02 16:55:50.220822757 +0000 UTC m=+874.676906993" lastFinishedPulling="2026-06-02 16:55:56.565542784 +0000 UTC m=+881.021627019" observedRunningTime="2026-06-02 16:55:57.190681222 +0000 UTC m=+881.646765479" watchObservedRunningTime="2026-06-02 16:55:57.192729299 +0000 UTC m=+881.648813557" Jun 02 16:56:00.064590 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:00.064537 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" Jun 02 16:56:00.065162 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:00.064608 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" Jun 02 16:56:00.077845 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:00.077811 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" Jun 02 16:56:00.197760 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:00.197723 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf" Jun 02 16:56:16.020230 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:16.020139 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vlq2q_43709aef-aafc-4d89-b794-916480842d72/console-operator/2.log" Jun 02 16:56:16.020920 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:16.020900 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vlq2q_43709aef-aafc-4d89-b794-916480842d72/console-operator/2.log" Jun 02 16:56:16.026647 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:16.026622 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sjt8_a9902c57-5190-456a-83a9-948e46bec4a0/ovn-acl-logging/0.log" Jun 02 16:56:16.027429 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:16.027395 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sjt8_a9902c57-5190-456a-83a9-948e46bec4a0/ovn-acl-logging/0.log" Jun 02 16:56:16.835051 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:16.834980 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v"] Jun 02 16:56:16.844028 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:16.843984 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" Jun 02 16:56:16.846159 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:16.846130 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 02 16:56:16.850039 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:16.849977 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v"] Jun 02 16:56:16.929997 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:16.929958 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v\" (UID: \"4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" Jun 02 16:56:16.930219 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:16.930041 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v\" (UID: \"4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" Jun 02 16:56:16.930219 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:16.930080 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v\" (UID: \"4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" Jun 02 16:56:16.930219 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:16.930131 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-966f4\" (UniqueName: \"kubernetes.io/projected/4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9-kube-api-access-966f4\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v\" (UID: \"4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" Jun 02 16:56:16.930219 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:16.930171 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v\" (UID: \"4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" Jun 02 16:56:16.930219 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:16.930194 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v\" (UID: \"4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" Jun 02 16:56:17.030676 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:17.030632 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v\" (UID: \"4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" Jun 02 16:56:17.031282 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:17.030704 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v\" (UID: \"4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" Jun 02 16:56:17.031282 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:17.030751 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-966f4\" (UniqueName: \"kubernetes.io/projected/4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9-kube-api-access-966f4\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v\" (UID: \"4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" Jun 02 16:56:17.031282 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:17.030805 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v\" (UID: \"4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" Jun 02 16:56:17.031282 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:17.030838 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v\" (UID: \"4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" Jun 02 16:56:17.031282 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:17.030911 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v\" (UID: \"4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" Jun 02 16:56:17.031282 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:17.031165 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v\" (UID: \"4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" Jun 02 16:56:17.031282 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:17.031225 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v\" (UID: \"4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" Jun 02 16:56:17.031623 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:17.031337 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v\" (UID: \"4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" Jun 02 16:56:17.033229 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:17.033207 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v\" (UID: \"4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" Jun 02 16:56:17.033491 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:17.033474 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v\" (UID: \"4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" Jun 02 16:56:17.039582 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:17.039556 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-966f4\" (UniqueName: \"kubernetes.io/projected/4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9-kube-api-access-966f4\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v\" (UID: \"4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" Jun 02 16:56:17.156857 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:17.156815 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" Jun 02 16:56:17.316701 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:17.312565 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v"] Jun 02 16:56:17.318918 ip-10-0-132-45 kubenswrapper[2565]: W0602 16:56:17.318883 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e62e8b2_4e5f_46cf_a7fe_b49a3cd1d5c9.slice/crio-c095fdc866a2ec980b46e171550e845c79a64e399fc7b62cdf25d65ad0ff32bc WatchSource:0}: Error finding container c095fdc866a2ec980b46e171550e845c79a64e399fc7b62cdf25d65ad0ff32bc: Status 404 returned error can't find the container with id c095fdc866a2ec980b46e171550e845c79a64e399fc7b62cdf25d65ad0ff32bc Jun 02 16:56:18.265971 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:18.265922 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" event={"ID":"4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9","Type":"ContainerStarted","Data":"302e1a674a935c8155a55f826bddb3de7311516a101c4140cdf09c62596a1bc6"} Jun 02 16:56:18.266494 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:18.265979 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" event={"ID":"4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9","Type":"ContainerStarted","Data":"c095fdc866a2ec980b46e171550e845c79a64e399fc7b62cdf25d65ad0ff32bc"} Jun 02 16:56:19.271301 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:19.271256 2565 generic.go:358] "Generic (PLEG): container finished" podID="4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9" containerID="302e1a674a935c8155a55f826bddb3de7311516a101c4140cdf09c62596a1bc6" exitCode=0 Jun 02 16:56:19.271817 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:19.271332 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" event={"ID":"4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9","Type":"ContainerDied","Data":"302e1a674a935c8155a55f826bddb3de7311516a101c4140cdf09c62596a1bc6"} Jun 02 16:56:21.280369 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:21.280329 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" event={"ID":"4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9","Type":"ContainerStarted","Data":"7490ee6b69225bc308b1da8e1c2c5a4e17f3f8f8a78153cba802c07e98f941de"} Jun 02 16:56:21.298380 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:21.298320 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" podStartSLOduration=4.015411481 podStartE2EDuration="5.298301751s" podCreationTimestamp="2026-06-02 16:56:16 +0000 UTC" firstStartedPulling="2026-06-02 16:56:19.27206217 +0000 UTC m=+903.728146405" lastFinishedPulling="2026-06-02 16:56:20.554952437 +0000 UTC m=+905.011036675" observedRunningTime="2026-06-02 16:56:21.29642366 +0000 UTC m=+905.752507917" watchObservedRunningTime="2026-06-02 16:56:21.298301751 +0000 UTC m=+905.754386008" Jun 02 16:56:27.157266 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:27.157224 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" Jun 02 16:56:27.157768 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:27.157287 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" Jun 02 16:56:27.169566 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:27.169535 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" Jun 02 16:56:27.313153 ip-10-0-132-45 kubenswrapper[2565]: I0602 16:56:27.313121 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v" Jun 02 17:01:16.047244 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:01:16.047210 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vlq2q_43709aef-aafc-4d89-b794-916480842d72/console-operator/2.log" Jun 02 17:01:16.050286 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:01:16.050266 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vlq2q_43709aef-aafc-4d89-b794-916480842d72/console-operator/2.log" Jun 02 17:01:16.053396 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:01:16.053378 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sjt8_a9902c57-5190-456a-83a9-948e46bec4a0/ovn-acl-logging/0.log" Jun 02 17:01:16.056027 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:01:16.055996 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sjt8_a9902c57-5190-456a-83a9-948e46bec4a0/ovn-acl-logging/0.log" Jun 02 17:01:55.158707 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:01:55.158678 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d7d8db8b5-w4cp6_6eefd826-6780-436b-af5f-e4f7b5aedfc3/authorino/0.log" Jun 02 17:01:59.997461 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:01:59.997432 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6dc766977c-gsrr7_6e133171-4ce6-4940-9fbc-eca28466aa06/maas-api/0.log" Jun 02 17:02:00.215926 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:00.215898 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7847646b5-l5xr8_2870ad52-9f7f-4bda-a9f4-d0c05a1df465/manager/0.log" Jun 02 17:02:00.665340 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:00.665312 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58857ff9f-qrkf9_7ab74b54-c323-480f-9048-e90782215e64/copy-manifests/0.log" Jun 02 17:02:00.678030 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:00.677980 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58857ff9f-qrkf9_7ab74b54-c323-480f-9048-e90782215e64/manager/0.log" Jun 02 17:02:02.134075 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:02.134041 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d7d8db8b5-w4cp6_6eefd826-6780-436b-af5f-e4f7b5aedfc3/authorino/0.log" Jun 02 17:02:02.523663 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:02.523588 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-bmmd4_01b7e369-22d1-478f-bd65-e1fabc55119f/kuadrant-console-plugin/0.log" Jun 02 17:02:02.755336 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:02.755306 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-m4nnp_735a2123-85f8-4196-96e4-ce84c17ada3f/manager/0.log" Jun 02 17:02:03.721148 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:03.721047 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8dc448d-mbt7p_4b092314-5a0e-4719-9fad-e971fe9e8311/kube-auth-proxy/0.log" Jun 02 17:02:04.064582 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:04.064483 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5dc97c89b5-hx4vl_f7b90812-e229-4aef-99c0-185f0d0f7d67/router/0.log" Jun 02 17:02:04.411691 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:04.411663 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf_76670041-cbed-442f-931b-f902da23bef8/storage-initializer/0.log" Jun 02 17:02:04.418552 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:04.418534 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-p6bbf_76670041-cbed-442f-931b-f902da23bef8/main/0.log" Jun 02 17:02:04.863260 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:04.863183 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v_4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9/storage-initializer/0.log" Jun 02 17:02:04.870931 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:04.870908 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-64h6v_4e62e8b2-4e5f-46cf-a7fe-b49a3cd1d5c9/main/0.log" Jun 02 17:02:13.012732 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:13.012701 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fbqmz_749a190a-f808-49fc-8cd2-81342e6da38b/global-pull-secret-syncer/0.log" Jun 02 17:02:13.107045 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:13.107000 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7fvwq_64a330d1-ae24-4e85-88b8-f595933f5d4a/konnectivity-agent/0.log" Jun 02 17:02:13.241608 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:13.241579 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-45.ec2.internal_a95576eca65fd8a1e75b2eee015468be/haproxy/0.log" Jun 02 17:02:17.642344 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:17.642311 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d7d8db8b5-w4cp6_6eefd826-6780-436b-af5f-e4f7b5aedfc3/authorino/0.log" Jun 02 17:02:17.735534 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:17.735508 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-bmmd4_01b7e369-22d1-478f-bd65-e1fabc55119f/kuadrant-console-plugin/0.log" Jun 02 17:02:17.809834 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:17.809794 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-m4nnp_735a2123-85f8-4196-96e4-ce84c17ada3f/manager/0.log" Jun 02 17:02:19.114137 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:19.114061 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cd00d6a-46a8-44e1-82ee-b46ac5169985/alertmanager/0.log" Jun 02 17:02:19.137447 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:19.137416 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cd00d6a-46a8-44e1-82ee-b46ac5169985/config-reloader/0.log" Jun 02 17:02:19.161208 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:19.161181 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cd00d6a-46a8-44e1-82ee-b46ac5169985/kube-rbac-proxy-web/0.log" Jun 02 17:02:19.183795 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:19.183773 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cd00d6a-46a8-44e1-82ee-b46ac5169985/kube-rbac-proxy/0.log" Jun 02 17:02:19.206392 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:19.206368 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cd00d6a-46a8-44e1-82ee-b46ac5169985/kube-rbac-proxy-metric/0.log" Jun 02 17:02:19.235176 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:19.235134 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cd00d6a-46a8-44e1-82ee-b46ac5169985/prom-label-proxy/0.log" Jun 02 17:02:19.254838 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:19.254816 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cd00d6a-46a8-44e1-82ee-b46ac5169985/init-config-reloader/0.log" Jun 02 17:02:19.333086 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:19.333058 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-hhbnj_f51b2e31-5ac0-4792-b344-04def6c849e4/kube-state-metrics/0.log" Jun 02 17:02:19.368768 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:19.368688 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-hhbnj_f51b2e31-5ac0-4792-b344-04def6c849e4/kube-rbac-proxy-main/0.log" Jun 02 17:02:19.393284 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:19.393260 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-hhbnj_f51b2e31-5ac0-4792-b344-04def6c849e4/kube-rbac-proxy-self/0.log" Jun 02 17:02:19.422890 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:19.422868 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-68bc859cc9-ct72d_33600001-cc09-4762-bd2c-88a85d533531/metrics-server/0.log" Jun 02 17:02:19.480785 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:19.480760 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jknmq_bce4c8bc-52a2-4000-a821-cae9e41948cb/node-exporter/0.log" Jun 02 17:02:19.507957 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:19.507933 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jknmq_bce4c8bc-52a2-4000-a821-cae9e41948cb/kube-rbac-proxy/0.log" Jun 02 17:02:19.538205 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:19.538179 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jknmq_bce4c8bc-52a2-4000-a821-cae9e41948cb/init-textfile/0.log" Jun 02 17:02:19.826190 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:19.826163 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_acc6bdf8-a252-481d-a198-9c6cdd5df7b2/prometheus/0.log" Jun 02 17:02:19.863660 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:19.863636 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_acc6bdf8-a252-481d-a198-9c6cdd5df7b2/config-reloader/0.log" Jun 02 17:02:19.893574 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:19.893553 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_acc6bdf8-a252-481d-a198-9c6cdd5df7b2/thanos-sidecar/0.log" Jun 02 17:02:19.915688 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:19.915664 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_acc6bdf8-a252-481d-a198-9c6cdd5df7b2/kube-rbac-proxy-web/0.log" Jun 02 17:02:19.935154 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:19.935132 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_acc6bdf8-a252-481d-a198-9c6cdd5df7b2/kube-rbac-proxy/0.log" Jun 02 17:02:19.956645 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:19.956622 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_acc6bdf8-a252-481d-a198-9c6cdd5df7b2/kube-rbac-proxy-thanos/0.log" Jun 02 17:02:19.980078 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:19.980059 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_acc6bdf8-a252-481d-a198-9c6cdd5df7b2/init-config-reloader/0.log" Jun 02 17:02:20.009054 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:20.009031 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-p8vjh_98efe448-8a8d-4480-8405-210dcd7b124b/prometheus-operator/0.log" Jun 02 17:02:20.030977 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:20.030954 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-p8vjh_98efe448-8a8d-4480-8405-210dcd7b124b/kube-rbac-proxy/0.log" Jun 02 17:02:21.355099 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:21.355069 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-mfzpt_2eb49fdc-49ec-4844-a2ed-108e1ad6a300/networking-console-plugin/0.log" Jun 02 17:02:21.874966 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:21.874934 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vlq2q_43709aef-aafc-4d89-b794-916480842d72/console-operator/2.log" Jun 02 17:02:21.880021 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:21.879977 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vlq2q_43709aef-aafc-4d89-b794-916480842d72/console-operator/3.log" Jun 02 17:02:22.878061 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:22.878034 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-svlz4_a2da4cf1-b407-41f1-8bd9-1b99c2a66aab/volume-data-source-validator/0.log" Jun 02 17:02:22.942611 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:22.942580 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9ksn2/perf-node-gather-daemonset-dmmhb"] Jun 02 17:02:22.947713 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:22.947696 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-dmmhb" Jun 02 17:02:22.949854 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:22.949835 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9ksn2\"/\"kube-root-ca.crt\"" Jun 02 17:02:22.950260 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:22.950241 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9ksn2\"/\"default-dockercfg-ccmd4\"" Jun 02 17:02:22.950344 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:22.950241 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9ksn2\"/\"openshift-service-ca.crt\"" Jun 02 17:02:22.957197 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:22.957173 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9ksn2/perf-node-gather-daemonset-dmmhb"] Jun 02 17:02:23.090110 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:23.090079 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d94e83ac-ed5b-4db2-87a4-c568e4b481f5-lib-modules\") pod \"perf-node-gather-daemonset-dmmhb\" (UID: \"d94e83ac-ed5b-4db2-87a4-c568e4b481f5\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-dmmhb" Jun 02 17:02:23.090286 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:23.090178 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6h4b\" (UniqueName: \"kubernetes.io/projected/d94e83ac-ed5b-4db2-87a4-c568e4b481f5-kube-api-access-p6h4b\") pod \"perf-node-gather-daemonset-dmmhb\" (UID: \"d94e83ac-ed5b-4db2-87a4-c568e4b481f5\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-dmmhb" Jun 02 17:02:23.090286 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:23.090206 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d94e83ac-ed5b-4db2-87a4-c568e4b481f5-podres\") pod \"perf-node-gather-daemonset-dmmhb\" (UID: \"d94e83ac-ed5b-4db2-87a4-c568e4b481f5\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-dmmhb" Jun 02 17:02:23.090286 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:23.090241 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d94e83ac-ed5b-4db2-87a4-c568e4b481f5-proc\") pod \"perf-node-gather-daemonset-dmmhb\" (UID: \"d94e83ac-ed5b-4db2-87a4-c568e4b481f5\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-dmmhb" Jun 02 17:02:23.090428 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:23.090292 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d94e83ac-ed5b-4db2-87a4-c568e4b481f5-sys\") pod \"perf-node-gather-daemonset-dmmhb\" (UID: \"d94e83ac-ed5b-4db2-87a4-c568e4b481f5\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-dmmhb" Jun 02 17:02:23.191412 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:23.191325 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d94e83ac-ed5b-4db2-87a4-c568e4b481f5-podres\") pod \"perf-node-gather-daemonset-dmmhb\" (UID: \"d94e83ac-ed5b-4db2-87a4-c568e4b481f5\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-dmmhb" Jun 02 17:02:23.191412 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:23.191365 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d94e83ac-ed5b-4db2-87a4-c568e4b481f5-proc\") pod \"perf-node-gather-daemonset-dmmhb\" (UID: \"d94e83ac-ed5b-4db2-87a4-c568e4b481f5\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-dmmhb" Jun 02 17:02:23.191619 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:23.191429 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d94e83ac-ed5b-4db2-87a4-c568e4b481f5-sys\") pod \"perf-node-gather-daemonset-dmmhb\" (UID: \"d94e83ac-ed5b-4db2-87a4-c568e4b481f5\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-dmmhb" Jun 02 17:02:23.191619 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:23.191467 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d94e83ac-ed5b-4db2-87a4-c568e4b481f5-lib-modules\") pod \"perf-node-gather-daemonset-dmmhb\" (UID: \"d94e83ac-ed5b-4db2-87a4-c568e4b481f5\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-dmmhb" Jun 02 17:02:23.191619 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:23.191497 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d94e83ac-ed5b-4db2-87a4-c568e4b481f5-podres\") pod \"perf-node-gather-daemonset-dmmhb\" (UID: \"d94e83ac-ed5b-4db2-87a4-c568e4b481f5\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-dmmhb" Jun 02 17:02:23.191619 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:23.191514 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d94e83ac-ed5b-4db2-87a4-c568e4b481f5-proc\") pod \"perf-node-gather-daemonset-dmmhb\" (UID: \"d94e83ac-ed5b-4db2-87a4-c568e4b481f5\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-dmmhb" Jun 02 17:02:23.191619 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:23.191523 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d94e83ac-ed5b-4db2-87a4-c568e4b481f5-sys\") pod \"perf-node-gather-daemonset-dmmhb\" (UID: \"d94e83ac-ed5b-4db2-87a4-c568e4b481f5\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-dmmhb" Jun 02 17:02:23.191619 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:23.191573 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6h4b\" (UniqueName: \"kubernetes.io/projected/d94e83ac-ed5b-4db2-87a4-c568e4b481f5-kube-api-access-p6h4b\") pod \"perf-node-gather-daemonset-dmmhb\" (UID: \"d94e83ac-ed5b-4db2-87a4-c568e4b481f5\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-dmmhb" Jun 02 17:02:23.191821 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:23.191638 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d94e83ac-ed5b-4db2-87a4-c568e4b481f5-lib-modules\") pod \"perf-node-gather-daemonset-dmmhb\" (UID: \"d94e83ac-ed5b-4db2-87a4-c568e4b481f5\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-dmmhb" Jun 02 17:02:23.199062 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:23.199032 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6h4b\" (UniqueName: \"kubernetes.io/projected/d94e83ac-ed5b-4db2-87a4-c568e4b481f5-kube-api-access-p6h4b\") pod \"perf-node-gather-daemonset-dmmhb\" (UID: \"d94e83ac-ed5b-4db2-87a4-c568e4b481f5\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-dmmhb" Jun 02 17:02:23.258570 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:23.258548 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-dmmhb" Jun 02 17:02:23.391716 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:23.391687 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9ksn2/perf-node-gather-daemonset-dmmhb"] Jun 02 17:02:23.394355 ip-10-0-132-45 kubenswrapper[2565]: W0602 17:02:23.394314 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd94e83ac_ed5b_4db2_87a4_c568e4b481f5.slice/crio-04d2472e84eeeaf329b70be9305196dc8249c0c62a164be19493e9242d76dc0a WatchSource:0}: Error finding container 04d2472e84eeeaf329b70be9305196dc8249c0c62a164be19493e9242d76dc0a: Status 404 returned error can't find the container with id 04d2472e84eeeaf329b70be9305196dc8249c0c62a164be19493e9242d76dc0a Jun 02 17:02:23.395939 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:23.395921 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 17:02:23.554630 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:23.554598 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-dmmhb" event={"ID":"d94e83ac-ed5b-4db2-87a4-c568e4b481f5","Type":"ContainerStarted","Data":"8a4828bb8bda7eb42d4fc6a58fd0b36f481ef9114fdac9a328905f28d9de8a37"} Jun 02 17:02:23.554777 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:23.554635 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-dmmhb" event={"ID":"d94e83ac-ed5b-4db2-87a4-c568e4b481f5","Type":"ContainerStarted","Data":"04d2472e84eeeaf329b70be9305196dc8249c0c62a164be19493e9242d76dc0a"} Jun 02 17:02:23.554777 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:23.554687 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-dmmhb" Jun 02 17:02:23.569781 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:23.569738 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-dmmhb" podStartSLOduration=1.5697262969999999 podStartE2EDuration="1.569726297s" podCreationTimestamp="2026-06-02 17:02:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 17:02:23.568484076 +0000 UTC m=+1268.024568336" watchObservedRunningTime="2026-06-02 17:02:23.569726297 +0000 UTC m=+1268.025810588" Jun 02 17:02:23.809028 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:23.808933 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7n7dn_6d6fcc1b-ce7e-4077-a070-269119a8e723/dns/0.log" Jun 02 17:02:23.828694 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:23.828675 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7n7dn_6d6fcc1b-ce7e-4077-a070-269119a8e723/kube-rbac-proxy/0.log" Jun 02 17:02:23.932457 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:23.932438 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xzbtx_7e662b53-0cfd-4ec3-94ee-554c1450e245/dns-node-resolver/0.log" Jun 02 17:02:24.406990 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:24.406958 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hhv9c_c231d988-ab86-41d3-be47-375ab32a84c2/node-ca/0.log" Jun 02 17:02:25.327630 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:25.327604 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8dc448d-mbt7p_4b092314-5a0e-4719-9fad-e971fe9e8311/kube-auth-proxy/0.log" Jun 02 17:02:25.396666 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:25.396641 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5dc97c89b5-hx4vl_f7b90812-e229-4aef-99c0-185f0d0f7d67/router/0.log" Jun 02 17:02:25.913320 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:25.913288 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lgc2j_70235929-1fb6-4b5d-bda3-f77b2899b79c/serve-healthcheck-canary/0.log" Jun 02 17:02:26.358088 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:26.357995 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ncs5x_db5c22b8-bea8-4f56-856a-2319a51a896f/kube-rbac-proxy/0.log" Jun 02 17:02:26.378290 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:26.378269 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ncs5x_db5c22b8-bea8-4f56-856a-2319a51a896f/exporter/0.log" Jun 02 17:02:26.397281 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:26.397256 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ncs5x_db5c22b8-bea8-4f56-856a-2319a51a896f/extractor/0.log" Jun 02 17:02:28.753978 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:28.753948 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6dc766977c-gsrr7_6e133171-4ce6-4940-9fbc-eca28466aa06/maas-api/0.log" Jun 02 17:02:28.797076 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:28.797046 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7847646b5-l5xr8_2870ad52-9f7f-4bda-a9f4-d0c05a1df465/manager/0.log" Jun 02 17:02:28.990121 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:28.990084 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58857ff9f-qrkf9_7ab74b54-c323-480f-9048-e90782215e64/manager/0.log" Jun 02 17:02:29.007497 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:29.007425 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58857ff9f-qrkf9_7ab74b54-c323-480f-9048-e90782215e64/copy-manifests/0.log" Jun 02 17:02:29.569325 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:29.569297 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-dmmhb" Jun 02 17:02:30.336123 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:30.336086 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-644f4f4cf6-mpclg_0bb77a77-801d-41c5-91be-d4b300ede29d/manager/0.log" Jun 02 17:02:36.742407 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:36.742362 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhcjt_6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed/kube-multus-additional-cni-plugins/0.log" Jun 02 17:02:36.762353 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:36.762299 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhcjt_6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed/egress-router-binary-copy/0.log" Jun 02 17:02:36.781129 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:36.781103 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhcjt_6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed/cni-plugins/0.log" Jun 02 17:02:36.800293 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:36.800258 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhcjt_6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed/bond-cni-plugin/0.log" Jun 02 17:02:36.818056 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:36.818029 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhcjt_6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed/routeoverride-cni/0.log" Jun 02 17:02:36.837676 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:36.837644 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhcjt_6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed/whereabouts-cni-bincopy/0.log" Jun 02 17:02:36.863222 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:36.863189 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhcjt_6d5ee87e-2516-4e3c-9136-b1ea06f0c5ed/whereabouts-cni/0.log" Jun 02 17:02:36.893478 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:36.893456 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fjcc9_a1c0d918-3ad4-446a-94dc-a29ff79b8476/kube-multus/0.log" Jun 02 17:02:36.942628 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:36.942587 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5p7z4_ab630523-7064-4dc5-a730-7b6b06551777/network-metrics-daemon/0.log" Jun 02 17:02:36.961790 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:36.961767 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5p7z4_ab630523-7064-4dc5-a730-7b6b06551777/kube-rbac-proxy/0.log" Jun 02 17:02:38.175713 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:38.175678 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sjt8_a9902c57-5190-456a-83a9-948e46bec4a0/ovn-controller/0.log" Jun 02 17:02:38.190720 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:38.190688 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sjt8_a9902c57-5190-456a-83a9-948e46bec4a0/ovn-acl-logging/0.log" Jun 02 17:02:38.196259 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:38.196240 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sjt8_a9902c57-5190-456a-83a9-948e46bec4a0/ovn-acl-logging/1.log" Jun 02 17:02:38.213585 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:38.213565 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sjt8_a9902c57-5190-456a-83a9-948e46bec4a0/kube-rbac-proxy-node/0.log" Jun 02 17:02:38.231140 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:38.231108 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sjt8_a9902c57-5190-456a-83a9-948e46bec4a0/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 17:02:38.248524 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:38.248498 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sjt8_a9902c57-5190-456a-83a9-948e46bec4a0/northd/0.log" Jun 02 17:02:38.268571 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:38.268543 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sjt8_a9902c57-5190-456a-83a9-948e46bec4a0/nbdb/0.log" Jun 02 17:02:38.286689 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:38.286657 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sjt8_a9902c57-5190-456a-83a9-948e46bec4a0/sbdb/0.log" Jun 02 17:02:38.397133 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:38.397102 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sjt8_a9902c57-5190-456a-83a9-948e46bec4a0/ovnkube-controller/0.log" Jun 02 17:02:39.742462 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:39.742427 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-56d84b9f44-w82gl_9b3c3828-74bf-4ade-bc25-dc4df6925d4e/check-endpoints/0.log" Jun 02 17:02:39.821133 ip-10-0-132-45 kubenswrapper[2565]: I0602 17:02:39.821100 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-vgkxp_4505a0c0-1c04-42cd-b0ab-cc964485cef7/network-check-target-container/0.log"