Jun 02 19:00:50.508481 ip-10-0-131-50 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 02 19:00:50.508491 ip-10-0-131-50 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 02 19:00:50.508500 ip-10-0-131-50 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 02 19:00:50.508821 ip-10-0-131-50 systemd[1]: Failed to start Kubernetes Kubelet. Jun 02 19:01:00.753491 ip-10-0-131-50 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 02 19:01:00.753507 ip-10-0-131-50 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1f9132bf7cdd4c6d8c4962281eda84d2 -- Jun 02 19:03:29.314979 ip-10-0-131-50 systemd[1]: Starting Kubernetes Kubelet... Jun 02 19:03:29.785290 ip-10-0-131-50 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 19:03:29.785290 ip-10-0-131-50 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 19:03:29.785290 ip-10-0-131-50 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 19:03:29.785290 ip-10-0-131-50 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 19:03:29.785290 ip-10-0-131-50 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 19:03:29.787961 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.787869 2569 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 19:03:29.795399 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795366 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 19:03:29.795399 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795386 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 19:03:29.795399 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795393 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 19:03:29.795399 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795398 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 19:03:29.795399 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795401 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 19:03:29.795399 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795405 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 19:03:29.795399 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795409 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 19:03:29.795818 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795414 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 19:03:29.795818 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795418 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 19:03:29.795818 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795422 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 19:03:29.795818 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795426 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 19:03:29.795818 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795430 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 19:03:29.795818 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795435 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 19:03:29.795818 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795438 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 19:03:29.795818 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795442 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 19:03:29.795818 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795445 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 19:03:29.795818 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795449 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 19:03:29.795818 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795453 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 19:03:29.795818 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795457 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 19:03:29.795818 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795461 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 19:03:29.795818 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795465 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 19:03:29.795818 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795468 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 19:03:29.795818 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795472 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 19:03:29.795818 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795476 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 19:03:29.795818 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795479 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 19:03:29.795818 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795483 2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 19:03:29.795818 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795486 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 19:03:29.796616 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795490 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 19:03:29.796616 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795495 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 19:03:29.796616 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795500 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 19:03:29.796616 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795503 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 19:03:29.796616 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795508 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 19:03:29.796616 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795512 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 19:03:29.796616 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795515 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 19:03:29.796616 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795519 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 19:03:29.796616 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795523 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 19:03:29.796616 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795527 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 19:03:29.796616 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795531 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 19:03:29.796616 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795534 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 19:03:29.796616 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795538 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 19:03:29.796616 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795544 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 19:03:29.796616 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795548 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 19:03:29.796616 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795552 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 19:03:29.796616 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795556 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 19:03:29.796616 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795560 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 19:03:29.796616 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795564 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 19:03:29.796616 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795569 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 19:03:29.797267 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795573 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 19:03:29.797267 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795577 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 19:03:29.797267 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795582 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 19:03:29.797267 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795587 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 19:03:29.797267 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795591 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 19:03:29.797267 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795595 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 19:03:29.797267 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795599 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 19:03:29.797267 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795603 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 19:03:29.797267 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795607 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 19:03:29.797267 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795612 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 19:03:29.797267 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795616 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 19:03:29.797267 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795620 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 19:03:29.797267 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795628 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 19:03:29.797267 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795634 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 19:03:29.797267 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795640 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 19:03:29.797267 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795645 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 19:03:29.797267 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795649 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 19:03:29.797267 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795654 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 19:03:29.797267 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795659 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 19:03:29.797267 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795663 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 19:03:29.798023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795667 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 19:03:29.798023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795671 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 19:03:29.798023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795675 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 19:03:29.798023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795699 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 19:03:29.798023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795703 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 19:03:29.798023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795711 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 19:03:29.798023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795715 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 19:03:29.798023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795720 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 19:03:29.798023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795724 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 19:03:29.798023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795731 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 19:03:29.798023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795737 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 19:03:29.798023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795744 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 19:03:29.798023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795749 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 02 19:03:29.798023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795754 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 19:03:29.798023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795758 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 19:03:29.798023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795763 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 19:03:29.798023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795767 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 19:03:29.798023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795771 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 19:03:29.798023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.795775 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 19:03:29.798023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796408 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 19:03:29.798883 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796417 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 19:03:29.798883 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796421 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 19:03:29.798883 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796426 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 19:03:29.798883 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796430 2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 19:03:29.798883 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796435 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 19:03:29.798883 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796439 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 19:03:29.798883 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796443 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 19:03:29.798883 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796448 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 19:03:29.798883 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796452 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 19:03:29.798883 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796456 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 19:03:29.798883 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796460 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 19:03:29.798883 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796465 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 19:03:29.798883 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796469 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 19:03:29.798883 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796474 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 19:03:29.798883 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796479 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 19:03:29.798883 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796483 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 19:03:29.798883 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796487 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 19:03:29.798883 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796492 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 19:03:29.798883 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796496 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 19:03:29.798883 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796500 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 19:03:29.799389 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796505 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 19:03:29.799389 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796510 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 19:03:29.799389 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796514 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 19:03:29.799389 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796519 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 19:03:29.799389 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796524 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 19:03:29.799389 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796528 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 19:03:29.799389 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796535 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 19:03:29.799389 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796541 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 19:03:29.799389 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796546 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 19:03:29.799389 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796550 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 19:03:29.799389 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796555 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 19:03:29.799389 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796560 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 19:03:29.799389 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796564 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 19:03:29.799389 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796568 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 19:03:29.799389 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796572 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 19:03:29.799389 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796576 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 19:03:29.799389 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796580 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 19:03:29.799389 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796584 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 19:03:29.799389 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796589 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 19:03:29.800014 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796594 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 19:03:29.800014 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796598 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 19:03:29.800014 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796602 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 19:03:29.800014 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796607 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 19:03:29.800014 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796611 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 19:03:29.800014 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796614 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 19:03:29.800014 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796618 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 19:03:29.800014 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796622 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 19:03:29.800014 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796626 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 19:03:29.800014 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796629 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 19:03:29.800014 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796635 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 19:03:29.800014 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796639 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 19:03:29.800014 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796643 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 19:03:29.800014 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796649 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 19:03:29.800014 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796656 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 19:03:29.800014 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796660 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 19:03:29.800014 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796664 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 19:03:29.800014 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796669 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 19:03:29.800014 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796674 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 19:03:29.800014 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796697 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 19:03:29.800516 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796702 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 19:03:29.800516 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796706 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 19:03:29.800516 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796710 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 19:03:29.800516 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796714 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 19:03:29.800516 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796718 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 19:03:29.800516 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796722 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 19:03:29.800516 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796726 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 02 19:03:29.800516 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796730 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 19:03:29.800516 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796735 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 19:03:29.800516 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796739 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 19:03:29.800516 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796743 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 19:03:29.800516 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796747 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 19:03:29.800516 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796751 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 19:03:29.800516 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796755 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 19:03:29.800516 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796759 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 19:03:29.800516 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796763 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 19:03:29.800516 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796769 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 19:03:29.800516 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796773 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 19:03:29.800516 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796777 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 19:03:29.800516 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796783 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 19:03:29.801211 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796787 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 19:03:29.801211 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796791 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 19:03:29.801211 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796795 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 19:03:29.801211 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796800 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 19:03:29.801211 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796804 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 19:03:29.801211 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.796808 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 19:03:29.801211 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797465 2569 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 19:03:29.801211 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797486 2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 19:03:29.801211 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797496 2569 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 19:03:29.801211 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797503 2569 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 19:03:29.801211 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797511 2569 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 19:03:29.801211 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797517 2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 19:03:29.801211 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797524 2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 19:03:29.801211 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797531 2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 19:03:29.801211 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797537 2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 19:03:29.801211 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797542 2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 19:03:29.801211 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797547 2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 19:03:29.801211 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797552 2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 19:03:29.801211 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797557 2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 19:03:29.801211 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797562 2569 flags.go:64] FLAG: --cgroup-root="" Jun 02 19:03:29.801211 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797568 2569 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 19:03:29.801211 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797572 2569 flags.go:64] FLAG: --client-ca-file="" Jun 02 19:03:29.801211 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797578 2569 flags.go:64] FLAG: --cloud-config="" Jun 02 19:03:29.801882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797582 2569 flags.go:64] FLAG: --cloud-provider="external" Jun 02 19:03:29.801882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797587 2569 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 19:03:29.801882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797594 2569 flags.go:64] FLAG: --cluster-domain="" Jun 02 19:03:29.801882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797600 2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 19:03:29.801882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797605 2569 flags.go:64] FLAG: --config-dir="" Jun 02 19:03:29.801882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797610 2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 19:03:29.801882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797616 2569 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 19:03:29.801882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797622 2569 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 19:03:29.801882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797627 2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 19:03:29.801882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797632 2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 19:03:29.801882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797638 2569 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 19:03:29.801882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797643 2569 flags.go:64] FLAG: --contention-profiling="false" Jun 02 19:03:29.801882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797648 2569 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 19:03:29.801882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797653 2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 19:03:29.801882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797658 2569 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 19:03:29.801882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797663 2569 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 19:03:29.801882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797670 2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 19:03:29.801882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797693 2569 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 19:03:29.801882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797699 2569 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 19:03:29.801882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797703 2569 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 19:03:29.801882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797710 2569 flags.go:64] FLAG: --enable-server="true" Jun 02 19:03:29.801882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797715 2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 19:03:29.801882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797722 2569 flags.go:64] FLAG: --event-burst="100" Jun 02 19:03:29.801882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797727 2569 flags.go:64] FLAG: --event-qps="50" Jun 02 19:03:29.801882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797732 2569 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 19:03:29.802526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797737 2569 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 19:03:29.802526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797742 2569 flags.go:64] FLAG: --eviction-hard="" Jun 02 19:03:29.802526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797748 2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 19:03:29.802526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797753 2569 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 19:03:29.802526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797758 2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 19:03:29.802526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797763 2569 flags.go:64] FLAG: --eviction-soft="" Jun 02 19:03:29.802526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797768 2569 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 19:03:29.802526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797773 2569 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 19:03:29.802526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797778 2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 19:03:29.802526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797783 2569 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 19:03:29.802526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797788 2569 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 19:03:29.802526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797793 2569 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 19:03:29.802526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797798 2569 flags.go:64] FLAG: --feature-gates="" Jun 02 19:03:29.802526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797805 2569 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 19:03:29.802526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797810 2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 19:03:29.802526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797814 2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 19:03:29.802526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797819 2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 19:03:29.802526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797824 2569 flags.go:64] FLAG: --healthz-port="10248" Jun 02 19:03:29.802526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797830 2569 flags.go:64] FLAG: --help="false" Jun 02 19:03:29.802526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797835 2569 flags.go:64] FLAG: --hostname-override="ip-10-0-131-50.ec2.internal" Jun 02 19:03:29.802526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797840 2569 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 19:03:29.802526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797844 2569 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 19:03:29.802526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797849 2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 19:03:29.803152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797855 2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 19:03:29.803152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797861 2569 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 19:03:29.803152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797866 2569 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 19:03:29.803152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797871 2569 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 19:03:29.803152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797875 2569 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 19:03:29.803152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797881 2569 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 19:03:29.803152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797886 2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 19:03:29.803152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797891 2569 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 19:03:29.803152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797896 2569 flags.go:64] FLAG: --kube-reserved="" Jun 02 19:03:29.803152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797900 2569 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 19:03:29.803152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797905 2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 19:03:29.803152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797911 2569 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 19:03:29.803152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797916 2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 19:03:29.803152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797921 2569 flags.go:64] FLAG: --lock-file="" Jun 02 19:03:29.803152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797926 2569 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 19:03:29.803152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797931 2569 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 19:03:29.803152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797936 2569 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 19:03:29.803152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797945 2569 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 19:03:29.803152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797950 2569 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 19:03:29.803152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797955 2569 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 19:03:29.803152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797960 2569 flags.go:64] FLAG: --logging-format="text" Jun 02 19:03:29.803152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797965 2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 19:03:29.803152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797971 2569 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 19:03:29.803152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797975 2569 flags.go:64] FLAG: --manifest-url="" Jun 02 19:03:29.803781 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797979 2569 flags.go:64] FLAG: --manifest-url-header="" Jun 02 19:03:29.803781 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797986 2569 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 19:03:29.803781 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797991 2569 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 19:03:29.803781 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.797998 2569 flags.go:64] FLAG: --max-pods="110" Jun 02 19:03:29.803781 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798003 2569 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 19:03:29.803781 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798008 2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 19:03:29.803781 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798013 2569 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 19:03:29.803781 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798017 2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 19:03:29.803781 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798022 2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 19:03:29.803781 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798026 2569 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 19:03:29.803781 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798031 2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 19:03:29.803781 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798042 2569 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 19:03:29.803781 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798047 2569 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 19:03:29.803781 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798052 2569 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 19:03:29.803781 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798058 2569 flags.go:64] FLAG: --pod-cidr="" Jun 02 19:03:29.803781 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798064 2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 19:03:29.803781 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798073 2569 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 19:03:29.803781 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798077 2569 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 19:03:29.803781 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798083 2569 flags.go:64] FLAG: --pods-per-core="0" Jun 02 19:03:29.803781 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798091 2569 flags.go:64] FLAG: --port="10250" Jun 02 19:03:29.803781 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798096 2569 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 19:03:29.803781 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798101 2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0286b5f3f006df8be" Jun 02 19:03:29.803781 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798111 2569 flags.go:64] FLAG: --qos-reserved="" Jun 02 19:03:29.803781 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798116 2569 flags.go:64] FLAG: --read-only-port="10255" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798121 2569 flags.go:64] FLAG: --register-node="true" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798126 2569 flags.go:64] FLAG: --register-schedulable="true" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798131 2569 flags.go:64] FLAG: --register-with-taints="" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798137 2569 flags.go:64] FLAG: --registry-burst="10" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798142 2569 flags.go:64] FLAG: --registry-qps="5" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798147 2569 flags.go:64] FLAG: --reserved-cpus="" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798152 2569 flags.go:64] FLAG: --reserved-memory="" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798158 2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798163 2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798168 2569 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798173 2569 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798178 2569 flags.go:64] FLAG: --runonce="false" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798183 2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798188 2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798193 2569 flags.go:64] FLAG: --seccomp-default="false" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798198 2569 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798203 2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798208 2569 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798213 2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798218 2569 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798223 2569 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798228 2569 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798233 2569 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798238 2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798243 2569 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 19:03:29.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798248 2569 flags.go:64] FLAG: --system-cgroups="" Jun 02 19:03:29.805049 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798253 2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 19:03:29.805049 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798264 2569 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 19:03:29.805049 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798269 2569 flags.go:64] FLAG: --tls-cert-file="" Jun 02 19:03:29.805049 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798273 2569 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 19:03:29.805049 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798283 2569 flags.go:64] FLAG: --tls-min-version="" Jun 02 19:03:29.805049 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798288 2569 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 19:03:29.805049 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798293 2569 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 19:03:29.805049 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798297 2569 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 19:03:29.805049 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798303 2569 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 19:03:29.805049 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798308 2569 flags.go:64] FLAG: --v="2" Jun 02 19:03:29.805049 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798321 2569 flags.go:64] FLAG: --version="false" Jun 02 19:03:29.805049 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798328 2569 flags.go:64] FLAG: --vmodule="" Jun 02 19:03:29.805049 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798335 2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 19:03:29.805049 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.798340 2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 19:03:29.805049 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798487 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 19:03:29.805049 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798493 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 19:03:29.805049 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798498 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 19:03:29.805049 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798502 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 19:03:29.805049 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798506 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 19:03:29.805049 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798511 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 19:03:29.805049 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798515 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 19:03:29.805049 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798522 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 19:03:29.805049 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798528 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 19:03:29.805656 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798532 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 19:03:29.805656 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798537 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 19:03:29.805656 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798541 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 19:03:29.805656 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798546 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 19:03:29.805656 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798550 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 19:03:29.805656 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798554 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 19:03:29.805656 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798559 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 19:03:29.805656 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798564 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 19:03:29.805656 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798568 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 19:03:29.805656 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798573 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 19:03:29.805656 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798579 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 19:03:29.805656 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798584 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 19:03:29.805656 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798588 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 19:03:29.805656 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798594 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 19:03:29.805656 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798599 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 19:03:29.805656 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798603 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 19:03:29.805656 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798607 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 19:03:29.805656 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798612 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 19:03:29.805656 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798616 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 19:03:29.806158 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798620 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 19:03:29.806158 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798624 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 19:03:29.806158 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798629 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 19:03:29.806158 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798633 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 19:03:29.806158 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798638 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 19:03:29.806158 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798642 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 19:03:29.806158 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798646 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 19:03:29.806158 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798650 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 19:03:29.806158 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798654 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 19:03:29.806158 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798659 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 19:03:29.806158 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798663 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 02 19:03:29.806158 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798667 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 19:03:29.806158 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798671 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 19:03:29.806158 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798694 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 19:03:29.806158 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798700 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 19:03:29.806158 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798705 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 19:03:29.806158 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798709 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 19:03:29.806158 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798713 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 19:03:29.806158 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798717 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 19:03:29.806158 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798721 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 19:03:29.806652 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798726 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 19:03:29.806652 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798730 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 19:03:29.806652 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798735 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 19:03:29.806652 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798741 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 19:03:29.806652 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798745 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 19:03:29.806652 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798750 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 19:03:29.806652 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798755 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 19:03:29.806652 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798759 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 19:03:29.806652 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798763 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 19:03:29.806652 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798767 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 19:03:29.806652 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798772 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 19:03:29.806652 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798776 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 19:03:29.806652 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798780 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 19:03:29.806652 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798785 2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 19:03:29.806652 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798789 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 19:03:29.806652 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798793 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 19:03:29.806652 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798797 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 19:03:29.806652 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798802 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 19:03:29.806652 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798806 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 19:03:29.807156 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798810 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 19:03:29.807156 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798815 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 19:03:29.807156 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798819 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 19:03:29.807156 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798823 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 19:03:29.807156 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798828 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 19:03:29.807156 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798832 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 19:03:29.807156 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798836 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 19:03:29.807156 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798840 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 19:03:29.807156 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798845 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 19:03:29.807156 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798849 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 19:03:29.807156 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798853 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 19:03:29.807156 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798857 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 19:03:29.807156 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798862 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 19:03:29.807156 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798866 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 19:03:29.807156 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798870 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 19:03:29.807156 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798876 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 19:03:29.807156 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798881 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 19:03:29.807156 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798885 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 19:03:29.807156 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.798890 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 19:03:29.807637 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.799773 2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 19:03:29.807637 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.807494 2569 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 19:03:29.807637 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.807511 2569 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 19:03:29.807637 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807560 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 19:03:29.807637 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807564 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 19:03:29.807637 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807568 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 19:03:29.807637 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807571 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 19:03:29.807637 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807575 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 19:03:29.807637 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807579 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 19:03:29.807637 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807582 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 19:03:29.807637 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807586 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 19:03:29.807637 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807589 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 19:03:29.807637 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807592 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 19:03:29.807637 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807596 2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 19:03:29.807637 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807599 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 19:03:29.808029 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807601 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 19:03:29.808029 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807604 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 19:03:29.808029 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807607 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 19:03:29.808029 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807610 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 19:03:29.808029 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807613 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 19:03:29.808029 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807616 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 19:03:29.808029 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807618 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 19:03:29.808029 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807621 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 19:03:29.808029 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807624 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 19:03:29.808029 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807627 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 19:03:29.808029 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807630 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 19:03:29.808029 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807632 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 19:03:29.808029 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807635 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 19:03:29.808029 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807638 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 19:03:29.808029 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807641 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 19:03:29.808029 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807645 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 19:03:29.808029 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807648 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 19:03:29.808029 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807650 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 19:03:29.808029 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807653 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 19:03:29.808029 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807656 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 19:03:29.808567 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807659 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 19:03:29.808567 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807661 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 19:03:29.808567 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807664 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 19:03:29.808567 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807666 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 19:03:29.808567 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807669 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 19:03:29.808567 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807672 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 19:03:29.808567 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807674 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 19:03:29.808567 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807688 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 19:03:29.808567 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807691 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 19:03:29.808567 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807693 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 19:03:29.808567 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807696 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 19:03:29.808567 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807699 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 19:03:29.808567 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807701 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 19:03:29.808567 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807705 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 19:03:29.808567 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807708 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 19:03:29.808567 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807710 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 19:03:29.808567 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807713 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 19:03:29.808567 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807716 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 19:03:29.808567 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807718 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 19:03:29.808567 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807721 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 19:03:29.809101 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807723 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 19:03:29.809101 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807726 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 19:03:29.809101 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807729 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 19:03:29.809101 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807732 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 19:03:29.809101 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807734 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 19:03:29.809101 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807737 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 19:03:29.809101 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807740 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 19:03:29.809101 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807743 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 19:03:29.809101 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807746 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 19:03:29.809101 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807748 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 19:03:29.809101 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807751 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 19:03:29.809101 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807753 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 19:03:29.809101 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807756 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 19:03:29.809101 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807758 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 19:03:29.809101 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807761 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 19:03:29.809101 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807764 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 19:03:29.809101 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807767 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 19:03:29.809101 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807769 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 19:03:29.809101 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807773 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 19:03:29.809101 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807776 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 19:03:29.809601 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807779 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 19:03:29.809601 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807781 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 19:03:29.809601 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807784 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 19:03:29.809601 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807787 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 19:03:29.809601 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807789 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 19:03:29.809601 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807791 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 19:03:29.809601 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807796 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 19:03:29.809601 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807801 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 19:03:29.809601 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807804 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 19:03:29.809601 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807807 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 19:03:29.809601 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807810 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 02 19:03:29.809601 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807813 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 19:03:29.809601 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807815 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 19:03:29.809601 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807818 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 19:03:29.809601 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.807823 2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 19:03:29.810023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807920 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 19:03:29.810023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807925 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 19:03:29.810023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807928 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 19:03:29.810023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807932 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 19:03:29.810023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807936 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 19:03:29.810023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807939 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 19:03:29.810023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807942 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 19:03:29.810023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807945 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 19:03:29.810023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807947 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 19:03:29.810023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807950 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 19:03:29.810023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807953 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 19:03:29.810023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807956 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 19:03:29.810023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807958 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 19:03:29.810023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807961 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 19:03:29.810023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807965 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 19:03:29.810023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807967 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 19:03:29.810023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807970 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 19:03:29.810023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807973 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 19:03:29.810023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807976 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 19:03:29.810023 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807979 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 19:03:29.810492 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807981 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 02 19:03:29.810492 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807984 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 19:03:29.810492 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807987 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 19:03:29.810492 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807990 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 19:03:29.810492 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807992 2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 19:03:29.810492 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807995 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 19:03:29.810492 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.807998 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 19:03:29.810492 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808000 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 19:03:29.810492 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808003 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 19:03:29.810492 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808005 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 19:03:29.810492 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808008 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 19:03:29.810492 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808010 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 19:03:29.810492 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808013 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 19:03:29.810492 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808015 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 19:03:29.810492 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808018 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 19:03:29.810492 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808021 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 19:03:29.810492 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808023 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 19:03:29.810492 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808026 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 19:03:29.810492 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808029 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 19:03:29.810492 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808031 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 19:03:29.811020 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808034 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 19:03:29.811020 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808036 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 19:03:29.811020 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808039 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 19:03:29.811020 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808042 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 19:03:29.811020 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808045 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 19:03:29.811020 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808047 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 19:03:29.811020 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808050 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 19:03:29.811020 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808053 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 19:03:29.811020 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808056 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 19:03:29.811020 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808060 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 19:03:29.811020 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808063 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 19:03:29.811020 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808066 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 19:03:29.811020 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808069 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 19:03:29.811020 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808071 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 19:03:29.811020 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808074 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 19:03:29.811020 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808077 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 19:03:29.811020 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808080 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 19:03:29.811020 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808082 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 19:03:29.811020 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808085 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 19:03:29.811481 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808088 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 19:03:29.811481 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808091 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 19:03:29.811481 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808093 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 19:03:29.811481 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808096 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 19:03:29.811481 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808099 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 19:03:29.811481 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808102 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 19:03:29.811481 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808104 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 19:03:29.811481 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808107 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 19:03:29.811481 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808110 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 19:03:29.811481 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808113 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 19:03:29.811481 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808115 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 19:03:29.811481 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808119 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 19:03:29.811481 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808123 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 19:03:29.811481 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808126 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 19:03:29.811481 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808129 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 19:03:29.811481 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808132 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 19:03:29.811481 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808134 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 19:03:29.811481 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808137 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 19:03:29.811481 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808139 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 19:03:29.811481 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808142 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 19:03:29.812025 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808145 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 19:03:29.812025 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808148 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 19:03:29.812025 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808150 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 19:03:29.812025 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808153 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 19:03:29.812025 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808155 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 19:03:29.812025 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808158 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 19:03:29.812025 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:29.808160 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 19:03:29.812025 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.808165 2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 19:03:29.812025 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.808817 2569 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 19:03:29.812025 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.810759 2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 19:03:29.812025 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.811958 2569 server.go:1019] "Starting client certificate rotation" Jun 02 19:03:29.812296 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.812058 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 19:03:29.812955 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.812943 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 19:03:29.838582 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.838559 2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 19:03:29.839803 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.839782 2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 19:03:29.857239 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.857217 2569 log.go:25] "Validated CRI v1 runtime API" Jun 02 19:03:29.863373 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.863355 2569 log.go:25] "Validated CRI v1 image API" Jun 02 19:03:29.864565 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.864540 2569 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 19:03:29.869416 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.869395 2569 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a0964081-c595-4887-a2cc-61dd3c43cd72:/dev/nvme0n1p3 b001ceeb-3a5f-4fb9-9532-e5e8a6d3e5c3:/dev/nvme0n1p4] Jun 02 19:03:29.869493 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.869417 2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 19:03:29.873640 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.873623 2569 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 19:03:29.874250 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.874142 2569 manager.go:217] Machine: {Timestamp:2026-06-02 19:03:29.873616096 +0000 UTC m=+0.434419000 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3091762 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cea57f0977f4e98b482daf4ee09d1 SystemUUID:ec2cea57-f097-7f4e-98b4-82daf4ee09d1 BootID:1f9132bf-7cdd-4c6d-8c49-62281eda84d2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:92:c0:88:f9:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:92:c0:88:f9:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:d5:fe:32:48:05 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 19:03:29.875189 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.875178 2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 19:03:29.875313 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.875300 2569 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 19:03:29.877193 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.877171 2569 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 19:03:29.877330 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.877196 2569 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-50.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 19:03:29.877383 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.877339 2569 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 19:03:29.877383 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.877347 2569 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 19:03:29.877383 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.877355 2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 19:03:29.878156 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.878146 2569 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 19:03:29.879150 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.879140 2569 state_mem.go:36] "Initialized new in-memory state store" Jun 02 19:03:29.879458 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.879448 2569 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 19:03:29.882111 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.882101 2569 kubelet.go:491] "Attempting to sync node with API server" Jun 02 19:03:29.882145 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.882117 2569 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 19:03:29.882145 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.882131 2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 19:03:29.882145 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.882141 2569 kubelet.go:397] "Adding apiserver pod source" Jun 02 19:03:29.882236 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.882160 2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 19:03:29.883396 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.883384 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 19:03:29.883442 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.883403 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 19:03:29.886382 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.886368 2569 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 19:03:29.888113 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.888100 2569 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 19:03:29.890290 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.890271 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 19:03:29.890290 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.890287 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 19:03:29.890370 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.890297 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 19:03:29.890370 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.890306 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 19:03:29.890370 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.890320 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 19:03:29.890370 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.890328 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 19:03:29.890370 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.890337 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 19:03:29.890370 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.890345 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 19:03:29.890370 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.890360 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 19:03:29.890370 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.890370 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 19:03:29.890575 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.890382 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 19:03:29.890575 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.890391 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 19:03:29.892701 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.892688 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 19:03:29.892740 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.892704 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 19:03:29.897214 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.897193 2569 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-50.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 19:03:29.897546 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.897213 2569 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 19:03:29.897655 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.897644 2569 server.go:1295] "Started kubelet" Jun 02 19:03:29.898390 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:29.898362 2569 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-50.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 19:03:29.898390 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.898327 2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 19:03:29.898574 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.898524 2569 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 19:03:29.898664 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:29.898555 2569 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 19:03:29.898727 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.898696 2569 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 19:03:29.898992 ip-10-0-131-50 systemd[1]: Started Kubernetes Kubelet. Jun 02 19:03:29.899975 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.899959 2569 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 19:03:29.901040 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.901021 2569 server.go:317] "Adding debug handlers to kubelet server" Jun 02 19:03:29.904470 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.904455 2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 19:03:29.904598 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.904527 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 19:03:29.904754 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.904737 2569 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 19:03:29.904754 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.904755 2569 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 19:03:29.904857 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.904842 2569 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 19:03:29.904902 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.904890 2569 reconstruct.go:97] "Volume reconstruction finished" Jun 02 19:03:29.904902 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.904898 2569 reconciler.go:26] "Reconciler: start to sync state" Jun 02 19:03:29.905456 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.905438 2569 factory.go:55] Registering systemd factory Jun 02 19:03:29.905563 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.905553 2569 factory.go:223] Registration of the systemd container factory successfully Jun 02 19:03:29.905728 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:29.905497 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-50.ec2.internal\" not found" Jun 02 19:03:29.907405 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.907311 2569 factory.go:153] Registering CRI-O factory Jun 02 19:03:29.907405 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.907329 2569 factory.go:223] Registration of the crio container factory successfully Jun 02 19:03:29.907405 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.907377 2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 19:03:29.907405 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.907398 2569 factory.go:103] Registering Raw factory Jun 02 19:03:29.907628 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.907412 2569 manager.go:1196] Started watching for new ooms in manager Jun 02 19:03:29.908447 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:29.907342 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-50.ec2.internal.18b558eeb17449f6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-50.ec2.internal,UID:ip-10-0-131-50.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-50.ec2.internal,},FirstTimestamp:2026-06-02 19:03:29.897548278 +0000 UTC m=+0.458351179,LastTimestamp:2026-06-02 19:03:29.897548278 +0000 UTC m=+0.458351179,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-50.ec2.internal,}" Jun 02 19:03:29.908714 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.908661 2569 manager.go:319] Starting recovery of all containers Jun 02 19:03:29.913616 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:29.913585 2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-50.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 19:03:29.913760 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:29.913736 2569 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 19:03:29.915013 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.914990 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hg2vz" Jun 02 19:03:29.918531 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.918514 2569 manager.go:324] Recovery completed Jun 02 19:03:29.920056 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:29.920036 2569 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 02 19:03:29.922365 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.922350 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hg2vz" Jun 02 19:03:29.922794 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.922782 2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:03:29.924532 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.924517 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-50.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:03:29.924582 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.924547 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-50.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:03:29.924582 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.924558 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-50.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:03:29.925445 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.925425 2569 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 19:03:29.925445 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.925443 2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 19:03:29.925556 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.925462 2569 state_mem.go:36] "Initialized new in-memory state store" Jun 02 19:03:29.927125 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:29.927062 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-50.ec2.internal.18b558eeb3100d33 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-50.ec2.internal,UID:ip-10-0-131-50.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-50.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-50.ec2.internal,},FirstTimestamp:2026-06-02 19:03:29.924533555 +0000 UTC m=+0.485336452,LastTimestamp:2026-06-02 19:03:29.924533555 +0000 UTC m=+0.485336452,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-50.ec2.internal,}" Jun 02 19:03:29.927931 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.927917 2569 policy_none.go:49] "None policy: Start" Jun 02 19:03:29.927991 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.927936 2569 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 19:03:29.927991 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.927947 2569 state_mem.go:35] "Initializing new in-memory state store" Jun 02 19:03:29.960231 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.960211 2569 manager.go:341] "Starting Device Plugin manager" Jun 02 19:03:29.972602 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:29.960284 2569 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 19:03:29.972602 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.960299 2569 server.go:85] "Starting device plugin registration server" Jun 02 19:03:29.972602 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.960517 2569 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 19:03:29.972602 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.960526 2569 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 19:03:29.972602 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.960622 2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 19:03:29.972602 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.960754 2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 19:03:29.972602 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.960764 2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 19:03:29.972602 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:29.961482 2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 19:03:29.972602 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:29.961523 2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-50.ec2.internal\" not found" Jun 02 19:03:29.996281 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.996257 2569 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 19:03:29.997374 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.997361 2569 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 19:03:29.997434 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.997387 2569 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 19:03:29.997434 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.997406 2569 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 19:03:29.997434 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.997411 2569 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 19:03:29.997548 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:29.997445 2569 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 19:03:29.999908 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:29.999892 2569 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:03:30.061392 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.061301 2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:03:30.062375 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.062357 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-50.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:03:30.062453 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.062390 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-50.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:03:30.062453 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.062401 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-50.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:03:30.062453 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.062425 2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-50.ec2.internal" Jun 02 19:03:30.071559 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.071544 2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-50.ec2.internal" Jun 02 19:03:30.071614 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:30.071566 2569 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-50.ec2.internal\": node \"ip-10-0-131-50.ec2.internal\" not found" Jun 02 19:03:30.084292 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:30.084267 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-50.ec2.internal\" not found" Jun 02 19:03:30.097650 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.097631 2569 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-50.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-50.ec2.internal"] Jun 02 19:03:30.097713 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.097707 2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:03:30.098527 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.098512 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-50.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:03:30.098577 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.098538 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-50.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:03:30.098577 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.098548 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-50.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:03:30.099597 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.099582 2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:03:30.099777 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.099761 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-50.ec2.internal" Jun 02 19:03:30.099840 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.099800 2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:03:30.100306 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.100289 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-50.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:03:30.100306 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.100287 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-50.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:03:30.100399 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.100314 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-50.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:03:30.100399 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.100324 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-50.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:03:30.100399 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.100325 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-50.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:03:30.100399 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.100334 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-50.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:03:30.101294 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.101280 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-50.ec2.internal" Jun 02 19:03:30.101371 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.101302 2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:03:30.101985 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.101969 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-50.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:03:30.102073 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.101994 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-50.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:03:30.102073 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.102005 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-50.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:03:30.127277 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:30.127251 2569 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-50.ec2.internal\" not found" node="ip-10-0-131-50.ec2.internal" Jun 02 19:03:30.131656 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:30.131637 2569 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-50.ec2.internal\" not found" node="ip-10-0-131-50.ec2.internal" Jun 02 19:03:30.184404 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:30.184374 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-50.ec2.internal\" not found" Jun 02 19:03:30.205845 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.205817 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98115ce546e4d3244222024b59039f40-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-50.ec2.internal\" (UID: \"98115ce546e4d3244222024b59039f40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-50.ec2.internal" Jun 02 19:03:30.205845 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.205846 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98115ce546e4d3244222024b59039f40-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-50.ec2.internal\" (UID: \"98115ce546e4d3244222024b59039f40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-50.ec2.internal" Jun 02 19:03:30.206001 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.205866 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0f9e61bb920547c421ae35a4490f954e-config\") pod \"kube-apiserver-proxy-ip-10-0-131-50.ec2.internal\" (UID: \"0f9e61bb920547c421ae35a4490f954e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-50.ec2.internal" Jun 02 19:03:30.285170 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:30.285116 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-50.ec2.internal\" not found" Jun 02 19:03:30.306476 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.306458 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0f9e61bb920547c421ae35a4490f954e-config\") pod \"kube-apiserver-proxy-ip-10-0-131-50.ec2.internal\" (UID: \"0f9e61bb920547c421ae35a4490f954e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-50.ec2.internal" Jun 02 19:03:30.306582 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.306495 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98115ce546e4d3244222024b59039f40-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-50.ec2.internal\" (UID: \"98115ce546e4d3244222024b59039f40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-50.ec2.internal" Jun 02 19:03:30.306582 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.306512 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0f9e61bb920547c421ae35a4490f954e-config\") pod \"kube-apiserver-proxy-ip-10-0-131-50.ec2.internal\" (UID: \"0f9e61bb920547c421ae35a4490f954e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-50.ec2.internal" Jun 02 19:03:30.306582 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.306521 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98115ce546e4d3244222024b59039f40-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-50.ec2.internal\" (UID: \"98115ce546e4d3244222024b59039f40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-50.ec2.internal" Jun 02 19:03:30.306582 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.306548 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98115ce546e4d3244222024b59039f40-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-50.ec2.internal\" (UID: \"98115ce546e4d3244222024b59039f40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-50.ec2.internal" Jun 02 19:03:30.306735 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.306602 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98115ce546e4d3244222024b59039f40-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-50.ec2.internal\" (UID: \"98115ce546e4d3244222024b59039f40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-50.ec2.internal" Jun 02 19:03:30.385801 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:30.385729 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-50.ec2.internal\" not found" Jun 02 19:03:30.429199 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.429168 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-50.ec2.internal" Jun 02 19:03:30.434695 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.434656 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-50.ec2.internal" Jun 02 19:03:30.486175 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:30.486141 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-50.ec2.internal\" not found" Jun 02 19:03:30.586639 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:30.586593 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-50.ec2.internal\" not found" Jun 02 19:03:30.687157 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:30.687064 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-50.ec2.internal\" not found" Jun 02 19:03:30.787719 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:30.787658 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-50.ec2.internal\" not found" Jun 02 19:03:30.811065 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.811031 2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 19:03:30.811207 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.811191 2569 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 19:03:30.888547 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:30.888517 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-50.ec2.internal\" not found" Jun 02 19:03:30.905805 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.905781 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 19:03:30.913660 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.913640 2569 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 19:03:30.924618 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.924588 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 18:58:29 +0000 UTC" deadline="2027-12-26 19:38:20.027040983 +0000 UTC" Jun 02 19:03:30.924618 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.924616 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13728h34m49.102427727s" Jun 02 19:03:30.938615 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.938561 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mbv65" Jun 02 19:03:30.944554 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.944534 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mbv65" Jun 02 19:03:30.945227 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:30.945206 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98115ce546e4d3244222024b59039f40.slice/crio-55c17de94d8c7d03e681bb41a0fcb8e369dbf6cd05693bf6132e4fe979ff335d WatchSource:0}: Error finding container 55c17de94d8c7d03e681bb41a0fcb8e369dbf6cd05693bf6132e4fe979ff335d: Status 404 returned error can't find the container with id 55c17de94d8c7d03e681bb41a0fcb8e369dbf6cd05693bf6132e4fe979ff335d Jun 02 19:03:30.945397 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:30.945378 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f9e61bb920547c421ae35a4490f954e.slice/crio-f8ef56a8c599619653b118fd3301fa1e1da53bc0287035e5c8efe978c74815f8 WatchSource:0}: Error finding container f8ef56a8c599619653b118fd3301fa1e1da53bc0287035e5c8efe978c74815f8: Status 404 returned error can't find the container with id f8ef56a8c599619653b118fd3301fa1e1da53bc0287035e5c8efe978c74815f8 Jun 02 19:03:30.950643 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.950629 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 19:03:30.988749 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:30.988722 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-50.ec2.internal\" not found" Jun 02 19:03:30.993828 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.993807 2569 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:03:31.000027 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:30.999989 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-50.ec2.internal" event={"ID":"98115ce546e4d3244222024b59039f40","Type":"ContainerStarted","Data":"55c17de94d8c7d03e681bb41a0fcb8e369dbf6cd05693bf6132e4fe979ff335d"} Jun 02 19:03:31.000902 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.000873 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-50.ec2.internal" event={"ID":"0f9e61bb920547c421ae35a4490f954e","Type":"ContainerStarted","Data":"f8ef56a8c599619653b118fd3301fa1e1da53bc0287035e5c8efe978c74815f8"} Jun 02 19:03:31.023161 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.023139 2569 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:03:31.104878 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.104850 2569 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-50.ec2.internal" Jun 02 19:03:31.117870 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.117850 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 19:03:31.118971 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.118959 2569 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-50.ec2.internal" Jun 02 19:03:31.133428 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.133409 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 19:03:31.246829 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.246753 2569 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:03:31.717953 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.717882 2569 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:03:31.882948 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.882909 2569 apiserver.go:52] "Watching apiserver" Jun 02 19:03:31.890627 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.890598 2569 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 19:03:31.891103 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.891078 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-xbtzq","openshift-multus/network-metrics-daemon-4vsd7","openshift-network-operator/iptables-alerter-vnggx","openshift-ovn-kubernetes/ovnkube-node-xz76r","kube-system/kube-apiserver-proxy-ip-10-0-131-50.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qdbck","openshift-dns/node-resolver-rrknd","openshift-image-registry/node-ca-nqr8d","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-50.ec2.internal","openshift-multus/multus-additional-cni-plugins-7k55l","openshift-network-diagnostics/network-check-target-qxvtt","kube-system/konnectivity-agent-fdb42","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw"] Jun 02 19:03:31.893138 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.893119 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rrknd" Jun 02 19:03:31.893964 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.893932 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:03:31.894048 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:31.894022 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsd7" podUID="18ce0d3d-f461-41fa-95fa-9bb77c484d5d" Jun 02 19:03:31.894098 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.894043 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vnggx" Jun 02 19:03:31.895143 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.895126 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:31.895720 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.895696 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 19:03:31.895847 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.895738 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 19:03:31.895847 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.895750 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x2nh6\"" Jun 02 19:03:31.896379 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.896123 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:31.896379 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.896196 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:03:31.896379 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.896196 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 19:03:31.896626 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.896588 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 19:03:31.896748 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.896727 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d5km9\"" Jun 02 19:03:31.897403 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.897355 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 19:03:31.897485 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.897449 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 19:03:31.897660 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.897636 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 19:03:31.897826 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.897806 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 19:03:31.897927 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.897824 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 19:03:31.897983 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.897824 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tsxxb\"" Jun 02 19:03:31.899185 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.898999 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:03:31.899185 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.899098 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 19:03:31.901356 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.899667 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gx4jp\"" Jun 02 19:03:31.901356 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.899747 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xbtzq" Jun 02 19:03:31.901356 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.900013 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 19:03:31.901906 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.901885 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 19:03:31.902445 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.902290 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 19:03:31.902445 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.902383 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 19:03:31.902551 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.902383 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 19:03:31.903450 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.902749 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nqr8d" Jun 02 19:03:31.903450 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.902986 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vd2ql\"" Jun 02 19:03:31.903450 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.903157 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:31.904981 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.904828 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 19:03:31.904981 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.904821 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 19:03:31.904981 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.904890 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rn5j8\"" Jun 02 19:03:31.905186 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.905151 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rmtdt\"" Jun 02 19:03:31.905186 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.905172 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:03:31.905288 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:31.905248 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qxvtt" podUID="14752c98-15e2-4594-baee-21a0d3c49b1e" Jun 02 19:03:31.905341 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.905325 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 19:03:31.906134 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.906114 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 19:03:31.906221 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.906188 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fdb42" Jun 02 19:03:31.906623 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.906539 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 19:03:31.907422 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.907406 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" Jun 02 19:03:31.908037 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.908020 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 19:03:31.908126 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.908079 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 19:03:31.908370 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.908351 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lw2pg\"" Jun 02 19:03:31.908869 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.908854 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cksjb\"" Jun 02 19:03:31.909276 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.909257 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 19:03:31.909276 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.909270 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 19:03:31.909419 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.909393 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 19:03:31.916018 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.915995 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-etc-sysconfig\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:31.916148 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916026 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-host-run-netns\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:31.916148 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916054 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/597d1a89-5f63-4e9e-9c43-6d841864384a-hosts-file\") pod \"node-resolver-rrknd\" (UID: \"597d1a89-5f63-4e9e-9c43-6d841864384a\") " pod="openshift-dns/node-resolver-rrknd" Jun 02 19:03:31.916148 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916097 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-host-slash\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:31.916329 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916144 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:31.916329 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916184 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-run\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:31.916329 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916212 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-etc-kubernetes\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:31.916329 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916244 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-sys\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:31.916329 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916274 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrn45\" (UniqueName: \"kubernetes.io/projected/a4288a48-a796-43e5-b664-8c86fc11ebc3-kube-api-access-xrn45\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:31.916329 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916298 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26230ee1-9ed4-472f-9b1c-26724eddd354-cni-binary-copy\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:31.916329 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916328 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-run-systemd\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:31.916639 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916352 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6d38637d-caa3-4eb1-a749-9fe24430d039-ovn-node-metrics-cert\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:31.916639 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916391 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-multus-socket-dir-parent\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:31.916639 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916425 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-host-run-multus-certs\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:31.916639 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916465 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-systemd-units\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:31.916639 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916489 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-node-log\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:31.916639 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916519 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-host-cni-bin\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:31.916639 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916542 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-os-release\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:31.916639 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916564 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcgmj\" (UniqueName: \"kubernetes.io/projected/26230ee1-9ed4-472f-9b1c-26724eddd354-kube-api-access-tcgmj\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:31.916639 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916581 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a534831c-1da1-4acc-85ae-6e089da15b9c-host\") pod \"node-ca-nqr8d\" (UID: \"a534831c-1da1-4acc-85ae-6e089da15b9c\") " pod="openshift-image-registry/node-ca-nqr8d" Jun 02 19:03:31.916639 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916612 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d1ae20d8-d6b8-4375-8568-94b4accc60a3-konnectivity-ca\") pod \"konnectivity-agent-fdb42\" (UID: \"d1ae20d8-d6b8-4375-8568-94b4accc60a3\") " pod="kube-system/konnectivity-agent-fdb42" Jun 02 19:03:31.916639 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916643 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-etc-openvswitch\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:31.917118 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916666 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-etc-systemd\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:31.917118 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916711 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-system-cni-dir\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:31.917118 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916740 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a534831c-1da1-4acc-85ae-6e089da15b9c-serviceca\") pod \"node-ca-nqr8d\" (UID: \"a534831c-1da1-4acc-85ae-6e089da15b9c\") " pod="openshift-image-registry/node-ca-nqr8d" Jun 02 19:03:31.917118 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916775 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfk6c\" (UniqueName: \"kubernetes.io/projected/597d1a89-5f63-4e9e-9c43-6d841864384a-kube-api-access-wfk6c\") pod \"node-resolver-rrknd\" (UID: \"597d1a89-5f63-4e9e-9c43-6d841864384a\") " pod="openshift-dns/node-resolver-rrknd" Jun 02 19:03:31.917118 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916800 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d1ae20d8-d6b8-4375-8568-94b4accc60a3-agent-certs\") pod \"konnectivity-agent-fdb42\" (UID: \"d1ae20d8-d6b8-4375-8568-94b4accc60a3\") " pod="kube-system/konnectivity-agent-fdb42" Jun 02 19:03:31.917118 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916827 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-var-lib-openvswitch\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:31.917118 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916849 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6d38637d-caa3-4eb1-a749-9fe24430d039-ovnkube-script-lib\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:31.917118 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916875 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a715f5f5-4d65-4ab8-a7f4-f8949cd9a429-host-slash\") pod \"iptables-alerter-vnggx\" (UID: \"a715f5f5-4d65-4ab8-a7f4-f8949cd9a429\") " pod="openshift-network-operator/iptables-alerter-vnggx" Jun 02 19:03:31.917118 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916904 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-run-ovn\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:31.917118 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916927 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs\") pod \"network-metrics-daemon-4vsd7\" (UID: \"18ce0d3d-f461-41fa-95fa-9bb77c484d5d\") " pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:03:31.917118 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916970 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-host-kubelet\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:31.917118 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.916991 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-host-run-netns\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:31.917118 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917023 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-lib-modules\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:31.917118 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917040 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4288a48-a796-43e5-b664-8c86fc11ebc3-tmp\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:31.917118 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917059 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-host-run-ovn-kubernetes\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:31.917118 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917082 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a574bbc7-9afe-4c8a-9319-39c5a32a63b9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7k55l\" (UID: \"a574bbc7-9afe-4c8a-9319-39c5a32a63b9\") " pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:31.917866 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917125 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm8xb\" (UniqueName: \"kubernetes.io/projected/a715f5f5-4d65-4ab8-a7f4-f8949cd9a429-kube-api-access-jm8xb\") pod \"iptables-alerter-vnggx\" (UID: \"a715f5f5-4d65-4ab8-a7f4-f8949cd9a429\") " pod="openshift-network-operator/iptables-alerter-vnggx" Jun 02 19:03:31.917866 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917167 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-log-socket\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:31.917866 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917195 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/26230ee1-9ed4-472f-9b1c-26724eddd354-multus-daemon-config\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:31.917866 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917218 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/597d1a89-5f63-4e9e-9c43-6d841864384a-tmp-dir\") pod \"node-resolver-rrknd\" (UID: \"597d1a89-5f63-4e9e-9c43-6d841864384a\") " pod="openshift-dns/node-resolver-rrknd" Jun 02 19:03:31.917866 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917247 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a574bbc7-9afe-4c8a-9319-39c5a32a63b9-os-release\") pod \"multus-additional-cni-plugins-7k55l\" (UID: \"a574bbc7-9afe-4c8a-9319-39c5a32a63b9\") " pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:31.917866 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917269 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a574bbc7-9afe-4c8a-9319-39c5a32a63b9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7k55l\" (UID: \"a574bbc7-9afe-4c8a-9319-39c5a32a63b9\") " pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:31.917866 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917292 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7rzd\" (UniqueName: \"kubernetes.io/projected/a574bbc7-9afe-4c8a-9319-39c5a32a63b9-kube-api-access-t7rzd\") pod \"multus-additional-cni-plugins-7k55l\" (UID: \"a574bbc7-9afe-4c8a-9319-39c5a32a63b9\") " pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:31.917866 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917315 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6d38637d-caa3-4eb1-a749-9fe24430d039-env-overrides\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:31.917866 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917335 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-etc-sysctl-conf\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:31.917866 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917361 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-host-var-lib-cni-multus\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:31.917866 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917383 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a574bbc7-9afe-4c8a-9319-39c5a32a63b9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7k55l\" (UID: \"a574bbc7-9afe-4c8a-9319-39c5a32a63b9\") " pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:31.917866 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917406 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-host\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:31.917866 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917428 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a4288a48-a796-43e5-b664-8c86fc11ebc3-etc-tuned\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:31.917866 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917452 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-host-run-k8s-cni-cncf-io\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:31.917866 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917478 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a574bbc7-9afe-4c8a-9319-39c5a32a63b9-cnibin\") pod \"multus-additional-cni-plugins-7k55l\" (UID: \"a574bbc7-9afe-4c8a-9319-39c5a32a63b9\") " pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:31.917866 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917503 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-run-openvswitch\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:31.918521 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917528 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-host-cni-netd\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:31.918521 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917601 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6d38637d-caa3-4eb1-a749-9fe24430d039-ovnkube-config\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:31.918521 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917637 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-etc-modprobe-d\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:31.918521 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917662 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-cnibin\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:31.918521 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917718 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-host-var-lib-cni-bin\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:31.918521 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917742 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-multus-conf-dir\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:31.918521 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917771 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a715f5f5-4d65-4ab8-a7f4-f8949cd9a429-iptables-alerter-script\") pod \"iptables-alerter-vnggx\" (UID: \"a715f5f5-4d65-4ab8-a7f4-f8949cd9a429\") " pod="openshift-network-operator/iptables-alerter-vnggx" Jun 02 19:03:31.918521 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917792 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-var-lib-kubelet\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:31.918521 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917831 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-host-var-lib-kubelet\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:31.918521 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917866 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-hostroot\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:31.918521 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917889 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbr6r\" (UniqueName: \"kubernetes.io/projected/a534831c-1da1-4acc-85ae-6e089da15b9c-kube-api-access-dbr6r\") pod \"node-ca-nqr8d\" (UID: \"a534831c-1da1-4acc-85ae-6e089da15b9c\") " pod="openshift-image-registry/node-ca-nqr8d" Jun 02 19:03:31.918521 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917926 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk89j\" (UniqueName: \"kubernetes.io/projected/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-kube-api-access-jk89j\") pod \"network-metrics-daemon-4vsd7\" (UID: \"18ce0d3d-f461-41fa-95fa-9bb77c484d5d\") " pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:03:31.918521 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917947 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a574bbc7-9afe-4c8a-9319-39c5a32a63b9-cni-binary-copy\") pod \"multus-additional-cni-plugins-7k55l\" (UID: \"a574bbc7-9afe-4c8a-9319-39c5a32a63b9\") " pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:31.918521 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917970 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6tlp\" (UniqueName: \"kubernetes.io/projected/6d38637d-caa3-4eb1-a749-9fe24430d039-kube-api-access-p6tlp\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:31.918521 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.917993 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-etc-sysctl-d\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:31.918521 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.918014 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-multus-cni-dir\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:31.919201 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.918037 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a574bbc7-9afe-4c8a-9319-39c5a32a63b9-system-cni-dir\") pod \"multus-additional-cni-plugins-7k55l\" (UID: \"a574bbc7-9afe-4c8a-9319-39c5a32a63b9\") " pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:31.919201 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.918062 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnwtz\" (UniqueName: \"kubernetes.io/projected/14752c98-15e2-4594-baee-21a0d3c49b1e-kube-api-access-lnwtz\") pod \"network-check-target-qxvtt\" (UID: \"14752c98-15e2-4594-baee-21a0d3c49b1e\") " pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:03:31.919201 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.918086 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-etc-kubernetes\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:31.945284 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.945255 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 18:58:30 +0000 UTC" deadline="2028-01-30 09:02:15.359900253 +0000 UTC" Jun 02 19:03:31.945370 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:31.945285 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14557h58m43.414618113s" Jun 02 19:03:32.005412 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.005349 2569 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 19:03:32.019073 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019045 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-os-release\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.019073 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019076 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tcgmj\" (UniqueName: \"kubernetes.io/projected/26230ee1-9ed4-472f-9b1c-26724eddd354-kube-api-access-tcgmj\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.019316 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019099 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a534831c-1da1-4acc-85ae-6e089da15b9c-host\") pod \"node-ca-nqr8d\" (UID: \"a534831c-1da1-4acc-85ae-6e089da15b9c\") " pod="openshift-image-registry/node-ca-nqr8d" Jun 02 19:03:32.019316 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019116 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d1ae20d8-d6b8-4375-8568-94b4accc60a3-konnectivity-ca\") pod \"konnectivity-agent-fdb42\" (UID: \"d1ae20d8-d6b8-4375-8568-94b4accc60a3\") " pod="kube-system/konnectivity-agent-fdb42" Jun 02 19:03:32.019316 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019132 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-etc-openvswitch\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.019316 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019147 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-etc-systemd\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.019316 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019174 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-system-cni-dir\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.019316 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019185 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a534831c-1da1-4acc-85ae-6e089da15b9c-host\") pod \"node-ca-nqr8d\" (UID: \"a534831c-1da1-4acc-85ae-6e089da15b9c\") " pod="openshift-image-registry/node-ca-nqr8d" Jun 02 19:03:32.019316 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019216 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a534831c-1da1-4acc-85ae-6e089da15b9c-serviceca\") pod \"node-ca-nqr8d\" (UID: \"a534831c-1da1-4acc-85ae-6e089da15b9c\") " pod="openshift-image-registry/node-ca-nqr8d" Jun 02 19:03:32.019316 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019245 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wfk6c\" (UniqueName: \"kubernetes.io/projected/597d1a89-5f63-4e9e-9c43-6d841864384a-kube-api-access-wfk6c\") pod \"node-resolver-rrknd\" (UID: \"597d1a89-5f63-4e9e-9c43-6d841864384a\") " pod="openshift-dns/node-resolver-rrknd" Jun 02 19:03:32.019316 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019268 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-etc-systemd\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.019316 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019272 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d1ae20d8-d6b8-4375-8568-94b4accc60a3-agent-certs\") pod \"konnectivity-agent-fdb42\" (UID: \"d1ae20d8-d6b8-4375-8568-94b4accc60a3\") " pod="kube-system/konnectivity-agent-fdb42" Jun 02 19:03:32.019316 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019275 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-system-cni-dir\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.019316 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019216 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-etc-openvswitch\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.019316 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019299 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-var-lib-openvswitch\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.019316 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019325 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6d38637d-caa3-4eb1-a749-9fe24430d039-ovnkube-script-lib\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.019956 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019348 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a715f5f5-4d65-4ab8-a7f4-f8949cd9a429-host-slash\") pod \"iptables-alerter-vnggx\" (UID: \"a715f5f5-4d65-4ab8-a7f4-f8949cd9a429\") " pod="openshift-network-operator/iptables-alerter-vnggx" Jun 02 19:03:32.019956 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019371 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-run-ovn\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.019956 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019402 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs\") pod \"network-metrics-daemon-4vsd7\" (UID: \"18ce0d3d-f461-41fa-95fa-9bb77c484d5d\") " pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:03:32.019956 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019436 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc4sw\" (UniqueName: \"kubernetes.io/projected/20a7d510-3c6c-444e-930e-f77bc4d392f7-kube-api-access-zc4sw\") pod \"aws-ebs-csi-driver-node-2pzvw\" (UID: \"20a7d510-3c6c-444e-930e-f77bc4d392f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" Jun 02 19:03:32.019956 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019436 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-os-release\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.019956 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019463 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-host-kubelet\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.019956 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019487 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-host-run-netns\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.019956 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019495 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a715f5f5-4d65-4ab8-a7f4-f8949cd9a429-host-slash\") pod \"iptables-alerter-vnggx\" (UID: \"a715f5f5-4d65-4ab8-a7f4-f8949cd9a429\") " pod="openshift-network-operator/iptables-alerter-vnggx" Jun 02 19:03:32.019956 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019519 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-lib-modules\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.019956 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019539 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-var-lib-openvswitch\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.019956 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019542 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4288a48-a796-43e5-b664-8c86fc11ebc3-tmp\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.019956 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019575 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-host-run-ovn-kubernetes\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.019956 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019608 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/20a7d510-3c6c-444e-930e-f77bc4d392f7-socket-dir\") pod \"aws-ebs-csi-driver-node-2pzvw\" (UID: \"20a7d510-3c6c-444e-930e-f77bc4d392f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" Jun 02 19:03:32.019956 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019636 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a574bbc7-9afe-4c8a-9319-39c5a32a63b9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7k55l\" (UID: \"a574bbc7-9afe-4c8a-9319-39c5a32a63b9\") " pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:32.019956 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019699 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jm8xb\" (UniqueName: \"kubernetes.io/projected/a715f5f5-4d65-4ab8-a7f4-f8949cd9a429-kube-api-access-jm8xb\") pod \"iptables-alerter-vnggx\" (UID: \"a715f5f5-4d65-4ab8-a7f4-f8949cd9a429\") " pod="openshift-network-operator/iptables-alerter-vnggx" Jun 02 19:03:32.019956 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019727 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-log-socket\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.019956 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019734 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a534831c-1da1-4acc-85ae-6e089da15b9c-serviceca\") pod \"node-ca-nqr8d\" (UID: \"a534831c-1da1-4acc-85ae-6e089da15b9c\") " pod="openshift-image-registry/node-ca-nqr8d" Jun 02 19:03:32.020750 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019754 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/26230ee1-9ed4-472f-9b1c-26724eddd354-multus-daemon-config\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.020750 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019787 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/597d1a89-5f63-4e9e-9c43-6d841864384a-tmp-dir\") pod \"node-resolver-rrknd\" (UID: \"597d1a89-5f63-4e9e-9c43-6d841864384a\") " pod="openshift-dns/node-resolver-rrknd" Jun 02 19:03:32.020750 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019791 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d1ae20d8-d6b8-4375-8568-94b4accc60a3-konnectivity-ca\") pod \"konnectivity-agent-fdb42\" (UID: \"d1ae20d8-d6b8-4375-8568-94b4accc60a3\") " pod="kube-system/konnectivity-agent-fdb42" Jun 02 19:03:32.020750 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019811 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a574bbc7-9afe-4c8a-9319-39c5a32a63b9-os-release\") pod \"multus-additional-cni-plugins-7k55l\" (UID: \"a574bbc7-9afe-4c8a-9319-39c5a32a63b9\") " pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:32.020750 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019836 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-lib-modules\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.020750 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019845 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a574bbc7-9afe-4c8a-9319-39c5a32a63b9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7k55l\" (UID: \"a574bbc7-9afe-4c8a-9319-39c5a32a63b9\") " pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:32.020750 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019866 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-log-socket\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.020750 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019895 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7rzd\" (UniqueName: \"kubernetes.io/projected/a574bbc7-9afe-4c8a-9319-39c5a32a63b9-kube-api-access-t7rzd\") pod \"multus-additional-cni-plugins-7k55l\" (UID: \"a574bbc7-9afe-4c8a-9319-39c5a32a63b9\") " pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:32.020750 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019898 2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 19:03:32.020750 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019926 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6d38637d-caa3-4eb1-a749-9fe24430d039-env-overrides\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.020750 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019953 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-etc-sysctl-conf\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.020750 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019976 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a574bbc7-9afe-4c8a-9319-39c5a32a63b9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7k55l\" (UID: \"a574bbc7-9afe-4c8a-9319-39c5a32a63b9\") " pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:32.020750 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020016 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-host-var-lib-cni-multus\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.020750 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020023 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-run-ovn\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.020750 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020086 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6d38637d-caa3-4eb1-a749-9fe24430d039-ovnkube-script-lib\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.020750 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:32.020109 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:32.020750 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020162 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-host-run-ovn-kubernetes\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.021509 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:32.020179 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs podName:18ce0d3d-f461-41fa-95fa-9bb77c484d5d nodeName:}" failed. No retries permitted until 2026-06-02 19:03:32.520158275 +0000 UTC m=+3.080961163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs") pod "network-metrics-daemon-4vsd7" (UID: "18ce0d3d-f461-41fa-95fa-9bb77c484d5d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:32.021509 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.019975 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-host-var-lib-cni-multus\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.021509 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020228 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a574bbc7-9afe-4c8a-9319-39c5a32a63b9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7k55l\" (UID: \"a574bbc7-9afe-4c8a-9319-39c5a32a63b9\") " pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:32.021509 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020260 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-host\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.021509 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020092 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a574bbc7-9afe-4c8a-9319-39c5a32a63b9-os-release\") pod \"multus-additional-cni-plugins-7k55l\" (UID: \"a574bbc7-9afe-4c8a-9319-39c5a32a63b9\") " pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:32.021509 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020287 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a4288a48-a796-43e5-b664-8c86fc11ebc3-etc-tuned\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.021509 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020323 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-host-run-k8s-cni-cncf-io\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.021509 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020356 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/20a7d510-3c6c-444e-930e-f77bc4d392f7-device-dir\") pod \"aws-ebs-csi-driver-node-2pzvw\" (UID: \"20a7d510-3c6c-444e-930e-f77bc4d392f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" Jun 02 19:03:32.021509 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020383 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/20a7d510-3c6c-444e-930e-f77bc4d392f7-etc-selinux\") pod \"aws-ebs-csi-driver-node-2pzvw\" (UID: \"20a7d510-3c6c-444e-930e-f77bc4d392f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" Jun 02 19:03:32.021509 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020410 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a574bbc7-9afe-4c8a-9319-39c5a32a63b9-cnibin\") pod \"multus-additional-cni-plugins-7k55l\" (UID: \"a574bbc7-9afe-4c8a-9319-39c5a32a63b9\") " pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:32.021509 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020422 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-host-run-netns\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.021509 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020437 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-run-openvswitch\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.021509 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020464 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-host-cni-netd\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.021509 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020478 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-host-kubelet\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.021509 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020490 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6d38637d-caa3-4eb1-a749-9fe24430d039-ovnkube-config\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.021509 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020514 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-etc-modprobe-d\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.022157 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020521 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a574bbc7-9afe-4c8a-9319-39c5a32a63b9-cnibin\") pod \"multus-additional-cni-plugins-7k55l\" (UID: \"a574bbc7-9afe-4c8a-9319-39c5a32a63b9\") " pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:32.022157 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020541 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-cnibin\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.022157 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020556 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-host-run-k8s-cni-cncf-io\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.022157 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020566 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-host-var-lib-cni-bin\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.022157 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020612 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-host-var-lib-cni-bin\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.022157 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020628 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6d38637d-caa3-4eb1-a749-9fe24430d039-env-overrides\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.022157 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020641 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-multus-conf-dir\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.022157 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020697 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-multus-conf-dir\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.022157 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020698 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a715f5f5-4d65-4ab8-a7f4-f8949cd9a429-iptables-alerter-script\") pod \"iptables-alerter-vnggx\" (UID: \"a715f5f5-4d65-4ab8-a7f4-f8949cd9a429\") " pod="openshift-network-operator/iptables-alerter-vnggx" Jun 02 19:03:32.022157 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020705 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/26230ee1-9ed4-472f-9b1c-26724eddd354-multus-daemon-config\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.022157 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020730 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-var-lib-kubelet\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.022157 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020769 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-host-var-lib-kubelet\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.022157 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020801 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-hostroot\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.022157 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020828 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dbr6r\" (UniqueName: \"kubernetes.io/projected/a534831c-1da1-4acc-85ae-6e089da15b9c-kube-api-access-dbr6r\") pod \"node-ca-nqr8d\" (UID: \"a534831c-1da1-4acc-85ae-6e089da15b9c\") " pod="openshift-image-registry/node-ca-nqr8d" Jun 02 19:03:32.022157 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020856 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jk89j\" (UniqueName: \"kubernetes.io/projected/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-kube-api-access-jk89j\") pod \"network-metrics-daemon-4vsd7\" (UID: \"18ce0d3d-f461-41fa-95fa-9bb77c484d5d\") " pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:03:32.022157 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020832 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-host-cni-netd\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.022157 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020884 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/20a7d510-3c6c-444e-930e-f77bc4d392f7-registration-dir\") pod \"aws-ebs-csi-driver-node-2pzvw\" (UID: \"20a7d510-3c6c-444e-930e-f77bc4d392f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" Jun 02 19:03:32.022709 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020908 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a574bbc7-9afe-4c8a-9319-39c5a32a63b9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7k55l\" (UID: \"a574bbc7-9afe-4c8a-9319-39c5a32a63b9\") " pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:32.022709 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020915 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a574bbc7-9afe-4c8a-9319-39c5a32a63b9-cni-binary-copy\") pod \"multus-additional-cni-plugins-7k55l\" (UID: \"a574bbc7-9afe-4c8a-9319-39c5a32a63b9\") " pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:32.022709 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020922 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/597d1a89-5f63-4e9e-9c43-6d841864384a-tmp-dir\") pod \"node-resolver-rrknd\" (UID: \"597d1a89-5f63-4e9e-9c43-6d841864384a\") " pod="openshift-dns/node-resolver-rrknd" Jun 02 19:03:32.022709 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020941 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6tlp\" (UniqueName: \"kubernetes.io/projected/6d38637d-caa3-4eb1-a749-9fe24430d039-kube-api-access-p6tlp\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.022709 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020965 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-etc-sysctl-d\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.022709 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020986 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-multus-cni-dir\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.022709 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021013 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/20a7d510-3c6c-444e-930e-f77bc4d392f7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2pzvw\" (UID: \"20a7d510-3c6c-444e-930e-f77bc4d392f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" Jun 02 19:03:32.022709 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021020 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-etc-modprobe-d\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.022709 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021041 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a574bbc7-9afe-4c8a-9319-39c5a32a63b9-system-cni-dir\") pod \"multus-additional-cni-plugins-7k55l\" (UID: \"a574bbc7-9afe-4c8a-9319-39c5a32a63b9\") " pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:32.022709 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021070 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lnwtz\" (UniqueName: \"kubernetes.io/projected/14752c98-15e2-4594-baee-21a0d3c49b1e-kube-api-access-lnwtz\") pod \"network-check-target-qxvtt\" (UID: \"14752c98-15e2-4594-baee-21a0d3c49b1e\") " pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:03:32.022709 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021096 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-etc-kubernetes\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.022709 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021120 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-etc-sysconfig\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.022709 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021146 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-host-run-netns\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.022709 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021170 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/597d1a89-5f63-4e9e-9c43-6d841864384a-hosts-file\") pod \"node-resolver-rrknd\" (UID: \"597d1a89-5f63-4e9e-9c43-6d841864384a\") " pod="openshift-dns/node-resolver-rrknd" Jun 02 19:03:32.022709 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021192 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-host-slash\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.022709 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021199 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a715f5f5-4d65-4ab8-a7f4-f8949cd9a429-iptables-alerter-script\") pod \"iptables-alerter-vnggx\" (UID: \"a715f5f5-4d65-4ab8-a7f4-f8949cd9a429\") " pod="openshift-network-operator/iptables-alerter-vnggx" Jun 02 19:03:32.022709 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021226 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.023267 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021253 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-run\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.023267 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021255 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-etc-sysctl-conf\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.023267 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021273 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-cnibin\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.023267 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021277 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-etc-kubernetes\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.023267 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021307 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-host-var-lib-kubelet\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.023267 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021316 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-etc-kubernetes\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.023267 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020802 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-run-openvswitch\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.023267 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020773 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-var-lib-kubelet\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.023267 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021373 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-etc-kubernetes\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.023267 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021376 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-host\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.023267 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021379 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-etc-sysconfig\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.023267 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021388 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6d38637d-caa3-4eb1-a749-9fe24430d039-ovnkube-config\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.023267 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021415 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-host-run-netns\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.023267 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021449 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-host-slash\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.023267 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021461 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a574bbc7-9afe-4c8a-9319-39c5a32a63b9-cni-binary-copy\") pod \"multus-additional-cni-plugins-7k55l\" (UID: \"a574bbc7-9afe-4c8a-9319-39c5a32a63b9\") " pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:32.023267 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021467 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-run\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.023267 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.020433 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a574bbc7-9afe-4c8a-9319-39c5a32a63b9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7k55l\" (UID: \"a574bbc7-9afe-4c8a-9319-39c5a32a63b9\") " pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:32.023267 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021310 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/20a7d510-3c6c-444e-930e-f77bc4d392f7-sys-fs\") pod \"aws-ebs-csi-driver-node-2pzvw\" (UID: \"20a7d510-3c6c-444e-930e-f77bc4d392f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" Jun 02 19:03:32.023795 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021509 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/597d1a89-5f63-4e9e-9c43-6d841864384a-hosts-file\") pod \"node-resolver-rrknd\" (UID: \"597d1a89-5f63-4e9e-9c43-6d841864384a\") " pod="openshift-dns/node-resolver-rrknd" Jun 02 19:03:32.023795 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021516 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-sys\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.023795 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021535 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a574bbc7-9afe-4c8a-9319-39c5a32a63b9-system-cni-dir\") pod \"multus-additional-cni-plugins-7k55l\" (UID: \"a574bbc7-9afe-4c8a-9319-39c5a32a63b9\") " pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:32.023795 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021542 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xrn45\" (UniqueName: \"kubernetes.io/projected/a4288a48-a796-43e5-b664-8c86fc11ebc3-kube-api-access-xrn45\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.023795 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021545 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-hostroot\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.023795 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021572 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26230ee1-9ed4-472f-9b1c-26724eddd354-cni-binary-copy\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.023795 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021602 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.023795 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021635 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-run-systemd\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.023795 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021648 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-etc-sysctl-d\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.023795 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021731 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4288a48-a796-43e5-b664-8c86fc11ebc3-sys\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.023795 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021718 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-multus-cni-dir\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.023795 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021602 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-run-systemd\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.023795 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021777 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6d38637d-caa3-4eb1-a749-9fe24430d039-ovn-node-metrics-cert\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.023795 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021806 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-multus-socket-dir-parent\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.023795 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021834 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-host-run-multus-certs\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.023795 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021862 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-systemd-units\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.023795 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021880 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-multus-socket-dir-parent\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.023795 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021891 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-node-log\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.024421 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021891 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/26230ee1-9ed4-472f-9b1c-26724eddd354-host-run-multus-certs\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.024421 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021932 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-systemd-units\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.024421 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021944 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-node-log\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.024421 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.021963 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-host-cni-bin\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.024421 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.022024 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6d38637d-caa3-4eb1-a749-9fe24430d039-host-cni-bin\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.024421 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.022758 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4288a48-a796-43e5-b664-8c86fc11ebc3-tmp\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.024421 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.022851 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26230ee1-9ed4-472f-9b1c-26724eddd354-cni-binary-copy\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.024421 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.023064 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a4288a48-a796-43e5-b664-8c86fc11ebc3-etc-tuned\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.024421 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.024332 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d1ae20d8-d6b8-4375-8568-94b4accc60a3-agent-certs\") pod \"konnectivity-agent-fdb42\" (UID: \"d1ae20d8-d6b8-4375-8568-94b4accc60a3\") " pod="kube-system/konnectivity-agent-fdb42" Jun 02 19:03:32.024421 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.024381 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6d38637d-caa3-4eb1-a749-9fe24430d039-ovn-node-metrics-cert\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.028454 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.028423 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcgmj\" (UniqueName: \"kubernetes.io/projected/26230ee1-9ed4-472f-9b1c-26724eddd354-kube-api-access-tcgmj\") pod \"multus-xbtzq\" (UID: \"26230ee1-9ed4-472f-9b1c-26724eddd354\") " pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.029076 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.029054 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7rzd\" (UniqueName: \"kubernetes.io/projected/a574bbc7-9afe-4c8a-9319-39c5a32a63b9-kube-api-access-t7rzd\") pod \"multus-additional-cni-plugins-7k55l\" (UID: \"a574bbc7-9afe-4c8a-9319-39c5a32a63b9\") " pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:32.031629 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:32.031607 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:03:32.031749 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:32.031633 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:03:32.031749 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:32.031646 2569 projected.go:194] Error preparing data for projected volume kube-api-access-lnwtz for pod openshift-network-diagnostics/network-check-target-qxvtt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:32.031855 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:32.031794 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14752c98-15e2-4594-baee-21a0d3c49b1e-kube-api-access-lnwtz podName:14752c98-15e2-4594-baee-21a0d3c49b1e nodeName:}" failed. No retries permitted until 2026-06-02 19:03:32.531774028 +0000 UTC m=+3.092576942 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lnwtz" (UniqueName: "kubernetes.io/projected/14752c98-15e2-4594-baee-21a0d3c49b1e-kube-api-access-lnwtz") pod "network-check-target-qxvtt" (UID: "14752c98-15e2-4594-baee-21a0d3c49b1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:32.033198 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.033143 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm8xb\" (UniqueName: \"kubernetes.io/projected/a715f5f5-4d65-4ab8-a7f4-f8949cd9a429-kube-api-access-jm8xb\") pod \"iptables-alerter-vnggx\" (UID: \"a715f5f5-4d65-4ab8-a7f4-f8949cd9a429\") " pod="openshift-network-operator/iptables-alerter-vnggx" Jun 02 19:03:32.033452 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.033429 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrn45\" (UniqueName: \"kubernetes.io/projected/a4288a48-a796-43e5-b664-8c86fc11ebc3-kube-api-access-xrn45\") pod \"tuned-qdbck\" (UID: \"a4288a48-a796-43e5-b664-8c86fc11ebc3\") " pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.033811 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.033769 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk89j\" (UniqueName: \"kubernetes.io/projected/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-kube-api-access-jk89j\") pod \"network-metrics-daemon-4vsd7\" (UID: \"18ce0d3d-f461-41fa-95fa-9bb77c484d5d\") " pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:03:32.034059 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.034040 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6tlp\" (UniqueName: \"kubernetes.io/projected/6d38637d-caa3-4eb1-a749-9fe24430d039-kube-api-access-p6tlp\") pod \"ovnkube-node-xz76r\" (UID: \"6d38637d-caa3-4eb1-a749-9fe24430d039\") " pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.034595 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.034575 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfk6c\" (UniqueName: \"kubernetes.io/projected/597d1a89-5f63-4e9e-9c43-6d841864384a-kube-api-access-wfk6c\") pod \"node-resolver-rrknd\" (UID: \"597d1a89-5f63-4e9e-9c43-6d841864384a\") " pod="openshift-dns/node-resolver-rrknd" Jun 02 19:03:32.034889 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.034873 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbr6r\" (UniqueName: \"kubernetes.io/projected/a534831c-1da1-4acc-85ae-6e089da15b9c-kube-api-access-dbr6r\") pod \"node-ca-nqr8d\" (UID: \"a534831c-1da1-4acc-85ae-6e089da15b9c\") " pod="openshift-image-registry/node-ca-nqr8d" Jun 02 19:03:32.122410 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.122375 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zc4sw\" (UniqueName: \"kubernetes.io/projected/20a7d510-3c6c-444e-930e-f77bc4d392f7-kube-api-access-zc4sw\") pod \"aws-ebs-csi-driver-node-2pzvw\" (UID: \"20a7d510-3c6c-444e-930e-f77bc4d392f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" Jun 02 19:03:32.122410 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.122413 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/20a7d510-3c6c-444e-930e-f77bc4d392f7-socket-dir\") pod \"aws-ebs-csi-driver-node-2pzvw\" (UID: \"20a7d510-3c6c-444e-930e-f77bc4d392f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" Jun 02 19:03:32.122634 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.122435 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/20a7d510-3c6c-444e-930e-f77bc4d392f7-device-dir\") pod \"aws-ebs-csi-driver-node-2pzvw\" (UID: \"20a7d510-3c6c-444e-930e-f77bc4d392f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" Jun 02 19:03:32.122634 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.122464 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/20a7d510-3c6c-444e-930e-f77bc4d392f7-etc-selinux\") pod \"aws-ebs-csi-driver-node-2pzvw\" (UID: \"20a7d510-3c6c-444e-930e-f77bc4d392f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" Jun 02 19:03:32.122634 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.122496 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/20a7d510-3c6c-444e-930e-f77bc4d392f7-registration-dir\") pod \"aws-ebs-csi-driver-node-2pzvw\" (UID: \"20a7d510-3c6c-444e-930e-f77bc4d392f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" Jun 02 19:03:32.122634 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.122525 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/20a7d510-3c6c-444e-930e-f77bc4d392f7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2pzvw\" (UID: \"20a7d510-3c6c-444e-930e-f77bc4d392f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" Jun 02 19:03:32.122634 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.122543 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/20a7d510-3c6c-444e-930e-f77bc4d392f7-device-dir\") pod \"aws-ebs-csi-driver-node-2pzvw\" (UID: \"20a7d510-3c6c-444e-930e-f77bc4d392f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" Jun 02 19:03:32.122634 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.122553 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/20a7d510-3c6c-444e-930e-f77bc4d392f7-etc-selinux\") pod \"aws-ebs-csi-driver-node-2pzvw\" (UID: \"20a7d510-3c6c-444e-930e-f77bc4d392f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" Jun 02 19:03:32.122634 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.122568 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/20a7d510-3c6c-444e-930e-f77bc4d392f7-sys-fs\") pod \"aws-ebs-csi-driver-node-2pzvw\" (UID: \"20a7d510-3c6c-444e-930e-f77bc4d392f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" Jun 02 19:03:32.122634 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.122574 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/20a7d510-3c6c-444e-930e-f77bc4d392f7-socket-dir\") pod \"aws-ebs-csi-driver-node-2pzvw\" (UID: \"20a7d510-3c6c-444e-930e-f77bc4d392f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" Jun 02 19:03:32.122634 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.122603 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/20a7d510-3c6c-444e-930e-f77bc4d392f7-registration-dir\") pod \"aws-ebs-csi-driver-node-2pzvw\" (UID: \"20a7d510-3c6c-444e-930e-f77bc4d392f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" Jun 02 19:03:32.122634 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.122625 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/20a7d510-3c6c-444e-930e-f77bc4d392f7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2pzvw\" (UID: \"20a7d510-3c6c-444e-930e-f77bc4d392f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" Jun 02 19:03:32.122965 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.122666 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/20a7d510-3c6c-444e-930e-f77bc4d392f7-sys-fs\") pod \"aws-ebs-csi-driver-node-2pzvw\" (UID: \"20a7d510-3c6c-444e-930e-f77bc4d392f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" Jun 02 19:03:32.130395 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.130364 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc4sw\" (UniqueName: \"kubernetes.io/projected/20a7d510-3c6c-444e-930e-f77bc4d392f7-kube-api-access-zc4sw\") pod \"aws-ebs-csi-driver-node-2pzvw\" (UID: \"20a7d510-3c6c-444e-930e-f77bc4d392f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" Jun 02 19:03:32.206275 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.206223 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rrknd" Jun 02 19:03:32.213869 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.213841 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vnggx" Jun 02 19:03:32.223589 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.223557 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:32.229297 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.229270 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qdbck" Jun 02 19:03:32.235970 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.235949 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xbtzq" Jun 02 19:03:32.241673 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.241645 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nqr8d" Jun 02 19:03:32.247391 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.247361 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7k55l" Jun 02 19:03:32.255142 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.255116 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fdb42" Jun 02 19:03:32.258820 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.258798 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" Jun 02 19:03:32.522802 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:32.522632 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4288a48_a796_43e5_b664_8c86fc11ebc3.slice/crio-39822c54f0e540b9f753bd3c2bccf680f476f645da804cd55dd82a657a878162 WatchSource:0}: Error finding container 39822c54f0e540b9f753bd3c2bccf680f476f645da804cd55dd82a657a878162: Status 404 returned error can't find the container with id 39822c54f0e540b9f753bd3c2bccf680f476f645da804cd55dd82a657a878162 Jun 02 19:03:32.524024 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:32.523973 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ae20d8_d6b8_4375_8568_94b4accc60a3.slice/crio-4615760e804427af90aced0fb72fedb2eecaa94379b778fbff40bc5beea92c71 WatchSource:0}: Error finding container 4615760e804427af90aced0fb72fedb2eecaa94379b778fbff40bc5beea92c71: Status 404 returned error can't find the container with id 4615760e804427af90aced0fb72fedb2eecaa94379b778fbff40bc5beea92c71 Jun 02 19:03:32.525183 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:32.525100 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda574bbc7_9afe_4c8a_9319_39c5a32a63b9.slice/crio-416b9c9477d524666706388ad91e3ad08c7de1fccdd4af3c5879b5803fd6c14d WatchSource:0}: Error finding container 416b9c9477d524666706388ad91e3ad08c7de1fccdd4af3c5879b5803fd6c14d: Status 404 returned error can't find the container with id 416b9c9477d524666706388ad91e3ad08c7de1fccdd4af3c5879b5803fd6c14d Jun 02 19:03:32.525616 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.525595 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs\") pod \"network-metrics-daemon-4vsd7\" (UID: \"18ce0d3d-f461-41fa-95fa-9bb77c484d5d\") " pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:03:32.525820 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:32.525799 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:32.525898 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:32.525870 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs podName:18ce0d3d-f461-41fa-95fa-9bb77c484d5d nodeName:}" failed. No retries permitted until 2026-06-02 19:03:33.525850077 +0000 UTC m=+4.086652970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs") pod "network-metrics-daemon-4vsd7" (UID: "18ce0d3d-f461-41fa-95fa-9bb77c484d5d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:32.528314 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:32.528287 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod597d1a89_5f63_4e9e_9c43_6d841864384a.slice/crio-2fc154dfb8351aa14023977e5a50ef6a5117b7d0c786c9782125f6e8292653b6 WatchSource:0}: Error finding container 2fc154dfb8351aa14023977e5a50ef6a5117b7d0c786c9782125f6e8292653b6: Status 404 returned error can't find the container with id 2fc154dfb8351aa14023977e5a50ef6a5117b7d0c786c9782125f6e8292653b6 Jun 02 19:03:32.529078 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:32.529061 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20a7d510_3c6c_444e_930e_f77bc4d392f7.slice/crio-db2e6dfae51f00b2c6130ef15e1842abf464202274a33a16fe6542c5d71c138c WatchSource:0}: Error finding container db2e6dfae51f00b2c6130ef15e1842abf464202274a33a16fe6542c5d71c138c: Status 404 returned error can't find the container with id db2e6dfae51f00b2c6130ef15e1842abf464202274a33a16fe6542c5d71c138c Jun 02 19:03:32.529986 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:32.529958 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26230ee1_9ed4_472f_9b1c_26724eddd354.slice/crio-7a5dc3c95ade9dd059c025bb7d688b488dbc364e513d9ef5247b7240a7858927 WatchSource:0}: Error finding container 7a5dc3c95ade9dd059c025bb7d688b488dbc364e513d9ef5247b7240a7858927: Status 404 returned error can't find the container with id 7a5dc3c95ade9dd059c025bb7d688b488dbc364e513d9ef5247b7240a7858927 Jun 02 19:03:32.531301 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:32.530948 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda534831c_1da1_4acc_85ae_6e089da15b9c.slice/crio-cbbe028024aeaf7611eff6559279caaaec1a83e07cf23061704a78e34343295d WatchSource:0}: Error finding container cbbe028024aeaf7611eff6559279caaaec1a83e07cf23061704a78e34343295d: Status 404 returned error can't find the container with id cbbe028024aeaf7611eff6559279caaaec1a83e07cf23061704a78e34343295d Jun 02 19:03:32.532794 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:32.532776 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d38637d_caa3_4eb1_a749_9fe24430d039.slice/crio-51f9c95c641ecc014c4727e70d5ff1ddf9daf9adf9f061eba23090bba3f24bcc WatchSource:0}: Error finding container 51f9c95c641ecc014c4727e70d5ff1ddf9daf9adf9f061eba23090bba3f24bcc: Status 404 returned error can't find the container with id 51f9c95c641ecc014c4727e70d5ff1ddf9daf9adf9f061eba23090bba3f24bcc Jun 02 19:03:32.534145 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:03:32.534082 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda715f5f5_4d65_4ab8_a7f4_f8949cd9a429.slice/crio-652c2223c6b20d3ab3f28c16388880115c4648de4a3e6e32a64c1afbfb34119c WatchSource:0}: Error finding container 652c2223c6b20d3ab3f28c16388880115c4648de4a3e6e32a64c1afbfb34119c: Status 404 returned error can't find the container with id 652c2223c6b20d3ab3f28c16388880115c4648de4a3e6e32a64c1afbfb34119c Jun 02 19:03:32.626909 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.626875 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lnwtz\" (UniqueName: \"kubernetes.io/projected/14752c98-15e2-4594-baee-21a0d3c49b1e-kube-api-access-lnwtz\") pod \"network-check-target-qxvtt\" (UID: \"14752c98-15e2-4594-baee-21a0d3c49b1e\") " pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:03:32.627062 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:32.627003 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:03:32.627062 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:32.627030 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:03:32.627062 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:32.627039 2569 projected.go:194] Error preparing data for projected volume kube-api-access-lnwtz for pod openshift-network-diagnostics/network-check-target-qxvtt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:32.627205 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:32.627089 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14752c98-15e2-4594-baee-21a0d3c49b1e-kube-api-access-lnwtz podName:14752c98-15e2-4594-baee-21a0d3c49b1e nodeName:}" failed. No retries permitted until 2026-06-02 19:03:33.627076058 +0000 UTC m=+4.187878939 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lnwtz" (UniqueName: "kubernetes.io/projected/14752c98-15e2-4594-baee-21a0d3c49b1e-kube-api-access-lnwtz") pod "network-check-target-qxvtt" (UID: "14752c98-15e2-4594-baee-21a0d3c49b1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:32.945834 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.945757 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 18:58:30 +0000 UTC" deadline="2028-02-17 03:27:56.538293722 +0000 UTC" Jun 02 19:03:32.945834 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.945797 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14984h24m23.592500235s" Jun 02 19:03:32.998779 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:32.998242 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:03:32.998779 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:32.998378 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qxvtt" podUID="14752c98-15e2-4594-baee-21a0d3c49b1e" Jun 02 19:03:33.017339 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:33.017213 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nqr8d" event={"ID":"a534831c-1da1-4acc-85ae-6e089da15b9c","Type":"ContainerStarted","Data":"cbbe028024aeaf7611eff6559279caaaec1a83e07cf23061704a78e34343295d"} Jun 02 19:03:33.030058 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:33.030006 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xbtzq" event={"ID":"26230ee1-9ed4-472f-9b1c-26724eddd354","Type":"ContainerStarted","Data":"7a5dc3c95ade9dd059c025bb7d688b488dbc364e513d9ef5247b7240a7858927"} Jun 02 19:03:33.043138 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:33.043057 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" event={"ID":"20a7d510-3c6c-444e-930e-f77bc4d392f7","Type":"ContainerStarted","Data":"db2e6dfae51f00b2c6130ef15e1842abf464202274a33a16fe6542c5d71c138c"} Jun 02 19:03:33.045789 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:33.045747 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rrknd" event={"ID":"597d1a89-5f63-4e9e-9c43-6d841864384a","Type":"ContainerStarted","Data":"2fc154dfb8351aa14023977e5a50ef6a5117b7d0c786c9782125f6e8292653b6"} Jun 02 19:03:33.050077 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:33.050045 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fdb42" event={"ID":"d1ae20d8-d6b8-4375-8568-94b4accc60a3","Type":"ContainerStarted","Data":"4615760e804427af90aced0fb72fedb2eecaa94379b778fbff40bc5beea92c71"} Jun 02 19:03:33.060738 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:33.060670 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qdbck" event={"ID":"a4288a48-a796-43e5-b664-8c86fc11ebc3","Type":"ContainerStarted","Data":"39822c54f0e540b9f753bd3c2bccf680f476f645da804cd55dd82a657a878162"} Jun 02 19:03:33.066965 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:33.066930 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-50.ec2.internal" event={"ID":"0f9e61bb920547c421ae35a4490f954e","Type":"ContainerStarted","Data":"4c2b37d912bf9f40fc28acb0b17cc443ad8474001e1ad560eaeb48351eec2b24"} Jun 02 19:03:33.085042 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:33.085010 2569 generic.go:358] "Generic (PLEG): container finished" podID="98115ce546e4d3244222024b59039f40" containerID="57747963918db38967074c1b9c922bdc8902cf51c50e89ef4afc12b8d7f3c31e" exitCode=0 Jun 02 19:03:33.085909 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:33.085470 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-50.ec2.internal" event={"ID":"98115ce546e4d3244222024b59039f40","Type":"ContainerDied","Data":"57747963918db38967074c1b9c922bdc8902cf51c50e89ef4afc12b8d7f3c31e"} Jun 02 19:03:33.101556 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:33.101503 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-50.ec2.internal" podStartSLOduration=2.10148499 podStartE2EDuration="2.10148499s" podCreationTimestamp="2026-06-02 19:03:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:03:33.080310922 +0000 UTC m=+3.641113827" watchObservedRunningTime="2026-06-02 19:03:33.10148499 +0000 UTC m=+3.662287894" Jun 02 19:03:33.110936 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:33.110904 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" event={"ID":"6d38637d-caa3-4eb1-a749-9fe24430d039","Type":"ContainerStarted","Data":"51f9c95c641ecc014c4727e70d5ff1ddf9daf9adf9f061eba23090bba3f24bcc"} Jun 02 19:03:33.122018 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:33.121978 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7k55l" event={"ID":"a574bbc7-9afe-4c8a-9319-39c5a32a63b9","Type":"ContainerStarted","Data":"416b9c9477d524666706388ad91e3ad08c7de1fccdd4af3c5879b5803fd6c14d"} Jun 02 19:03:33.130105 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:33.130067 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vnggx" event={"ID":"a715f5f5-4d65-4ab8-a7f4-f8949cd9a429","Type":"ContainerStarted","Data":"652c2223c6b20d3ab3f28c16388880115c4648de4a3e6e32a64c1afbfb34119c"} Jun 02 19:03:33.534023 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:33.533338 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs\") pod \"network-metrics-daemon-4vsd7\" (UID: \"18ce0d3d-f461-41fa-95fa-9bb77c484d5d\") " pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:03:33.534023 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:33.533547 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:33.534023 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:33.533613 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs podName:18ce0d3d-f461-41fa-95fa-9bb77c484d5d nodeName:}" failed. No retries permitted until 2026-06-02 19:03:35.533594187 +0000 UTC m=+6.094397073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs") pod "network-metrics-daemon-4vsd7" (UID: "18ce0d3d-f461-41fa-95fa-9bb77c484d5d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:33.634930 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:33.634238 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lnwtz\" (UniqueName: \"kubernetes.io/projected/14752c98-15e2-4594-baee-21a0d3c49b1e-kube-api-access-lnwtz\") pod \"network-check-target-qxvtt\" (UID: \"14752c98-15e2-4594-baee-21a0d3c49b1e\") " pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:03:33.634930 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:33.634447 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:03:33.634930 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:33.634466 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:03:33.634930 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:33.634480 2569 projected.go:194] Error preparing data for projected volume kube-api-access-lnwtz for pod openshift-network-diagnostics/network-check-target-qxvtt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:33.634930 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:33.634536 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14752c98-15e2-4594-baee-21a0d3c49b1e-kube-api-access-lnwtz podName:14752c98-15e2-4594-baee-21a0d3c49b1e nodeName:}" failed. No retries permitted until 2026-06-02 19:03:35.634517547 +0000 UTC m=+6.195320431 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lnwtz" (UniqueName: "kubernetes.io/projected/14752c98-15e2-4594-baee-21a0d3c49b1e-kube-api-access-lnwtz") pod "network-check-target-qxvtt" (UID: "14752c98-15e2-4594-baee-21a0d3c49b1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:34.000065 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:33.999990 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:03:34.000488 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:34.000135 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsd7" podUID="18ce0d3d-f461-41fa-95fa-9bb77c484d5d" Jun 02 19:03:34.143798 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:34.143737 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-50.ec2.internal" event={"ID":"98115ce546e4d3244222024b59039f40","Type":"ContainerStarted","Data":"23d730e8896abed93aad7a6485b3968007764dedd9ee6f086a4e27733f655579"} Jun 02 19:03:34.157945 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:34.156906 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-50.ec2.internal" podStartSLOduration=3.156876517 podStartE2EDuration="3.156876517s" podCreationTimestamp="2026-06-02 19:03:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:03:34.156572682 +0000 UTC m=+4.717375586" watchObservedRunningTime="2026-06-02 19:03:34.156876517 +0000 UTC m=+4.717679423" Jun 02 19:03:34.998445 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:34.998413 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:03:34.998639 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:34.998537 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qxvtt" podUID="14752c98-15e2-4594-baee-21a0d3c49b1e" Jun 02 19:03:35.551069 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:35.551033 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs\") pod \"network-metrics-daemon-4vsd7\" (UID: \"18ce0d3d-f461-41fa-95fa-9bb77c484d5d\") " pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:03:35.551567 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:35.551187 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:35.551567 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:35.551249 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs podName:18ce0d3d-f461-41fa-95fa-9bb77c484d5d nodeName:}" failed. No retries permitted until 2026-06-02 19:03:39.55123064 +0000 UTC m=+10.112033528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs") pod "network-metrics-daemon-4vsd7" (UID: "18ce0d3d-f461-41fa-95fa-9bb77c484d5d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:35.651811 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:35.651774 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lnwtz\" (UniqueName: \"kubernetes.io/projected/14752c98-15e2-4594-baee-21a0d3c49b1e-kube-api-access-lnwtz\") pod \"network-check-target-qxvtt\" (UID: \"14752c98-15e2-4594-baee-21a0d3c49b1e\") " pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:03:35.651977 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:35.651947 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:03:35.651977 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:35.651966 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:03:35.651977 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:35.651978 2569 projected.go:194] Error preparing data for projected volume kube-api-access-lnwtz for pod openshift-network-diagnostics/network-check-target-qxvtt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:35.652172 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:35.652030 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14752c98-15e2-4594-baee-21a0d3c49b1e-kube-api-access-lnwtz podName:14752c98-15e2-4594-baee-21a0d3c49b1e nodeName:}" failed. No retries permitted until 2026-06-02 19:03:39.65201316 +0000 UTC m=+10.212816050 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lnwtz" (UniqueName: "kubernetes.io/projected/14752c98-15e2-4594-baee-21a0d3c49b1e-kube-api-access-lnwtz") pod "network-check-target-qxvtt" (UID: "14752c98-15e2-4594-baee-21a0d3c49b1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:35.998303 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:35.998213 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:03:35.998464 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:35.998366 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsd7" podUID="18ce0d3d-f461-41fa-95fa-9bb77c484d5d" Jun 02 19:03:36.998017 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:36.997927 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:03:36.998501 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:36.998075 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qxvtt" podUID="14752c98-15e2-4594-baee-21a0d3c49b1e" Jun 02 19:03:37.998414 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:37.998362 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:03:38.001071 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:38.001018 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsd7" podUID="18ce0d3d-f461-41fa-95fa-9bb77c484d5d" Jun 02 19:03:38.998023 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:38.997978 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:03:38.998190 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:38.998128 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qxvtt" podUID="14752c98-15e2-4594-baee-21a0d3c49b1e" Jun 02 19:03:39.581030 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:39.580986 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs\") pod \"network-metrics-daemon-4vsd7\" (UID: \"18ce0d3d-f461-41fa-95fa-9bb77c484d5d\") " pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:03:39.581485 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:39.581148 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:39.581485 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:39.581215 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs podName:18ce0d3d-f461-41fa-95fa-9bb77c484d5d nodeName:}" failed. No retries permitted until 2026-06-02 19:03:47.58119942 +0000 UTC m=+18.142002303 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs") pod "network-metrics-daemon-4vsd7" (UID: "18ce0d3d-f461-41fa-95fa-9bb77c484d5d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:39.681998 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:39.681959 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lnwtz\" (UniqueName: \"kubernetes.io/projected/14752c98-15e2-4594-baee-21a0d3c49b1e-kube-api-access-lnwtz\") pod \"network-check-target-qxvtt\" (UID: \"14752c98-15e2-4594-baee-21a0d3c49b1e\") " pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:03:39.682179 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:39.682153 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:03:39.682179 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:39.682175 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:03:39.682313 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:39.682189 2569 projected.go:194] Error preparing data for projected volume kube-api-access-lnwtz for pod openshift-network-diagnostics/network-check-target-qxvtt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:39.682313 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:39.682254 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14752c98-15e2-4594-baee-21a0d3c49b1e-kube-api-access-lnwtz podName:14752c98-15e2-4594-baee-21a0d3c49b1e nodeName:}" failed. No retries permitted until 2026-06-02 19:03:47.682235672 +0000 UTC m=+18.243038558 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lnwtz" (UniqueName: "kubernetes.io/projected/14752c98-15e2-4594-baee-21a0d3c49b1e-kube-api-access-lnwtz") pod "network-check-target-qxvtt" (UID: "14752c98-15e2-4594-baee-21a0d3c49b1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:39.999527 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:39.999298 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:03:39.999527 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:39.999425 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsd7" podUID="18ce0d3d-f461-41fa-95fa-9bb77c484d5d" Jun 02 19:03:40.998165 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:40.998102 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:03:40.998604 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:40.998243 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qxvtt" podUID="14752c98-15e2-4594-baee-21a0d3c49b1e" Jun 02 19:03:41.997767 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:41.997673 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:03:41.997957 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:41.997850 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsd7" podUID="18ce0d3d-f461-41fa-95fa-9bb77c484d5d" Jun 02 19:03:42.997965 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:42.997935 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:03:42.998407 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:42.998064 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qxvtt" podUID="14752c98-15e2-4594-baee-21a0d3c49b1e" Jun 02 19:03:43.998695 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:43.998654 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:03:43.999112 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:43.998786 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsd7" podUID="18ce0d3d-f461-41fa-95fa-9bb77c484d5d" Jun 02 19:03:44.997828 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:44.997792 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:03:44.997999 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:44.997910 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qxvtt" podUID="14752c98-15e2-4594-baee-21a0d3c49b1e" Jun 02 19:03:45.998036 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:45.998000 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:03:45.998485 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:45.998142 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsd7" podUID="18ce0d3d-f461-41fa-95fa-9bb77c484d5d" Jun 02 19:03:46.997651 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:46.997612 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:03:46.997829 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:46.997738 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qxvtt" podUID="14752c98-15e2-4594-baee-21a0d3c49b1e" Jun 02 19:03:47.639696 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:47.639647 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs\") pod \"network-metrics-daemon-4vsd7\" (UID: \"18ce0d3d-f461-41fa-95fa-9bb77c484d5d\") " pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:03:47.640097 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:47.639818 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:47.640097 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:47.639898 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs podName:18ce0d3d-f461-41fa-95fa-9bb77c484d5d nodeName:}" failed. No retries permitted until 2026-06-02 19:04:03.639879324 +0000 UTC m=+34.200682205 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs") pod "network-metrics-daemon-4vsd7" (UID: "18ce0d3d-f461-41fa-95fa-9bb77c484d5d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:47.740736 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:47.740698 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lnwtz\" (UniqueName: \"kubernetes.io/projected/14752c98-15e2-4594-baee-21a0d3c49b1e-kube-api-access-lnwtz\") pod \"network-check-target-qxvtt\" (UID: \"14752c98-15e2-4594-baee-21a0d3c49b1e\") " pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:03:47.740906 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:47.740864 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:03:47.740906 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:47.740889 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:03:47.740906 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:47.740904 2569 projected.go:194] Error preparing data for projected volume kube-api-access-lnwtz for pod openshift-network-diagnostics/network-check-target-qxvtt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:47.741048 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:47.740973 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14752c98-15e2-4594-baee-21a0d3c49b1e-kube-api-access-lnwtz podName:14752c98-15e2-4594-baee-21a0d3c49b1e nodeName:}" failed. No retries permitted until 2026-06-02 19:04:03.74095253 +0000 UTC m=+34.301755463 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lnwtz" (UniqueName: "kubernetes.io/projected/14752c98-15e2-4594-baee-21a0d3c49b1e-kube-api-access-lnwtz") pod "network-check-target-qxvtt" (UID: "14752c98-15e2-4594-baee-21a0d3c49b1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:47.998094 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:47.998016 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:03:47.998244 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:47.998161 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsd7" podUID="18ce0d3d-f461-41fa-95fa-9bb77c484d5d" Jun 02 19:03:48.998041 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:48.998002 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:03:48.998475 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:48.998129 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qxvtt" podUID="14752c98-15e2-4594-baee-21a0d3c49b1e" Jun 02 19:03:49.762895 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:49.762846 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-zzdxq"] Jun 02 19:03:49.928931 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:49.928890 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zzdxq" Jun 02 19:03:49.929108 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:49.929007 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zzdxq" podUID="094221b7-ebed-49a8-b6bb-19635956bceb" Jun 02 19:03:49.999201 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:49.999165 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:03:49.999557 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:49.999288 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsd7" podUID="18ce0d3d-f461-41fa-95fa-9bb77c484d5d" Jun 02 19:03:50.057881 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:50.057851 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/094221b7-ebed-49a8-b6bb-19635956bceb-original-pull-secret\") pod \"global-pull-secret-syncer-zzdxq\" (UID: \"094221b7-ebed-49a8-b6bb-19635956bceb\") " pod="kube-system/global-pull-secret-syncer-zzdxq" Jun 02 19:03:50.057985 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:50.057888 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/094221b7-ebed-49a8-b6bb-19635956bceb-dbus\") pod \"global-pull-secret-syncer-zzdxq\" (UID: \"094221b7-ebed-49a8-b6bb-19635956bceb\") " pod="kube-system/global-pull-secret-syncer-zzdxq" Jun 02 19:03:50.058025 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:50.058009 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/094221b7-ebed-49a8-b6bb-19635956bceb-kubelet-config\") pod \"global-pull-secret-syncer-zzdxq\" (UID: \"094221b7-ebed-49a8-b6bb-19635956bceb\") " pod="kube-system/global-pull-secret-syncer-zzdxq" Jun 02 19:03:50.159103 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:50.159065 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/094221b7-ebed-49a8-b6bb-19635956bceb-kubelet-config\") pod \"global-pull-secret-syncer-zzdxq\" (UID: \"094221b7-ebed-49a8-b6bb-19635956bceb\") " pod="kube-system/global-pull-secret-syncer-zzdxq" Jun 02 19:03:50.159251 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:50.159115 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/094221b7-ebed-49a8-b6bb-19635956bceb-original-pull-secret\") pod \"global-pull-secret-syncer-zzdxq\" (UID: \"094221b7-ebed-49a8-b6bb-19635956bceb\") " pod="kube-system/global-pull-secret-syncer-zzdxq" Jun 02 19:03:50.159251 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:50.159166 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/094221b7-ebed-49a8-b6bb-19635956bceb-dbus\") pod \"global-pull-secret-syncer-zzdxq\" (UID: \"094221b7-ebed-49a8-b6bb-19635956bceb\") " pod="kube-system/global-pull-secret-syncer-zzdxq" Jun 02 19:03:50.159251 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:50.159199 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/094221b7-ebed-49a8-b6bb-19635956bceb-kubelet-config\") pod \"global-pull-secret-syncer-zzdxq\" (UID: \"094221b7-ebed-49a8-b6bb-19635956bceb\") " pod="kube-system/global-pull-secret-syncer-zzdxq" Jun 02 19:03:50.159341 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:50.159288 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 19:03:50.159341 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:50.159306 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/094221b7-ebed-49a8-b6bb-19635956bceb-dbus\") pod \"global-pull-secret-syncer-zzdxq\" (UID: \"094221b7-ebed-49a8-b6bb-19635956bceb\") " pod="kube-system/global-pull-secret-syncer-zzdxq" Jun 02 19:03:50.159404 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:50.159347 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/094221b7-ebed-49a8-b6bb-19635956bceb-original-pull-secret podName:094221b7-ebed-49a8-b6bb-19635956bceb nodeName:}" failed. No retries permitted until 2026-06-02 19:03:50.659331427 +0000 UTC m=+21.220134330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/094221b7-ebed-49a8-b6bb-19635956bceb-original-pull-secret") pod "global-pull-secret-syncer-zzdxq" (UID: "094221b7-ebed-49a8-b6bb-19635956bceb") : object "kube-system"/"original-pull-secret" not registered Jun 02 19:03:50.662554 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:50.662530 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/094221b7-ebed-49a8-b6bb-19635956bceb-original-pull-secret\") pod \"global-pull-secret-syncer-zzdxq\" (UID: \"094221b7-ebed-49a8-b6bb-19635956bceb\") " pod="kube-system/global-pull-secret-syncer-zzdxq" Jun 02 19:03:50.662664 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:50.662638 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 19:03:50.662756 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:50.662701 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/094221b7-ebed-49a8-b6bb-19635956bceb-original-pull-secret podName:094221b7-ebed-49a8-b6bb-19635956bceb nodeName:}" failed. No retries permitted until 2026-06-02 19:03:51.662670171 +0000 UTC m=+22.223473053 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/094221b7-ebed-49a8-b6bb-19635956bceb-original-pull-secret") pod "global-pull-secret-syncer-zzdxq" (UID: "094221b7-ebed-49a8-b6bb-19635956bceb") : object "kube-system"/"original-pull-secret" not registered Jun 02 19:03:50.997809 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:50.997615 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:03:50.997944 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:50.997920 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qxvtt" podUID="14752c98-15e2-4594-baee-21a0d3c49b1e" Jun 02 19:03:51.172553 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.172432 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rrknd" event={"ID":"597d1a89-5f63-4e9e-9c43-6d841864384a","Type":"ContainerStarted","Data":"15e41c73c54aaf4a6d5b9ca38e74c18ce166d6a3a7fbef4ef79c5ecbeedd11f6"} Jun 02 19:03:51.173889 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.173865 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fdb42" event={"ID":"d1ae20d8-d6b8-4375-8568-94b4accc60a3","Type":"ContainerStarted","Data":"519ebc9f0e37a2e8cc7a93dc457d6dbdaeeebc9085da370d635643085bc4b784"} Jun 02 19:03:51.175267 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.175242 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qdbck" event={"ID":"a4288a48-a796-43e5-b664-8c86fc11ebc3","Type":"ContainerStarted","Data":"651709b53f7caaf68a27d97123db38eeb14dbccf5163e67113fcdb55b2acac95"} Jun 02 19:03:51.177840 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.177820 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xz76r_6d38637d-caa3-4eb1-a749-9fe24430d039/ovn-acl-logging/0.log" Jun 02 19:03:51.178145 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.178118 2569 generic.go:358] "Generic (PLEG): container finished" podID="6d38637d-caa3-4eb1-a749-9fe24430d039" containerID="f944a6d380438df5238b84a0fc31885e8994006335978b3e6c45f58a9e0c0dc0" exitCode=1 Jun 02 19:03:51.178236 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.178182 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" event={"ID":"6d38637d-caa3-4eb1-a749-9fe24430d039","Type":"ContainerStarted","Data":"1bbdc19329b20754f4330139ff06e88e77bc08f23ca25e886a0649fa8135b02a"} Jun 02 19:03:51.178288 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.178246 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" event={"ID":"6d38637d-caa3-4eb1-a749-9fe24430d039","Type":"ContainerStarted","Data":"86e9861e21def33524b0d7c21755cdafd82f1f4419aa5f1fb813117309eae816"} Jun 02 19:03:51.178288 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.178260 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" event={"ID":"6d38637d-caa3-4eb1-a749-9fe24430d039","Type":"ContainerStarted","Data":"0e3b80aed0f6deb72fb3b1ce6a9bfe6cdbae37aeb6ea99e839b3e387d75a0af1"} Jun 02 19:03:51.178288 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.178273 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" event={"ID":"6d38637d-caa3-4eb1-a749-9fe24430d039","Type":"ContainerStarted","Data":"3a9af854574b892d3fa43ac15edfe8c6ee4e1206c0c6764ae0dbc533bd6ede5b"} Jun 02 19:03:51.178288 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.178286 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" event={"ID":"6d38637d-caa3-4eb1-a749-9fe24430d039","Type":"ContainerDied","Data":"f944a6d380438df5238b84a0fc31885e8994006335978b3e6c45f58a9e0c0dc0"} Jun 02 19:03:51.178466 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.178301 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" event={"ID":"6d38637d-caa3-4eb1-a749-9fe24430d039","Type":"ContainerStarted","Data":"08d1be9e8d982f650a0046e42ef3a65c7f9716ae4b1b434eaef3bc49403b62f6"} Jun 02 19:03:51.179604 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.179585 2569 generic.go:358] "Generic (PLEG): container finished" podID="a574bbc7-9afe-4c8a-9319-39c5a32a63b9" containerID="33b29466643cd2efe411fe4de5d25db6825a21e2fc4e76ebb9cce04a850c4c15" exitCode=0 Jun 02 19:03:51.179670 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.179642 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7k55l" event={"ID":"a574bbc7-9afe-4c8a-9319-39c5a32a63b9","Type":"ContainerDied","Data":"33b29466643cd2efe411fe4de5d25db6825a21e2fc4e76ebb9cce04a850c4c15"} Jun 02 19:03:51.180911 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.180888 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nqr8d" event={"ID":"a534831c-1da1-4acc-85ae-6e089da15b9c","Type":"ContainerStarted","Data":"86a0ed9483d3544e3344629d35f1bfd37b6627432ff38132876e2f1e24fd4aba"} Jun 02 19:03:51.182212 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.182192 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xbtzq" event={"ID":"26230ee1-9ed4-472f-9b1c-26724eddd354","Type":"ContainerStarted","Data":"6f8cb9cc82d27fcb29da266a2bfe7dac15eca4547d13f08ca5b25b9f8b886a46"} Jun 02 19:03:51.183503 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.183485 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" event={"ID":"20a7d510-3c6c-444e-930e-f77bc4d392f7","Type":"ContainerStarted","Data":"382d11303ff472a0f896b423a9112ec82a380e4a8752abd743a42d5e42f225b4"} Jun 02 19:03:51.188454 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.188411 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-rrknd" podStartSLOduration=3.310051569 podStartE2EDuration="21.188397734s" podCreationTimestamp="2026-06-02 19:03:30 +0000 UTC" firstStartedPulling="2026-06-02 19:03:32.530072163 +0000 UTC m=+3.090875048" lastFinishedPulling="2026-06-02 19:03:50.408418327 +0000 UTC m=+20.969221213" observedRunningTime="2026-06-02 19:03:51.187660615 +0000 UTC m=+21.748463518" watchObservedRunningTime="2026-06-02 19:03:51.188397734 +0000 UTC m=+21.749200641" Jun 02 19:03:51.198503 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.198460 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fdb42" podStartSLOduration=7.932034168 podStartE2EDuration="21.198445547s" podCreationTimestamp="2026-06-02 19:03:30 +0000 UTC" firstStartedPulling="2026-06-02 19:03:32.526299738 +0000 UTC m=+3.087102618" lastFinishedPulling="2026-06-02 19:03:45.79271111 +0000 UTC m=+16.353513997" observedRunningTime="2026-06-02 19:03:51.197892767 +0000 UTC m=+21.758695669" watchObservedRunningTime="2026-06-02 19:03:51.198445547 +0000 UTC m=+21.759248452" Jun 02 19:03:51.222248 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.222194 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-xbtzq" podStartSLOduration=3.310490632 podStartE2EDuration="21.222177122s" podCreationTimestamp="2026-06-02 19:03:30 +0000 UTC" firstStartedPulling="2026-06-02 19:03:32.531742953 +0000 UTC m=+3.092545834" lastFinishedPulling="2026-06-02 19:03:50.443429442 +0000 UTC m=+21.004232324" observedRunningTime="2026-06-02 19:03:51.222064471 +0000 UTC m=+21.782867378" watchObservedRunningTime="2026-06-02 19:03:51.222177122 +0000 UTC m=+21.782980026" Jun 02 19:03:51.222619 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.222584 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qdbck" podStartSLOduration=3.307732014 podStartE2EDuration="21.222572409s" podCreationTimestamp="2026-06-02 19:03:30 +0000 UTC" firstStartedPulling="2026-06-02 19:03:32.524534203 +0000 UTC m=+3.085337092" lastFinishedPulling="2026-06-02 19:03:50.4393746 +0000 UTC m=+21.000177487" observedRunningTime="2026-06-02 19:03:51.210074824 +0000 UTC m=+21.770877738" watchObservedRunningTime="2026-06-02 19:03:51.222572409 +0000 UTC m=+21.783375312" Jun 02 19:03:51.263014 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.262957 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nqr8d" podStartSLOduration=3.766554959 podStartE2EDuration="21.262940467s" podCreationTimestamp="2026-06-02 19:03:30 +0000 UTC" firstStartedPulling="2026-06-02 19:03:32.532553745 +0000 UTC m=+3.093356626" lastFinishedPulling="2026-06-02 19:03:50.028939241 +0000 UTC m=+20.589742134" observedRunningTime="2026-06-02 19:03:51.262700096 +0000 UTC m=+21.823502998" watchObservedRunningTime="2026-06-02 19:03:51.262940467 +0000 UTC m=+21.823743371" Jun 02 19:03:51.600014 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.599975 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fdb42" Jun 02 19:03:51.600563 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.600544 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fdb42" Jun 02 19:03:51.670329 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.670299 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/094221b7-ebed-49a8-b6bb-19635956bceb-original-pull-secret\") pod \"global-pull-secret-syncer-zzdxq\" (UID: \"094221b7-ebed-49a8-b6bb-19635956bceb\") " pod="kube-system/global-pull-secret-syncer-zzdxq" Jun 02 19:03:51.670507 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:51.670482 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 19:03:51.670570 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:51.670558 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/094221b7-ebed-49a8-b6bb-19635956bceb-original-pull-secret podName:094221b7-ebed-49a8-b6bb-19635956bceb nodeName:}" failed. No retries permitted until 2026-06-02 19:03:53.670538481 +0000 UTC m=+24.231341368 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/094221b7-ebed-49a8-b6bb-19635956bceb-original-pull-secret") pod "global-pull-secret-syncer-zzdxq" (UID: "094221b7-ebed-49a8-b6bb-19635956bceb") : object "kube-system"/"original-pull-secret" not registered Jun 02 19:03:51.998155 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.998122 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:03:51.998366 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:51.998158 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zzdxq" Jun 02 19:03:51.998366 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:51.998272 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsd7" podUID="18ce0d3d-f461-41fa-95fa-9bb77c484d5d" Jun 02 19:03:51.998452 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:51.998410 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zzdxq" podUID="094221b7-ebed-49a8-b6bb-19635956bceb" Jun 02 19:03:52.186607 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:52.186565 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vnggx" event={"ID":"a715f5f5-4d65-4ab8-a7f4-f8949cd9a429","Type":"ContainerStarted","Data":"7b5741728615eeecb179fc677ad3c8258bc7cd95af496adcf9eed0f5eedd0880"} Jun 02 19:03:52.187092 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:52.186986 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fdb42" Jun 02 19:03:52.187656 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:52.187631 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fdb42" Jun 02 19:03:52.213019 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:52.212957 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vnggx" podStartSLOduration=4.309779311 podStartE2EDuration="22.212942068s" podCreationTimestamp="2026-06-02 19:03:30 +0000 UTC" firstStartedPulling="2026-06-02 19:03:32.536239102 +0000 UTC m=+3.097041999" lastFinishedPulling="2026-06-02 19:03:50.439401858 +0000 UTC m=+21.000204756" observedRunningTime="2026-06-02 19:03:52.212482705 +0000 UTC m=+22.773285608" watchObservedRunningTime="2026-06-02 19:03:52.212942068 +0000 UTC m=+22.773745006" Jun 02 19:03:52.281348 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:52.281324 2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 19:03:52.975237 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:52.975104 2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T19:03:52.281341979Z","UUID":"769369db-e813-46b2-b951-a1b6d619f126","Handler":null,"Name":"","Endpoint":""} Jun 02 19:03:52.977873 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:52.977845 2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 19:03:52.978009 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:52.977884 2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 19:03:52.998242 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:52.998211 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:03:52.998402 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:52.998342 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qxvtt" podUID="14752c98-15e2-4594-baee-21a0d3c49b1e" Jun 02 19:03:53.190119 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:53.190085 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" event={"ID":"20a7d510-3c6c-444e-930e-f77bc4d392f7","Type":"ContainerStarted","Data":"ce859f6f30c0ad4dc5ab570bc380c071ba7507f4a7898f1d5980b2867ef17923"} Jun 02 19:03:53.687562 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:53.687330 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/094221b7-ebed-49a8-b6bb-19635956bceb-original-pull-secret\") pod \"global-pull-secret-syncer-zzdxq\" (UID: \"094221b7-ebed-49a8-b6bb-19635956bceb\") " pod="kube-system/global-pull-secret-syncer-zzdxq" Jun 02 19:03:53.687562 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:53.687480 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 19:03:53.687802 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:53.687604 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/094221b7-ebed-49a8-b6bb-19635956bceb-original-pull-secret podName:094221b7-ebed-49a8-b6bb-19635956bceb nodeName:}" failed. No retries permitted until 2026-06-02 19:03:57.687586407 +0000 UTC m=+28.248389300 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/094221b7-ebed-49a8-b6bb-19635956bceb-original-pull-secret") pod "global-pull-secret-syncer-zzdxq" (UID: "094221b7-ebed-49a8-b6bb-19635956bceb") : object "kube-system"/"original-pull-secret" not registered Jun 02 19:03:53.998540 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:53.998505 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:03:53.998692 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:53.998505 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zzdxq" Jun 02 19:03:53.998692 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:53.998644 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsd7" podUID="18ce0d3d-f461-41fa-95fa-9bb77c484d5d" Jun 02 19:03:53.998816 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:53.998756 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zzdxq" podUID="094221b7-ebed-49a8-b6bb-19635956bceb" Jun 02 19:03:54.193959 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:54.193929 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xz76r_6d38637d-caa3-4eb1-a749-9fe24430d039/ovn-acl-logging/0.log" Jun 02 19:03:54.194318 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:54.194250 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" event={"ID":"6d38637d-caa3-4eb1-a749-9fe24430d039","Type":"ContainerStarted","Data":"5e8eddda734e55dfe95c2c63b56858764bd8491366b911b8ad687cb06855e6c4"} Jun 02 19:03:54.195884 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:54.195859 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" event={"ID":"20a7d510-3c6c-444e-930e-f77bc4d392f7","Type":"ContainerStarted","Data":"9f36bf18365f0dc93a5789b61f85cb47b4a91e300aee0c48454fc609aa116382"} Jun 02 19:03:54.212157 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:54.212086 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pzvw" podStartSLOduration=2.9099493709999997 podStartE2EDuration="24.21207542s" podCreationTimestamp="2026-06-02 19:03:30 +0000 UTC" firstStartedPulling="2026-06-02 19:03:32.531190041 +0000 UTC m=+3.091992929" lastFinishedPulling="2026-06-02 19:03:53.833316082 +0000 UTC m=+24.394118978" observedRunningTime="2026-06-02 19:03:54.211895474 +0000 UTC m=+24.772698376" watchObservedRunningTime="2026-06-02 19:03:54.21207542 +0000 UTC m=+24.772878323" Jun 02 19:03:54.998464 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:54.998432 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:03:54.998630 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:54.998541 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qxvtt" podUID="14752c98-15e2-4594-baee-21a0d3c49b1e" Jun 02 19:03:55.998518 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:55.998468 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:03:55.999252 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:55.998477 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zzdxq" Jun 02 19:03:55.999252 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:55.998619 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsd7" podUID="18ce0d3d-f461-41fa-95fa-9bb77c484d5d" Jun 02 19:03:55.999252 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:55.998721 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zzdxq" podUID="094221b7-ebed-49a8-b6bb-19635956bceb" Jun 02 19:03:56.998120 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:56.997945 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:03:56.998319 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:56.998190 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qxvtt" podUID="14752c98-15e2-4594-baee-21a0d3c49b1e" Jun 02 19:03:57.204044 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:57.204016 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xz76r_6d38637d-caa3-4eb1-a749-9fe24430d039/ovn-acl-logging/0.log" Jun 02 19:03:57.204544 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:57.204369 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" event={"ID":"6d38637d-caa3-4eb1-a749-9fe24430d039","Type":"ContainerStarted","Data":"c6e56633cdf5a2ce901fa58a34b7dd716c6e615b616565547eede4d97c44afb6"} Jun 02 19:03:57.204649 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:57.204632 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:57.204872 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:57.204851 2569 scope.go:117] "RemoveContainer" containerID="f944a6d380438df5238b84a0fc31885e8994006335978b3e6c45f58a9e0c0dc0" Jun 02 19:03:57.206076 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:57.206050 2569 generic.go:358] "Generic (PLEG): container finished" podID="a574bbc7-9afe-4c8a-9319-39c5a32a63b9" containerID="8707ab6f92afd818acfb025fa268c929f5c2fc164ba3822b2ffd038f8d4c0539" exitCode=0 Jun 02 19:03:57.206196 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:57.206090 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7k55l" event={"ID":"a574bbc7-9afe-4c8a-9319-39c5a32a63b9","Type":"ContainerDied","Data":"8707ab6f92afd818acfb025fa268c929f5c2fc164ba3822b2ffd038f8d4c0539"} Jun 02 19:03:57.221959 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:57.221927 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:57.721022 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:57.720980 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/094221b7-ebed-49a8-b6bb-19635956bceb-original-pull-secret\") pod \"global-pull-secret-syncer-zzdxq\" (UID: \"094221b7-ebed-49a8-b6bb-19635956bceb\") " pod="kube-system/global-pull-secret-syncer-zzdxq" Jun 02 19:03:57.721174 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:57.721135 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 19:03:57.721229 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:57.721201 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/094221b7-ebed-49a8-b6bb-19635956bceb-original-pull-secret podName:094221b7-ebed-49a8-b6bb-19635956bceb nodeName:}" failed. No retries permitted until 2026-06-02 19:04:05.721185546 +0000 UTC m=+36.281988428 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/094221b7-ebed-49a8-b6bb-19635956bceb-original-pull-secret") pod "global-pull-secret-syncer-zzdxq" (UID: "094221b7-ebed-49a8-b6bb-19635956bceb") : object "kube-system"/"original-pull-secret" not registered Jun 02 19:03:57.998573 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:57.998488 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:03:57.998573 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:57.998531 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zzdxq" Jun 02 19:03:57.998804 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:57.998629 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsd7" podUID="18ce0d3d-f461-41fa-95fa-9bb77c484d5d" Jun 02 19:03:57.998804 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:57.998770 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zzdxq" podUID="094221b7-ebed-49a8-b6bb-19635956bceb" Jun 02 19:03:58.211956 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:58.211930 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xz76r_6d38637d-caa3-4eb1-a749-9fe24430d039/ovn-acl-logging/0.log" Jun 02 19:03:58.212425 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:58.212318 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" event={"ID":"6d38637d-caa3-4eb1-a749-9fe24430d039","Type":"ContainerStarted","Data":"c8c8faa134b04cd4392108fe34476c5ce586be25750fab6163aba0ee6e692596"} Jun 02 19:03:58.212745 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:58.212720 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:58.212880 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:58.212754 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:58.214390 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:58.214362 2569 generic.go:358] "Generic (PLEG): container finished" podID="a574bbc7-9afe-4c8a-9319-39c5a32a63b9" containerID="8128e370cc82bcb985317c1609550beb01bcb779629a982ade2f4f0c8fe8f991" exitCode=0 Jun 02 19:03:58.214492 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:58.214398 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7k55l" event={"ID":"a574bbc7-9afe-4c8a-9319-39c5a32a63b9","Type":"ContainerDied","Data":"8128e370cc82bcb985317c1609550beb01bcb779629a982ade2f4f0c8fe8f991"} Jun 02 19:03:58.228880 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:58.228852 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:03:58.244242 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:58.244194 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" podStartSLOduration=10.287070012 podStartE2EDuration="28.244177682s" podCreationTimestamp="2026-06-02 19:03:30 +0000 UTC" firstStartedPulling="2026-06-02 19:03:32.534755069 +0000 UTC m=+3.095557956" lastFinishedPulling="2026-06-02 19:03:50.491862745 +0000 UTC m=+21.052665626" observedRunningTime="2026-06-02 19:03:58.243336366 +0000 UTC m=+28.804139272" watchObservedRunningTime="2026-06-02 19:03:58.244177682 +0000 UTC m=+28.804980585" Jun 02 19:03:58.554870 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:58.554839 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qxvtt"] Jun 02 19:03:58.555045 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:58.554962 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:03:58.555103 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:58.555052 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qxvtt" podUID="14752c98-15e2-4594-baee-21a0d3c49b1e" Jun 02 19:03:58.558597 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:58.558563 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zzdxq"] Jun 02 19:03:58.558754 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:58.558712 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zzdxq" Jun 02 19:03:58.558857 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:58.558830 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zzdxq" podUID="094221b7-ebed-49a8-b6bb-19635956bceb" Jun 02 19:03:58.559230 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:58.559209 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4vsd7"] Jun 02 19:03:58.559320 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:58.559296 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:03:58.559394 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:03:58.559372 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsd7" podUID="18ce0d3d-f461-41fa-95fa-9bb77c484d5d" Jun 02 19:03:59.218311 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:59.218276 2569 generic.go:358] "Generic (PLEG): container finished" podID="a574bbc7-9afe-4c8a-9319-39c5a32a63b9" containerID="a9f231591e44e66f0f9c5b9eb35686c440213e7fc5370c94565dec6078b34c85" exitCode=0 Jun 02 19:03:59.218696 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:59.218354 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7k55l" event={"ID":"a574bbc7-9afe-4c8a-9319-39c5a32a63b9","Type":"ContainerDied","Data":"a9f231591e44e66f0f9c5b9eb35686c440213e7fc5370c94565dec6078b34c85"} Jun 02 19:04:00.001795 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:59.999719 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:04:00.001795 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:00.000124 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsd7" podUID="18ce0d3d-f461-41fa-95fa-9bb77c484d5d" Jun 02 19:04:00.001795 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:59.999821 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:04:00.001795 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:00.000399 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qxvtt" podUID="14752c98-15e2-4594-baee-21a0d3c49b1e" Jun 02 19:04:00.001795 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:03:59.999667 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zzdxq" Jun 02 19:04:00.001795 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:00.000635 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zzdxq" podUID="094221b7-ebed-49a8-b6bb-19635956bceb" Jun 02 19:04:01.997966 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:01.997926 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:04:01.998582 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:01.997926 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zzdxq" Jun 02 19:04:01.998582 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:01.998054 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qxvtt" podUID="14752c98-15e2-4594-baee-21a0d3c49b1e" Jun 02 19:04:01.998582 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:01.997930 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:04:01.998582 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:01.998135 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zzdxq" podUID="094221b7-ebed-49a8-b6bb-19635956bceb" Jun 02 19:04:01.998582 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:01.998214 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsd7" podUID="18ce0d3d-f461-41fa-95fa-9bb77c484d5d" Jun 02 19:04:03.288150 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.288066 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-50.ec2.internal" event="NodeReady" Jun 02 19:04:03.288583 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.288230 2569 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 19:04:03.323576 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.323540 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77c5d48869-46n58"] Jun 02 19:04:03.327487 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.327460 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:03.330608 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.329984 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 19:04:03.330608 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.330009 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 19:04:03.330608 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.330045 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zfb7c\"" Jun 02 19:04:03.330608 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.330388 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 19:04:03.338052 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.338025 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 19:04:03.338205 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.338080 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77c5d48869-46n58"] Jun 02 19:04:03.344652 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.344617 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kjwpj"] Jun 02 19:04:03.347876 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.347852 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gdqng"] Jun 02 19:04:03.348032 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.348011 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kjwpj" Jun 02 19:04:03.350809 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.350790 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gdqng" Jun 02 19:04:03.351492 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.351468 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 19:04:03.352190 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.352151 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bdn92\"" Jun 02 19:04:03.352190 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.352173 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 19:04:03.352649 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.352633 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 19:04:03.352897 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.352879 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ljpzl\"" Jun 02 19:04:03.352981 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.352896 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 19:04:03.353180 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.353161 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 19:04:03.356408 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.356390 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gdqng"] Jun 02 19:04:03.359118 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.359097 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kjwpj"] Jun 02 19:04:03.465004 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.464964 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45de563d-69ab-4e4c-87c6-d06c2d4ee695-trusted-ca\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:03.465176 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.465027 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45de563d-69ab-4e4c-87c6-d06c2d4ee695-ca-trust-extracted\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:03.465176 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.465084 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/37654fa6-9127-48c7-8517-c221330b4460-config-volume\") pod \"dns-default-kjwpj\" (UID: \"37654fa6-9127-48c7-8517-c221330b4460\") " pod="openshift-dns/dns-default-kjwpj" Jun 02 19:04:03.465176 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.465121 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88bv7\" (UniqueName: \"kubernetes.io/projected/37654fa6-9127-48c7-8517-c221330b4460-kube-api-access-88bv7\") pod \"dns-default-kjwpj\" (UID: \"37654fa6-9127-48c7-8517-c221330b4460\") " pod="openshift-dns/dns-default-kjwpj" Jun 02 19:04:03.465299 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.465183 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45de563d-69ab-4e4c-87c6-d06c2d4ee695-installation-pull-secrets\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:03.465299 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.465276 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-bound-sa-token\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:03.465427 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.465312 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert\") pod \"ingress-canary-gdqng\" (UID: \"e722091f-abf8-4361-9442-9a0c103355dc\") " pod="openshift-ingress-canary/ingress-canary-gdqng" Jun 02 19:04:03.465427 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.465363 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37654fa6-9127-48c7-8517-c221330b4460-tmp-dir\") pod \"dns-default-kjwpj\" (UID: \"37654fa6-9127-48c7-8517-c221330b4460\") " pod="openshift-dns/dns-default-kjwpj" Jun 02 19:04:03.465427 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.465398 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45de563d-69ab-4e4c-87c6-d06c2d4ee695-image-registry-private-configuration\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:03.465427 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.465416 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-certificates\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:03.465557 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.465446 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:03.465557 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.465480 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls\") pod \"dns-default-kjwpj\" (UID: \"37654fa6-9127-48c7-8517-c221330b4460\") " pod="openshift-dns/dns-default-kjwpj" Jun 02 19:04:03.465557 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.465516 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd22f\" (UniqueName: \"kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-kube-api-access-sd22f\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:03.465557 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.465540 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lctvb\" (UniqueName: \"kubernetes.io/projected/e722091f-abf8-4361-9442-9a0c103355dc-kube-api-access-lctvb\") pod \"ingress-canary-gdqng\" (UID: \"e722091f-abf8-4361-9442-9a0c103355dc\") " pod="openshift-ingress-canary/ingress-canary-gdqng" Jun 02 19:04:03.566917 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.566826 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-bound-sa-token\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:03.566917 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.566878 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert\") pod \"ingress-canary-gdqng\" (UID: \"e722091f-abf8-4361-9442-9a0c103355dc\") " pod="openshift-ingress-canary/ingress-canary-gdqng" Jun 02 19:04:03.566917 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.566915 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37654fa6-9127-48c7-8517-c221330b4460-tmp-dir\") pod \"dns-default-kjwpj\" (UID: \"37654fa6-9127-48c7-8517-c221330b4460\") " pod="openshift-dns/dns-default-kjwpj" Jun 02 19:04:03.567208 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.566945 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45de563d-69ab-4e4c-87c6-d06c2d4ee695-image-registry-private-configuration\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:03.567208 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.566973 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-certificates\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:03.567208 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:03.567052 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:04:03.567208 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:03.567122 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert podName:e722091f-abf8-4361-9442-9a0c103355dc nodeName:}" failed. No retries permitted until 2026-06-02 19:04:04.067100087 +0000 UTC m=+34.627902972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert") pod "ingress-canary-gdqng" (UID: "e722091f-abf8-4361-9442-9a0c103355dc") : secret "canary-serving-cert" not found Jun 02 19:04:03.567208 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.567160 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:03.567208 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.567193 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls\") pod \"dns-default-kjwpj\" (UID: \"37654fa6-9127-48c7-8517-c221330b4460\") " pod="openshift-dns/dns-default-kjwpj" Jun 02 19:04:03.567510 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.567224 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sd22f\" (UniqueName: \"kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-kube-api-access-sd22f\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:03.567510 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.567254 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lctvb\" (UniqueName: \"kubernetes.io/projected/e722091f-abf8-4361-9442-9a0c103355dc-kube-api-access-lctvb\") pod \"ingress-canary-gdqng\" (UID: \"e722091f-abf8-4361-9442-9a0c103355dc\") " pod="openshift-ingress-canary/ingress-canary-gdqng" Jun 02 19:04:03.567510 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.567284 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45de563d-69ab-4e4c-87c6-d06c2d4ee695-trusted-ca\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:03.567510 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:03.567288 2569 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:04:03.567510 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.567296 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37654fa6-9127-48c7-8517-c221330b4460-tmp-dir\") pod \"dns-default-kjwpj\" (UID: \"37654fa6-9127-48c7-8517-c221330b4460\") " pod="openshift-dns/dns-default-kjwpj" Jun 02 19:04:03.567510 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:03.567305 2569 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c5d48869-46n58: secret "image-registry-tls" not found Jun 02 19:04:03.567510 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.567337 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45de563d-69ab-4e4c-87c6-d06c2d4ee695-ca-trust-extracted\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:03.567510 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.567370 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/37654fa6-9127-48c7-8517-c221330b4460-config-volume\") pod \"dns-default-kjwpj\" (UID: \"37654fa6-9127-48c7-8517-c221330b4460\") " pod="openshift-dns/dns-default-kjwpj" Jun 02 19:04:03.567510 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:03.567406 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:04:03.567510 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:03.567411 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls podName:45de563d-69ab-4e4c-87c6-d06c2d4ee695 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:04.067379895 +0000 UTC m=+34.628182777 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls") pod "image-registry-77c5d48869-46n58" (UID: "45de563d-69ab-4e4c-87c6-d06c2d4ee695") : secret "image-registry-tls" not found Jun 02 19:04:03.567510 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.567435 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88bv7\" (UniqueName: \"kubernetes.io/projected/37654fa6-9127-48c7-8517-c221330b4460-kube-api-access-88bv7\") pod \"dns-default-kjwpj\" (UID: \"37654fa6-9127-48c7-8517-c221330b4460\") " pod="openshift-dns/dns-default-kjwpj" Jun 02 19:04:03.567510 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:03.567453 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls podName:37654fa6-9127-48c7-8517-c221330b4460 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:04.067440405 +0000 UTC m=+34.628243292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls") pod "dns-default-kjwpj" (UID: "37654fa6-9127-48c7-8517-c221330b4460") : secret "dns-default-metrics-tls" not found Jun 02 19:04:03.567510 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.567503 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45de563d-69ab-4e4c-87c6-d06c2d4ee695-installation-pull-secrets\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:03.568136 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.567586 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-certificates\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:03.568136 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.567767 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45de563d-69ab-4e4c-87c6-d06c2d4ee695-ca-trust-extracted\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:03.568136 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.567925 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/37654fa6-9127-48c7-8517-c221330b4460-config-volume\") pod \"dns-default-kjwpj\" (UID: \"37654fa6-9127-48c7-8517-c221330b4460\") " pod="openshift-dns/dns-default-kjwpj" Jun 02 19:04:03.568505 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.568473 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45de563d-69ab-4e4c-87c6-d06c2d4ee695-trusted-ca\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:03.572540 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.572510 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45de563d-69ab-4e4c-87c6-d06c2d4ee695-installation-pull-secrets\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:03.572670 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.572510 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45de563d-69ab-4e4c-87c6-d06c2d4ee695-image-registry-private-configuration\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:03.577440 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.577179 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-bound-sa-token\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:03.577440 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.577186 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lctvb\" (UniqueName: \"kubernetes.io/projected/e722091f-abf8-4361-9442-9a0c103355dc-kube-api-access-lctvb\") pod \"ingress-canary-gdqng\" (UID: \"e722091f-abf8-4361-9442-9a0c103355dc\") " pod="openshift-ingress-canary/ingress-canary-gdqng" Jun 02 19:04:03.578293 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.578256 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88bv7\" (UniqueName: \"kubernetes.io/projected/37654fa6-9127-48c7-8517-c221330b4460-kube-api-access-88bv7\") pod \"dns-default-kjwpj\" (UID: \"37654fa6-9127-48c7-8517-c221330b4460\") " pod="openshift-dns/dns-default-kjwpj" Jun 02 19:04:03.579200 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.579181 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd22f\" (UniqueName: \"kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-kube-api-access-sd22f\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:03.668402 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.668360 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs\") pod \"network-metrics-daemon-4vsd7\" (UID: \"18ce0d3d-f461-41fa-95fa-9bb77c484d5d\") " pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:04:03.668577 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:03.668502 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:04:03.668636 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:03.668587 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs podName:18ce0d3d-f461-41fa-95fa-9bb77c484d5d nodeName:}" failed. No retries permitted until 2026-06-02 19:04:35.668572226 +0000 UTC m=+66.229375119 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs") pod "network-metrics-daemon-4vsd7" (UID: "18ce0d3d-f461-41fa-95fa-9bb77c484d5d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:04:03.769484 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.769445 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lnwtz\" (UniqueName: \"kubernetes.io/projected/14752c98-15e2-4594-baee-21a0d3c49b1e-kube-api-access-lnwtz\") pod \"network-check-target-qxvtt\" (UID: \"14752c98-15e2-4594-baee-21a0d3c49b1e\") " pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:04:03.769698 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:03.769618 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:04:03.769698 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:03.769638 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:04:03.769698 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:03.769653 2569 projected.go:194] Error preparing data for projected volume kube-api-access-lnwtz for pod openshift-network-diagnostics/network-check-target-qxvtt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:04:03.769827 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:03.769730 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14752c98-15e2-4594-baee-21a0d3c49b1e-kube-api-access-lnwtz podName:14752c98-15e2-4594-baee-21a0d3c49b1e nodeName:}" failed. No retries permitted until 2026-06-02 19:04:35.769712252 +0000 UTC m=+66.330515133 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lnwtz" (UniqueName: "kubernetes.io/projected/14752c98-15e2-4594-baee-21a0d3c49b1e-kube-api-access-lnwtz") pod "network-check-target-qxvtt" (UID: "14752c98-15e2-4594-baee-21a0d3c49b1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:04:03.997926 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.997891 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zzdxq" Jun 02 19:04:03.997926 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.997910 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:04:03.998184 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:03.998087 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:04:04.000588 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:04.000559 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 19:04:04.000749 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:04.000675 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 19:04:04.000749 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:04.000711 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9kj59\"" Jun 02 19:04:04.001002 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:04.000986 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 19:04:04.001074 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:04.001010 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-djr2n\"" Jun 02 19:04:04.001074 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:04.000986 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 19:04:04.072637 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:04.072598 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert\") pod \"ingress-canary-gdqng\" (UID: \"e722091f-abf8-4361-9442-9a0c103355dc\") " pod="openshift-ingress-canary/ingress-canary-gdqng" Jun 02 19:04:04.072845 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:04.072670 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:04.072845 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:04.072723 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls\") pod \"dns-default-kjwpj\" (UID: \"37654fa6-9127-48c7-8517-c221330b4460\") " pod="openshift-dns/dns-default-kjwpj" Jun 02 19:04:04.072845 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:04.072770 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:04:04.072845 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:04.072787 2569 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:04:04.072845 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:04.072807 2569 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c5d48869-46n58: secret "image-registry-tls" not found Jun 02 19:04:04.072845 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:04.072826 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:04:04.072845 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:04.072849 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert podName:e722091f-abf8-4361-9442-9a0c103355dc nodeName:}" failed. No retries permitted until 2026-06-02 19:04:05.072829568 +0000 UTC m=+35.633632474 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert") pod "ingress-canary-gdqng" (UID: "e722091f-abf8-4361-9442-9a0c103355dc") : secret "canary-serving-cert" not found Jun 02 19:04:04.073208 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:04.072869 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls podName:45de563d-69ab-4e4c-87c6-d06c2d4ee695 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:05.072858577 +0000 UTC m=+35.633661458 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls") pod "image-registry-77c5d48869-46n58" (UID: "45de563d-69ab-4e4c-87c6-d06c2d4ee695") : secret "image-registry-tls" not found Jun 02 19:04:04.073208 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:04.072884 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls podName:37654fa6-9127-48c7-8517-c221330b4460 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:05.072876881 +0000 UTC m=+35.633679764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls") pod "dns-default-kjwpj" (UID: "37654fa6-9127-48c7-8517-c221330b4460") : secret "dns-default-metrics-tls" not found Jun 02 19:04:05.081852 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:05.081809 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert\") pod \"ingress-canary-gdqng\" (UID: \"e722091f-abf8-4361-9442-9a0c103355dc\") " pod="openshift-ingress-canary/ingress-canary-gdqng" Jun 02 19:04:05.082569 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:05.081875 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:05.082569 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:05.081905 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls\") pod \"dns-default-kjwpj\" (UID: \"37654fa6-9127-48c7-8517-c221330b4460\") " pod="openshift-dns/dns-default-kjwpj" Jun 02 19:04:05.082569 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:05.081977 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:04:05.082569 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:05.082036 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:04:05.082569 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:05.082049 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert podName:e722091f-abf8-4361-9442-9a0c103355dc nodeName:}" failed. No retries permitted until 2026-06-02 19:04:07.082030914 +0000 UTC m=+37.642833807 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert") pod "ingress-canary-gdqng" (UID: "e722091f-abf8-4361-9442-9a0c103355dc") : secret "canary-serving-cert" not found Jun 02 19:04:05.082569 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:05.082066 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls podName:37654fa6-9127-48c7-8517-c221330b4460 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:07.082057023 +0000 UTC m=+37.642859904 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls") pod "dns-default-kjwpj" (UID: "37654fa6-9127-48c7-8517-c221330b4460") : secret "dns-default-metrics-tls" not found Jun 02 19:04:05.082569 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:05.082067 2569 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:04:05.082569 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:05.082089 2569 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c5d48869-46n58: secret "image-registry-tls" not found Jun 02 19:04:05.082569 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:05.082167 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls podName:45de563d-69ab-4e4c-87c6-d06c2d4ee695 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:07.082148212 +0000 UTC m=+37.642951097 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls") pod "image-registry-77c5d48869-46n58" (UID: "45de563d-69ab-4e4c-87c6-d06c2d4ee695") : secret "image-registry-tls" not found Jun 02 19:04:05.787166 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:05.787124 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/094221b7-ebed-49a8-b6bb-19635956bceb-original-pull-secret\") pod \"global-pull-secret-syncer-zzdxq\" (UID: \"094221b7-ebed-49a8-b6bb-19635956bceb\") " pod="kube-system/global-pull-secret-syncer-zzdxq" Jun 02 19:04:05.789389 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:05.789369 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/094221b7-ebed-49a8-b6bb-19635956bceb-original-pull-secret\") pod \"global-pull-secret-syncer-zzdxq\" (UID: \"094221b7-ebed-49a8-b6bb-19635956bceb\") " pod="kube-system/global-pull-secret-syncer-zzdxq" Jun 02 19:04:05.809077 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:05.809046 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zzdxq" Jun 02 19:04:05.981880 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:05.981717 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zzdxq"] Jun 02 19:04:06.013638 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:04:06.013477 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod094221b7_ebed_49a8_b6bb_19635956bceb.slice/crio-fb0e61962a8daea7904c17a0f19c91fb190f572db9a32615ef4c406e48fc9d0b WatchSource:0}: Error finding container fb0e61962a8daea7904c17a0f19c91fb190f572db9a32615ef4c406e48fc9d0b: Status 404 returned error can't find the container with id fb0e61962a8daea7904c17a0f19c91fb190f572db9a32615ef4c406e48fc9d0b Jun 02 19:04:06.234980 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:06.234942 2569 generic.go:358] "Generic (PLEG): container finished" podID="a574bbc7-9afe-4c8a-9319-39c5a32a63b9" containerID="f6182c2a1de4e6d3af872f34c1a50dc0d2b83c16e9848fd0ea441fd57b13a52c" exitCode=0 Jun 02 19:04:06.235441 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:06.235033 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7k55l" event={"ID":"a574bbc7-9afe-4c8a-9319-39c5a32a63b9","Type":"ContainerDied","Data":"f6182c2a1de4e6d3af872f34c1a50dc0d2b83c16e9848fd0ea441fd57b13a52c"} Jun 02 19:04:06.236123 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:06.236102 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zzdxq" event={"ID":"094221b7-ebed-49a8-b6bb-19635956bceb","Type":"ContainerStarted","Data":"fb0e61962a8daea7904c17a0f19c91fb190f572db9a32615ef4c406e48fc9d0b"} Jun 02 19:04:07.099043 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:07.099004 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:07.099043 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:07.099052 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls\") pod \"dns-default-kjwpj\" (UID: \"37654fa6-9127-48c7-8517-c221330b4460\") " pod="openshift-dns/dns-default-kjwpj" Jun 02 19:04:07.099278 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:07.099116 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert\") pod \"ingress-canary-gdqng\" (UID: \"e722091f-abf8-4361-9442-9a0c103355dc\") " pod="openshift-ingress-canary/ingress-canary-gdqng" Jun 02 19:04:07.099278 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:07.099173 2569 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:04:07.099278 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:07.099198 2569 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c5d48869-46n58: secret "image-registry-tls" not found Jun 02 19:04:07.099278 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:07.099232 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:04:07.099278 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:07.099232 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:04:07.099278 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:07.099267 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls podName:45de563d-69ab-4e4c-87c6-d06c2d4ee695 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:11.099246941 +0000 UTC m=+41.660049831 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls") pod "image-registry-77c5d48869-46n58" (UID: "45de563d-69ab-4e4c-87c6-d06c2d4ee695") : secret "image-registry-tls" not found Jun 02 19:04:07.099491 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:07.099301 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls podName:37654fa6-9127-48c7-8517-c221330b4460 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:11.099287622 +0000 UTC m=+41.660090505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls") pod "dns-default-kjwpj" (UID: "37654fa6-9127-48c7-8517-c221330b4460") : secret "dns-default-metrics-tls" not found Jun 02 19:04:07.099491 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:07.099319 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert podName:e722091f-abf8-4361-9442-9a0c103355dc nodeName:}" failed. No retries permitted until 2026-06-02 19:04:11.099309642 +0000 UTC m=+41.660112523 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert") pod "ingress-canary-gdqng" (UID: "e722091f-abf8-4361-9442-9a0c103355dc") : secret "canary-serving-cert" not found Jun 02 19:04:07.240712 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:07.240656 2569 generic.go:358] "Generic (PLEG): container finished" podID="a574bbc7-9afe-4c8a-9319-39c5a32a63b9" containerID="b3ff566186a4a5c26d2f9bd415e06bec22ccf740c2ac423ace053664c1796c9a" exitCode=0 Jun 02 19:04:07.241122 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:07.240748 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7k55l" event={"ID":"a574bbc7-9afe-4c8a-9319-39c5a32a63b9","Type":"ContainerDied","Data":"b3ff566186a4a5c26d2f9bd415e06bec22ccf740c2ac423ace053664c1796c9a"} Jun 02 19:04:08.246408 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:08.246179 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7k55l" event={"ID":"a574bbc7-9afe-4c8a-9319-39c5a32a63b9","Type":"ContainerStarted","Data":"ebf41686174e5774032061f10fee8c57c37b8e08dee4351fa3d4eb01368c9b7e"} Jun 02 19:04:10.020348 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:10.020288 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7k55l" podStartSLOduration=6.86755053 podStartE2EDuration="40.020267454s" podCreationTimestamp="2026-06-02 19:03:30 +0000 UTC" firstStartedPulling="2026-06-02 19:03:32.526900423 +0000 UTC m=+3.087703322" lastFinishedPulling="2026-06-02 19:04:05.679617362 +0000 UTC m=+36.240420246" observedRunningTime="2026-06-02 19:04:08.28397738 +0000 UTC m=+38.844780283" watchObservedRunningTime="2026-06-02 19:04:10.020267454 +0000 UTC m=+40.581070357" Jun 02 19:04:11.137524 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:11.137480 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:11.137524 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:11.137527 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls\") pod \"dns-default-kjwpj\" (UID: \"37654fa6-9127-48c7-8517-c221330b4460\") " pod="openshift-dns/dns-default-kjwpj" Jun 02 19:04:11.138011 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:11.137625 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:04:11.138011 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:11.137631 2569 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:04:11.138011 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:11.137650 2569 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c5d48869-46n58: secret "image-registry-tls" not found Jun 02 19:04:11.138011 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:11.137697 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls podName:37654fa6-9127-48c7-8517-c221330b4460 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:19.137665505 +0000 UTC m=+49.698468392 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls") pod "dns-default-kjwpj" (UID: "37654fa6-9127-48c7-8517-c221330b4460") : secret "dns-default-metrics-tls" not found Jun 02 19:04:11.138011 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:11.137754 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls podName:45de563d-69ab-4e4c-87c6-d06c2d4ee695 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:19.137734281 +0000 UTC m=+49.698537166 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls") pod "image-registry-77c5d48869-46n58" (UID: "45de563d-69ab-4e4c-87c6-d06c2d4ee695") : secret "image-registry-tls" not found Jun 02 19:04:11.138011 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:11.137799 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert\") pod \"ingress-canary-gdqng\" (UID: \"e722091f-abf8-4361-9442-9a0c103355dc\") " pod="openshift-ingress-canary/ingress-canary-gdqng" Jun 02 19:04:11.138011 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:11.137894 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:04:11.138011 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:11.137928 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert podName:e722091f-abf8-4361-9442-9a0c103355dc nodeName:}" failed. No retries permitted until 2026-06-02 19:04:19.137917997 +0000 UTC m=+49.698720880 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert") pod "ingress-canary-gdqng" (UID: "e722091f-abf8-4361-9442-9a0c103355dc") : secret "canary-serving-cert" not found Jun 02 19:04:11.253674 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:11.253639 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zzdxq" event={"ID":"094221b7-ebed-49a8-b6bb-19635956bceb","Type":"ContainerStarted","Data":"d699984739235516128e7290b27dfda7348e02dd86993a76bec570f821c387df"} Jun 02 19:04:11.268351 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:11.268303 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zzdxq" podStartSLOduration=17.905668452 podStartE2EDuration="22.26828951s" podCreationTimestamp="2026-06-02 19:03:49 +0000 UTC" firstStartedPulling="2026-06-02 19:04:06.015291313 +0000 UTC m=+36.576094194" lastFinishedPulling="2026-06-02 19:04:10.377912366 +0000 UTC m=+40.938715252" observedRunningTime="2026-06-02 19:04:11.267442619 +0000 UTC m=+41.828245523" watchObservedRunningTime="2026-06-02 19:04:11.26828951 +0000 UTC m=+41.829092413" Jun 02 19:04:19.192966 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:19.192926 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert\") pod \"ingress-canary-gdqng\" (UID: \"e722091f-abf8-4361-9442-9a0c103355dc\") " pod="openshift-ingress-canary/ingress-canary-gdqng" Jun 02 19:04:19.193365 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:19.193008 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:19.193365 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:19.193031 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls\") pod \"dns-default-kjwpj\" (UID: \"37654fa6-9127-48c7-8517-c221330b4460\") " pod="openshift-dns/dns-default-kjwpj" Jun 02 19:04:19.193365 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:19.193093 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:04:19.193365 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:19.193131 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:04:19.193365 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:19.193147 2569 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:04:19.193365 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:19.193162 2569 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c5d48869-46n58: secret "image-registry-tls" not found Jun 02 19:04:19.193365 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:19.193165 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert podName:e722091f-abf8-4361-9442-9a0c103355dc nodeName:}" failed. No retries permitted until 2026-06-02 19:04:35.193147035 +0000 UTC m=+65.753949929 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert") pod "ingress-canary-gdqng" (UID: "e722091f-abf8-4361-9442-9a0c103355dc") : secret "canary-serving-cert" not found Jun 02 19:04:19.193365 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:19.193180 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls podName:37654fa6-9127-48c7-8517-c221330b4460 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:35.193174035 +0000 UTC m=+65.753976916 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls") pod "dns-default-kjwpj" (UID: "37654fa6-9127-48c7-8517-c221330b4460") : secret "dns-default-metrics-tls" not found Jun 02 19:04:19.193365 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:19.193213 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls podName:45de563d-69ab-4e4c-87c6-d06c2d4ee695 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:35.193196756 +0000 UTC m=+65.753999642 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls") pod "image-registry-77c5d48869-46n58" (UID: "45de563d-69ab-4e4c-87c6-d06c2d4ee695") : secret "image-registry-tls" not found Jun 02 19:04:30.236747 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:30.236720 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xz76r" Jun 02 19:04:35.209914 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:35.209859 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:04:35.209914 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:35.209910 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls\") pod \"dns-default-kjwpj\" (UID: \"37654fa6-9127-48c7-8517-c221330b4460\") " pod="openshift-dns/dns-default-kjwpj" Jun 02 19:04:35.210332 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:35.209963 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert\") pod \"ingress-canary-gdqng\" (UID: \"e722091f-abf8-4361-9442-9a0c103355dc\") " pod="openshift-ingress-canary/ingress-canary-gdqng" Jun 02 19:04:35.210332 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:35.210000 2569 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:04:35.210332 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:35.210019 2569 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c5d48869-46n58: secret "image-registry-tls" not found Jun 02 19:04:35.210332 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:35.210061 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:04:35.210332 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:35.210070 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls podName:45de563d-69ab-4e4c-87c6-d06c2d4ee695 nodeName:}" failed. No retries permitted until 2026-06-02 19:05:07.210055676 +0000 UTC m=+97.770858557 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls") pod "image-registry-77c5d48869-46n58" (UID: "45de563d-69ab-4e4c-87c6-d06c2d4ee695") : secret "image-registry-tls" not found Jun 02 19:04:35.210332 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:35.210105 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert podName:e722091f-abf8-4361-9442-9a0c103355dc nodeName:}" failed. No retries permitted until 2026-06-02 19:05:07.210093612 +0000 UTC m=+97.770896493 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert") pod "ingress-canary-gdqng" (UID: "e722091f-abf8-4361-9442-9a0c103355dc") : secret "canary-serving-cert" not found Jun 02 19:04:35.210332 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:35.210061 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:04:35.210332 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:35.210137 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls podName:37654fa6-9127-48c7-8517-c221330b4460 nodeName:}" failed. No retries permitted until 2026-06-02 19:05:07.210127078 +0000 UTC m=+97.770929960 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls") pod "dns-default-kjwpj" (UID: "37654fa6-9127-48c7-8517-c221330b4460") : secret "dns-default-metrics-tls" not found Jun 02 19:04:35.713273 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:35.713235 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs\") pod \"network-metrics-daemon-4vsd7\" (UID: \"18ce0d3d-f461-41fa-95fa-9bb77c484d5d\") " pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:04:35.715620 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:35.715602 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 19:04:35.724328 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:35.724312 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 19:04:35.724439 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:04:35.724377 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs podName:18ce0d3d-f461-41fa-95fa-9bb77c484d5d nodeName:}" failed. No retries permitted until 2026-06-02 19:05:39.724362693 +0000 UTC m=+130.285165574 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs") pod "network-metrics-daemon-4vsd7" (UID: "18ce0d3d-f461-41fa-95fa-9bb77c484d5d") : secret "metrics-daemon-secret" not found Jun 02 19:04:35.814187 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:35.814141 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lnwtz\" (UniqueName: \"kubernetes.io/projected/14752c98-15e2-4594-baee-21a0d3c49b1e-kube-api-access-lnwtz\") pod \"network-check-target-qxvtt\" (UID: \"14752c98-15e2-4594-baee-21a0d3c49b1e\") " pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:04:35.816522 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:35.816506 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 19:04:35.827410 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:35.827394 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 19:04:35.839660 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:35.839638 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnwtz\" (UniqueName: \"kubernetes.io/projected/14752c98-15e2-4594-baee-21a0d3c49b1e-kube-api-access-lnwtz\") pod \"network-check-target-qxvtt\" (UID: \"14752c98-15e2-4594-baee-21a0d3c49b1e\") " pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:04:36.118196 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:36.118114 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-djr2n\"" Jun 02 19:04:36.126892 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:36.126869 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:04:36.265897 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:36.265864 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qxvtt"] Jun 02 19:04:36.269329 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:04:36.269302 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14752c98_15e2_4594_baee_21a0d3c49b1e.slice/crio-f8559999ec72382cb585436aab10e0ea78b5c447f12dba4766f9aa1fc02ac53f WatchSource:0}: Error finding container f8559999ec72382cb585436aab10e0ea78b5c447f12dba4766f9aa1fc02ac53f: Status 404 returned error can't find the container with id f8559999ec72382cb585436aab10e0ea78b5c447f12dba4766f9aa1fc02ac53f Jun 02 19:04:36.300858 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:36.300835 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qxvtt" event={"ID":"14752c98-15e2-4594-baee-21a0d3c49b1e","Type":"ContainerStarted","Data":"f8559999ec72382cb585436aab10e0ea78b5c447f12dba4766f9aa1fc02ac53f"} Jun 02 19:04:40.310047 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:40.310011 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qxvtt" event={"ID":"14752c98-15e2-4594-baee-21a0d3c49b1e","Type":"ContainerStarted","Data":"9bac5d1f72768b5e54258edce6ea3a029762d3868c7c979f5731b1084d65711e"} Jun 02 19:04:40.310429 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:40.310135 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:04:40.324567 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:04:40.324524 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qxvtt" podStartSLOduration=67.104594977 podStartE2EDuration="1m10.324510722s" podCreationTimestamp="2026-06-02 19:03:30 +0000 UTC" firstStartedPulling="2026-06-02 19:04:36.271069416 +0000 UTC m=+66.831872297" lastFinishedPulling="2026-06-02 19:04:39.490985162 +0000 UTC m=+70.051788042" observedRunningTime="2026-06-02 19:04:40.324420837 +0000 UTC m=+70.885223741" watchObservedRunningTime="2026-06-02 19:04:40.324510722 +0000 UTC m=+70.885313624" Jun 02 19:05:07.245931 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:07.245876 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:05:07.245931 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:07.245926 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls\") pod \"dns-default-kjwpj\" (UID: \"37654fa6-9127-48c7-8517-c221330b4460\") " pod="openshift-dns/dns-default-kjwpj" Jun 02 19:05:07.246452 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:07.245980 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert\") pod \"ingress-canary-gdqng\" (UID: \"e722091f-abf8-4361-9442-9a0c103355dc\") " pod="openshift-ingress-canary/ingress-canary-gdqng" Jun 02 19:05:07.246452 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:07.246037 2569 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:05:07.246452 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:07.246059 2569 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c5d48869-46n58: secret "image-registry-tls" not found Jun 02 19:05:07.246452 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:07.246095 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:05:07.246452 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:07.246099 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:05:07.246452 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:07.246139 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls podName:45de563d-69ab-4e4c-87c6-d06c2d4ee695 nodeName:}" failed. No retries permitted until 2026-06-02 19:06:11.246115732 +0000 UTC m=+161.806918614 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls") pod "image-registry-77c5d48869-46n58" (UID: "45de563d-69ab-4e4c-87c6-d06c2d4ee695") : secret "image-registry-tls" not found Jun 02 19:05:07.246452 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:07.246157 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls podName:37654fa6-9127-48c7-8517-c221330b4460 nodeName:}" failed. No retries permitted until 2026-06-02 19:06:11.246147961 +0000 UTC m=+161.806950844 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls") pod "dns-default-kjwpj" (UID: "37654fa6-9127-48c7-8517-c221330b4460") : secret "dns-default-metrics-tls" not found Jun 02 19:05:07.246452 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:07.246170 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert podName:e722091f-abf8-4361-9442-9a0c103355dc nodeName:}" failed. No retries permitted until 2026-06-02 19:06:11.246163573 +0000 UTC m=+161.806966455 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert") pod "ingress-canary-gdqng" (UID: "e722091f-abf8-4361-9442-9a0c103355dc") : secret "canary-serving-cert" not found Jun 02 19:05:11.314766 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:11.314728 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qxvtt" Jun 02 19:05:39.768486 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:39.768429 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs\") pod \"network-metrics-daemon-4vsd7\" (UID: \"18ce0d3d-f461-41fa-95fa-9bb77c484d5d\") " pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:05:39.769158 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:39.768597 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 19:05:39.769158 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:39.768722 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs podName:18ce0d3d-f461-41fa-95fa-9bb77c484d5d nodeName:}" failed. No retries permitted until 2026-06-02 19:07:41.768700508 +0000 UTC m=+252.329503406 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs") pod "network-metrics-daemon-4vsd7" (UID: "18ce0d3d-f461-41fa-95fa-9bb77c484d5d") : secret "metrics-daemon-secret" not found Jun 02 19:05:49.819271 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.819236 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5df97bddf-525zw"] Jun 02 19:05:49.822085 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.822068 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:05:49.824041 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.824018 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 02 19:05:49.824041 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.824037 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 02 19:05:49.824289 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.824272 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 02 19:05:49.824359 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.824288 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 19:05:49.824359 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.824292 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 19:05:49.824440 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.824276 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 02 19:05:49.824440 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.824298 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-m2mqt\"" Jun 02 19:05:49.832514 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.832494 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5df97bddf-525zw"] Jun 02 19:05:49.925471 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.925443 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-dsq5s"] Jun 02 19:05:49.928195 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.928178 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-l54m6"] Jun 02 19:05:49.928344 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.928325 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" Jun 02 19:05:49.930378 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.930338 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 02 19:05:49.930546 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.930527 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6ssjh\"" Jun 02 19:05:49.930642 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.930532 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 02 19:05:49.930776 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.930759 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-9gswq"] Jun 02 19:05:49.930915 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.930886 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:05:49.930974 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.930931 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 02 19:05:49.931056 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.931006 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-l54m6" Jun 02 19:05:49.932926 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.932904 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:05:49.933025 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.932912 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 02 19:05:49.933025 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.932912 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 02 19:05:49.933254 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.933237 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-m229q\"" Jun 02 19:05:49.933573 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.933549 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-9gswq" Jun 02 19:05:49.936029 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.936006 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 19:05:49.936877 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.936860 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 02 19:05:49.940401 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.939184 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 19:05:49.942151 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.942130 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 02 19:05:49.942306 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.942245 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 02 19:05:49.943317 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.943288 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-chb2l\"" Jun 02 19:05:49.944029 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.944010 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-dsq5s"] Jun 02 19:05:49.945369 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.945349 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-9gswq"] Jun 02 19:05:49.945635 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.945615 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-default-certificate\") pod \"router-default-5df97bddf-525zw\" (UID: \"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d\") " pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:05:49.945725 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.945670 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-stats-auth\") pod \"router-default-5df97bddf-525zw\" (UID: \"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d\") " pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:05:49.945792 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.945766 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-service-ca-bundle\") pod \"router-default-5df97bddf-525zw\" (UID: \"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d\") " pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:05:49.945844 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.945793 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-metrics-certs\") pod \"router-default-5df97bddf-525zw\" (UID: \"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d\") " pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:05:49.945898 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.945871 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gjw9\" (UniqueName: \"kubernetes.io/projected/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-kube-api-access-4gjw9\") pod \"router-default-5df97bddf-525zw\" (UID: \"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d\") " pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:05:49.946093 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.946076 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 02 19:05:49.946507 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:49.946490 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-l54m6"] Jun 02 19:05:50.025594 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.025555 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vxtdt"] Jun 02 19:05:50.028427 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.028411 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vxtdt" Jun 02 19:05:50.030791 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.030770 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 02 19:05:50.030886 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.030821 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-l8g72\"" Jun 02 19:05:50.031109 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.031093 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 02 19:05:50.031272 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.031245 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 02 19:05:50.031879 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.031861 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:05:50.044041 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.044018 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vxtdt"] Jun 02 19:05:50.046456 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.046429 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlkdl\" (UniqueName: \"kubernetes.io/projected/975a5e94-6791-4548-8945-a3085447e0d2-kube-api-access-wlkdl\") pod \"insights-operator-788bf58df5-9gswq\" (UID: \"975a5e94-6791-4548-8945-a3085447e0d2\") " pod="openshift-insights/insights-operator-788bf58df5-9gswq" Jun 02 19:05:50.046456 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.046458 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415-trusted-ca\") pod \"console-operator-86d7c6cc77-dsq5s\" (UID: \"3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415\") " pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" Jun 02 19:05:50.046597 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.046479 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-service-ca-bundle\") pod \"router-default-5df97bddf-525zw\" (UID: \"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d\") " pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:05:50.046597 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.046503 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/975a5e94-6791-4548-8945-a3085447e0d2-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-9gswq\" (UID: \"975a5e94-6791-4548-8945-a3085447e0d2\") " pod="openshift-insights/insights-operator-788bf58df5-9gswq" Jun 02 19:05:50.046597 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.046548 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk728\" (UniqueName: \"kubernetes.io/projected/3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415-kube-api-access-qk728\") pod \"console-operator-86d7c6cc77-dsq5s\" (UID: \"3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415\") " pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" Jun 02 19:05:50.046597 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.046568 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4gjw9\" (UniqueName: \"kubernetes.io/projected/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-kube-api-access-4gjw9\") pod \"router-default-5df97bddf-525zw\" (UID: \"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d\") " pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:05:50.046597 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.046592 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/975a5e94-6791-4548-8945-a3085447e0d2-tmp\") pod \"insights-operator-788bf58df5-9gswq\" (UID: \"975a5e94-6791-4548-8945-a3085447e0d2\") " pod="openshift-insights/insights-operator-788bf58df5-9gswq" Jun 02 19:05:50.046794 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:50.046636 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-service-ca-bundle podName:fccebb43-30c1-4fee-a112-ecd9e9dd2f8d nodeName:}" failed. No retries permitted until 2026-06-02 19:05:50.546614681 +0000 UTC m=+141.107417581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-service-ca-bundle") pod "router-default-5df97bddf-525zw" (UID: "fccebb43-30c1-4fee-a112-ecd9e9dd2f8d") : configmap references non-existent config key: service-ca.crt Jun 02 19:05:50.046794 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.046699 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415-serving-cert\") pod \"console-operator-86d7c6cc77-dsq5s\" (UID: \"3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415\") " pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" Jun 02 19:05:50.046794 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.046743 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/975a5e94-6791-4548-8945-a3085447e0d2-service-ca-bundle\") pod \"insights-operator-788bf58df5-9gswq\" (UID: \"975a5e94-6791-4548-8945-a3085447e0d2\") " pod="openshift-insights/insights-operator-788bf58df5-9gswq" Jun 02 19:05:50.046794 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.046769 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb2b4\" (UniqueName: \"kubernetes.io/projected/f4e4ad4e-ed84-4c54-9fb8-4b3481050606-kube-api-access-cb2b4\") pod \"cluster-samples-operator-755bbf9bfb-l54m6\" (UID: \"f4e4ad4e-ed84-4c54-9fb8-4b3481050606\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-l54m6" Jun 02 19:05:50.046968 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.046797 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-stats-auth\") pod \"router-default-5df97bddf-525zw\" (UID: \"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d\") " pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:05:50.046968 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.046851 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/975a5e94-6791-4548-8945-a3085447e0d2-snapshots\") pod \"insights-operator-788bf58df5-9gswq\" (UID: \"975a5e94-6791-4548-8945-a3085447e0d2\") " pod="openshift-insights/insights-operator-788bf58df5-9gswq" Jun 02 19:05:50.046968 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.046939 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/975a5e94-6791-4548-8945-a3085447e0d2-serving-cert\") pod \"insights-operator-788bf58df5-9gswq\" (UID: \"975a5e94-6791-4548-8945-a3085447e0d2\") " pod="openshift-insights/insights-operator-788bf58df5-9gswq" Jun 02 19:05:50.046968 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.046964 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-metrics-certs\") pod \"router-default-5df97bddf-525zw\" (UID: \"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d\") " pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:05:50.047107 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.046985 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4e4ad4e-ed84-4c54-9fb8-4b3481050606-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-l54m6\" (UID: \"f4e4ad4e-ed84-4c54-9fb8-4b3481050606\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-l54m6" Jun 02 19:05:50.047107 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.047017 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415-config\") pod \"console-operator-86d7c6cc77-dsq5s\" (UID: \"3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415\") " pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" Jun 02 19:05:50.047107 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:50.047036 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 19:05:50.047107 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.047053 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-default-certificate\") pod \"router-default-5df97bddf-525zw\" (UID: \"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d\") " pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:05:50.047107 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:50.047081 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-metrics-certs podName:fccebb43-30c1-4fee-a112-ecd9e9dd2f8d nodeName:}" failed. No retries permitted until 2026-06-02 19:05:50.547068519 +0000 UTC m=+141.107871417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-metrics-certs") pod "router-default-5df97bddf-525zw" (UID: "fccebb43-30c1-4fee-a112-ecd9e9dd2f8d") : secret "router-metrics-certs-default" not found Jun 02 19:05:50.049304 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.049281 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-default-certificate\") pod \"router-default-5df97bddf-525zw\" (UID: \"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d\") " pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:05:50.049304 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.049289 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-stats-auth\") pod \"router-default-5df97bddf-525zw\" (UID: \"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d\") " pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:05:50.064106 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.064073 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gjw9\" (UniqueName: \"kubernetes.io/projected/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-kube-api-access-4gjw9\") pod \"router-default-5df97bddf-525zw\" (UID: \"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d\") " pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:05:50.148437 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.148326 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/975a5e94-6791-4548-8945-a3085447e0d2-service-ca-bundle\") pod \"insights-operator-788bf58df5-9gswq\" (UID: \"975a5e94-6791-4548-8945-a3085447e0d2\") " pod="openshift-insights/insights-operator-788bf58df5-9gswq" Jun 02 19:05:50.148437 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.148378 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cb2b4\" (UniqueName: \"kubernetes.io/projected/f4e4ad4e-ed84-4c54-9fb8-4b3481050606-kube-api-access-cb2b4\") pod \"cluster-samples-operator-755bbf9bfb-l54m6\" (UID: \"f4e4ad4e-ed84-4c54-9fb8-4b3481050606\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-l54m6" Jun 02 19:05:50.148437 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.148405 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/975a5e94-6791-4548-8945-a3085447e0d2-snapshots\") pod \"insights-operator-788bf58df5-9gswq\" (UID: \"975a5e94-6791-4548-8945-a3085447e0d2\") " pod="openshift-insights/insights-operator-788bf58df5-9gswq" Jun 02 19:05:50.148437 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.148421 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/975a5e94-6791-4548-8945-a3085447e0d2-serving-cert\") pod \"insights-operator-788bf58df5-9gswq\" (UID: \"975a5e94-6791-4548-8945-a3085447e0d2\") " pod="openshift-insights/insights-operator-788bf58df5-9gswq" Jun 02 19:05:50.148437 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.148452 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4e4ad4e-ed84-4c54-9fb8-4b3481050606-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-l54m6\" (UID: \"f4e4ad4e-ed84-4c54-9fb8-4b3481050606\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-l54m6" Jun 02 19:05:50.148909 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.148535 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415-config\") pod \"console-operator-86d7c6cc77-dsq5s\" (UID: \"3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415\") " pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" Jun 02 19:05:50.148909 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:50.148549 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 19:05:50.148909 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.148601 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-vxtdt\" (UID: \"fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vxtdt" Jun 02 19:05:50.148909 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:50.148618 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4e4ad4e-ed84-4c54-9fb8-4b3481050606-samples-operator-tls podName:f4e4ad4e-ed84-4c54-9fb8-4b3481050606 nodeName:}" failed. No retries permitted until 2026-06-02 19:05:50.648597628 +0000 UTC m=+141.209400510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f4e4ad4e-ed84-4c54-9fb8-4b3481050606-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-l54m6" (UID: "f4e4ad4e-ed84-4c54-9fb8-4b3481050606") : secret "samples-operator-tls" not found Jun 02 19:05:50.148909 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.148653 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-vxtdt\" (UID: \"fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vxtdt" Jun 02 19:05:50.148909 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.148721 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wlkdl\" (UniqueName: \"kubernetes.io/projected/975a5e94-6791-4548-8945-a3085447e0d2-kube-api-access-wlkdl\") pod \"insights-operator-788bf58df5-9gswq\" (UID: \"975a5e94-6791-4548-8945-a3085447e0d2\") " pod="openshift-insights/insights-operator-788bf58df5-9gswq" Jun 02 19:05:50.148909 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.148749 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415-trusted-ca\") pod \"console-operator-86d7c6cc77-dsq5s\" (UID: \"3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415\") " pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" Jun 02 19:05:50.148909 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.148811 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq452\" (UniqueName: \"kubernetes.io/projected/fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924-kube-api-access-pq452\") pod \"kube-storage-version-migrator-operator-96ddc787c-vxtdt\" (UID: \"fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vxtdt" Jun 02 19:05:50.148909 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.148874 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/975a5e94-6791-4548-8945-a3085447e0d2-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-9gswq\" (UID: \"975a5e94-6791-4548-8945-a3085447e0d2\") " pod="openshift-insights/insights-operator-788bf58df5-9gswq" Jun 02 19:05:50.149464 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.148920 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qk728\" (UniqueName: \"kubernetes.io/projected/3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415-kube-api-access-qk728\") pod \"console-operator-86d7c6cc77-dsq5s\" (UID: \"3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415\") " pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" Jun 02 19:05:50.149464 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.148956 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/975a5e94-6791-4548-8945-a3085447e0d2-tmp\") pod \"insights-operator-788bf58df5-9gswq\" (UID: \"975a5e94-6791-4548-8945-a3085447e0d2\") " pod="openshift-insights/insights-operator-788bf58df5-9gswq" Jun 02 19:05:50.149464 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.148998 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415-serving-cert\") pod \"console-operator-86d7c6cc77-dsq5s\" (UID: \"3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415\") " pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" Jun 02 19:05:50.149464 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.149148 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/975a5e94-6791-4548-8945-a3085447e0d2-service-ca-bundle\") pod \"insights-operator-788bf58df5-9gswq\" (UID: \"975a5e94-6791-4548-8945-a3085447e0d2\") " pod="openshift-insights/insights-operator-788bf58df5-9gswq" Jun 02 19:05:50.149464 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.149254 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/975a5e94-6791-4548-8945-a3085447e0d2-snapshots\") pod \"insights-operator-788bf58df5-9gswq\" (UID: \"975a5e94-6791-4548-8945-a3085447e0d2\") " pod="openshift-insights/insights-operator-788bf58df5-9gswq" Jun 02 19:05:50.149464 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.149325 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415-config\") pod \"console-operator-86d7c6cc77-dsq5s\" (UID: \"3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415\") " pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" Jun 02 19:05:50.149665 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.149561 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/975a5e94-6791-4548-8945-a3085447e0d2-tmp\") pod \"insights-operator-788bf58df5-9gswq\" (UID: \"975a5e94-6791-4548-8945-a3085447e0d2\") " pod="openshift-insights/insights-operator-788bf58df5-9gswq" Jun 02 19:05:50.149715 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.149661 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415-trusted-ca\") pod \"console-operator-86d7c6cc77-dsq5s\" (UID: \"3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415\") " pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" Jun 02 19:05:50.149777 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.149760 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/975a5e94-6791-4548-8945-a3085447e0d2-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-9gswq\" (UID: \"975a5e94-6791-4548-8945-a3085447e0d2\") " pod="openshift-insights/insights-operator-788bf58df5-9gswq" Jun 02 19:05:50.151131 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.151110 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/975a5e94-6791-4548-8945-a3085447e0d2-serving-cert\") pod \"insights-operator-788bf58df5-9gswq\" (UID: \"975a5e94-6791-4548-8945-a3085447e0d2\") " pod="openshift-insights/insights-operator-788bf58df5-9gswq" Jun 02 19:05:50.151209 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.151143 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415-serving-cert\") pod \"console-operator-86d7c6cc77-dsq5s\" (UID: \"3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415\") " pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" Jun 02 19:05:50.158819 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.158799 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlkdl\" (UniqueName: \"kubernetes.io/projected/975a5e94-6791-4548-8945-a3085447e0d2-kube-api-access-wlkdl\") pod \"insights-operator-788bf58df5-9gswq\" (UID: \"975a5e94-6791-4548-8945-a3085447e0d2\") " pod="openshift-insights/insights-operator-788bf58df5-9gswq" Jun 02 19:05:50.158924 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.158843 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk728\" (UniqueName: \"kubernetes.io/projected/3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415-kube-api-access-qk728\") pod \"console-operator-86d7c6cc77-dsq5s\" (UID: \"3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415\") " pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" Jun 02 19:05:50.158924 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.158860 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb2b4\" (UniqueName: \"kubernetes.io/projected/f4e4ad4e-ed84-4c54-9fb8-4b3481050606-kube-api-access-cb2b4\") pod \"cluster-samples-operator-755bbf9bfb-l54m6\" (UID: \"f4e4ad4e-ed84-4c54-9fb8-4b3481050606\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-l54m6" Jun 02 19:05:50.243276 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.243238 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" Jun 02 19:05:50.250308 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.250286 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-vxtdt\" (UID: \"fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vxtdt" Jun 02 19:05:50.250443 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.250320 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-vxtdt\" (UID: \"fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vxtdt" Jun 02 19:05:50.250443 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.250360 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pq452\" (UniqueName: \"kubernetes.io/projected/fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924-kube-api-access-pq452\") pod \"kube-storage-version-migrator-operator-96ddc787c-vxtdt\" (UID: \"fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vxtdt" Jun 02 19:05:50.251015 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.250990 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-vxtdt\" (UID: \"fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vxtdt" Jun 02 19:05:50.252382 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.252363 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-vxtdt\" (UID: \"fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vxtdt" Jun 02 19:05:50.254414 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.254396 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-9gswq" Jun 02 19:05:50.259497 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.259473 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq452\" (UniqueName: \"kubernetes.io/projected/fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924-kube-api-access-pq452\") pod \"kube-storage-version-migrator-operator-96ddc787c-vxtdt\" (UID: \"fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vxtdt" Jun 02 19:05:50.337643 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.337599 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vxtdt" Jun 02 19:05:50.389121 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.389058 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-dsq5s"] Jun 02 19:05:50.393606 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:05:50.393562 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c4d756d_6bf1_4ad4_b7cc_a06e10ac9415.slice/crio-5ae35eb22ed2aa11a0c3f5ba4229a1b30bc3f87d86f5553e997a5f4ce0326c3b WatchSource:0}: Error finding container 5ae35eb22ed2aa11a0c3f5ba4229a1b30bc3f87d86f5553e997a5f4ce0326c3b: Status 404 returned error can't find the container with id 5ae35eb22ed2aa11a0c3f5ba4229a1b30bc3f87d86f5553e997a5f4ce0326c3b Jun 02 19:05:50.397783 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.397755 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-9gswq"] Jun 02 19:05:50.400574 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:05:50.400548 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod975a5e94_6791_4548_8945_a3085447e0d2.slice/crio-6190b57c134297e35a2bae45c51f792db9d6cd987eb873df1bec19e43866e1c5 WatchSource:0}: Error finding container 6190b57c134297e35a2bae45c51f792db9d6cd987eb873df1bec19e43866e1c5: Status 404 returned error can't find the container with id 6190b57c134297e35a2bae45c51f792db9d6cd987eb873df1bec19e43866e1c5 Jun 02 19:05:50.446178 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.446145 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" event={"ID":"3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415","Type":"ContainerStarted","Data":"5ae35eb22ed2aa11a0c3f5ba4229a1b30bc3f87d86f5553e997a5f4ce0326c3b"} Jun 02 19:05:50.447078 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.447054 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-9gswq" event={"ID":"975a5e94-6791-4548-8945-a3085447e0d2","Type":"ContainerStarted","Data":"6190b57c134297e35a2bae45c51f792db9d6cd987eb873df1bec19e43866e1c5"} Jun 02 19:05:50.465387 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.465359 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vxtdt"] Jun 02 19:05:50.468522 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:05:50.468500 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb2d9d03_4df2_4e9c_8982_2b4c7b4c7924.slice/crio-486c342715131e147df06de1e765e0641a2952888c21ffa359b3ca639df003b5 WatchSource:0}: Error finding container 486c342715131e147df06de1e765e0641a2952888c21ffa359b3ca639df003b5: Status 404 returned error can't find the container with id 486c342715131e147df06de1e765e0641a2952888c21ffa359b3ca639df003b5 Jun 02 19:05:50.553512 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.553478 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-metrics-certs\") pod \"router-default-5df97bddf-525zw\" (UID: \"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d\") " pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:05:50.553712 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.553586 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-service-ca-bundle\") pod \"router-default-5df97bddf-525zw\" (UID: \"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d\") " pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:05:50.553712 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:50.553633 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 19:05:50.553792 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:50.553721 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-metrics-certs podName:fccebb43-30c1-4fee-a112-ecd9e9dd2f8d nodeName:}" failed. No retries permitted until 2026-06-02 19:05:51.553706711 +0000 UTC m=+142.114509596 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-metrics-certs") pod "router-default-5df97bddf-525zw" (UID: "fccebb43-30c1-4fee-a112-ecd9e9dd2f8d") : secret "router-metrics-certs-default" not found Jun 02 19:05:50.553792 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:50.553773 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-service-ca-bundle podName:fccebb43-30c1-4fee-a112-ecd9e9dd2f8d nodeName:}" failed. No retries permitted until 2026-06-02 19:05:51.553758472 +0000 UTC m=+142.114561353 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-service-ca-bundle") pod "router-default-5df97bddf-525zw" (UID: "fccebb43-30c1-4fee-a112-ecd9e9dd2f8d") : configmap references non-existent config key: service-ca.crt Jun 02 19:05:50.654291 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:50.654200 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4e4ad4e-ed84-4c54-9fb8-4b3481050606-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-l54m6\" (UID: \"f4e4ad4e-ed84-4c54-9fb8-4b3481050606\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-l54m6" Jun 02 19:05:50.654435 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:50.654337 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 19:05:50.654435 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:50.654399 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4e4ad4e-ed84-4c54-9fb8-4b3481050606-samples-operator-tls podName:f4e4ad4e-ed84-4c54-9fb8-4b3481050606 nodeName:}" failed. No retries permitted until 2026-06-02 19:05:51.654385322 +0000 UTC m=+142.215188203 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f4e4ad4e-ed84-4c54-9fb8-4b3481050606-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-l54m6" (UID: "f4e4ad4e-ed84-4c54-9fb8-4b3481050606") : secret "samples-operator-tls" not found Jun 02 19:05:51.450574 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:51.450522 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vxtdt" event={"ID":"fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924","Type":"ContainerStarted","Data":"486c342715131e147df06de1e765e0641a2952888c21ffa359b3ca639df003b5"} Jun 02 19:05:51.564539 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:51.563746 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-metrics-certs\") pod \"router-default-5df97bddf-525zw\" (UID: \"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d\") " pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:05:51.564539 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:51.563867 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-service-ca-bundle\") pod \"router-default-5df97bddf-525zw\" (UID: \"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d\") " pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:05:51.564539 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:51.564037 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-service-ca-bundle podName:fccebb43-30c1-4fee-a112-ecd9e9dd2f8d nodeName:}" failed. No retries permitted until 2026-06-02 19:05:53.564017028 +0000 UTC m=+144.124819916 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-service-ca-bundle") pod "router-default-5df97bddf-525zw" (UID: "fccebb43-30c1-4fee-a112-ecd9e9dd2f8d") : configmap references non-existent config key: service-ca.crt Jun 02 19:05:51.564539 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:51.564449 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 19:05:51.564539 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:51.564500 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-metrics-certs podName:fccebb43-30c1-4fee-a112-ecd9e9dd2f8d nodeName:}" failed. No retries permitted until 2026-06-02 19:05:53.564484989 +0000 UTC m=+144.125287876 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-metrics-certs") pod "router-default-5df97bddf-525zw" (UID: "fccebb43-30c1-4fee-a112-ecd9e9dd2f8d") : secret "router-metrics-certs-default" not found Jun 02 19:05:51.664730 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:51.664690 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4e4ad4e-ed84-4c54-9fb8-4b3481050606-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-l54m6\" (UID: \"f4e4ad4e-ed84-4c54-9fb8-4b3481050606\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-l54m6" Jun 02 19:05:51.664910 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:51.664853 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 19:05:51.664972 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:51.664935 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4e4ad4e-ed84-4c54-9fb8-4b3481050606-samples-operator-tls podName:f4e4ad4e-ed84-4c54-9fb8-4b3481050606 nodeName:}" failed. No retries permitted until 2026-06-02 19:05:53.664915325 +0000 UTC m=+144.225718212 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f4e4ad4e-ed84-4c54-9fb8-4b3481050606-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-l54m6" (UID: "f4e4ad4e-ed84-4c54-9fb8-4b3481050606") : secret "samples-operator-tls" not found Jun 02 19:05:53.269113 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:53.269078 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-7fks2"] Jun 02 19:05:53.272400 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:53.272379 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-7fks2" Jun 02 19:05:53.274429 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:53.274405 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-nmvx8\"" Jun 02 19:05:53.279265 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:53.279240 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-7fks2"] Jun 02 19:05:53.379833 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:53.379789 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqtl4\" (UniqueName: \"kubernetes.io/projected/14302789-9dd4-4aac-b9fd-4343c1426ebc-kube-api-access-gqtl4\") pod \"network-check-source-56d84b9f44-7fks2\" (UID: \"14302789-9dd4-4aac-b9fd-4343c1426ebc\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-7fks2" Jun 02 19:05:53.480537 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:53.480504 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gqtl4\" (UniqueName: \"kubernetes.io/projected/14302789-9dd4-4aac-b9fd-4343c1426ebc-kube-api-access-gqtl4\") pod \"network-check-source-56d84b9f44-7fks2\" (UID: \"14302789-9dd4-4aac-b9fd-4343c1426ebc\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-7fks2" Jun 02 19:05:53.489384 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:53.489349 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqtl4\" (UniqueName: \"kubernetes.io/projected/14302789-9dd4-4aac-b9fd-4343c1426ebc-kube-api-access-gqtl4\") pod \"network-check-source-56d84b9f44-7fks2\" (UID: \"14302789-9dd4-4aac-b9fd-4343c1426ebc\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-7fks2" Jun 02 19:05:53.581522 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:53.581428 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-service-ca-bundle\") pod \"router-default-5df97bddf-525zw\" (UID: \"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d\") " pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:05:53.581709 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:53.581523 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-metrics-certs\") pod \"router-default-5df97bddf-525zw\" (UID: \"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d\") " pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:05:53.581709 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:53.581596 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-service-ca-bundle podName:fccebb43-30c1-4fee-a112-ecd9e9dd2f8d nodeName:}" failed. No retries permitted until 2026-06-02 19:05:57.581576616 +0000 UTC m=+148.142379510 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-service-ca-bundle") pod "router-default-5df97bddf-525zw" (UID: "fccebb43-30c1-4fee-a112-ecd9e9dd2f8d") : configmap references non-existent config key: service-ca.crt Jun 02 19:05:53.581709 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:53.581630 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 19:05:53.581709 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:53.581666 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-metrics-certs podName:fccebb43-30c1-4fee-a112-ecd9e9dd2f8d nodeName:}" failed. No retries permitted until 2026-06-02 19:05:57.581655955 +0000 UTC m=+148.142458837 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-metrics-certs") pod "router-default-5df97bddf-525zw" (UID: "fccebb43-30c1-4fee-a112-ecd9e9dd2f8d") : secret "router-metrics-certs-default" not found Jun 02 19:05:53.583309 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:53.583281 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-7fks2" Jun 02 19:05:53.682887 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:53.682329 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4e4ad4e-ed84-4c54-9fb8-4b3481050606-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-l54m6\" (UID: \"f4e4ad4e-ed84-4c54-9fb8-4b3481050606\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-l54m6" Jun 02 19:05:53.682887 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:53.682509 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 19:05:53.682887 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:53.682561 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4e4ad4e-ed84-4c54-9fb8-4b3481050606-samples-operator-tls podName:f4e4ad4e-ed84-4c54-9fb8-4b3481050606 nodeName:}" failed. No retries permitted until 2026-06-02 19:05:57.682543761 +0000 UTC m=+148.243346646 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f4e4ad4e-ed84-4c54-9fb8-4b3481050606-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-l54m6" (UID: "f4e4ad4e-ed84-4c54-9fb8-4b3481050606") : secret "samples-operator-tls" not found Jun 02 19:05:53.788633 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:53.788575 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-7fks2"] Jun 02 19:05:53.794063 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:05:53.794016 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14302789_9dd4_4aac_b9fd_4343c1426ebc.slice/crio-f415dd8ad13c7e9d5caf1b8521318e58cc17a15df8ffe0a2c27d9cfc8ae958eb WatchSource:0}: Error finding container f415dd8ad13c7e9d5caf1b8521318e58cc17a15df8ffe0a2c27d9cfc8ae958eb: Status 404 returned error can't find the container with id f415dd8ad13c7e9d5caf1b8521318e58cc17a15df8ffe0a2c27d9cfc8ae958eb Jun 02 19:05:54.460968 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:54.460928 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-9gswq" event={"ID":"975a5e94-6791-4548-8945-a3085447e0d2","Type":"ContainerStarted","Data":"4306c70440659d83618864282e698113e00b91ac1e24f042e6afb5367aaac746"} Jun 02 19:05:54.462648 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:54.462623 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-dsq5s_3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415/console-operator/0.log" Jun 02 19:05:54.462805 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:54.462669 2569 generic.go:358] "Generic (PLEG): container finished" podID="3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415" containerID="67362f4b0aecbfc94a6df59d5276c04e72743e781819c2d9c3de6d2108f007cb" exitCode=255 Jun 02 19:05:54.462805 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:54.462783 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" event={"ID":"3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415","Type":"ContainerDied","Data":"67362f4b0aecbfc94a6df59d5276c04e72743e781819c2d9c3de6d2108f007cb"} Jun 02 19:05:54.462987 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:54.462964 2569 scope.go:117] "RemoveContainer" containerID="67362f4b0aecbfc94a6df59d5276c04e72743e781819c2d9c3de6d2108f007cb" Jun 02 19:05:54.464605 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:54.464585 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-7fks2" event={"ID":"14302789-9dd4-4aac-b9fd-4343c1426ebc","Type":"ContainerStarted","Data":"07fbcead3141d66e4b4443a15a01c6db6b4c58b0c8c219fd2a5a6820ab53621e"} Jun 02 19:05:54.464760 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:54.464745 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-7fks2" event={"ID":"14302789-9dd4-4aac-b9fd-4343c1426ebc","Type":"ContainerStarted","Data":"f415dd8ad13c7e9d5caf1b8521318e58cc17a15df8ffe0a2c27d9cfc8ae958eb"} Jun 02 19:05:54.465940 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:54.465917 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vxtdt" event={"ID":"fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924","Type":"ContainerStarted","Data":"a31d779ee2519dc8cd62e6965b15113e90984f582aca8821460ec1cffc2db98f"} Jun 02 19:05:54.477228 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:54.477190 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-9gswq" podStartSLOduration=2.217678283 podStartE2EDuration="5.477178122s" podCreationTimestamp="2026-06-02 19:05:49 +0000 UTC" firstStartedPulling="2026-06-02 19:05:50.402365194 +0000 UTC m=+140.963168075" lastFinishedPulling="2026-06-02 19:05:53.661865031 +0000 UTC m=+144.222667914" observedRunningTime="2026-06-02 19:05:54.476554998 +0000 UTC m=+145.037357902" watchObservedRunningTime="2026-06-02 19:05:54.477178122 +0000 UTC m=+145.037981019" Jun 02 19:05:54.506593 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:54.506539 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vxtdt" podStartSLOduration=1.311099789 podStartE2EDuration="4.506519475s" podCreationTimestamp="2026-06-02 19:05:50 +0000 UTC" firstStartedPulling="2026-06-02 19:05:50.471824587 +0000 UTC m=+141.032627472" lastFinishedPulling="2026-06-02 19:05:53.667244273 +0000 UTC m=+144.228047158" observedRunningTime="2026-06-02 19:05:54.50545798 +0000 UTC m=+145.066260898" watchObservedRunningTime="2026-06-02 19:05:54.506519475 +0000 UTC m=+145.067322379" Jun 02 19:05:54.518699 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:54.518611 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-7fks2" podStartSLOduration=1.518594811 podStartE2EDuration="1.518594811s" podCreationTimestamp="2026-06-02 19:05:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:05:54.51851651 +0000 UTC m=+145.079319414" watchObservedRunningTime="2026-06-02 19:05:54.518594811 +0000 UTC m=+145.079397714" Jun 02 19:05:54.672451 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:54.672415 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-mg8wz"] Jun 02 19:05:54.675588 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:54.675569 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-mg8wz" Jun 02 19:05:54.677806 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:54.677740 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 02 19:05:54.678358 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:54.678103 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 02 19:05:54.678358 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:54.678180 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-2qsns\"" Jun 02 19:05:54.681448 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:54.681427 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-mg8wz"] Jun 02 19:05:54.793158 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:54.793055 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpwrn\" (UniqueName: \"kubernetes.io/projected/24835e19-dac8-49b1-b946-a65ee150f15f-kube-api-access-gpwrn\") pod \"migrator-96c6f749-mg8wz\" (UID: \"24835e19-dac8-49b1-b946-a65ee150f15f\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-mg8wz" Jun 02 19:05:54.898442 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:54.898404 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gpwrn\" (UniqueName: \"kubernetes.io/projected/24835e19-dac8-49b1-b946-a65ee150f15f-kube-api-access-gpwrn\") pod \"migrator-96c6f749-mg8wz\" (UID: \"24835e19-dac8-49b1-b946-a65ee150f15f\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-mg8wz" Jun 02 19:05:54.905589 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:54.905557 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpwrn\" (UniqueName: \"kubernetes.io/projected/24835e19-dac8-49b1-b946-a65ee150f15f-kube-api-access-gpwrn\") pod \"migrator-96c6f749-mg8wz\" (UID: \"24835e19-dac8-49b1-b946-a65ee150f15f\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-mg8wz" Jun 02 19:05:54.986776 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:54.986747 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-mg8wz" Jun 02 19:05:55.117446 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:55.117416 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-mg8wz"] Jun 02 19:05:55.120474 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:05:55.120446 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24835e19_dac8_49b1_b946_a65ee150f15f.slice/crio-ae57da3c7a31a552d58ae64a24f24aa74f8562f48cef93a0e299e525607c147e WatchSource:0}: Error finding container ae57da3c7a31a552d58ae64a24f24aa74f8562f48cef93a0e299e525607c147e: Status 404 returned error can't find the container with id ae57da3c7a31a552d58ae64a24f24aa74f8562f48cef93a0e299e525607c147e Jun 02 19:05:55.469668 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:55.469637 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-mg8wz" event={"ID":"24835e19-dac8-49b1-b946-a65ee150f15f","Type":"ContainerStarted","Data":"ae57da3c7a31a552d58ae64a24f24aa74f8562f48cef93a0e299e525607c147e"} Jun 02 19:05:55.470919 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:55.470900 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-dsq5s_3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415/console-operator/1.log" Jun 02 19:05:55.471242 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:55.471228 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-dsq5s_3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415/console-operator/0.log" Jun 02 19:05:55.471287 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:55.471260 2569 generic.go:358] "Generic (PLEG): container finished" podID="3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415" containerID="7502c723e1972f6139e5e74777d2d73bfadbcf6923d85920f3a563a613ebe8e9" exitCode=255 Jun 02 19:05:55.471326 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:55.471289 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" event={"ID":"3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415","Type":"ContainerDied","Data":"7502c723e1972f6139e5e74777d2d73bfadbcf6923d85920f3a563a613ebe8e9"} Jun 02 19:05:55.471366 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:55.471339 2569 scope.go:117] "RemoveContainer" containerID="67362f4b0aecbfc94a6df59d5276c04e72743e781819c2d9c3de6d2108f007cb" Jun 02 19:05:55.471858 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:55.471838 2569 scope.go:117] "RemoveContainer" containerID="7502c723e1972f6139e5e74777d2d73bfadbcf6923d85920f3a563a613ebe8e9" Jun 02 19:05:55.472030 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:55.472003 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-dsq5s_openshift-console-operator(3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" podUID="3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415" Jun 02 19:05:56.475671 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:56.475645 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-dsq5s_3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415/console-operator/1.log" Jun 02 19:05:56.476073 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:56.476041 2569 scope.go:117] "RemoveContainer" containerID="7502c723e1972f6139e5e74777d2d73bfadbcf6923d85920f3a563a613ebe8e9" Jun 02 19:05:56.476274 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:56.476249 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-dsq5s_openshift-console-operator(3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" podUID="3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415" Jun 02 19:05:57.481004 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:57.480965 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-mg8wz" event={"ID":"24835e19-dac8-49b1-b946-a65ee150f15f","Type":"ContainerStarted","Data":"d5b6e73828bba53021e17c0be22bf6dcfe1d1b400afd23c30c5fb913c7cebd41"} Jun 02 19:05:57.481004 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:57.481005 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-mg8wz" event={"ID":"24835e19-dac8-49b1-b946-a65ee150f15f","Type":"ContainerStarted","Data":"f2ea37b57921836ef7bb26760607bcc2f0230dc917f60e32fc27425ad7265cb4"} Jun 02 19:05:57.499549 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:57.499487 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-mg8wz" podStartSLOduration=1.942690946 podStartE2EDuration="3.49947219s" podCreationTimestamp="2026-06-02 19:05:54 +0000 UTC" firstStartedPulling="2026-06-02 19:05:55.122307231 +0000 UTC m=+145.683110117" lastFinishedPulling="2026-06-02 19:05:56.679088471 +0000 UTC m=+147.239891361" observedRunningTime="2026-06-02 19:05:57.498832576 +0000 UTC m=+148.059635478" watchObservedRunningTime="2026-06-02 19:05:57.49947219 +0000 UTC m=+148.060275093" Jun 02 19:05:57.571363 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:57.571341 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rrknd_597d1a89-5f63-4e9e-9c43-6d841864384a/dns-node-resolver/0.log" Jun 02 19:05:57.621997 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:57.621948 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-metrics-certs\") pod \"router-default-5df97bddf-525zw\" (UID: \"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d\") " pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:05:57.622167 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:57.622050 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-service-ca-bundle\") pod \"router-default-5df97bddf-525zw\" (UID: \"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d\") " pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:05:57.622167 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:57.622104 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 19:05:57.622261 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:57.622184 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-metrics-certs podName:fccebb43-30c1-4fee-a112-ecd9e9dd2f8d nodeName:}" failed. No retries permitted until 2026-06-02 19:06:05.622161781 +0000 UTC m=+156.182964662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-metrics-certs") pod "router-default-5df97bddf-525zw" (UID: "fccebb43-30c1-4fee-a112-ecd9e9dd2f8d") : secret "router-metrics-certs-default" not found Jun 02 19:05:57.622261 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:57.622248 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-service-ca-bundle podName:fccebb43-30c1-4fee-a112-ecd9e9dd2f8d nodeName:}" failed. No retries permitted until 2026-06-02 19:06:05.622222895 +0000 UTC m=+156.183025781 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-service-ca-bundle") pod "router-default-5df97bddf-525zw" (UID: "fccebb43-30c1-4fee-a112-ecd9e9dd2f8d") : configmap references non-existent config key: service-ca.crt Jun 02 19:05:57.722720 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:57.722665 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4e4ad4e-ed84-4c54-9fb8-4b3481050606-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-l54m6\" (UID: \"f4e4ad4e-ed84-4c54-9fb8-4b3481050606\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-l54m6" Jun 02 19:05:57.722858 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:57.722805 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 19:05:57.722921 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:05:57.722867 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4e4ad4e-ed84-4c54-9fb8-4b3481050606-samples-operator-tls podName:f4e4ad4e-ed84-4c54-9fb8-4b3481050606 nodeName:}" failed. No retries permitted until 2026-06-02 19:06:05.722852072 +0000 UTC m=+156.283654953 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f4e4ad4e-ed84-4c54-9fb8-4b3481050606-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-l54m6" (UID: "f4e4ad4e-ed84-4c54-9fb8-4b3481050606") : secret "samples-operator-tls" not found Jun 02 19:05:58.589550 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:58.589523 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nqr8d_a534831c-1da1-4acc-85ae-6e089da15b9c/node-ca/0.log" Jun 02 19:05:59.772119 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:59.772087 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-mg8wz_24835e19-dac8-49b1-b946-a65ee150f15f/migrator/0.log" Jun 02 19:05:59.972005 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:05:59.971977 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-mg8wz_24835e19-dac8-49b1-b946-a65ee150f15f/graceful-termination/0.log" Jun 02 19:06:00.172864 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:00.172779 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-vxtdt_fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924/kube-storage-version-migrator-operator/0.log" Jun 02 19:06:00.243341 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:00.243312 2569 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" Jun 02 19:06:00.243341 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:00.243341 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" Jun 02 19:06:00.243654 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:00.243640 2569 scope.go:117] "RemoveContainer" containerID="7502c723e1972f6139e5e74777d2d73bfadbcf6923d85920f3a563a613ebe8e9" Jun 02 19:06:00.243840 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:06:00.243821 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-dsq5s_openshift-console-operator(3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" podUID="3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415" Jun 02 19:06:05.687890 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:05.687850 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-service-ca-bundle\") pod \"router-default-5df97bddf-525zw\" (UID: \"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d\") " pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:06:05.688282 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:05.687933 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-metrics-certs\") pod \"router-default-5df97bddf-525zw\" (UID: \"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d\") " pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:06:05.688596 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:05.688565 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-service-ca-bundle\") pod \"router-default-5df97bddf-525zw\" (UID: \"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d\") " pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:06:05.690285 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:05.690266 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fccebb43-30c1-4fee-a112-ecd9e9dd2f8d-metrics-certs\") pod \"router-default-5df97bddf-525zw\" (UID: \"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d\") " pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:06:05.731268 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:05.731231 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:06:05.789440 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:05.789393 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4e4ad4e-ed84-4c54-9fb8-4b3481050606-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-l54m6\" (UID: \"f4e4ad4e-ed84-4c54-9fb8-4b3481050606\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-l54m6" Jun 02 19:06:05.793120 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:05.793053 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4e4ad4e-ed84-4c54-9fb8-4b3481050606-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-l54m6\" (UID: \"f4e4ad4e-ed84-4c54-9fb8-4b3481050606\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-l54m6" Jun 02 19:06:05.849499 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:05.849460 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-l54m6" Jun 02 19:06:05.859517 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:05.859481 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5df97bddf-525zw"] Jun 02 19:06:05.862295 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:06:05.862263 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfccebb43_30c1_4fee_a112_ecd9e9dd2f8d.slice/crio-a9816c0d13fd24d694e08d4b619632cd900411b9aa113c603883f07208a8c220 WatchSource:0}: Error finding container a9816c0d13fd24d694e08d4b619632cd900411b9aa113c603883f07208a8c220: Status 404 returned error can't find the container with id a9816c0d13fd24d694e08d4b619632cd900411b9aa113c603883f07208a8c220 Jun 02 19:06:05.980758 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:05.980663 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-l54m6"] Jun 02 19:06:06.342597 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:06:06.342504 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-77c5d48869-46n58" podUID="45de563d-69ab-4e4c-87c6-d06c2d4ee695" Jun 02 19:06:06.360610 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:06:06.360573 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kjwpj" podUID="37654fa6-9127-48c7-8517-c221330b4460" Jun 02 19:06:06.367739 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:06:06.367705 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-gdqng" podUID="e722091f-abf8-4361-9442-9a0c103355dc" Jun 02 19:06:06.505138 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:06.505094 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5df97bddf-525zw" event={"ID":"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d","Type":"ContainerStarted","Data":"2c7798017779c383ef81a2b4acd883d0914201b6c9428190691e5e08a2c64a78"} Jun 02 19:06:06.505307 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:06.505147 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5df97bddf-525zw" event={"ID":"fccebb43-30c1-4fee-a112-ecd9e9dd2f8d","Type":"ContainerStarted","Data":"a9816c0d13fd24d694e08d4b619632cd900411b9aa113c603883f07208a8c220"} Jun 02 19:06:06.506055 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:06.506035 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gdqng" Jun 02 19:06:06.506151 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:06.506080 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-l54m6" event={"ID":"f4e4ad4e-ed84-4c54-9fb8-4b3481050606","Type":"ContainerStarted","Data":"76352fa16ed79e4767eff8abab2c11fffdb1f4da29508dac5a6bc3ba1de50f95"} Jun 02 19:06:06.506151 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:06.506142 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:06:06.506242 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:06.506166 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kjwpj" Jun 02 19:06:06.521798 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:06.521723 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-5df97bddf-525zw" podStartSLOduration=17.521708391 podStartE2EDuration="17.521708391s" podCreationTimestamp="2026-06-02 19:05:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:06:06.521341072 +0000 UTC m=+157.082143975" watchObservedRunningTime="2026-06-02 19:06:06.521708391 +0000 UTC m=+157.082511294" Jun 02 19:06:06.731827 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:06.731781 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:06:06.734429 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:06.734404 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:06:07.021777 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:06:07.021661 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4vsd7" podUID="18ce0d3d-f461-41fa-95fa-9bb77c484d5d" Jun 02 19:06:07.508508 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:07.508474 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:06:07.509663 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:07.509642 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5df97bddf-525zw" Jun 02 19:06:08.513742 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:08.513638 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-l54m6" event={"ID":"f4e4ad4e-ed84-4c54-9fb8-4b3481050606","Type":"ContainerStarted","Data":"172b43fd9eb031c70d128d138b4fde157c3ee88b228324ea4ddff14754fdb8dc"} Jun 02 19:06:08.513742 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:08.513705 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-l54m6" event={"ID":"f4e4ad4e-ed84-4c54-9fb8-4b3481050606","Type":"ContainerStarted","Data":"8b26b4634655fc88803fde5c67f109ab0b0805c275c68af7686d76ffce4f8687"} Jun 02 19:06:08.528554 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:08.528508 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-l54m6" podStartSLOduration=17.397115800999998 podStartE2EDuration="19.528495862s" podCreationTimestamp="2026-06-02 19:05:49 +0000 UTC" firstStartedPulling="2026-06-02 19:06:06.023416293 +0000 UTC m=+156.584219175" lastFinishedPulling="2026-06-02 19:06:08.154796345 +0000 UTC m=+158.715599236" observedRunningTime="2026-06-02 19:06:08.527197127 +0000 UTC m=+159.088000029" watchObservedRunningTime="2026-06-02 19:06:08.528495862 +0000 UTC m=+159.089298764" Jun 02 19:06:10.998217 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:10.998179 2569 scope.go:117] "RemoveContainer" containerID="7502c723e1972f6139e5e74777d2d73bfadbcf6923d85920f3a563a613ebe8e9" Jun 02 19:06:11.335703 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:11.335592 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert\") pod \"ingress-canary-gdqng\" (UID: \"e722091f-abf8-4361-9442-9a0c103355dc\") " pod="openshift-ingress-canary/ingress-canary-gdqng" Jun 02 19:06:11.335703 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:11.335636 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:06:11.335703 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:11.335655 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls\") pod \"dns-default-kjwpj\" (UID: \"37654fa6-9127-48c7-8517-c221330b4460\") " pod="openshift-dns/dns-default-kjwpj" Jun 02 19:06:11.338006 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:11.337976 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37654fa6-9127-48c7-8517-c221330b4460-metrics-tls\") pod \"dns-default-kjwpj\" (UID: \"37654fa6-9127-48c7-8517-c221330b4460\") " pod="openshift-dns/dns-default-kjwpj" Jun 02 19:06:11.338144 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:11.338023 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e722091f-abf8-4361-9442-9a0c103355dc-cert\") pod \"ingress-canary-gdqng\" (UID: \"e722091f-abf8-4361-9442-9a0c103355dc\") " pod="openshift-ingress-canary/ingress-canary-gdqng" Jun 02 19:06:11.338144 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:11.338081 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls\") pod \"image-registry-77c5d48869-46n58\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:06:11.523835 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:11.523807 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-dsq5s_3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415/console-operator/2.log" Jun 02 19:06:11.524183 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:11.524168 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-dsq5s_3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415/console-operator/1.log" Jun 02 19:06:11.524250 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:11.524201 2569 generic.go:358] "Generic (PLEG): container finished" podID="3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415" containerID="beaec9d9961a9a357fcc2557af398b3dc841727ab03cd59f2df8901fee5eca4b" exitCode=255 Jun 02 19:06:11.524293 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:11.524277 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" event={"ID":"3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415","Type":"ContainerDied","Data":"beaec9d9961a9a357fcc2557af398b3dc841727ab03cd59f2df8901fee5eca4b"} Jun 02 19:06:11.524328 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:11.524318 2569 scope.go:117] "RemoveContainer" containerID="7502c723e1972f6139e5e74777d2d73bfadbcf6923d85920f3a563a613ebe8e9" Jun 02 19:06:11.524638 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:11.524625 2569 scope.go:117] "RemoveContainer" containerID="beaec9d9961a9a357fcc2557af398b3dc841727ab03cd59f2df8901fee5eca4b" Jun 02 19:06:11.524845 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:06:11.524823 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-dsq5s_openshift-console-operator(3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" podUID="3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415" Jun 02 19:06:11.609111 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:11.609028 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bdn92\"" Jun 02 19:06:11.609111 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:11.609028 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ljpzl\"" Jun 02 19:06:11.609111 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:11.609084 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zfb7c\"" Jun 02 19:06:11.617692 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:11.617658 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gdqng" Jun 02 19:06:11.617847 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:11.617695 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kjwpj" Jun 02 19:06:11.617847 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:11.617787 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:06:11.784032 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:11.783974 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kjwpj"] Jun 02 19:06:11.788668 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:06:11.788622 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37654fa6_9127_48c7_8517_c221330b4460.slice/crio-e3804f513326f3b5021f43581da865897452ab8092a92d2f93e59365257efb67 WatchSource:0}: Error finding container e3804f513326f3b5021f43581da865897452ab8092a92d2f93e59365257efb67: Status 404 returned error can't find the container with id e3804f513326f3b5021f43581da865897452ab8092a92d2f93e59365257efb67 Jun 02 19:06:12.009673 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:12.009638 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gdqng"] Jun 02 19:06:12.012735 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:12.012712 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77c5d48869-46n58"] Jun 02 19:06:12.014198 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:06:12.014172 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode722091f_abf8_4361_9442_9a0c103355dc.slice/crio-5d83dd51b228e4bd5ca6650f23de5052dfeb6079a4093351588ed3383b635a42 WatchSource:0}: Error finding container 5d83dd51b228e4bd5ca6650f23de5052dfeb6079a4093351588ed3383b635a42: Status 404 returned error can't find the container with id 5d83dd51b228e4bd5ca6650f23de5052dfeb6079a4093351588ed3383b635a42 Jun 02 19:06:12.016394 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:06:12.016372 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45de563d_69ab_4e4c_87c6_d06c2d4ee695.slice/crio-3de662797b9d762af9666c1c1942ae74528bcea1ac9eb5bc3baf274e383d77ae WatchSource:0}: Error finding container 3de662797b9d762af9666c1c1942ae74528bcea1ac9eb5bc3baf274e383d77ae: Status 404 returned error can't find the container with id 3de662797b9d762af9666c1c1942ae74528bcea1ac9eb5bc3baf274e383d77ae Jun 02 19:06:12.527992 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:12.527949 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gdqng" event={"ID":"e722091f-abf8-4361-9442-9a0c103355dc","Type":"ContainerStarted","Data":"5d83dd51b228e4bd5ca6650f23de5052dfeb6079a4093351588ed3383b635a42"} Jun 02 19:06:12.529069 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:12.529036 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kjwpj" event={"ID":"37654fa6-9127-48c7-8517-c221330b4460","Type":"ContainerStarted","Data":"e3804f513326f3b5021f43581da865897452ab8092a92d2f93e59365257efb67"} Jun 02 19:06:12.530498 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:12.530478 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-dsq5s_3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415/console-operator/2.log" Jun 02 19:06:12.531856 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:12.531833 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77c5d48869-46n58" event={"ID":"45de563d-69ab-4e4c-87c6-d06c2d4ee695","Type":"ContainerStarted","Data":"94ecd85bae009e11331fe8663efc51bfe37446e7d5cfa8811a5475c4c49c4d4c"} Jun 02 19:06:12.531961 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:12.531864 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77c5d48869-46n58" event={"ID":"45de563d-69ab-4e4c-87c6-d06c2d4ee695","Type":"ContainerStarted","Data":"3de662797b9d762af9666c1c1942ae74528bcea1ac9eb5bc3baf274e383d77ae"} Jun 02 19:06:12.532018 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:12.531993 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:06:12.551033 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:12.550984 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77c5d48869-46n58" podStartSLOduration=162.550965891 podStartE2EDuration="2m42.550965891s" podCreationTimestamp="2026-06-02 19:03:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:06:12.549892608 +0000 UTC m=+163.110695522" watchObservedRunningTime="2026-06-02 19:06:12.550965891 +0000 UTC m=+163.111768794" Jun 02 19:06:14.538390 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:14.538353 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gdqng" event={"ID":"e722091f-abf8-4361-9442-9a0c103355dc","Type":"ContainerStarted","Data":"e9b018719ce61bfa42698973fb9a6a39a23f77dcd631738f87a6c49913866c41"} Jun 02 19:06:14.539835 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:14.539810 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kjwpj" event={"ID":"37654fa6-9127-48c7-8517-c221330b4460","Type":"ContainerStarted","Data":"fb2bcc8a901d4cf1a98747b271367d0bd536ee301bb144ce74f1e2145efb404e"} Jun 02 19:06:14.539835 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:14.539838 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kjwpj" event={"ID":"37654fa6-9127-48c7-8517-c221330b4460","Type":"ContainerStarted","Data":"e5653154dd529938932c1328eb7dad06fc2df4adbdc66f35e48bd7d91b5eecbc"} Jun 02 19:06:14.540031 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:14.539959 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kjwpj" Jun 02 19:06:14.553339 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:14.553295 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gdqng" podStartSLOduration=129.524233746 podStartE2EDuration="2m11.553280934s" podCreationTimestamp="2026-06-02 19:04:03 +0000 UTC" firstStartedPulling="2026-06-02 19:06:12.016592673 +0000 UTC m=+162.577395554" lastFinishedPulling="2026-06-02 19:06:14.045639862 +0000 UTC m=+164.606442742" observedRunningTime="2026-06-02 19:06:14.5523527 +0000 UTC m=+165.113155602" watchObservedRunningTime="2026-06-02 19:06:14.553280934 +0000 UTC m=+165.114083837" Jun 02 19:06:14.568300 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:14.568254 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-kjwpj" podStartSLOduration=129.316653575 podStartE2EDuration="2m11.568241871s" podCreationTimestamp="2026-06-02 19:04:03 +0000 UTC" firstStartedPulling="2026-06-02 19:06:11.790378126 +0000 UTC m=+162.351181007" lastFinishedPulling="2026-06-02 19:06:14.04196642 +0000 UTC m=+164.602769303" observedRunningTime="2026-06-02 19:06:14.567572262 +0000 UTC m=+165.128375164" watchObservedRunningTime="2026-06-02 19:06:14.568241871 +0000 UTC m=+165.129044774" Jun 02 19:06:16.652948 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:16.652914 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zvcv5"] Jun 02 19:06:16.659049 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:16.659018 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zvcv5" Jun 02 19:06:16.661441 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:16.661416 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vsdwt\"" Jun 02 19:06:16.661808 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:16.661792 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 19:06:16.662271 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:16.662250 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 19:06:16.674617 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:16.674078 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zvcv5"] Jun 02 19:06:16.781649 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:16.781616 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a4b3d60-909a-4ddd-8d93-6f0c9689abf1-data-volume\") pod \"insights-runtime-extractor-zvcv5\" (UID: \"2a4b3d60-909a-4ddd-8d93-6f0c9689abf1\") " pod="openshift-insights/insights-runtime-extractor-zvcv5" Jun 02 19:06:16.781793 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:16.781667 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a4b3d60-909a-4ddd-8d93-6f0c9689abf1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvcv5\" (UID: \"2a4b3d60-909a-4ddd-8d93-6f0c9689abf1\") " pod="openshift-insights/insights-runtime-extractor-zvcv5" Jun 02 19:06:16.781793 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:16.781746 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a4b3d60-909a-4ddd-8d93-6f0c9689abf1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvcv5\" (UID: \"2a4b3d60-909a-4ddd-8d93-6f0c9689abf1\") " pod="openshift-insights/insights-runtime-extractor-zvcv5" Jun 02 19:06:16.781855 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:16.781793 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg78h\" (UniqueName: \"kubernetes.io/projected/2a4b3d60-909a-4ddd-8d93-6f0c9689abf1-kube-api-access-tg78h\") pod \"insights-runtime-extractor-zvcv5\" (UID: \"2a4b3d60-909a-4ddd-8d93-6f0c9689abf1\") " pod="openshift-insights/insights-runtime-extractor-zvcv5" Jun 02 19:06:16.781907 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:16.781882 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2a4b3d60-909a-4ddd-8d93-6f0c9689abf1-crio-socket\") pod \"insights-runtime-extractor-zvcv5\" (UID: \"2a4b3d60-909a-4ddd-8d93-6f0c9689abf1\") " pod="openshift-insights/insights-runtime-extractor-zvcv5" Jun 02 19:06:16.882828 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:16.882795 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2a4b3d60-909a-4ddd-8d93-6f0c9689abf1-crio-socket\") pod \"insights-runtime-extractor-zvcv5\" (UID: \"2a4b3d60-909a-4ddd-8d93-6f0c9689abf1\") " pod="openshift-insights/insights-runtime-extractor-zvcv5" Jun 02 19:06:16.883008 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:16.882847 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a4b3d60-909a-4ddd-8d93-6f0c9689abf1-data-volume\") pod \"insights-runtime-extractor-zvcv5\" (UID: \"2a4b3d60-909a-4ddd-8d93-6f0c9689abf1\") " pod="openshift-insights/insights-runtime-extractor-zvcv5" Jun 02 19:06:16.883008 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:16.882887 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a4b3d60-909a-4ddd-8d93-6f0c9689abf1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvcv5\" (UID: \"2a4b3d60-909a-4ddd-8d93-6f0c9689abf1\") " pod="openshift-insights/insights-runtime-extractor-zvcv5" Jun 02 19:06:16.883008 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:16.882922 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a4b3d60-909a-4ddd-8d93-6f0c9689abf1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvcv5\" (UID: \"2a4b3d60-909a-4ddd-8d93-6f0c9689abf1\") " pod="openshift-insights/insights-runtime-extractor-zvcv5" Jun 02 19:06:16.883008 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:16.882933 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2a4b3d60-909a-4ddd-8d93-6f0c9689abf1-crio-socket\") pod \"insights-runtime-extractor-zvcv5\" (UID: \"2a4b3d60-909a-4ddd-8d93-6f0c9689abf1\") " pod="openshift-insights/insights-runtime-extractor-zvcv5" Jun 02 19:06:16.883008 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:16.882969 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tg78h\" (UniqueName: \"kubernetes.io/projected/2a4b3d60-909a-4ddd-8d93-6f0c9689abf1-kube-api-access-tg78h\") pod \"insights-runtime-extractor-zvcv5\" (UID: \"2a4b3d60-909a-4ddd-8d93-6f0c9689abf1\") " pod="openshift-insights/insights-runtime-extractor-zvcv5" Jun 02 19:06:16.883318 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:16.883241 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a4b3d60-909a-4ddd-8d93-6f0c9689abf1-data-volume\") pod \"insights-runtime-extractor-zvcv5\" (UID: \"2a4b3d60-909a-4ddd-8d93-6f0c9689abf1\") " pod="openshift-insights/insights-runtime-extractor-zvcv5" Jun 02 19:06:16.883516 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:16.883494 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a4b3d60-909a-4ddd-8d93-6f0c9689abf1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvcv5\" (UID: \"2a4b3d60-909a-4ddd-8d93-6f0c9689abf1\") " pod="openshift-insights/insights-runtime-extractor-zvcv5" Jun 02 19:06:16.885362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:16.885343 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a4b3d60-909a-4ddd-8d93-6f0c9689abf1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvcv5\" (UID: \"2a4b3d60-909a-4ddd-8d93-6f0c9689abf1\") " pod="openshift-insights/insights-runtime-extractor-zvcv5" Jun 02 19:06:16.892255 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:16.892231 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg78h\" (UniqueName: \"kubernetes.io/projected/2a4b3d60-909a-4ddd-8d93-6f0c9689abf1-kube-api-access-tg78h\") pod \"insights-runtime-extractor-zvcv5\" (UID: \"2a4b3d60-909a-4ddd-8d93-6f0c9689abf1\") " pod="openshift-insights/insights-runtime-extractor-zvcv5" Jun 02 19:06:16.969850 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:16.969821 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zvcv5" Jun 02 19:06:17.095480 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:17.095454 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zvcv5"] Jun 02 19:06:17.098285 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:06:17.098247 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a4b3d60_909a_4ddd_8d93_6f0c9689abf1.slice/crio-76d70ff19d6b8dff5e8b8519167bada47ea50a0b4d2094342adc67cfc4c8f415 WatchSource:0}: Error finding container 76d70ff19d6b8dff5e8b8519167bada47ea50a0b4d2094342adc67cfc4c8f415: Status 404 returned error can't find the container with id 76d70ff19d6b8dff5e8b8519167bada47ea50a0b4d2094342adc67cfc4c8f415 Jun 02 19:06:17.548484 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:17.548395 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvcv5" event={"ID":"2a4b3d60-909a-4ddd-8d93-6f0c9689abf1","Type":"ContainerStarted","Data":"f3fd07972807637e490cf841644cb4850e59df8915b9c555c579f8ab5d585260"} Jun 02 19:06:17.548484 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:17.548430 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvcv5" event={"ID":"2a4b3d60-909a-4ddd-8d93-6f0c9689abf1","Type":"ContainerStarted","Data":"76d70ff19d6b8dff5e8b8519167bada47ea50a0b4d2094342adc67cfc4c8f415"} Jun 02 19:06:18.552664 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:18.552634 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvcv5" event={"ID":"2a4b3d60-909a-4ddd-8d93-6f0c9689abf1","Type":"ContainerStarted","Data":"f376b998d8bff338574f45082fe1a9d1dd2275f239f2d594704e480c75c4738b"} Jun 02 19:06:20.001377 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:20.001343 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:06:20.243985 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:20.243896 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" Jun 02 19:06:20.243985 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:20.243934 2569 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" Jun 02 19:06:20.244279 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:20.244267 2569 scope.go:117] "RemoveContainer" containerID="beaec9d9961a9a357fcc2557af398b3dc841727ab03cd59f2df8901fee5eca4b" Jun 02 19:06:20.244441 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:06:20.244423 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-dsq5s_openshift-console-operator(3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" podUID="3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415" Jun 02 19:06:20.561208 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:20.561123 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvcv5" event={"ID":"2a4b3d60-909a-4ddd-8d93-6f0c9689abf1","Type":"ContainerStarted","Data":"00955fe2f7e275fb51ae698323d789d0d67aebb8adca156fa8d4a9e1cf5e76c5"} Jun 02 19:06:20.577859 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:20.577816 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zvcv5" podStartSLOduration=1.819714887 podStartE2EDuration="4.577802335s" podCreationTimestamp="2026-06-02 19:06:16 +0000 UTC" firstStartedPulling="2026-06-02 19:06:17.22511221 +0000 UTC m=+167.785915091" lastFinishedPulling="2026-06-02 19:06:19.983199657 +0000 UTC m=+170.544002539" observedRunningTime="2026-06-02 19:06:20.577385609 +0000 UTC m=+171.138188512" watchObservedRunningTime="2026-06-02 19:06:20.577802335 +0000 UTC m=+171.138605280" Jun 02 19:06:24.544138 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:24.544106 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kjwpj" Jun 02 19:06:24.965103 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:24.965071 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-m4nkj"] Jun 02 19:06:24.968320 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:24.968302 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-m4nkj" Jun 02 19:06:24.970091 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:24.970055 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 02 19:06:24.970172 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:24.970145 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-pvvbr\"" Jun 02 19:06:24.973563 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:24.973540 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-m4nkj"] Jun 02 19:06:25.148631 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:25.148594 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/13e74629-9f61-4dd7-a90f-728c800c91bd-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-m4nkj\" (UID: \"13e74629-9f61-4dd7-a90f-728c800c91bd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-m4nkj" Jun 02 19:06:25.249991 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:25.249904 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/13e74629-9f61-4dd7-a90f-728c800c91bd-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-m4nkj\" (UID: \"13e74629-9f61-4dd7-a90f-728c800c91bd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-m4nkj" Jun 02 19:06:25.250134 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:06:25.250044 2569 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 02 19:06:25.250134 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:06:25.250105 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13e74629-9f61-4dd7-a90f-728c800c91bd-tls-certificates podName:13e74629-9f61-4dd7-a90f-728c800c91bd nodeName:}" failed. No retries permitted until 2026-06-02 19:06:25.750090024 +0000 UTC m=+176.310892907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/13e74629-9f61-4dd7-a90f-728c800c91bd-tls-certificates") pod "prometheus-operator-admission-webhook-59b7f8756b-m4nkj" (UID: "13e74629-9f61-4dd7-a90f-728c800c91bd") : secret "prometheus-operator-admission-webhook-tls" not found Jun 02 19:06:25.754115 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:25.754081 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/13e74629-9f61-4dd7-a90f-728c800c91bd-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-m4nkj\" (UID: \"13e74629-9f61-4dd7-a90f-728c800c91bd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-m4nkj" Jun 02 19:06:25.756632 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:25.756608 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/13e74629-9f61-4dd7-a90f-728c800c91bd-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-m4nkj\" (UID: \"13e74629-9f61-4dd7-a90f-728c800c91bd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-m4nkj" Jun 02 19:06:25.877589 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:25.877555 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-m4nkj" Jun 02 19:06:26.002422 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:26.002396 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-m4nkj"] Jun 02 19:06:26.005062 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:06:26.004993 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13e74629_9f61_4dd7_a90f_728c800c91bd.slice/crio-695136a3b49a846952d575f018994c8a22e58613c4997d2ac9f5d163ed815f1f WatchSource:0}: Error finding container 695136a3b49a846952d575f018994c8a22e58613c4997d2ac9f5d163ed815f1f: Status 404 returned error can't find the container with id 695136a3b49a846952d575f018994c8a22e58613c4997d2ac9f5d163ed815f1f Jun 02 19:06:26.577258 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:26.577223 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-m4nkj" event={"ID":"13e74629-9f61-4dd7-a90f-728c800c91bd","Type":"ContainerStarted","Data":"695136a3b49a846952d575f018994c8a22e58613c4997d2ac9f5d163ed815f1f"} Jun 02 19:06:27.580984 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:27.580947 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-m4nkj" event={"ID":"13e74629-9f61-4dd7-a90f-728c800c91bd","Type":"ContainerStarted","Data":"bc27f3ae0c0e29dc2a240ab2bf96be9fd7e962559cb3ce38e0951705868302d4"} Jun 02 19:06:27.581361 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:27.581130 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-m4nkj" Jun 02 19:06:27.585614 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:27.585591 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-m4nkj" Jun 02 19:06:27.595388 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:27.595343 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-m4nkj" podStartSLOduration=2.521022292 podStartE2EDuration="3.595328736s" podCreationTimestamp="2026-06-02 19:06:24 +0000 UTC" firstStartedPulling="2026-06-02 19:06:26.006816974 +0000 UTC m=+176.567619858" lastFinishedPulling="2026-06-02 19:06:27.081123418 +0000 UTC m=+177.641926302" observedRunningTime="2026-06-02 19:06:27.594708128 +0000 UTC m=+178.155511027" watchObservedRunningTime="2026-06-02 19:06:27.595328736 +0000 UTC m=+178.156131638" Jun 02 19:06:31.621647 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:31.621602 2569 patch_prober.go:28] interesting pod/image-registry-77c5d48869-46n58 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 19:06:31.622096 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:31.621668 2569 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-77c5d48869-46n58" podUID="45de563d-69ab-4e4c-87c6-d06c2d4ee695" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 19:06:32.999103 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:32.999072 2569 scope.go:117] "RemoveContainer" containerID="beaec9d9961a9a357fcc2557af398b3dc841727ab03cd59f2df8901fee5eca4b" Jun 02 19:06:33.378785 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.378688 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c"] Jun 02 19:06:33.380832 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.380810 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c" Jun 02 19:06:33.383068 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.383047 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 19:06:33.383195 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.383051 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 02 19:06:33.383195 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.383051 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 19:06:33.383398 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.383283 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 02 19:06:33.383398 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.383354 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 02 19:06:33.383548 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.383485 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 19:06:33.383717 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.383704 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-j8p9l\"" Jun 02 19:06:33.394374 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.394354 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c"] Jun 02 19:06:33.412401 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.412380 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8z8jx"] Jun 02 19:06:33.412517 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.412383 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmx7m\" (UniqueName: \"kubernetes.io/projected/fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81-kube-api-access-zmx7m\") pod \"kube-state-metrics-8469c486bb-v7n6c\" (UID: \"fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c" Jun 02 19:06:33.412565 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.412521 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-v7n6c\" (UID: \"fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c" Jun 02 19:06:33.412565 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.412554 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-v7n6c\" (UID: \"fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c" Jun 02 19:06:33.412655 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.412583 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-v7n6c\" (UID: \"fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c" Jun 02 19:06:33.412704 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.412664 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-v7n6c\" (UID: \"fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c" Jun 02 19:06:33.412755 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.412715 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-v7n6c\" (UID: \"fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c" Jun 02 19:06:33.414177 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.414163 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.416184 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.416166 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 19:06:33.416465 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.416446 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 19:06:33.416560 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.416520 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dnvg8\"" Jun 02 19:06:33.417186 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.417167 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 19:06:33.513946 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.513915 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-v7n6c\" (UID: \"fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c" Jun 02 19:06:33.514137 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.513953 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-node-exporter-tls\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.514137 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.513978 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-v7n6c\" (UID: \"fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c" Jun 02 19:06:33.514137 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.514016 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-node-exporter-textfile\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.514137 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.514040 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.514137 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.514061 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-node-exporter-wtmp\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.514137 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.514085 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zmx7m\" (UniqueName: \"kubernetes.io/projected/fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81-kube-api-access-zmx7m\") pod \"kube-state-metrics-8469c486bb-v7n6c\" (UID: \"fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c" Jun 02 19:06:33.514414 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.514298 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-root\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.514414 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.514344 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfh6s\" (UniqueName: \"kubernetes.io/projected/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-kube-api-access-kfh6s\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.514414 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.514388 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-v7n6c\" (UID: \"fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c" Jun 02 19:06:33.514549 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.514428 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.514549 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.514453 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-v7n6c\" (UID: \"fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c" Jun 02 19:06:33.514549 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.514484 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-v7n6c\" (UID: \"fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c" Jun 02 19:06:33.514549 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.514519 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-sys\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.514549 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.514546 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-metrics-client-ca\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.514882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.514861 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-v7n6c\" (UID: \"fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c" Jun 02 19:06:33.515135 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.515117 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-v7n6c\" (UID: \"fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c" Jun 02 19:06:33.515193 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.515155 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-v7n6c\" (UID: \"fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c" Jun 02 19:06:33.516954 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.516933 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-v7n6c\" (UID: \"fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c" Jun 02 19:06:33.517391 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.517370 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-v7n6c\" (UID: \"fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c" Jun 02 19:06:33.522988 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.522964 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmx7m\" (UniqueName: \"kubernetes.io/projected/fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81-kube-api-access-zmx7m\") pod \"kube-state-metrics-8469c486bb-v7n6c\" (UID: \"fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c" Jun 02 19:06:33.539255 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.539237 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:06:33.601831 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.601805 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-dsq5s_3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415/console-operator/2.log" Jun 02 19:06:33.602022 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.601907 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" event={"ID":"3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415","Type":"ContainerStarted","Data":"daf0ddf77a7dd189324f267c97f2f2e5f185262328c2ae2be157e220be3974b8"} Jun 02 19:06:33.602310 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.602208 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" Jun 02 19:06:33.612180 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.612150 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" Jun 02 19:06:33.615411 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.615392 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-sys\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.615517 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.615416 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-metrics-client-ca\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.615565 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.615546 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-node-exporter-tls\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.615746 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.615628 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-node-exporter-textfile\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.615746 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.615673 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-sys\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.615746 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.615712 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.615986 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.615755 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-node-exporter-wtmp\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.615986 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.615846 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-root\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.615986 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.615882 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kfh6s\" (UniqueName: \"kubernetes.io/projected/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-kube-api-access-kfh6s\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.615986 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.615919 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.615986 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.615934 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-node-exporter-wtmp\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.616233 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:06:33.616050 2569 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 19:06:33.616233 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.616063 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-metrics-client-ca\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.616233 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:06:33.616107 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-node-exporter-tls podName:2a957dfd-069e-4f27-ae0f-7ea78ee397cf nodeName:}" failed. No retries permitted until 2026-06-02 19:06:34.116087876 +0000 UTC m=+184.676890758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-node-exporter-tls") pod "node-exporter-8z8jx" (UID: "2a957dfd-069e-4f27-ae0f-7ea78ee397cf") : secret "node-exporter-tls" not found Jun 02 19:06:33.616233 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.616210 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-root\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.616440 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.616308 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-node-exporter-textfile\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.616538 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.616508 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.618007 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.617963 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-dsq5s" podStartSLOduration=41.353723051 podStartE2EDuration="44.61795273s" podCreationTimestamp="2026-06-02 19:05:49 +0000 UTC" firstStartedPulling="2026-06-02 19:05:50.397636551 +0000 UTC m=+140.958439435" lastFinishedPulling="2026-06-02 19:05:53.66186623 +0000 UTC m=+144.222669114" observedRunningTime="2026-06-02 19:06:33.616852349 +0000 UTC m=+184.177655261" watchObservedRunningTime="2026-06-02 19:06:33.61795273 +0000 UTC m=+184.178755631" Jun 02 19:06:33.618245 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.618227 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.624712 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.624671 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfh6s\" (UniqueName: \"kubernetes.io/projected/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-kube-api-access-kfh6s\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:33.690554 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.690524 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c" Jun 02 19:06:33.836943 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:33.836904 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c"] Jun 02 19:06:33.840568 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:06:33.840543 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb8c6e28_1a36_40eb_9c1f_b3a250ea7a81.slice/crio-50dcb30f8212918c2cdfba9b2b1c4bfa07d2689439edaad10ed801f586d16e7f WatchSource:0}: Error finding container 50dcb30f8212918c2cdfba9b2b1c4bfa07d2689439edaad10ed801f586d16e7f: Status 404 returned error can't find the container with id 50dcb30f8212918c2cdfba9b2b1c4bfa07d2689439edaad10ed801f586d16e7f Jun 02 19:06:34.120510 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.120427 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-node-exporter-tls\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:34.122704 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.122669 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a957dfd-069e-4f27-ae0f-7ea78ee397cf-node-exporter-tls\") pod \"node-exporter-8z8jx\" (UID: \"2a957dfd-069e-4f27-ae0f-7ea78ee397cf\") " pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:34.322481 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.322445 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8z8jx" Jun 02 19:06:34.334533 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:06:34.334489 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a957dfd_069e_4f27_ae0f_7ea78ee397cf.slice/crio-dcadd624572e3dae5f468c43c867e8d4188ca6e821f032752ed72e4a053279ac WatchSource:0}: Error finding container dcadd624572e3dae5f468c43c867e8d4188ca6e821f032752ed72e4a053279ac: Status 404 returned error can't find the container with id dcadd624572e3dae5f468c43c867e8d4188ca6e821f032752ed72e4a053279ac Jun 02 19:06:34.484989 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.484951 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 19:06:34.488154 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.488137 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.491160 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.491137 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 19:06:34.491560 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.491545 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 19:06:34.491560 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.491555 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 19:06:34.491711 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.491576 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 19:06:34.491855 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.491830 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 19:06:34.491955 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.491833 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 19:06:34.491955 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.491836 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 19:06:34.491955 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.491913 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wft5b\"" Jun 02 19:06:34.492179 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.492165 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 19:06:34.492381 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.492368 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 19:06:34.502540 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.502520 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 19:06:34.524281 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.524249 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-config-volume\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.524281 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.524284 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf5kl\" (UniqueName: \"kubernetes.io/projected/8ded5b28-f3a9-456c-bf6a-009033422378-kube-api-access-bf5kl\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.524469 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.524368 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8ded5b28-f3a9-456c-bf6a-009033422378-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.524469 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.524407 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ded5b28-f3a9-456c-bf6a-009033422378-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.524469 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.524425 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-web-config\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.524469 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.524442 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.524614 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.524477 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ded5b28-f3a9-456c-bf6a-009033422378-config-out\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.524614 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.524495 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.524614 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.524511 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.524614 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.524527 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ded5b28-f3a9-456c-bf6a-009033422378-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.524614 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.524552 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.524614 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.524568 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ded5b28-f3a9-456c-bf6a-009033422378-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.524614 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.524584 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.606414 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.606373 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8z8jx" event={"ID":"2a957dfd-069e-4f27-ae0f-7ea78ee397cf","Type":"ContainerStarted","Data":"dcadd624572e3dae5f468c43c867e8d4188ca6e821f032752ed72e4a053279ac"} Jun 02 19:06:34.607513 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.607485 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c" event={"ID":"fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81","Type":"ContainerStarted","Data":"50dcb30f8212918c2cdfba9b2b1c4bfa07d2689439edaad10ed801f586d16e7f"} Jun 02 19:06:34.625977 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.625942 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ded5b28-f3a9-456c-bf6a-009033422378-config-out\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.626142 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.625995 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.626142 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.626024 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.626142 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.626050 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ded5b28-f3a9-456c-bf6a-009033422378-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.626142 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.626100 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.626142 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.626126 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ded5b28-f3a9-456c-bf6a-009033422378-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.626357 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.626152 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.626415 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.626390 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-config-volume\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.626469 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.626432 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bf5kl\" (UniqueName: \"kubernetes.io/projected/8ded5b28-f3a9-456c-bf6a-009033422378-kube-api-access-bf5kl\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.626578 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.626560 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8ded5b28-f3a9-456c-bf6a-009033422378-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.626647 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.626604 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ded5b28-f3a9-456c-bf6a-009033422378-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.627078 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.627055 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-web-config\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.627159 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.627112 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.627159 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.627149 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ded5b28-f3a9-456c-bf6a-009033422378-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.628707 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.628665 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8ded5b28-f3a9-456c-bf6a-009033422378-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.628966 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.628942 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ded5b28-f3a9-456c-bf6a-009033422378-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.629310 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.629285 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.629771 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.629746 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.630381 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.630355 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.630961 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.630905 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.631081 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.631057 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ded5b28-f3a9-456c-bf6a-009033422378-config-out\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.631313 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.631286 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-web-config\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.631769 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.631729 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-config-volume\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.631998 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.631971 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ded5b28-f3a9-456c-bf6a-009033422378-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.633080 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.633037 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.636244 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.636215 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf5kl\" (UniqueName: \"kubernetes.io/projected/8ded5b28-f3a9-456c-bf6a-009033422378-kube-api-access-bf5kl\") pod \"alertmanager-main-0\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.797961 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.797879 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:06:34.968566 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:34.968533 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 19:06:34.972539 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:06:34.972510 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ded5b28_f3a9_456c_bf6a_009033422378.slice/crio-09f450b458c5c7a62bc30b023b0a5e6df3b93e3659e2cb494c685273d11ea3d5 WatchSource:0}: Error finding container 09f450b458c5c7a62bc30b023b0a5e6df3b93e3659e2cb494c685273d11ea3d5: Status 404 returned error can't find the container with id 09f450b458c5c7a62bc30b023b0a5e6df3b93e3659e2cb494c685273d11ea3d5 Jun 02 19:06:35.611739 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:35.611707 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ded5b28-f3a9-456c-bf6a-009033422378","Type":"ContainerStarted","Data":"09f450b458c5c7a62bc30b023b0a5e6df3b93e3659e2cb494c685273d11ea3d5"} Jun 02 19:06:36.619124 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:36.619031 2569 generic.go:358] "Generic (PLEG): container finished" podID="2a957dfd-069e-4f27-ae0f-7ea78ee397cf" containerID="d3d595be29522e35b420125fd0a0a23307a0c1d622075d6f1b801db103a9c612" exitCode=0 Jun 02 19:06:36.619574 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:36.619116 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8z8jx" event={"ID":"2a957dfd-069e-4f27-ae0f-7ea78ee397cf","Type":"ContainerDied","Data":"d3d595be29522e35b420125fd0a0a23307a0c1d622075d6f1b801db103a9c612"} Jun 02 19:06:36.620502 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:36.620482 2569 generic.go:358] "Generic (PLEG): container finished" podID="8ded5b28-f3a9-456c-bf6a-009033422378" containerID="25d227c1bdab6d16265894f431abfe19f361fe8d2a8753613d46021fe11eeccc" exitCode=0 Jun 02 19:06:36.620647 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:36.620626 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ded5b28-f3a9-456c-bf6a-009033422378","Type":"ContainerDied","Data":"25d227c1bdab6d16265894f431abfe19f361fe8d2a8753613d46021fe11eeccc"} Jun 02 19:06:36.622651 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:36.622629 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c" event={"ID":"fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81","Type":"ContainerStarted","Data":"02fb2a30da24a5a4362c66d240504779ad797322cee6c0aba080ae9cf67e41d4"} Jun 02 19:06:36.622785 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:36.622654 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c" event={"ID":"fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81","Type":"ContainerStarted","Data":"1ba285b87b04ae1a50b08e58c950b3adeae4f51bbe281e5f1fb5b7d0c571b0b2"} Jun 02 19:06:36.622785 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:36.622664 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c" event={"ID":"fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81","Type":"ContainerStarted","Data":"dd434d63e6fed3dc23fa491c93406af56eb288ff1719e7219924b5e56c9f3385"} Jun 02 19:06:36.655581 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:36.655536 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-v7n6c" podStartSLOduration=1.9031700630000001 podStartE2EDuration="3.655521184s" podCreationTimestamp="2026-06-02 19:06:33 +0000 UTC" firstStartedPulling="2026-06-02 19:06:33.842507414 +0000 UTC m=+184.403310295" lastFinishedPulling="2026-06-02 19:06:35.59485853 +0000 UTC m=+186.155661416" observedRunningTime="2026-06-02 19:06:36.655093452 +0000 UTC m=+187.215896361" watchObservedRunningTime="2026-06-02 19:06:36.655521184 +0000 UTC m=+187.216324085" Jun 02 19:06:37.632985 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.632948 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8z8jx" event={"ID":"2a957dfd-069e-4f27-ae0f-7ea78ee397cf","Type":"ContainerStarted","Data":"42cde9454f5045ff0f0cae92ca91d02124be76be71166c72d2dfbbfbc51b5300"} Jun 02 19:06:37.633445 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.632994 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8z8jx" event={"ID":"2a957dfd-069e-4f27-ae0f-7ea78ee397cf","Type":"ContainerStarted","Data":"d10afafb011a610258a7dc491e719449207947e21b426f8b6ef224c8215e6085"} Jun 02 19:06:37.652746 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.652673 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8z8jx" podStartSLOduration=3.392266648 podStartE2EDuration="4.652655781s" podCreationTimestamp="2026-06-02 19:06:33 +0000 UTC" firstStartedPulling="2026-06-02 19:06:34.336321185 +0000 UTC m=+184.897124088" lastFinishedPulling="2026-06-02 19:06:35.596710332 +0000 UTC m=+186.157513221" observedRunningTime="2026-06-02 19:06:37.651746263 +0000 UTC m=+188.212549166" watchObservedRunningTime="2026-06-02 19:06:37.652655781 +0000 UTC m=+188.213459053" Jun 02 19:06:37.819045 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.819012 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-78566d6c6f-vrlx7"] Jun 02 19:06:37.822269 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.822248 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:06:37.824533 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.824508 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 02 19:06:37.824645 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.824602 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 19:06:37.824912 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.824899 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-83d4lt4c2sda8\"" Jun 02 19:06:37.824974 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.824947 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vlm7v\"" Jun 02 19:06:37.825213 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.825198 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 02 19:06:37.825513 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.825493 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 02 19:06:37.832325 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.832300 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78566d6c6f-vrlx7"] Jun 02 19:06:37.856400 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.856362 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1b252c60-fca2-49ac-bc65-dc7d857cc14f-secret-metrics-server-tls\") pod \"metrics-server-78566d6c6f-vrlx7\" (UID: \"1b252c60-fca2-49ac-bc65-dc7d857cc14f\") " pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:06:37.856536 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.856412 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b252c60-fca2-49ac-bc65-dc7d857cc14f-client-ca-bundle\") pod \"metrics-server-78566d6c6f-vrlx7\" (UID: \"1b252c60-fca2-49ac-bc65-dc7d857cc14f\") " pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:06:37.856536 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.856490 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1b252c60-fca2-49ac-bc65-dc7d857cc14f-audit-log\") pod \"metrics-server-78566d6c6f-vrlx7\" (UID: \"1b252c60-fca2-49ac-bc65-dc7d857cc14f\") " pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:06:37.856661 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.856550 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b252c60-fca2-49ac-bc65-dc7d857cc14f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78566d6c6f-vrlx7\" (UID: \"1b252c60-fca2-49ac-bc65-dc7d857cc14f\") " pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:06:37.856661 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.856604 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1b252c60-fca2-49ac-bc65-dc7d857cc14f-metrics-server-audit-profiles\") pod \"metrics-server-78566d6c6f-vrlx7\" (UID: \"1b252c60-fca2-49ac-bc65-dc7d857cc14f\") " pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:06:37.856661 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.856639 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1b252c60-fca2-49ac-bc65-dc7d857cc14f-secret-metrics-server-client-certs\") pod \"metrics-server-78566d6c6f-vrlx7\" (UID: \"1b252c60-fca2-49ac-bc65-dc7d857cc14f\") " pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:06:37.856661 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.856656 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfkmx\" (UniqueName: \"kubernetes.io/projected/1b252c60-fca2-49ac-bc65-dc7d857cc14f-kube-api-access-zfkmx\") pod \"metrics-server-78566d6c6f-vrlx7\" (UID: \"1b252c60-fca2-49ac-bc65-dc7d857cc14f\") " pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:06:37.957489 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.957434 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1b252c60-fca2-49ac-bc65-dc7d857cc14f-audit-log\") pod \"metrics-server-78566d6c6f-vrlx7\" (UID: \"1b252c60-fca2-49ac-bc65-dc7d857cc14f\") " pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:06:37.957707 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.957520 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b252c60-fca2-49ac-bc65-dc7d857cc14f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78566d6c6f-vrlx7\" (UID: \"1b252c60-fca2-49ac-bc65-dc7d857cc14f\") " pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:06:37.957707 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.957552 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1b252c60-fca2-49ac-bc65-dc7d857cc14f-metrics-server-audit-profiles\") pod \"metrics-server-78566d6c6f-vrlx7\" (UID: \"1b252c60-fca2-49ac-bc65-dc7d857cc14f\") " pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:06:37.957707 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.957587 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1b252c60-fca2-49ac-bc65-dc7d857cc14f-secret-metrics-server-client-certs\") pod \"metrics-server-78566d6c6f-vrlx7\" (UID: \"1b252c60-fca2-49ac-bc65-dc7d857cc14f\") " pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:06:37.957707 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.957607 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zfkmx\" (UniqueName: \"kubernetes.io/projected/1b252c60-fca2-49ac-bc65-dc7d857cc14f-kube-api-access-zfkmx\") pod \"metrics-server-78566d6c6f-vrlx7\" (UID: \"1b252c60-fca2-49ac-bc65-dc7d857cc14f\") " pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:06:37.957707 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.957640 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1b252c60-fca2-49ac-bc65-dc7d857cc14f-secret-metrics-server-tls\") pod \"metrics-server-78566d6c6f-vrlx7\" (UID: \"1b252c60-fca2-49ac-bc65-dc7d857cc14f\") " pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:06:37.957707 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.957667 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b252c60-fca2-49ac-bc65-dc7d857cc14f-client-ca-bundle\") pod \"metrics-server-78566d6c6f-vrlx7\" (UID: \"1b252c60-fca2-49ac-bc65-dc7d857cc14f\") " pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:06:37.958003 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.957941 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1b252c60-fca2-49ac-bc65-dc7d857cc14f-audit-log\") pod \"metrics-server-78566d6c6f-vrlx7\" (UID: \"1b252c60-fca2-49ac-bc65-dc7d857cc14f\") " pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:06:37.958487 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.958440 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b252c60-fca2-49ac-bc65-dc7d857cc14f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78566d6c6f-vrlx7\" (UID: \"1b252c60-fca2-49ac-bc65-dc7d857cc14f\") " pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:06:37.958842 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.958819 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1b252c60-fca2-49ac-bc65-dc7d857cc14f-metrics-server-audit-profiles\") pod \"metrics-server-78566d6c6f-vrlx7\" (UID: \"1b252c60-fca2-49ac-bc65-dc7d857cc14f\") " pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:06:37.960610 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.960585 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b252c60-fca2-49ac-bc65-dc7d857cc14f-client-ca-bundle\") pod \"metrics-server-78566d6c6f-vrlx7\" (UID: \"1b252c60-fca2-49ac-bc65-dc7d857cc14f\") " pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:06:37.960774 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.960753 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1b252c60-fca2-49ac-bc65-dc7d857cc14f-secret-metrics-server-tls\") pod \"metrics-server-78566d6c6f-vrlx7\" (UID: \"1b252c60-fca2-49ac-bc65-dc7d857cc14f\") " pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:06:37.960854 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.960839 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1b252c60-fca2-49ac-bc65-dc7d857cc14f-secret-metrics-server-client-certs\") pod \"metrics-server-78566d6c6f-vrlx7\" (UID: \"1b252c60-fca2-49ac-bc65-dc7d857cc14f\") " pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:06:37.966295 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:37.966271 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfkmx\" (UniqueName: \"kubernetes.io/projected/1b252c60-fca2-49ac-bc65-dc7d857cc14f-kube-api-access-zfkmx\") pod \"metrics-server-78566d6c6f-vrlx7\" (UID: \"1b252c60-fca2-49ac-bc65-dc7d857cc14f\") " pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:06:38.133467 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:38.133408 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:06:38.322593 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:38.322571 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78566d6c6f-vrlx7"] Jun 02 19:06:38.326183 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:06:38.326151 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b252c60_fca2_49ac_bc65_dc7d857cc14f.slice/crio-2031ea46ed05819d7990f08e7cd31db66df7799e0fcfd1b0194e677b16a61716 WatchSource:0}: Error finding container 2031ea46ed05819d7990f08e7cd31db66df7799e0fcfd1b0194e677b16a61716: Status 404 returned error can't find the container with id 2031ea46ed05819d7990f08e7cd31db66df7799e0fcfd1b0194e677b16a61716 Jun 02 19:06:38.638815 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:38.638780 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ded5b28-f3a9-456c-bf6a-009033422378","Type":"ContainerStarted","Data":"ff928f4f0440a48cb170caee815b4b27125107946be8b41562562397d83cd537"} Jun 02 19:06:38.639214 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:38.638823 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ded5b28-f3a9-456c-bf6a-009033422378","Type":"ContainerStarted","Data":"d907c76cb90ec6d0e417846b086c30c58475fc9806db61f78e870c0c78d401b1"} Jun 02 19:06:38.639214 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:38.638839 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ded5b28-f3a9-456c-bf6a-009033422378","Type":"ContainerStarted","Data":"04e0ae19768f5863df11602d2ab9d08e0b25ce29a402834de63cca5d13a92a03"} Jun 02 19:06:38.639214 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:38.638851 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ded5b28-f3a9-456c-bf6a-009033422378","Type":"ContainerStarted","Data":"540076931abe2a85b8bb3e7c576b8dce0b68bccb33b3a6e5caee625634b9dd39"} Jun 02 19:06:38.639214 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:38.638862 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ded5b28-f3a9-456c-bf6a-009033422378","Type":"ContainerStarted","Data":"8e3e82aaca8c4f569c8335a417bdc78c0109200733c77e0239a8a03c2f5c6b73"} Jun 02 19:06:38.640003 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:38.639969 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" event={"ID":"1b252c60-fca2-49ac-bc65-dc7d857cc14f","Type":"ContainerStarted","Data":"2031ea46ed05819d7990f08e7cd31db66df7799e0fcfd1b0194e677b16a61716"} Jun 02 19:06:39.022720 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:39.022663 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77c5d48869-46n58"] Jun 02 19:06:40.648011 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:40.647970 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" event={"ID":"1b252c60-fca2-49ac-bc65-dc7d857cc14f","Type":"ContainerStarted","Data":"d9ed12d01bbf33585b7b67ed979f9ba3f0617d48a488f5d9a6a97d8f71d43cb0"} Jun 02 19:06:40.650923 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:40.650888 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ded5b28-f3a9-456c-bf6a-009033422378","Type":"ContainerStarted","Data":"ccde267fde76501d30500ab4ab0f4e97da86492ec949ffcaa1f582589e91ad36"} Jun 02 19:06:40.670366 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:40.670315 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" podStartSLOduration=2.196999985 podStartE2EDuration="3.670301202s" podCreationTimestamp="2026-06-02 19:06:37 +0000 UTC" firstStartedPulling="2026-06-02 19:06:38.328288289 +0000 UTC m=+188.889091182" lastFinishedPulling="2026-06-02 19:06:39.801589507 +0000 UTC m=+190.362392399" observedRunningTime="2026-06-02 19:06:40.669261155 +0000 UTC m=+191.230064057" watchObservedRunningTime="2026-06-02 19:06:40.670301202 +0000 UTC m=+191.231104107" Jun 02 19:06:40.695947 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:40.695897 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.9171190550000001 podStartE2EDuration="6.695882667s" podCreationTimestamp="2026-06-02 19:06:34 +0000 UTC" firstStartedPulling="2026-06-02 19:06:34.974898684 +0000 UTC m=+185.535701565" lastFinishedPulling="2026-06-02 19:06:39.753662282 +0000 UTC m=+190.314465177" observedRunningTime="2026-06-02 19:06:40.695123538 +0000 UTC m=+191.255926441" watchObservedRunningTime="2026-06-02 19:06:40.695882667 +0000 UTC m=+191.256685568" Jun 02 19:06:48.317593 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.317554 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7df565c89-w7sc4"] Jun 02 19:06:48.320510 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.320492 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:48.323254 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.323074 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 19:06:48.323254 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.323098 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 19:06:48.323254 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.323122 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 19:06:48.323254 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.323140 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 19:06:48.323254 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.323106 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-m5dlq\"" Jun 02 19:06:48.323254 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.323168 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 19:06:48.323254 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.323184 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 19:06:48.323541 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.323523 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 19:06:48.328124 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.327458 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 19:06:48.328729 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.328712 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7df565c89-w7sc4"] Jun 02 19:06:48.461464 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.461416 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-oauth-serving-cert\") pod \"console-7df565c89-w7sc4\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:48.461464 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.461468 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tl66\" (UniqueName: \"kubernetes.io/projected/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-kube-api-access-2tl66\") pod \"console-7df565c89-w7sc4\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:48.461668 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.461494 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-service-ca\") pod \"console-7df565c89-w7sc4\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:48.461668 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.461542 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-console-config\") pod \"console-7df565c89-w7sc4\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:48.461668 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.461570 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-console-serving-cert\") pod \"console-7df565c89-w7sc4\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:48.461668 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.461622 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-trusted-ca-bundle\") pod \"console-7df565c89-w7sc4\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:48.461668 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.461660 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-console-oauth-config\") pod \"console-7df565c89-w7sc4\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:48.562566 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.562524 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-service-ca\") pod \"console-7df565c89-w7sc4\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:48.562782 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.562575 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-console-config\") pod \"console-7df565c89-w7sc4\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:48.562782 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.562710 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-console-serving-cert\") pod \"console-7df565c89-w7sc4\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:48.562782 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.562757 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-trusted-ca-bundle\") pod \"console-7df565c89-w7sc4\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:48.562949 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.562786 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-console-oauth-config\") pod \"console-7df565c89-w7sc4\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:48.562949 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.562866 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-oauth-serving-cert\") pod \"console-7df565c89-w7sc4\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:48.562949 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.562932 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2tl66\" (UniqueName: \"kubernetes.io/projected/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-kube-api-access-2tl66\") pod \"console-7df565c89-w7sc4\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:48.563333 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.563306 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-service-ca\") pod \"console-7df565c89-w7sc4\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:48.563443 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.563379 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-console-config\") pod \"console-7df565c89-w7sc4\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:48.563541 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.563521 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-oauth-serving-cert\") pod \"console-7df565c89-w7sc4\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:48.563933 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.563910 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-trusted-ca-bundle\") pod \"console-7df565c89-w7sc4\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:48.565123 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.565097 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-console-serving-cert\") pod \"console-7df565c89-w7sc4\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:48.565204 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.565144 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-console-oauth-config\") pod \"console-7df565c89-w7sc4\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:48.570773 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.570722 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tl66\" (UniqueName: \"kubernetes.io/projected/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-kube-api-access-2tl66\") pod \"console-7df565c89-w7sc4\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:48.630817 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.630769 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:48.753833 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:48.753805 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7df565c89-w7sc4"] Jun 02 19:06:48.756290 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:06:48.756258 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17a3a4dc_a0ed_4e6e_8598_5a3046596f1d.slice/crio-29474bd464c391f7e887dd76cfea537b492089cad1e8ce9a7ec0ed8046d08ae8 WatchSource:0}: Error finding container 29474bd464c391f7e887dd76cfea537b492089cad1e8ce9a7ec0ed8046d08ae8: Status 404 returned error can't find the container with id 29474bd464c391f7e887dd76cfea537b492089cad1e8ce9a7ec0ed8046d08ae8 Jun 02 19:06:49.677856 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:49.677816 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7df565c89-w7sc4" event={"ID":"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d","Type":"ContainerStarted","Data":"29474bd464c391f7e887dd76cfea537b492089cad1e8ce9a7ec0ed8046d08ae8"} Jun 02 19:06:52.691210 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:52.691177 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7df565c89-w7sc4" event={"ID":"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d","Type":"ContainerStarted","Data":"81f596f75bbdc14b4838f7b34643e6929cd4e786fdc61f4f5fab6b1f2702bb95"} Jun 02 19:06:52.710954 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:52.710899 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7df565c89-w7sc4" podStartSLOduration=1.541504786 podStartE2EDuration="4.71088427s" podCreationTimestamp="2026-06-02 19:06:48 +0000 UTC" firstStartedPulling="2026-06-02 19:06:48.758129646 +0000 UTC m=+199.318932526" lastFinishedPulling="2026-06-02 19:06:51.927509125 +0000 UTC m=+202.488312010" observedRunningTime="2026-06-02 19:06:52.709595279 +0000 UTC m=+203.270398180" watchObservedRunningTime="2026-06-02 19:06:52.71088427 +0000 UTC m=+203.271687171" Jun 02 19:06:58.134042 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:58.133995 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:06:58.134042 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:58.134051 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:06:58.631834 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:58.631798 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:58.631834 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:58.631839 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:58.636522 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:58.636499 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:06:58.711983 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:06:58.711949 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:07:04.047648 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.047605 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77c5d48869-46n58" podUID="45de563d-69ab-4e4c-87c6-d06c2d4ee695" containerName="registry" containerID="cri-o://94ecd85bae009e11331fe8663efc51bfe37446e7d5cfa8811a5475c4c49c4d4c" gracePeriod=30 Jun 02 19:07:04.291061 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.291037 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:07:04.404200 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.404159 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-certificates\") pod \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " Jun 02 19:07:04.404200 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.404208 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls\") pod \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " Jun 02 19:07:04.404393 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.404290 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sd22f\" (UniqueName: \"kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-kube-api-access-sd22f\") pod \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " Jun 02 19:07:04.404393 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.404312 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45de563d-69ab-4e4c-87c6-d06c2d4ee695-installation-pull-secrets\") pod \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " Jun 02 19:07:04.404393 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.404338 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45de563d-69ab-4e4c-87c6-d06c2d4ee695-ca-trust-extracted\") pod \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " Jun 02 19:07:04.404582 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.404545 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-bound-sa-token\") pod \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " Jun 02 19:07:04.404642 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.404624 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45de563d-69ab-4e4c-87c6-d06c2d4ee695-trusted-ca\") pod \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " Jun 02 19:07:04.404728 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.404658 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45de563d-69ab-4e4c-87c6-d06c2d4ee695-image-registry-private-configuration\") pod \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\" (UID: \"45de563d-69ab-4e4c-87c6-d06c2d4ee695\") " Jun 02 19:07:04.404728 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.404709 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "45de563d-69ab-4e4c-87c6-d06c2d4ee695" (UID: "45de563d-69ab-4e4c-87c6-d06c2d4ee695"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:07:04.404979 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.404944 2569 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-certificates\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:07:04.405201 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.405177 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45de563d-69ab-4e4c-87c6-d06c2d4ee695-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "45de563d-69ab-4e4c-87c6-d06c2d4ee695" (UID: "45de563d-69ab-4e4c-87c6-d06c2d4ee695"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:07:04.406983 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.406957 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "45de563d-69ab-4e4c-87c6-d06c2d4ee695" (UID: "45de563d-69ab-4e4c-87c6-d06c2d4ee695"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:07:04.407229 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.407202 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45de563d-69ab-4e4c-87c6-d06c2d4ee695-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "45de563d-69ab-4e4c-87c6-d06c2d4ee695" (UID: "45de563d-69ab-4e4c-87c6-d06c2d4ee695"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:07:04.407329 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.407287 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-kube-api-access-sd22f" (OuterVolumeSpecName: "kube-api-access-sd22f") pod "45de563d-69ab-4e4c-87c6-d06c2d4ee695" (UID: "45de563d-69ab-4e4c-87c6-d06c2d4ee695"). InnerVolumeSpecName "kube-api-access-sd22f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:07:04.407329 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.407295 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45de563d-69ab-4e4c-87c6-d06c2d4ee695-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "45de563d-69ab-4e4c-87c6-d06c2d4ee695" (UID: "45de563d-69ab-4e4c-87c6-d06c2d4ee695"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:07:04.407424 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.407347 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "45de563d-69ab-4e4c-87c6-d06c2d4ee695" (UID: "45de563d-69ab-4e4c-87c6-d06c2d4ee695"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:07:04.413567 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.413543 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45de563d-69ab-4e4c-87c6-d06c2d4ee695-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "45de563d-69ab-4e4c-87c6-d06c2d4ee695" (UID: "45de563d-69ab-4e4c-87c6-d06c2d4ee695"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:07:04.506550 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.506517 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sd22f\" (UniqueName: \"kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-kube-api-access-sd22f\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:07:04.506550 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.506546 2569 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45de563d-69ab-4e4c-87c6-d06c2d4ee695-installation-pull-secrets\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:07:04.506550 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.506556 2569 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45de563d-69ab-4e4c-87c6-d06c2d4ee695-ca-trust-extracted\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:07:04.506810 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.506566 2569 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-bound-sa-token\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:07:04.506810 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.506575 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45de563d-69ab-4e4c-87c6-d06c2d4ee695-trusted-ca\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:07:04.506810 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.506584 2569 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45de563d-69ab-4e4c-87c6-d06c2d4ee695-image-registry-private-configuration\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:07:04.506810 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.506593 2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45de563d-69ab-4e4c-87c6-d06c2d4ee695-registry-tls\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:07:04.724939 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.724907 2569 generic.go:358] "Generic (PLEG): container finished" podID="45de563d-69ab-4e4c-87c6-d06c2d4ee695" containerID="94ecd85bae009e11331fe8663efc51bfe37446e7d5cfa8811a5475c4c49c4d4c" exitCode=0 Jun 02 19:07:04.725116 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.724971 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c5d48869-46n58" Jun 02 19:07:04.725116 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.724987 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77c5d48869-46n58" event={"ID":"45de563d-69ab-4e4c-87c6-d06c2d4ee695","Type":"ContainerDied","Data":"94ecd85bae009e11331fe8663efc51bfe37446e7d5cfa8811a5475c4c49c4d4c"} Jun 02 19:07:04.725116 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.725024 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77c5d48869-46n58" event={"ID":"45de563d-69ab-4e4c-87c6-d06c2d4ee695","Type":"ContainerDied","Data":"3de662797b9d762af9666c1c1942ae74528bcea1ac9eb5bc3baf274e383d77ae"} Jun 02 19:07:04.725116 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.725044 2569 scope.go:117] "RemoveContainer" containerID="94ecd85bae009e11331fe8663efc51bfe37446e7d5cfa8811a5475c4c49c4d4c" Jun 02 19:07:04.726403 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.726376 2569 generic.go:358] "Generic (PLEG): container finished" podID="fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924" containerID="a31d779ee2519dc8cd62e6965b15113e90984f582aca8821460ec1cffc2db98f" exitCode=0 Jun 02 19:07:04.726502 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.726422 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vxtdt" event={"ID":"fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924","Type":"ContainerDied","Data":"a31d779ee2519dc8cd62e6965b15113e90984f582aca8821460ec1cffc2db98f"} Jun 02 19:07:04.726787 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.726767 2569 scope.go:117] "RemoveContainer" containerID="a31d779ee2519dc8cd62e6965b15113e90984f582aca8821460ec1cffc2db98f" Jun 02 19:07:04.736202 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.736185 2569 scope.go:117] "RemoveContainer" containerID="94ecd85bae009e11331fe8663efc51bfe37446e7d5cfa8811a5475c4c49c4d4c" Jun 02 19:07:04.736428 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:07:04.736412 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94ecd85bae009e11331fe8663efc51bfe37446e7d5cfa8811a5475c4c49c4d4c\": container with ID starting with 94ecd85bae009e11331fe8663efc51bfe37446e7d5cfa8811a5475c4c49c4d4c not found: ID does not exist" containerID="94ecd85bae009e11331fe8663efc51bfe37446e7d5cfa8811a5475c4c49c4d4c" Jun 02 19:07:04.736467 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.736436 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94ecd85bae009e11331fe8663efc51bfe37446e7d5cfa8811a5475c4c49c4d4c"} err="failed to get container status \"94ecd85bae009e11331fe8663efc51bfe37446e7d5cfa8811a5475c4c49c4d4c\": rpc error: code = NotFound desc = could not find container \"94ecd85bae009e11331fe8663efc51bfe37446e7d5cfa8811a5475c4c49c4d4c\": container with ID starting with 94ecd85bae009e11331fe8663efc51bfe37446e7d5cfa8811a5475c4c49c4d4c not found: ID does not exist" Jun 02 19:07:04.777480 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.777456 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77c5d48869-46n58"] Jun 02 19:07:04.783371 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:04.783347 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77c5d48869-46n58"] Jun 02 19:07:05.732140 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:05.732103 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vxtdt" event={"ID":"fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924","Type":"ContainerStarted","Data":"22e51fed4669fd95aeda6ebdccf4925b5c5108c50bc791de7b38b5c8a537d0f0"} Jun 02 19:07:06.003840 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:06.003762 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45de563d-69ab-4e4c-87c6-d06c2d4ee695" path="/var/lib/kubelet/pods/45de563d-69ab-4e4c-87c6-d06c2d4ee695/volumes" Jun 02 19:07:18.139264 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:18.139224 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:07:18.143237 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:18.143208 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-78566d6c6f-vrlx7" Jun 02 19:07:24.790887 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:24.790854 2569 generic.go:358] "Generic (PLEG): container finished" podID="975a5e94-6791-4548-8945-a3085447e0d2" containerID="4306c70440659d83618864282e698113e00b91ac1e24f042e6afb5367aaac746" exitCode=0 Jun 02 19:07:24.791268 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:24.790938 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-9gswq" event={"ID":"975a5e94-6791-4548-8945-a3085447e0d2","Type":"ContainerDied","Data":"4306c70440659d83618864282e698113e00b91ac1e24f042e6afb5367aaac746"} Jun 02 19:07:24.791308 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:24.791284 2569 scope.go:117] "RemoveContainer" containerID="4306c70440659d83618864282e698113e00b91ac1e24f042e6afb5367aaac746" Jun 02 19:07:25.795490 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:25.795458 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-9gswq" event={"ID":"975a5e94-6791-4548-8945-a3085447e0d2","Type":"ContainerStarted","Data":"3513e64b1e73cc1b5e1c95dc4af29a39d6bba90a6831d9cab1da00929c2640f3"} Jun 02 19:07:41.823571 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:41.823481 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs\") pod \"network-metrics-daemon-4vsd7\" (UID: \"18ce0d3d-f461-41fa-95fa-9bb77c484d5d\") " pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:07:41.825950 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:41.825924 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18ce0d3d-f461-41fa-95fa-9bb77c484d5d-metrics-certs\") pod \"network-metrics-daemon-4vsd7\" (UID: \"18ce0d3d-f461-41fa-95fa-9bb77c484d5d\") " pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:07:41.904096 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:41.904061 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9kj59\"" Jun 02 19:07:41.912720 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:41.912696 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsd7" Jun 02 19:07:42.039568 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:42.039536 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4vsd7"] Jun 02 19:07:42.042759 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:07:42.042731 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18ce0d3d_f461_41fa_95fa_9bb77c484d5d.slice/crio-0e3cc0d774e6983b2271df4c0767711f1a7a666c6c72783b35ab5c74e52c00d5 WatchSource:0}: Error finding container 0e3cc0d774e6983b2271df4c0767711f1a7a666c6c72783b35ab5c74e52c00d5: Status 404 returned error can't find the container with id 0e3cc0d774e6983b2271df4c0767711f1a7a666c6c72783b35ab5c74e52c00d5 Jun 02 19:07:42.844646 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:42.844609 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4vsd7" event={"ID":"18ce0d3d-f461-41fa-95fa-9bb77c484d5d","Type":"ContainerStarted","Data":"0e3cc0d774e6983b2271df4c0767711f1a7a666c6c72783b35ab5c74e52c00d5"} Jun 02 19:07:43.848653 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:43.848612 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4vsd7" event={"ID":"18ce0d3d-f461-41fa-95fa-9bb77c484d5d","Type":"ContainerStarted","Data":"6548f078d6886b23066601e0ecb573d39eb6fd81f926f8d6461048aee76d4226"} Jun 02 19:07:43.849046 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:43.848660 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4vsd7" event={"ID":"18ce0d3d-f461-41fa-95fa-9bb77c484d5d","Type":"ContainerStarted","Data":"c2fb60e200cc6fe4ad996d322a983c8bf9e68e67fd3f8b5ecbe40cccdecad050"} Jun 02 19:07:43.950980 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:43.950924 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4vsd7" podStartSLOduration=252.568096646 podStartE2EDuration="4m13.950899967s" podCreationTimestamp="2026-06-02 19:03:30 +0000 UTC" firstStartedPulling="2026-06-02 19:07:42.04506737 +0000 UTC m=+252.605870251" lastFinishedPulling="2026-06-02 19:07:43.427870688 +0000 UTC m=+253.988673572" observedRunningTime="2026-06-02 19:07:43.948864489 +0000 UTC m=+254.509667392" watchObservedRunningTime="2026-06-02 19:07:43.950899967 +0000 UTC m=+254.511702870" Jun 02 19:07:53.831244 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:53.831201 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 19:07:53.882098 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:53.882035 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="alertmanager" containerID="cri-o://8e3e82aaca8c4f569c8335a417bdc78c0109200733c77e0239a8a03c2f5c6b73" gracePeriod=120 Jun 02 19:07:53.882274 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:53.882090 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="kube-rbac-proxy-web" containerID="cri-o://04e0ae19768f5863df11602d2ab9d08e0b25ce29a402834de63cca5d13a92a03" gracePeriod=120 Jun 02 19:07:53.882274 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:53.882091 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="kube-rbac-proxy-metric" containerID="cri-o://ff928f4f0440a48cb170caee815b4b27125107946be8b41562562397d83cd537" gracePeriod=120 Jun 02 19:07:53.882274 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:53.882107 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="kube-rbac-proxy" containerID="cri-o://d907c76cb90ec6d0e417846b086c30c58475fc9806db61f78e870c0c78d401b1" gracePeriod=120 Jun 02 19:07:53.882274 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:53.882121 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="config-reloader" containerID="cri-o://540076931abe2a85b8bb3e7c576b8dce0b68bccb33b3a6e5caee625634b9dd39" gracePeriod=120 Jun 02 19:07:53.882274 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:53.882182 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="prom-label-proxy" containerID="cri-o://ccde267fde76501d30500ab4ab0f4e97da86492ec949ffcaa1f582589e91ad36" gracePeriod=120 Jun 02 19:07:54.887931 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:54.887891 2569 generic.go:358] "Generic (PLEG): container finished" podID="8ded5b28-f3a9-456c-bf6a-009033422378" containerID="ccde267fde76501d30500ab4ab0f4e97da86492ec949ffcaa1f582589e91ad36" exitCode=0 Jun 02 19:07:54.887931 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:54.887927 2569 generic.go:358] "Generic (PLEG): container finished" podID="8ded5b28-f3a9-456c-bf6a-009033422378" containerID="ff928f4f0440a48cb170caee815b4b27125107946be8b41562562397d83cd537" exitCode=0 Jun 02 19:07:54.887931 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:54.887935 2569 generic.go:358] "Generic (PLEG): container finished" podID="8ded5b28-f3a9-456c-bf6a-009033422378" containerID="d907c76cb90ec6d0e417846b086c30c58475fc9806db61f78e870c0c78d401b1" exitCode=0 Jun 02 19:07:54.887931 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:54.887941 2569 generic.go:358] "Generic (PLEG): container finished" podID="8ded5b28-f3a9-456c-bf6a-009033422378" containerID="540076931abe2a85b8bb3e7c576b8dce0b68bccb33b3a6e5caee625634b9dd39" exitCode=0 Jun 02 19:07:54.888423 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:54.887947 2569 generic.go:358] "Generic (PLEG): container finished" podID="8ded5b28-f3a9-456c-bf6a-009033422378" containerID="8e3e82aaca8c4f569c8335a417bdc78c0109200733c77e0239a8a03c2f5c6b73" exitCode=0 Jun 02 19:07:54.888423 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:54.887959 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ded5b28-f3a9-456c-bf6a-009033422378","Type":"ContainerDied","Data":"ccde267fde76501d30500ab4ab0f4e97da86492ec949ffcaa1f582589e91ad36"} Jun 02 19:07:54.888423 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:54.887999 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ded5b28-f3a9-456c-bf6a-009033422378","Type":"ContainerDied","Data":"ff928f4f0440a48cb170caee815b4b27125107946be8b41562562397d83cd537"} Jun 02 19:07:54.888423 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:54.888014 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ded5b28-f3a9-456c-bf6a-009033422378","Type":"ContainerDied","Data":"d907c76cb90ec6d0e417846b086c30c58475fc9806db61f78e870c0c78d401b1"} Jun 02 19:07:54.888423 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:54.888030 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ded5b28-f3a9-456c-bf6a-009033422378","Type":"ContainerDied","Data":"540076931abe2a85b8bb3e7c576b8dce0b68bccb33b3a6e5caee625634b9dd39"} Jun 02 19:07:54.888423 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:54.888042 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ded5b28-f3a9-456c-bf6a-009033422378","Type":"ContainerDied","Data":"8e3e82aaca8c4f569c8335a417bdc78c0109200733c77e0239a8a03c2f5c6b73"} Jun 02 19:07:55.131776 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.131745 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:55.239134 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.239098 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-secret-alertmanager-kube-rbac-proxy-web\") pod \"8ded5b28-f3a9-456c-bf6a-009033422378\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " Jun 02 19:07:55.239134 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.239143 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-secret-alertmanager-kube-rbac-proxy\") pod \"8ded5b28-f3a9-456c-bf6a-009033422378\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " Jun 02 19:07:55.239401 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.239171 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-config-volume\") pod \"8ded5b28-f3a9-456c-bf6a-009033422378\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " Jun 02 19:07:55.239401 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.239197 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-web-config\") pod \"8ded5b28-f3a9-456c-bf6a-009033422378\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " Jun 02 19:07:55.239401 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.239218 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf5kl\" (UniqueName: \"kubernetes.io/projected/8ded5b28-f3a9-456c-bf6a-009033422378-kube-api-access-bf5kl\") pod \"8ded5b28-f3a9-456c-bf6a-009033422378\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " Jun 02 19:07:55.239401 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.239271 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8ded5b28-f3a9-456c-bf6a-009033422378\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " Jun 02 19:07:55.239401 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.239301 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ded5b28-f3a9-456c-bf6a-009033422378-metrics-client-ca\") pod \"8ded5b28-f3a9-456c-bf6a-009033422378\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " Jun 02 19:07:55.239401 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.239326 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ded5b28-f3a9-456c-bf6a-009033422378-alertmanager-trusted-ca-bundle\") pod \"8ded5b28-f3a9-456c-bf6a-009033422378\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " Jun 02 19:07:55.239401 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.239354 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ded5b28-f3a9-456c-bf6a-009033422378-tls-assets\") pod \"8ded5b28-f3a9-456c-bf6a-009033422378\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " Jun 02 19:07:55.239401 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.239384 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8ded5b28-f3a9-456c-bf6a-009033422378-alertmanager-main-db\") pod \"8ded5b28-f3a9-456c-bf6a-009033422378\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " Jun 02 19:07:55.239842 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.239408 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ded5b28-f3a9-456c-bf6a-009033422378-config-out\") pod \"8ded5b28-f3a9-456c-bf6a-009033422378\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " Jun 02 19:07:55.239842 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.239433 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-cluster-tls-config\") pod \"8ded5b28-f3a9-456c-bf6a-009033422378\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " Jun 02 19:07:55.239842 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.239463 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-secret-alertmanager-main-tls\") pod \"8ded5b28-f3a9-456c-bf6a-009033422378\" (UID: \"8ded5b28-f3a9-456c-bf6a-009033422378\") " Jun 02 19:07:55.240016 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.239984 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ded5b28-f3a9-456c-bf6a-009033422378-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8ded5b28-f3a9-456c-bf6a-009033422378" (UID: "8ded5b28-f3a9-456c-bf6a-009033422378"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:07:55.241172 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.241136 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ded5b28-f3a9-456c-bf6a-009033422378-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8ded5b28-f3a9-456c-bf6a-009033422378" (UID: "8ded5b28-f3a9-456c-bf6a-009033422378"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:07:55.241369 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.241344 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ded5b28-f3a9-456c-bf6a-009033422378-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8ded5b28-f3a9-456c-bf6a-009033422378" (UID: "8ded5b28-f3a9-456c-bf6a-009033422378"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:07:55.242082 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.241968 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8ded5b28-f3a9-456c-bf6a-009033422378" (UID: "8ded5b28-f3a9-456c-bf6a-009033422378"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:07:55.242082 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.242003 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8ded5b28-f3a9-456c-bf6a-009033422378" (UID: "8ded5b28-f3a9-456c-bf6a-009033422378"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:07:55.242230 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.242104 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-config-volume" (OuterVolumeSpecName: "config-volume") pod "8ded5b28-f3a9-456c-bf6a-009033422378" (UID: "8ded5b28-f3a9-456c-bf6a-009033422378"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:07:55.242360 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.242340 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8ded5b28-f3a9-456c-bf6a-009033422378" (UID: "8ded5b28-f3a9-456c-bf6a-009033422378"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:07:55.242836 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.242811 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ded5b28-f3a9-456c-bf6a-009033422378-kube-api-access-bf5kl" (OuterVolumeSpecName: "kube-api-access-bf5kl") pod "8ded5b28-f3a9-456c-bf6a-009033422378" (UID: "8ded5b28-f3a9-456c-bf6a-009033422378"). InnerVolumeSpecName "kube-api-access-bf5kl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:07:55.243105 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.243075 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8ded5b28-f3a9-456c-bf6a-009033422378" (UID: "8ded5b28-f3a9-456c-bf6a-009033422378"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:07:55.243487 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.243452 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ded5b28-f3a9-456c-bf6a-009033422378-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8ded5b28-f3a9-456c-bf6a-009033422378" (UID: "8ded5b28-f3a9-456c-bf6a-009033422378"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:07:55.244061 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.244037 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ded5b28-f3a9-456c-bf6a-009033422378-config-out" (OuterVolumeSpecName: "config-out") pod "8ded5b28-f3a9-456c-bf6a-009033422378" (UID: "8ded5b28-f3a9-456c-bf6a-009033422378"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:07:55.247203 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.247107 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8ded5b28-f3a9-456c-bf6a-009033422378" (UID: "8ded5b28-f3a9-456c-bf6a-009033422378"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:07:55.253709 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.253663 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-web-config" (OuterVolumeSpecName: "web-config") pod "8ded5b28-f3a9-456c-bf6a-009033422378" (UID: "8ded5b28-f3a9-456c-bf6a-009033422378"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:07:55.340258 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.340213 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-secret-alertmanager-main-tls\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:07:55.340258 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.340253 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:07:55.340480 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.340269 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:07:55.340480 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.340284 2569 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-config-volume\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:07:55.340480 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.340297 2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-web-config\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:07:55.340480 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.340308 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf5kl\" (UniqueName: \"kubernetes.io/projected/8ded5b28-f3a9-456c-bf6a-009033422378-kube-api-access-bf5kl\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:07:55.340480 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.340321 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:07:55.340480 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.340334 2569 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ded5b28-f3a9-456c-bf6a-009033422378-metrics-client-ca\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:07:55.340480 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.340347 2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ded5b28-f3a9-456c-bf6a-009033422378-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:07:55.340480 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.340359 2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ded5b28-f3a9-456c-bf6a-009033422378-tls-assets\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:07:55.340480 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.340371 2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8ded5b28-f3a9-456c-bf6a-009033422378-alertmanager-main-db\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:07:55.340480 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.340384 2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ded5b28-f3a9-456c-bf6a-009033422378-config-out\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:07:55.340480 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.340396 2569 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ded5b28-f3a9-456c-bf6a-009033422378-cluster-tls-config\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:07:55.893086 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.893052 2569 generic.go:358] "Generic (PLEG): container finished" podID="8ded5b28-f3a9-456c-bf6a-009033422378" containerID="04e0ae19768f5863df11602d2ab9d08e0b25ce29a402834de63cca5d13a92a03" exitCode=0 Jun 02 19:07:55.893514 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.893140 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ded5b28-f3a9-456c-bf6a-009033422378","Type":"ContainerDied","Data":"04e0ae19768f5863df11602d2ab9d08e0b25ce29a402834de63cca5d13a92a03"} Jun 02 19:07:55.893514 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.893178 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ded5b28-f3a9-456c-bf6a-009033422378","Type":"ContainerDied","Data":"09f450b458c5c7a62bc30b023b0a5e6df3b93e3659e2cb494c685273d11ea3d5"} Jun 02 19:07:55.893514 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.893179 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:55.893514 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.893195 2569 scope.go:117] "RemoveContainer" containerID="ccde267fde76501d30500ab4ab0f4e97da86492ec949ffcaa1f582589e91ad36" Jun 02 19:07:55.901117 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.901099 2569 scope.go:117] "RemoveContainer" containerID="ff928f4f0440a48cb170caee815b4b27125107946be8b41562562397d83cd537" Jun 02 19:07:55.907878 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.907855 2569 scope.go:117] "RemoveContainer" containerID="d907c76cb90ec6d0e417846b086c30c58475fc9806db61f78e870c0c78d401b1" Jun 02 19:07:55.915827 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.915788 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 19:07:55.916307 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.916275 2569 scope.go:117] "RemoveContainer" containerID="04e0ae19768f5863df11602d2ab9d08e0b25ce29a402834de63cca5d13a92a03" Jun 02 19:07:55.919840 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.919813 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 19:07:55.924354 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.924325 2569 scope.go:117] "RemoveContainer" containerID="540076931abe2a85b8bb3e7c576b8dce0b68bccb33b3a6e5caee625634b9dd39" Jun 02 19:07:55.935062 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.935039 2569 scope.go:117] "RemoveContainer" containerID="8e3e82aaca8c4f569c8335a417bdc78c0109200733c77e0239a8a03c2f5c6b73" Jun 02 19:07:55.943519 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.943389 2569 scope.go:117] "RemoveContainer" containerID="25d227c1bdab6d16265894f431abfe19f361fe8d2a8753613d46021fe11eeccc" Jun 02 19:07:55.946331 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.946308 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 19:07:55.946759 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.946743 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="config-reloader" Jun 02 19:07:55.946817 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.946761 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="config-reloader" Jun 02 19:07:55.946817 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.946776 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45de563d-69ab-4e4c-87c6-d06c2d4ee695" containerName="registry" Jun 02 19:07:55.946817 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.946784 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="45de563d-69ab-4e4c-87c6-d06c2d4ee695" containerName="registry" Jun 02 19:07:55.946817 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.946795 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="init-config-reloader" Jun 02 19:07:55.946817 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.946803 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="init-config-reloader" Jun 02 19:07:55.946817 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.946815 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="kube-rbac-proxy-web" Jun 02 19:07:55.946998 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.946823 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="kube-rbac-proxy-web" Jun 02 19:07:55.946998 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.946839 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="prom-label-proxy" Jun 02 19:07:55.946998 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.946847 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="prom-label-proxy" Jun 02 19:07:55.946998 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.946862 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="alertmanager" Jun 02 19:07:55.946998 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.946868 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="alertmanager" Jun 02 19:07:55.946998 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.946878 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="kube-rbac-proxy" Jun 02 19:07:55.946998 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.946886 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="kube-rbac-proxy" Jun 02 19:07:55.946998 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.946900 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="kube-rbac-proxy-metric" Jun 02 19:07:55.946998 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.946916 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="kube-rbac-proxy-metric" Jun 02 19:07:55.946998 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.946989 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="kube-rbac-proxy-metric" Jun 02 19:07:55.946998 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.947002 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="config-reloader" Jun 02 19:07:55.947287 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.947010 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="prom-label-proxy" Jun 02 19:07:55.947287 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.947017 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="kube-rbac-proxy" Jun 02 19:07:55.947287 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.947024 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="alertmanager" Jun 02 19:07:55.947287 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.947032 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="45de563d-69ab-4e4c-87c6-d06c2d4ee695" containerName="registry" Jun 02 19:07:55.947287 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.947037 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" containerName="kube-rbac-proxy-web" Jun 02 19:07:55.950593 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.950577 2569 scope.go:117] "RemoveContainer" containerID="ccde267fde76501d30500ab4ab0f4e97da86492ec949ffcaa1f582589e91ad36" Jun 02 19:07:55.950871 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:07:55.950851 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccde267fde76501d30500ab4ab0f4e97da86492ec949ffcaa1f582589e91ad36\": container with ID starting with ccde267fde76501d30500ab4ab0f4e97da86492ec949ffcaa1f582589e91ad36 not found: ID does not exist" containerID="ccde267fde76501d30500ab4ab0f4e97da86492ec949ffcaa1f582589e91ad36" Jun 02 19:07:55.950947 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.950881 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccde267fde76501d30500ab4ab0f4e97da86492ec949ffcaa1f582589e91ad36"} err="failed to get container status \"ccde267fde76501d30500ab4ab0f4e97da86492ec949ffcaa1f582589e91ad36\": rpc error: code = NotFound desc = could not find container \"ccde267fde76501d30500ab4ab0f4e97da86492ec949ffcaa1f582589e91ad36\": container with ID starting with ccde267fde76501d30500ab4ab0f4e97da86492ec949ffcaa1f582589e91ad36 not found: ID does not exist" Jun 02 19:07:55.950947 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.950900 2569 scope.go:117] "RemoveContainer" containerID="ff928f4f0440a48cb170caee815b4b27125107946be8b41562562397d83cd537" Jun 02 19:07:55.951163 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:07:55.951143 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff928f4f0440a48cb170caee815b4b27125107946be8b41562562397d83cd537\": container with ID starting with ff928f4f0440a48cb170caee815b4b27125107946be8b41562562397d83cd537 not found: ID does not exist" containerID="ff928f4f0440a48cb170caee815b4b27125107946be8b41562562397d83cd537" Jun 02 19:07:55.951212 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.951170 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff928f4f0440a48cb170caee815b4b27125107946be8b41562562397d83cd537"} err="failed to get container status \"ff928f4f0440a48cb170caee815b4b27125107946be8b41562562397d83cd537\": rpc error: code = NotFound desc = could not find container \"ff928f4f0440a48cb170caee815b4b27125107946be8b41562562397d83cd537\": container with ID starting with ff928f4f0440a48cb170caee815b4b27125107946be8b41562562397d83cd537 not found: ID does not exist" Jun 02 19:07:55.951212 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.951186 2569 scope.go:117] "RemoveContainer" containerID="d907c76cb90ec6d0e417846b086c30c58475fc9806db61f78e870c0c78d401b1" Jun 02 19:07:55.951388 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:07:55.951373 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d907c76cb90ec6d0e417846b086c30c58475fc9806db61f78e870c0c78d401b1\": container with ID starting with d907c76cb90ec6d0e417846b086c30c58475fc9806db61f78e870c0c78d401b1 not found: ID does not exist" containerID="d907c76cb90ec6d0e417846b086c30c58475fc9806db61f78e870c0c78d401b1" Jun 02 19:07:55.951426 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.951391 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d907c76cb90ec6d0e417846b086c30c58475fc9806db61f78e870c0c78d401b1"} err="failed to get container status \"d907c76cb90ec6d0e417846b086c30c58475fc9806db61f78e870c0c78d401b1\": rpc error: code = NotFound desc = could not find container \"d907c76cb90ec6d0e417846b086c30c58475fc9806db61f78e870c0c78d401b1\": container with ID starting with d907c76cb90ec6d0e417846b086c30c58475fc9806db61f78e870c0c78d401b1 not found: ID does not exist" Jun 02 19:07:55.951426 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.951403 2569 scope.go:117] "RemoveContainer" containerID="04e0ae19768f5863df11602d2ab9d08e0b25ce29a402834de63cca5d13a92a03" Jun 02 19:07:55.951775 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:07:55.951751 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04e0ae19768f5863df11602d2ab9d08e0b25ce29a402834de63cca5d13a92a03\": container with ID starting with 04e0ae19768f5863df11602d2ab9d08e0b25ce29a402834de63cca5d13a92a03 not found: ID does not exist" containerID="04e0ae19768f5863df11602d2ab9d08e0b25ce29a402834de63cca5d13a92a03" Jun 02 19:07:55.951881 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.951782 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04e0ae19768f5863df11602d2ab9d08e0b25ce29a402834de63cca5d13a92a03"} err="failed to get container status \"04e0ae19768f5863df11602d2ab9d08e0b25ce29a402834de63cca5d13a92a03\": rpc error: code = NotFound desc = could not find container \"04e0ae19768f5863df11602d2ab9d08e0b25ce29a402834de63cca5d13a92a03\": container with ID starting with 04e0ae19768f5863df11602d2ab9d08e0b25ce29a402834de63cca5d13a92a03 not found: ID does not exist" Jun 02 19:07:55.951881 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.951801 2569 scope.go:117] "RemoveContainer" containerID="540076931abe2a85b8bb3e7c576b8dce0b68bccb33b3a6e5caee625634b9dd39" Jun 02 19:07:55.951996 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.951917 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:55.952055 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:07:55.952028 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"540076931abe2a85b8bb3e7c576b8dce0b68bccb33b3a6e5caee625634b9dd39\": container with ID starting with 540076931abe2a85b8bb3e7c576b8dce0b68bccb33b3a6e5caee625634b9dd39 not found: ID does not exist" containerID="540076931abe2a85b8bb3e7c576b8dce0b68bccb33b3a6e5caee625634b9dd39" Jun 02 19:07:55.952107 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.952052 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"540076931abe2a85b8bb3e7c576b8dce0b68bccb33b3a6e5caee625634b9dd39"} err="failed to get container status \"540076931abe2a85b8bb3e7c576b8dce0b68bccb33b3a6e5caee625634b9dd39\": rpc error: code = NotFound desc = could not find container \"540076931abe2a85b8bb3e7c576b8dce0b68bccb33b3a6e5caee625634b9dd39\": container with ID starting with 540076931abe2a85b8bb3e7c576b8dce0b68bccb33b3a6e5caee625634b9dd39 not found: ID does not exist" Jun 02 19:07:55.952107 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.952072 2569 scope.go:117] "RemoveContainer" containerID="8e3e82aaca8c4f569c8335a417bdc78c0109200733c77e0239a8a03c2f5c6b73" Jun 02 19:07:55.952468 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:07:55.952438 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e3e82aaca8c4f569c8335a417bdc78c0109200733c77e0239a8a03c2f5c6b73\": container with ID starting with 8e3e82aaca8c4f569c8335a417bdc78c0109200733c77e0239a8a03c2f5c6b73 not found: ID does not exist" containerID="8e3e82aaca8c4f569c8335a417bdc78c0109200733c77e0239a8a03c2f5c6b73" Jun 02 19:07:55.952542 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.952472 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e3e82aaca8c4f569c8335a417bdc78c0109200733c77e0239a8a03c2f5c6b73"} err="failed to get container status \"8e3e82aaca8c4f569c8335a417bdc78c0109200733c77e0239a8a03c2f5c6b73\": rpc error: code = NotFound desc = could not find container \"8e3e82aaca8c4f569c8335a417bdc78c0109200733c77e0239a8a03c2f5c6b73\": container with ID starting with 8e3e82aaca8c4f569c8335a417bdc78c0109200733c77e0239a8a03c2f5c6b73 not found: ID does not exist" Jun 02 19:07:55.952542 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.952490 2569 scope.go:117] "RemoveContainer" containerID="25d227c1bdab6d16265894f431abfe19f361fe8d2a8753613d46021fe11eeccc" Jun 02 19:07:55.952780 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:07:55.952761 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25d227c1bdab6d16265894f431abfe19f361fe8d2a8753613d46021fe11eeccc\": container with ID starting with 25d227c1bdab6d16265894f431abfe19f361fe8d2a8753613d46021fe11eeccc not found: ID does not exist" containerID="25d227c1bdab6d16265894f431abfe19f361fe8d2a8753613d46021fe11eeccc" Jun 02 19:07:55.952826 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.952783 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25d227c1bdab6d16265894f431abfe19f361fe8d2a8753613d46021fe11eeccc"} err="failed to get container status \"25d227c1bdab6d16265894f431abfe19f361fe8d2a8753613d46021fe11eeccc\": rpc error: code = NotFound desc = could not find container \"25d227c1bdab6d16265894f431abfe19f361fe8d2a8753613d46021fe11eeccc\": container with ID starting with 25d227c1bdab6d16265894f431abfe19f361fe8d2a8753613d46021fe11eeccc not found: ID does not exist" Jun 02 19:07:55.953922 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.953904 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 19:07:55.953964 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.953927 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 19:07:55.954073 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.954053 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 19:07:55.954119 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.954077 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 19:07:55.954324 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.954308 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 19:07:55.954391 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.954310 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 19:07:55.954496 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.954398 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 19:07:55.954623 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.954608 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 19:07:55.954800 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.954785 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wft5b\"" Jun 02 19:07:55.960949 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.960212 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 19:07:55.961332 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:55.961313 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 19:07:56.001978 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.001943 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ded5b28-f3a9-456c-bf6a-009033422378" path="/var/lib/kubelet/pods/8ded5b28-f3a9-456c-bf6a-009033422378/volumes" Jun 02 19:07:56.044615 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.044577 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.044791 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.044628 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.044791 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.044721 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.044791 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.044758 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-config-out\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.044791 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.044775 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.044953 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.044813 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-web-config\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.044953 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.044847 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.044953 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.044870 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.044953 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.044894 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-config-volume\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.044953 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.044915 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjvsw\" (UniqueName: \"kubernetes.io/projected/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-kube-api-access-sjvsw\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.044953 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.044935 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.045152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.044966 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.045152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.045005 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.145751 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.145633 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-config-volume\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.145751 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.145675 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sjvsw\" (UniqueName: \"kubernetes.io/projected/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-kube-api-access-sjvsw\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.145751 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.145724 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.146004 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.145757 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.146004 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.145784 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.146004 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.145803 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.146004 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.145859 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.146004 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.145900 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.146004 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.145940 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-config-out\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.146004 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.145957 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.146004 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.145981 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-web-config\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.146004 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.146004 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.146421 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.146033 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.147192 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.146859 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.147333 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.147304 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.147543 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.147515 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.148808 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.148787 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-config-volume\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.148919 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.148888 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.149055 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.149034 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.149446 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.149393 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-config-out\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.149570 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.149552 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.149794 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.149774 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-web-config\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.149902 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.149883 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.149957 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.149943 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.150383 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.150368 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.153761 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.153656 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjvsw\" (UniqueName: \"kubernetes.io/projected/d9d3eee5-eb3d-441e-a2a6-61c1531e3bba-kube-api-access-sjvsw\") pod \"alertmanager-main-0\" (UID: \"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.264668 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.264625 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 19:07:56.401972 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.401924 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 19:07:56.404597 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:07:56.404568 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9d3eee5_eb3d_441e_a2a6_61c1531e3bba.slice/crio-2e608db3eb9785bd7e804ac3c0c28e7190df114cc61e00a8bfb73298fc442593 WatchSource:0}: Error finding container 2e608db3eb9785bd7e804ac3c0c28e7190df114cc61e00a8bfb73298fc442593: Status 404 returned error can't find the container with id 2e608db3eb9785bd7e804ac3c0c28e7190df114cc61e00a8bfb73298fc442593 Jun 02 19:07:56.901398 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.901361 2569 generic.go:358] "Generic (PLEG): container finished" podID="d9d3eee5-eb3d-441e-a2a6-61c1531e3bba" containerID="e373cd1cd8d2c948e87a94a1df41c9737904a157913b20c62202973c2a22dcd0" exitCode=0 Jun 02 19:07:56.901888 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.901399 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba","Type":"ContainerDied","Data":"e373cd1cd8d2c948e87a94a1df41c9737904a157913b20c62202973c2a22dcd0"} Jun 02 19:07:56.901888 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:56.901438 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba","Type":"ContainerStarted","Data":"2e608db3eb9785bd7e804ac3c0c28e7190df114cc61e00a8bfb73298fc442593"} Jun 02 19:07:57.907982 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:57.907945 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba","Type":"ContainerStarted","Data":"4c40061865169efc4f44d26a616f28bc1198936ef8b411d04aba5d109bb580af"} Jun 02 19:07:57.907982 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:57.907982 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba","Type":"ContainerStarted","Data":"531ba46350a733a61c4beb34873d57cca7644031ca75d209f1a829c1d3f7791b"} Jun 02 19:07:57.907982 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:57.907991 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba","Type":"ContainerStarted","Data":"23e3d74357dd2081ad52cd8012491733977f2d98af749ededc097a2a5bfe2f0a"} Jun 02 19:07:57.908563 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:57.908000 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba","Type":"ContainerStarted","Data":"576da8a076191bcb4a10c2d57ebd3c9c3a7271660a38f62f43c8c2cb587cb809"} Jun 02 19:07:57.908563 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:57.908008 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba","Type":"ContainerStarted","Data":"854c5dc4294500f8d011806510b51c90508caa075dd7ddabe5c5632476dd32f4"} Jun 02 19:07:57.908563 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:57.908016 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d9d3eee5-eb3d-441e-a2a6-61c1531e3bba","Type":"ContainerStarted","Data":"882f40d6e7a9d20dedccabfcef212969b072f981fd6d011f382791c57f64e1c8"} Jun 02 19:07:57.943120 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:07:57.943071 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.943057395 podStartE2EDuration="2.943057395s" podCreationTimestamp="2026-06-02 19:07:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:07:57.941231795 +0000 UTC m=+268.502034736" watchObservedRunningTime="2026-06-02 19:07:57.943057395 +0000 UTC m=+268.503860319" Jun 02 19:08:05.118591 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.118553 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6547d5b9-bng27"] Jun 02 19:08:05.123937 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.123910 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:05.132727 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.132669 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6547d5b9-bng27"] Jun 02 19:08:05.221396 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.221358 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-trusted-ca-bundle\") pod \"console-6547d5b9-bng27\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:05.221396 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.221403 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-service-ca\") pod \"console-6547d5b9-bng27\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:05.221718 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.221432 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-console-config\") pod \"console-6547d5b9-bng27\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:05.221718 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.221514 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-oauth-serving-cert\") pod \"console-6547d5b9-bng27\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:05.221718 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.221571 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-console-serving-cert\") pod \"console-6547d5b9-bng27\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:05.221718 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.221616 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gxw8\" (UniqueName: \"kubernetes.io/projected/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-kube-api-access-8gxw8\") pod \"console-6547d5b9-bng27\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:05.221718 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.221642 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-console-oauth-config\") pod \"console-6547d5b9-bng27\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:05.322988 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.322945 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-console-serving-cert\") pod \"console-6547d5b9-bng27\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:05.322988 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.322995 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8gxw8\" (UniqueName: \"kubernetes.io/projected/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-kube-api-access-8gxw8\") pod \"console-6547d5b9-bng27\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:05.323259 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.323013 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-console-oauth-config\") pod \"console-6547d5b9-bng27\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:05.323259 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.323102 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-trusted-ca-bundle\") pod \"console-6547d5b9-bng27\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:05.323259 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.323125 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-service-ca\") pod \"console-6547d5b9-bng27\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:05.323259 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.323163 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-console-config\") pod \"console-6547d5b9-bng27\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:05.323457 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.323331 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-oauth-serving-cert\") pod \"console-6547d5b9-bng27\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:05.323993 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.323960 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-service-ca\") pod \"console-6547d5b9-bng27\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:05.324133 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.323999 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-oauth-serving-cert\") pod \"console-6547d5b9-bng27\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:05.324133 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.323965 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-console-config\") pod \"console-6547d5b9-bng27\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:05.324133 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.324052 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-trusted-ca-bundle\") pod \"console-6547d5b9-bng27\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:05.325593 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.325562 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-console-serving-cert\") pod \"console-6547d5b9-bng27\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:05.325729 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.325646 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-console-oauth-config\") pod \"console-6547d5b9-bng27\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:05.333330 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.333303 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gxw8\" (UniqueName: \"kubernetes.io/projected/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-kube-api-access-8gxw8\") pod \"console-6547d5b9-bng27\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:05.436559 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.436523 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:05.575231 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.575199 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6547d5b9-bng27"] Jun 02 19:08:05.578432 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:08:05.578403 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c8028ee_c6f2_4a2c_adbe_6091cdce849a.slice/crio-6fed3194adaa57a60653d23049515a0b30652b5e89fdb27f82b47245f9da48c5 WatchSource:0}: Error finding container 6fed3194adaa57a60653d23049515a0b30652b5e89fdb27f82b47245f9da48c5: Status 404 returned error can't find the container with id 6fed3194adaa57a60653d23049515a0b30652b5e89fdb27f82b47245f9da48c5 Jun 02 19:08:05.937306 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.937266 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6547d5b9-bng27" event={"ID":"4c8028ee-c6f2-4a2c-adbe-6091cdce849a","Type":"ContainerStarted","Data":"a89c9bd81b2a3dea85054092da4740d449880f9b97cc73f2a716d4de7cd4a39d"} Jun 02 19:08:05.937306 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.937308 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6547d5b9-bng27" event={"ID":"4c8028ee-c6f2-4a2c-adbe-6091cdce849a","Type":"ContainerStarted","Data":"6fed3194adaa57a60653d23049515a0b30652b5e89fdb27f82b47245f9da48c5"} Jun 02 19:08:05.957986 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:05.957940 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6547d5b9-bng27" podStartSLOduration=0.957924777 podStartE2EDuration="957.924777ms" podCreationTimestamp="2026-06-02 19:08:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:08:05.957332675 +0000 UTC m=+276.518135592" watchObservedRunningTime="2026-06-02 19:08:05.957924777 +0000 UTC m=+276.518727679" Jun 02 19:08:15.437353 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:15.437295 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:15.437353 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:15.437363 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:15.442154 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:15.442128 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:15.972239 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:15.972209 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:08:16.066825 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:16.066790 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7df565c89-w7sc4"] Jun 02 19:08:29.931968 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:29.931941 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-dsq5s_3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415/console-operator/2.log" Jun 02 19:08:29.932415 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:29.932026 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-dsq5s_3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415/console-operator/2.log" Jun 02 19:08:29.935329 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:29.935051 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xz76r_6d38637d-caa3-4eb1-a749-9fe24430d039/ovn-acl-logging/0.log" Jun 02 19:08:29.935329 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:29.935313 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xz76r_6d38637d-caa3-4eb1-a749-9fe24430d039/ovn-acl-logging/0.log" Jun 02 19:08:41.086346 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:41.086288 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7df565c89-w7sc4" podUID="17a3a4dc-a0ed-4e6e-8598-5a3046596f1d" containerName="console" containerID="cri-o://81f596f75bbdc14b4838f7b34643e6929cd4e786fdc61f4f5fab6b1f2702bb95" gracePeriod=15 Jun 02 19:08:41.322494 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:41.322472 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7df565c89-w7sc4_17a3a4dc-a0ed-4e6e-8598-5a3046596f1d/console/0.log" Jun 02 19:08:41.322630 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:41.322543 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:08:41.431837 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:41.431740 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-trusted-ca-bundle\") pod \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " Jun 02 19:08:41.431837 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:41.431795 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-oauth-serving-cert\") pod \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " Jun 02 19:08:41.431837 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:41.431820 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-console-oauth-config\") pod \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " Jun 02 19:08:41.431837 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:41.431837 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-console-config\") pod \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " Jun 02 19:08:41.432151 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:41.431859 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tl66\" (UniqueName: \"kubernetes.io/projected/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-kube-api-access-2tl66\") pod \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " Jun 02 19:08:41.432151 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:41.431891 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-service-ca\") pod \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " Jun 02 19:08:41.432151 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:41.431987 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-console-serving-cert\") pod \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\" (UID: \"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d\") " Jun 02 19:08:41.432304 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:41.432259 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "17a3a4dc-a0ed-4e6e-8598-5a3046596f1d" (UID: "17a3a4dc-a0ed-4e6e-8598-5a3046596f1d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:08:41.432364 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:41.432320 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "17a3a4dc-a0ed-4e6e-8598-5a3046596f1d" (UID: "17a3a4dc-a0ed-4e6e-8598-5a3046596f1d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:08:41.432471 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:41.432445 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-console-config" (OuterVolumeSpecName: "console-config") pod "17a3a4dc-a0ed-4e6e-8598-5a3046596f1d" (UID: "17a3a4dc-a0ed-4e6e-8598-5a3046596f1d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:08:41.432550 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:41.432526 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-service-ca" (OuterVolumeSpecName: "service-ca") pod "17a3a4dc-a0ed-4e6e-8598-5a3046596f1d" (UID: "17a3a4dc-a0ed-4e6e-8598-5a3046596f1d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:08:41.434094 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:41.434069 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "17a3a4dc-a0ed-4e6e-8598-5a3046596f1d" (UID: "17a3a4dc-a0ed-4e6e-8598-5a3046596f1d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:08:41.434192 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:41.434114 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "17a3a4dc-a0ed-4e6e-8598-5a3046596f1d" (UID: "17a3a4dc-a0ed-4e6e-8598-5a3046596f1d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:08:41.434192 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:41.434128 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-kube-api-access-2tl66" (OuterVolumeSpecName: "kube-api-access-2tl66") pod "17a3a4dc-a0ed-4e6e-8598-5a3046596f1d" (UID: "17a3a4dc-a0ed-4e6e-8598-5a3046596f1d"). InnerVolumeSpecName "kube-api-access-2tl66". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:08:41.532865 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:41.532823 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-trusted-ca-bundle\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:08:41.532865 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:41.532856 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-oauth-serving-cert\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:08:41.532865 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:41.532865 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-console-oauth-config\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:08:41.532865 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:41.532875 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-console-config\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:08:41.533122 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:41.532884 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tl66\" (UniqueName: \"kubernetes.io/projected/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-kube-api-access-2tl66\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:08:41.533122 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:41.532894 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-service-ca\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:08:41.533122 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:41.532903 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d-console-serving-cert\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:08:42.050659 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:42.050628 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7df565c89-w7sc4_17a3a4dc-a0ed-4e6e-8598-5a3046596f1d/console/0.log" Jun 02 19:08:42.050822 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:42.050666 2569 generic.go:358] "Generic (PLEG): container finished" podID="17a3a4dc-a0ed-4e6e-8598-5a3046596f1d" containerID="81f596f75bbdc14b4838f7b34643e6929cd4e786fdc61f4f5fab6b1f2702bb95" exitCode=2 Jun 02 19:08:42.050822 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:42.050735 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7df565c89-w7sc4" event={"ID":"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d","Type":"ContainerDied","Data":"81f596f75bbdc14b4838f7b34643e6929cd4e786fdc61f4f5fab6b1f2702bb95"} Jun 02 19:08:42.050822 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:42.050749 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7df565c89-w7sc4" Jun 02 19:08:42.050822 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:42.050763 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7df565c89-w7sc4" event={"ID":"17a3a4dc-a0ed-4e6e-8598-5a3046596f1d","Type":"ContainerDied","Data":"29474bd464c391f7e887dd76cfea537b492089cad1e8ce9a7ec0ed8046d08ae8"} Jun 02 19:08:42.050822 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:42.050777 2569 scope.go:117] "RemoveContainer" containerID="81f596f75bbdc14b4838f7b34643e6929cd4e786fdc61f4f5fab6b1f2702bb95" Jun 02 19:08:42.058517 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:42.058497 2569 scope.go:117] "RemoveContainer" containerID="81f596f75bbdc14b4838f7b34643e6929cd4e786fdc61f4f5fab6b1f2702bb95" Jun 02 19:08:42.058789 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:08:42.058769 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81f596f75bbdc14b4838f7b34643e6929cd4e786fdc61f4f5fab6b1f2702bb95\": container with ID starting with 81f596f75bbdc14b4838f7b34643e6929cd4e786fdc61f4f5fab6b1f2702bb95 not found: ID does not exist" containerID="81f596f75bbdc14b4838f7b34643e6929cd4e786fdc61f4f5fab6b1f2702bb95" Jun 02 19:08:42.058871 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:42.058801 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81f596f75bbdc14b4838f7b34643e6929cd4e786fdc61f4f5fab6b1f2702bb95"} err="failed to get container status \"81f596f75bbdc14b4838f7b34643e6929cd4e786fdc61f4f5fab6b1f2702bb95\": rpc error: code = NotFound desc = could not find container \"81f596f75bbdc14b4838f7b34643e6929cd4e786fdc61f4f5fab6b1f2702bb95\": container with ID starting with 81f596f75bbdc14b4838f7b34643e6929cd4e786fdc61f4f5fab6b1f2702bb95 not found: ID does not exist" Jun 02 19:08:42.065249 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:42.065227 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7df565c89-w7sc4"] Jun 02 19:08:42.068895 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:42.068875 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7df565c89-w7sc4"] Jun 02 19:08:44.002431 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:44.002383 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17a3a4dc-a0ed-4e6e-8598-5a3046596f1d" path="/var/lib/kubelet/pods/17a3a4dc-a0ed-4e6e-8598-5a3046596f1d/volumes" Jun 02 19:08:54.453675 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:54.453637 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g"] Jun 02 19:08:54.454066 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:54.453971 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17a3a4dc-a0ed-4e6e-8598-5a3046596f1d" containerName="console" Jun 02 19:08:54.454066 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:54.453983 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="17a3a4dc-a0ed-4e6e-8598-5a3046596f1d" containerName="console" Jun 02 19:08:54.454066 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:54.454049 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="17a3a4dc-a0ed-4e6e-8598-5a3046596f1d" containerName="console" Jun 02 19:08:54.458222 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:54.458205 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g" Jun 02 19:08:54.460327 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:54.460308 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 19:08:54.460899 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:54.460882 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 19:08:54.461020 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:54.460899 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4hwsg\"" Jun 02 19:08:54.465303 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:54.465258 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g"] Jun 02 19:08:54.536189 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:54.536148 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d56a538d-dc68-44cb-ac92-4af35bc3da12-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g\" (UID: \"d56a538d-dc68-44cb-ac92-4af35bc3da12\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g" Jun 02 19:08:54.536368 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:54.536201 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d56a538d-dc68-44cb-ac92-4af35bc3da12-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g\" (UID: \"d56a538d-dc68-44cb-ac92-4af35bc3da12\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g" Jun 02 19:08:54.536368 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:54.536256 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7qr4\" (UniqueName: \"kubernetes.io/projected/d56a538d-dc68-44cb-ac92-4af35bc3da12-kube-api-access-t7qr4\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g\" (UID: \"d56a538d-dc68-44cb-ac92-4af35bc3da12\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g" Jun 02 19:08:54.637040 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:54.636997 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7qr4\" (UniqueName: \"kubernetes.io/projected/d56a538d-dc68-44cb-ac92-4af35bc3da12-kube-api-access-t7qr4\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g\" (UID: \"d56a538d-dc68-44cb-ac92-4af35bc3da12\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g" Jun 02 19:08:54.637210 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:54.637078 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d56a538d-dc68-44cb-ac92-4af35bc3da12-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g\" (UID: \"d56a538d-dc68-44cb-ac92-4af35bc3da12\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g" Jun 02 19:08:54.637210 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:54.637103 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d56a538d-dc68-44cb-ac92-4af35bc3da12-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g\" (UID: \"d56a538d-dc68-44cb-ac92-4af35bc3da12\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g" Jun 02 19:08:54.637524 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:54.637500 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d56a538d-dc68-44cb-ac92-4af35bc3da12-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g\" (UID: \"d56a538d-dc68-44cb-ac92-4af35bc3da12\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g" Jun 02 19:08:54.637596 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:54.637535 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d56a538d-dc68-44cb-ac92-4af35bc3da12-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g\" (UID: \"d56a538d-dc68-44cb-ac92-4af35bc3da12\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g" Jun 02 19:08:54.649738 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:54.649705 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7qr4\" (UniqueName: \"kubernetes.io/projected/d56a538d-dc68-44cb-ac92-4af35bc3da12-kube-api-access-t7qr4\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g\" (UID: \"d56a538d-dc68-44cb-ac92-4af35bc3da12\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g" Jun 02 19:08:54.768520 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:54.768419 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g" Jun 02 19:08:54.894465 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:54.894424 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g"] Jun 02 19:08:54.899136 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:08:54.899108 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd56a538d_dc68_44cb_ac92_4af35bc3da12.slice/crio-5f5d62e01a7c1ed66c54f09a4f0dd2a463311166c8d4c9b6ad7377dc726df2a7 WatchSource:0}: Error finding container 5f5d62e01a7c1ed66c54f09a4f0dd2a463311166c8d4c9b6ad7377dc726df2a7: Status 404 returned error can't find the container with id 5f5d62e01a7c1ed66c54f09a4f0dd2a463311166c8d4c9b6ad7377dc726df2a7 Jun 02 19:08:54.900836 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:54.900821 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 19:08:55.088589 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:08:55.088503 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g" event={"ID":"d56a538d-dc68-44cb-ac92-4af35bc3da12","Type":"ContainerStarted","Data":"5f5d62e01a7c1ed66c54f09a4f0dd2a463311166c8d4c9b6ad7377dc726df2a7"} Jun 02 19:09:02.113724 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:02.113665 2569 generic.go:358] "Generic (PLEG): container finished" podID="d56a538d-dc68-44cb-ac92-4af35bc3da12" containerID="ef9c184363e3f1ff9a383dc9f77e6c31dbb8e097bea2ecbf360adf5b0f297319" exitCode=0 Jun 02 19:09:02.114155 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:02.113749 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g" event={"ID":"d56a538d-dc68-44cb-ac92-4af35bc3da12","Type":"ContainerDied","Data":"ef9c184363e3f1ff9a383dc9f77e6c31dbb8e097bea2ecbf360adf5b0f297319"} Jun 02 19:09:05.124460 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:05.124424 2569 generic.go:358] "Generic (PLEG): container finished" podID="d56a538d-dc68-44cb-ac92-4af35bc3da12" containerID="d4171565671608855728b9046ab2a19f92047270d5202c1c30a31ab180c2bfe2" exitCode=0 Jun 02 19:09:05.124958 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:05.124488 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g" event={"ID":"d56a538d-dc68-44cb-ac92-4af35bc3da12","Type":"ContainerDied","Data":"d4171565671608855728b9046ab2a19f92047270d5202c1c30a31ab180c2bfe2"} Jun 02 19:09:16.164695 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:16.164649 2569 generic.go:358] "Generic (PLEG): container finished" podID="d56a538d-dc68-44cb-ac92-4af35bc3da12" containerID="95f9553552e438ad1f330259b025734bb5e50e3d80908f0ec38b065c049a4297" exitCode=0 Jun 02 19:09:16.165179 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:16.164720 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g" event={"ID":"d56a538d-dc68-44cb-ac92-4af35bc3da12","Type":"ContainerDied","Data":"95f9553552e438ad1f330259b025734bb5e50e3d80908f0ec38b065c049a4297"} Jun 02 19:09:17.287473 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:17.287449 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g" Jun 02 19:09:17.426731 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:17.426626 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d56a538d-dc68-44cb-ac92-4af35bc3da12-util\") pod \"d56a538d-dc68-44cb-ac92-4af35bc3da12\" (UID: \"d56a538d-dc68-44cb-ac92-4af35bc3da12\") " Jun 02 19:09:17.426731 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:17.426674 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7qr4\" (UniqueName: \"kubernetes.io/projected/d56a538d-dc68-44cb-ac92-4af35bc3da12-kube-api-access-t7qr4\") pod \"d56a538d-dc68-44cb-ac92-4af35bc3da12\" (UID: \"d56a538d-dc68-44cb-ac92-4af35bc3da12\") " Jun 02 19:09:17.426731 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:17.426730 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d56a538d-dc68-44cb-ac92-4af35bc3da12-bundle\") pod \"d56a538d-dc68-44cb-ac92-4af35bc3da12\" (UID: \"d56a538d-dc68-44cb-ac92-4af35bc3da12\") " Jun 02 19:09:17.427446 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:17.427420 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d56a538d-dc68-44cb-ac92-4af35bc3da12-bundle" (OuterVolumeSpecName: "bundle") pod "d56a538d-dc68-44cb-ac92-4af35bc3da12" (UID: "d56a538d-dc68-44cb-ac92-4af35bc3da12"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:09:17.428958 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:17.428935 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d56a538d-dc68-44cb-ac92-4af35bc3da12-kube-api-access-t7qr4" (OuterVolumeSpecName: "kube-api-access-t7qr4") pod "d56a538d-dc68-44cb-ac92-4af35bc3da12" (UID: "d56a538d-dc68-44cb-ac92-4af35bc3da12"). InnerVolumeSpecName "kube-api-access-t7qr4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:09:17.432463 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:17.432435 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d56a538d-dc68-44cb-ac92-4af35bc3da12-util" (OuterVolumeSpecName: "util") pod "d56a538d-dc68-44cb-ac92-4af35bc3da12" (UID: "d56a538d-dc68-44cb-ac92-4af35bc3da12"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:09:17.527418 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:17.527382 2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d56a538d-dc68-44cb-ac92-4af35bc3da12-bundle\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:09:17.527418 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:17.527411 2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d56a538d-dc68-44cb-ac92-4af35bc3da12-util\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:09:17.527418 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:17.527420 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7qr4\" (UniqueName: \"kubernetes.io/projected/d56a538d-dc68-44cb-ac92-4af35bc3da12-kube-api-access-t7qr4\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:09:18.172506 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:18.172477 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g" Jun 02 19:09:18.172699 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:18.172503 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2tg7g" event={"ID":"d56a538d-dc68-44cb-ac92-4af35bc3da12","Type":"ContainerDied","Data":"5f5d62e01a7c1ed66c54f09a4f0dd2a463311166c8d4c9b6ad7377dc726df2a7"} Jun 02 19:09:18.172699 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:18.172534 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f5d62e01a7c1ed66c54f09a4f0dd2a463311166c8d4c9b6ad7377dc726df2a7" Jun 02 19:09:22.586530 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:22.586488 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4pp8t"] Jun 02 19:09:22.586944 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:22.586803 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d56a538d-dc68-44cb-ac92-4af35bc3da12" containerName="util" Jun 02 19:09:22.586944 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:22.586814 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d56a538d-dc68-44cb-ac92-4af35bc3da12" containerName="util" Jun 02 19:09:22.586944 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:22.586830 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d56a538d-dc68-44cb-ac92-4af35bc3da12" containerName="pull" Jun 02 19:09:22.586944 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:22.586835 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d56a538d-dc68-44cb-ac92-4af35bc3da12" containerName="pull" Jun 02 19:09:22.586944 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:22.586841 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d56a538d-dc68-44cb-ac92-4af35bc3da12" containerName="extract" Jun 02 19:09:22.586944 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:22.586845 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d56a538d-dc68-44cb-ac92-4af35bc3da12" containerName="extract" Jun 02 19:09:22.586944 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:22.586914 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="d56a538d-dc68-44cb-ac92-4af35bc3da12" containerName="extract" Jun 02 19:09:22.590548 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:22.590532 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4pp8t" Jun 02 19:09:22.594062 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:22.594043 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-lnhkc\"" Jun 02 19:09:22.594224 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:22.594205 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 02 19:09:22.594302 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:22.594234 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:09:22.602564 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:22.602545 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4pp8t"] Jun 02 19:09:22.669914 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:22.669883 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f41c6ba-22c0-4f5c-96c7-71f4420b79ef-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-4pp8t\" (UID: \"8f41c6ba-22c0-4f5c-96c7-71f4420b79ef\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4pp8t" Jun 02 19:09:22.670048 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:22.669943 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj96x\" (UniqueName: \"kubernetes.io/projected/8f41c6ba-22c0-4f5c-96c7-71f4420b79ef-kube-api-access-kj96x\") pod \"cert-manager-operator-controller-manager-54b9655956-4pp8t\" (UID: \"8f41c6ba-22c0-4f5c-96c7-71f4420b79ef\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4pp8t" Jun 02 19:09:22.770793 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:22.770755 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f41c6ba-22c0-4f5c-96c7-71f4420b79ef-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-4pp8t\" (UID: \"8f41c6ba-22c0-4f5c-96c7-71f4420b79ef\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4pp8t" Jun 02 19:09:22.770968 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:22.770812 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kj96x\" (UniqueName: \"kubernetes.io/projected/8f41c6ba-22c0-4f5c-96c7-71f4420b79ef-kube-api-access-kj96x\") pod \"cert-manager-operator-controller-manager-54b9655956-4pp8t\" (UID: \"8f41c6ba-22c0-4f5c-96c7-71f4420b79ef\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4pp8t" Jun 02 19:09:22.771212 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:22.771188 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f41c6ba-22c0-4f5c-96c7-71f4420b79ef-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-4pp8t\" (UID: \"8f41c6ba-22c0-4f5c-96c7-71f4420b79ef\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4pp8t" Jun 02 19:09:22.779356 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:22.779325 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj96x\" (UniqueName: \"kubernetes.io/projected/8f41c6ba-22c0-4f5c-96c7-71f4420b79ef-kube-api-access-kj96x\") pod \"cert-manager-operator-controller-manager-54b9655956-4pp8t\" (UID: \"8f41c6ba-22c0-4f5c-96c7-71f4420b79ef\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4pp8t" Jun 02 19:09:22.899190 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:22.899107 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4pp8t" Jun 02 19:09:23.031918 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:23.031885 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4pp8t"] Jun 02 19:09:23.036717 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:09:23.036672 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f41c6ba_22c0_4f5c_96c7_71f4420b79ef.slice/crio-1b8c4f96bb068a622543acdbdf17a5e34d5dc589772e5e47155adc387b93cf66 WatchSource:0}: Error finding container 1b8c4f96bb068a622543acdbdf17a5e34d5dc589772e5e47155adc387b93cf66: Status 404 returned error can't find the container with id 1b8c4f96bb068a622543acdbdf17a5e34d5dc589772e5e47155adc387b93cf66 Jun 02 19:09:23.189073 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:23.189032 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4pp8t" event={"ID":"8f41c6ba-22c0-4f5c-96c7-71f4420b79ef","Type":"ContainerStarted","Data":"1b8c4f96bb068a622543acdbdf17a5e34d5dc589772e5e47155adc387b93cf66"} Jun 02 19:09:25.196778 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:25.196739 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4pp8t" event={"ID":"8f41c6ba-22c0-4f5c-96c7-71f4420b79ef","Type":"ContainerStarted","Data":"9a70eca78b7f81ba8867c43a8c9e88fc74847793530771a1d85506147a0d4386"} Jun 02 19:09:25.218805 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:25.218754 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4pp8t" podStartSLOduration=1.509715937 podStartE2EDuration="3.218736046s" podCreationTimestamp="2026-06-02 19:09:22 +0000 UTC" firstStartedPulling="2026-06-02 19:09:23.03935584 +0000 UTC m=+353.600158720" lastFinishedPulling="2026-06-02 19:09:24.748375949 +0000 UTC m=+355.309178829" observedRunningTime="2026-06-02 19:09:25.217997754 +0000 UTC m=+355.778800683" watchObservedRunningTime="2026-06-02 19:09:25.218736046 +0000 UTC m=+355.779538949" Jun 02 19:09:27.221766 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:27.221736 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-gn7xc"] Jun 02 19:09:27.224939 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:27.224921 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-gn7xc" Jun 02 19:09:27.226994 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:27.226970 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 19:09:27.227610 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:27.227594 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 19:09:27.227693 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:27.227609 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-nfv8t\"" Jun 02 19:09:27.234651 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:27.234625 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-gn7xc"] Jun 02 19:09:27.311214 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:27.311176 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12c5ace4-5f85-4eae-bcb8-676c321892df-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-gn7xc\" (UID: \"12c5ace4-5f85-4eae-bcb8-676c321892df\") " pod="cert-manager/cert-manager-webhook-587ccfb98-gn7xc" Jun 02 19:09:27.311389 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:27.311246 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8gj9\" (UniqueName: \"kubernetes.io/projected/12c5ace4-5f85-4eae-bcb8-676c321892df-kube-api-access-x8gj9\") pod \"cert-manager-webhook-587ccfb98-gn7xc\" (UID: \"12c5ace4-5f85-4eae-bcb8-676c321892df\") " pod="cert-manager/cert-manager-webhook-587ccfb98-gn7xc" Jun 02 19:09:27.412228 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:27.412184 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12c5ace4-5f85-4eae-bcb8-676c321892df-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-gn7xc\" (UID: \"12c5ace4-5f85-4eae-bcb8-676c321892df\") " pod="cert-manager/cert-manager-webhook-587ccfb98-gn7xc" Jun 02 19:09:27.412427 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:27.412285 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x8gj9\" (UniqueName: \"kubernetes.io/projected/12c5ace4-5f85-4eae-bcb8-676c321892df-kube-api-access-x8gj9\") pod \"cert-manager-webhook-587ccfb98-gn7xc\" (UID: \"12c5ace4-5f85-4eae-bcb8-676c321892df\") " pod="cert-manager/cert-manager-webhook-587ccfb98-gn7xc" Jun 02 19:09:27.420914 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:27.420883 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12c5ace4-5f85-4eae-bcb8-676c321892df-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-gn7xc\" (UID: \"12c5ace4-5f85-4eae-bcb8-676c321892df\") " pod="cert-manager/cert-manager-webhook-587ccfb98-gn7xc" Jun 02 19:09:27.421019 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:27.421004 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8gj9\" (UniqueName: \"kubernetes.io/projected/12c5ace4-5f85-4eae-bcb8-676c321892df-kube-api-access-x8gj9\") pod \"cert-manager-webhook-587ccfb98-gn7xc\" (UID: \"12c5ace4-5f85-4eae-bcb8-676c321892df\") " pod="cert-manager/cert-manager-webhook-587ccfb98-gn7xc" Jun 02 19:09:27.541448 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:27.541366 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-gn7xc" Jun 02 19:09:27.670672 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:27.670640 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-gn7xc"] Jun 02 19:09:27.674141 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:09:27.674112 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12c5ace4_5f85_4eae_bcb8_676c321892df.slice/crio-3a16c6038b64d46b58f9d5f6630deca2d767108024e3bfe0f748d761b1886871 WatchSource:0}: Error finding container 3a16c6038b64d46b58f9d5f6630deca2d767108024e3bfe0f748d761b1886871: Status 404 returned error can't find the container with id 3a16c6038b64d46b58f9d5f6630deca2d767108024e3bfe0f748d761b1886871 Jun 02 19:09:28.207348 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:28.207315 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-gn7xc" event={"ID":"12c5ace4-5f85-4eae-bcb8-676c321892df","Type":"ContainerStarted","Data":"3a16c6038b64d46b58f9d5f6630deca2d767108024e3bfe0f748d761b1886871"} Jun 02 19:09:31.218769 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:31.218735 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-gn7xc" event={"ID":"12c5ace4-5f85-4eae-bcb8-676c321892df","Type":"ContainerStarted","Data":"bebe55723d139e5004d4ee35db39f9ff8ff610a01d2a7d060392dbd4af23e8b4"} Jun 02 19:09:31.219165 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:31.218882 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-gn7xc" Jun 02 19:09:31.240171 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:31.240113 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-gn7xc" podStartSLOduration=1.622879562 podStartE2EDuration="4.240099286s" podCreationTimestamp="2026-06-02 19:09:27 +0000 UTC" firstStartedPulling="2026-06-02 19:09:27.675958345 +0000 UTC m=+358.236761225" lastFinishedPulling="2026-06-02 19:09:30.293178066 +0000 UTC m=+360.853980949" observedRunningTime="2026-06-02 19:09:31.238826141 +0000 UTC m=+361.799629043" watchObservedRunningTime="2026-06-02 19:09:31.240099286 +0000 UTC m=+361.800902189" Jun 02 19:09:37.223627 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:37.223595 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-gn7xc" Jun 02 19:09:38.627200 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:38.627170 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-cpxjz"] Jun 02 19:09:38.630377 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:38.630361 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-cpxjz" Jun 02 19:09:38.632646 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:38.632630 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-kkc8j\"" Jun 02 19:09:38.651921 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:38.651892 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-cpxjz"] Jun 02 19:09:38.706855 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:38.706830 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20c6b40d-6aef-489e-972a-dbcc04fad31c-bound-sa-token\") pod \"cert-manager-79c8d999ff-cpxjz\" (UID: \"20c6b40d-6aef-489e-972a-dbcc04fad31c\") " pod="cert-manager/cert-manager-79c8d999ff-cpxjz" Jun 02 19:09:38.706983 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:38.706862 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcrfh\" (UniqueName: \"kubernetes.io/projected/20c6b40d-6aef-489e-972a-dbcc04fad31c-kube-api-access-pcrfh\") pod \"cert-manager-79c8d999ff-cpxjz\" (UID: \"20c6b40d-6aef-489e-972a-dbcc04fad31c\") " pod="cert-manager/cert-manager-79c8d999ff-cpxjz" Jun 02 19:09:38.807354 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:38.807314 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcrfh\" (UniqueName: \"kubernetes.io/projected/20c6b40d-6aef-489e-972a-dbcc04fad31c-kube-api-access-pcrfh\") pod \"cert-manager-79c8d999ff-cpxjz\" (UID: \"20c6b40d-6aef-489e-972a-dbcc04fad31c\") " pod="cert-manager/cert-manager-79c8d999ff-cpxjz" Jun 02 19:09:38.807520 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:38.807436 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20c6b40d-6aef-489e-972a-dbcc04fad31c-bound-sa-token\") pod \"cert-manager-79c8d999ff-cpxjz\" (UID: \"20c6b40d-6aef-489e-972a-dbcc04fad31c\") " pod="cert-manager/cert-manager-79c8d999ff-cpxjz" Jun 02 19:09:38.816874 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:38.816848 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20c6b40d-6aef-489e-972a-dbcc04fad31c-bound-sa-token\") pod \"cert-manager-79c8d999ff-cpxjz\" (UID: \"20c6b40d-6aef-489e-972a-dbcc04fad31c\") " pod="cert-manager/cert-manager-79c8d999ff-cpxjz" Jun 02 19:09:38.817842 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:38.817824 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcrfh\" (UniqueName: \"kubernetes.io/projected/20c6b40d-6aef-489e-972a-dbcc04fad31c-kube-api-access-pcrfh\") pod \"cert-manager-79c8d999ff-cpxjz\" (UID: \"20c6b40d-6aef-489e-972a-dbcc04fad31c\") " pod="cert-manager/cert-manager-79c8d999ff-cpxjz" Jun 02 19:09:38.939390 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:38.939351 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-cpxjz" Jun 02 19:09:39.063873 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:39.063849 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-cpxjz"] Jun 02 19:09:39.067244 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:09:39.067205 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20c6b40d_6aef_489e_972a_dbcc04fad31c.slice/crio-4cc378dbefe66b8666967416a9726b160f13091de6b23392f7ab0d2fbb88baf1 WatchSource:0}: Error finding container 4cc378dbefe66b8666967416a9726b160f13091de6b23392f7ab0d2fbb88baf1: Status 404 returned error can't find the container with id 4cc378dbefe66b8666967416a9726b160f13091de6b23392f7ab0d2fbb88baf1 Jun 02 19:09:39.247286 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:39.247192 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-cpxjz" event={"ID":"20c6b40d-6aef-489e-972a-dbcc04fad31c","Type":"ContainerStarted","Data":"5fddf764b4e81c4ec1101693eb423952e51c60003937134e4ee3f42136c41b21"} Jun 02 19:09:39.247286 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:39.247230 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-cpxjz" event={"ID":"20c6b40d-6aef-489e-972a-dbcc04fad31c","Type":"ContainerStarted","Data":"4cc378dbefe66b8666967416a9726b160f13091de6b23392f7ab0d2fbb88baf1"} Jun 02 19:09:39.268812 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:39.268758 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-cpxjz" podStartSLOduration=1.268743157 podStartE2EDuration="1.268743157s" podCreationTimestamp="2026-06-02 19:09:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:09:39.266824844 +0000 UTC m=+369.827627756" watchObservedRunningTime="2026-06-02 19:09:39.268743157 +0000 UTC m=+369.829546059" Jun 02 19:09:57.193391 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:57.193352 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8"] Jun 02 19:09:57.199054 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:57.199035 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8" Jun 02 19:09:57.201399 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:57.201382 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 19:09:57.201479 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:57.201388 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4hwsg\"" Jun 02 19:09:57.201769 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:57.201746 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 19:09:57.205884 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:57.205860 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8"] Jun 02 19:09:57.257144 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:57.257116 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38a0dad9-f4fd-4608-97eb-50b0f94375e4-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8\" (UID: \"38a0dad9-f4fd-4608-97eb-50b0f94375e4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8" Jun 02 19:09:57.257289 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:57.257215 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctxcz\" (UniqueName: \"kubernetes.io/projected/38a0dad9-f4fd-4608-97eb-50b0f94375e4-kube-api-access-ctxcz\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8\" (UID: \"38a0dad9-f4fd-4608-97eb-50b0f94375e4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8" Jun 02 19:09:57.257289 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:57.257242 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38a0dad9-f4fd-4608-97eb-50b0f94375e4-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8\" (UID: \"38a0dad9-f4fd-4608-97eb-50b0f94375e4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8" Jun 02 19:09:57.357783 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:57.357746 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38a0dad9-f4fd-4608-97eb-50b0f94375e4-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8\" (UID: \"38a0dad9-f4fd-4608-97eb-50b0f94375e4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8" Jun 02 19:09:57.357960 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:57.357835 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ctxcz\" (UniqueName: \"kubernetes.io/projected/38a0dad9-f4fd-4608-97eb-50b0f94375e4-kube-api-access-ctxcz\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8\" (UID: \"38a0dad9-f4fd-4608-97eb-50b0f94375e4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8" Jun 02 19:09:57.357960 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:57.357862 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38a0dad9-f4fd-4608-97eb-50b0f94375e4-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8\" (UID: \"38a0dad9-f4fd-4608-97eb-50b0f94375e4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8" Jun 02 19:09:57.358116 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:57.358093 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38a0dad9-f4fd-4608-97eb-50b0f94375e4-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8\" (UID: \"38a0dad9-f4fd-4608-97eb-50b0f94375e4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8" Jun 02 19:09:57.358172 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:57.358122 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38a0dad9-f4fd-4608-97eb-50b0f94375e4-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8\" (UID: \"38a0dad9-f4fd-4608-97eb-50b0f94375e4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8" Jun 02 19:09:57.368716 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:57.368690 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctxcz\" (UniqueName: \"kubernetes.io/projected/38a0dad9-f4fd-4608-97eb-50b0f94375e4-kube-api-access-ctxcz\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8\" (UID: \"38a0dad9-f4fd-4608-97eb-50b0f94375e4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8" Jun 02 19:09:57.509249 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:57.509173 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8" Jun 02 19:09:57.666876 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:57.666843 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8"] Jun 02 19:09:57.669557 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:09:57.669509 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38a0dad9_f4fd_4608_97eb_50b0f94375e4.slice/crio-21d4f04afc5cfe0ab06d247bd5efa57b91908d0fcbf67011a1444dc9ad3713cd WatchSource:0}: Error finding container 21d4f04afc5cfe0ab06d247bd5efa57b91908d0fcbf67011a1444dc9ad3713cd: Status 404 returned error can't find the container with id 21d4f04afc5cfe0ab06d247bd5efa57b91908d0fcbf67011a1444dc9ad3713cd Jun 02 19:09:58.309173 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:58.309128 2569 generic.go:358] "Generic (PLEG): container finished" podID="38a0dad9-f4fd-4608-97eb-50b0f94375e4" containerID="9993d73396815ab311088afe655627d0a6d9bd1c05639562d2e7c11679f5c8fe" exitCode=0 Jun 02 19:09:58.309563 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:58.309176 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8" event={"ID":"38a0dad9-f4fd-4608-97eb-50b0f94375e4","Type":"ContainerDied","Data":"9993d73396815ab311088afe655627d0a6d9bd1c05639562d2e7c11679f5c8fe"} Jun 02 19:09:58.309563 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:58.309213 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8" event={"ID":"38a0dad9-f4fd-4608-97eb-50b0f94375e4","Type":"ContainerStarted","Data":"21d4f04afc5cfe0ab06d247bd5efa57b91908d0fcbf67011a1444dc9ad3713cd"} Jun 02 19:09:59.314215 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:59.314185 2569 generic.go:358] "Generic (PLEG): container finished" podID="38a0dad9-f4fd-4608-97eb-50b0f94375e4" containerID="ce9fad296930cd6588ebee5acfa72085c3bbc1671cf48b334e8b66c2e2cf139e" exitCode=0 Jun 02 19:09:59.314653 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:09:59.314271 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8" event={"ID":"38a0dad9-f4fd-4608-97eb-50b0f94375e4","Type":"ContainerDied","Data":"ce9fad296930cd6588ebee5acfa72085c3bbc1671cf48b334e8b66c2e2cf139e"} Jun 02 19:10:00.319701 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:00.319653 2569 generic.go:358] "Generic (PLEG): container finished" podID="38a0dad9-f4fd-4608-97eb-50b0f94375e4" containerID="0e3d8231cde0ca74e97abbe2a81c34b85e964998c1579a2768527c98a0c3c34d" exitCode=0 Jun 02 19:10:00.319701 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:00.319703 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8" event={"ID":"38a0dad9-f4fd-4608-97eb-50b0f94375e4","Type":"ContainerDied","Data":"0e3d8231cde0ca74e97abbe2a81c34b85e964998c1579a2768527c98a0c3c34d"} Jun 02 19:10:01.442069 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:01.442047 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8" Jun 02 19:10:01.500261 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:01.500231 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctxcz\" (UniqueName: \"kubernetes.io/projected/38a0dad9-f4fd-4608-97eb-50b0f94375e4-kube-api-access-ctxcz\") pod \"38a0dad9-f4fd-4608-97eb-50b0f94375e4\" (UID: \"38a0dad9-f4fd-4608-97eb-50b0f94375e4\") " Jun 02 19:10:01.500401 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:01.500269 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38a0dad9-f4fd-4608-97eb-50b0f94375e4-util\") pod \"38a0dad9-f4fd-4608-97eb-50b0f94375e4\" (UID: \"38a0dad9-f4fd-4608-97eb-50b0f94375e4\") " Jun 02 19:10:01.500401 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:01.500286 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38a0dad9-f4fd-4608-97eb-50b0f94375e4-bundle\") pod \"38a0dad9-f4fd-4608-97eb-50b0f94375e4\" (UID: \"38a0dad9-f4fd-4608-97eb-50b0f94375e4\") " Jun 02 19:10:01.501014 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:01.500984 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38a0dad9-f4fd-4608-97eb-50b0f94375e4-bundle" (OuterVolumeSpecName: "bundle") pod "38a0dad9-f4fd-4608-97eb-50b0f94375e4" (UID: "38a0dad9-f4fd-4608-97eb-50b0f94375e4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:10:01.502276 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:01.502254 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38a0dad9-f4fd-4608-97eb-50b0f94375e4-kube-api-access-ctxcz" (OuterVolumeSpecName: "kube-api-access-ctxcz") pod "38a0dad9-f4fd-4608-97eb-50b0f94375e4" (UID: "38a0dad9-f4fd-4608-97eb-50b0f94375e4"). InnerVolumeSpecName "kube-api-access-ctxcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:10:01.505525 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:01.505505 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38a0dad9-f4fd-4608-97eb-50b0f94375e4-util" (OuterVolumeSpecName: "util") pod "38a0dad9-f4fd-4608-97eb-50b0f94375e4" (UID: "38a0dad9-f4fd-4608-97eb-50b0f94375e4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:10:01.600850 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:01.600783 2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38a0dad9-f4fd-4608-97eb-50b0f94375e4-util\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:10:01.600850 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:01.600812 2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38a0dad9-f4fd-4608-97eb-50b0f94375e4-bundle\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:10:01.600850 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:01.600821 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctxcz\" (UniqueName: \"kubernetes.io/projected/38a0dad9-f4fd-4608-97eb-50b0f94375e4-kube-api-access-ctxcz\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:10:02.327380 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:02.327300 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8" Jun 02 19:10:02.327608 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:02.327294 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5x2d8" event={"ID":"38a0dad9-f4fd-4608-97eb-50b0f94375e4","Type":"ContainerDied","Data":"21d4f04afc5cfe0ab06d247bd5efa57b91908d0fcbf67011a1444dc9ad3713cd"} Jun 02 19:10:02.327608 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:02.327405 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21d4f04afc5cfe0ab06d247bd5efa57b91908d0fcbf67011a1444dc9ad3713cd" Jun 02 19:10:09.927608 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:09.927575 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-686947f9c6-78h2b"] Jun 02 19:10:09.928010 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:09.927888 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38a0dad9-f4fd-4608-97eb-50b0f94375e4" containerName="extract" Jun 02 19:10:09.928010 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:09.927899 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="38a0dad9-f4fd-4608-97eb-50b0f94375e4" containerName="extract" Jun 02 19:10:09.928010 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:09.927908 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38a0dad9-f4fd-4608-97eb-50b0f94375e4" containerName="pull" Jun 02 19:10:09.928010 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:09.927914 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="38a0dad9-f4fd-4608-97eb-50b0f94375e4" containerName="pull" Jun 02 19:10:09.928010 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:09.927932 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38a0dad9-f4fd-4608-97eb-50b0f94375e4" containerName="util" Jun 02 19:10:09.928010 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:09.927937 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="38a0dad9-f4fd-4608-97eb-50b0f94375e4" containerName="util" Jun 02 19:10:09.928010 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:09.927985 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="38a0dad9-f4fd-4608-97eb-50b0f94375e4" containerName="extract" Jun 02 19:10:09.930859 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:09.930844 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-686947f9c6-78h2b" Jun 02 19:10:09.933886 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:09.933837 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 02 19:10:09.933886 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:09.933877 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 02 19:10:09.934096 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:09.933903 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 02 19:10:09.934096 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:09.933917 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:10:09.934096 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:09.933842 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5vvfd\"" Jun 02 19:10:09.934096 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:09.933977 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 19:10:09.939747 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:09.939728 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-686947f9c6-78h2b"] Jun 02 19:10:09.963175 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:09.963156 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/994c8bcd-c37e-4511-86d6-b604b897c0b2-cert\") pod \"lws-controller-manager-686947f9c6-78h2b\" (UID: \"994c8bcd-c37e-4511-86d6-b604b897c0b2\") " pod="openshift-lws-operator/lws-controller-manager-686947f9c6-78h2b" Jun 02 19:10:09.963286 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:09.963207 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/994c8bcd-c37e-4511-86d6-b604b897c0b2-metrics-cert\") pod \"lws-controller-manager-686947f9c6-78h2b\" (UID: \"994c8bcd-c37e-4511-86d6-b604b897c0b2\") " pod="openshift-lws-operator/lws-controller-manager-686947f9c6-78h2b" Jun 02 19:10:09.963286 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:09.963236 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lrqb\" (UniqueName: \"kubernetes.io/projected/994c8bcd-c37e-4511-86d6-b604b897c0b2-kube-api-access-4lrqb\") pod \"lws-controller-manager-686947f9c6-78h2b\" (UID: \"994c8bcd-c37e-4511-86d6-b604b897c0b2\") " pod="openshift-lws-operator/lws-controller-manager-686947f9c6-78h2b" Jun 02 19:10:09.963286 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:09.963262 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/994c8bcd-c37e-4511-86d6-b604b897c0b2-manager-config\") pod \"lws-controller-manager-686947f9c6-78h2b\" (UID: \"994c8bcd-c37e-4511-86d6-b604b897c0b2\") " pod="openshift-lws-operator/lws-controller-manager-686947f9c6-78h2b" Jun 02 19:10:10.064310 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:10.064275 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4lrqb\" (UniqueName: \"kubernetes.io/projected/994c8bcd-c37e-4511-86d6-b604b897c0b2-kube-api-access-4lrqb\") pod \"lws-controller-manager-686947f9c6-78h2b\" (UID: \"994c8bcd-c37e-4511-86d6-b604b897c0b2\") " pod="openshift-lws-operator/lws-controller-manager-686947f9c6-78h2b" Jun 02 19:10:10.064497 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:10.064319 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/994c8bcd-c37e-4511-86d6-b604b897c0b2-manager-config\") pod \"lws-controller-manager-686947f9c6-78h2b\" (UID: \"994c8bcd-c37e-4511-86d6-b604b897c0b2\") " pod="openshift-lws-operator/lws-controller-manager-686947f9c6-78h2b" Jun 02 19:10:10.064497 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:10.064364 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/994c8bcd-c37e-4511-86d6-b604b897c0b2-cert\") pod \"lws-controller-manager-686947f9c6-78h2b\" (UID: \"994c8bcd-c37e-4511-86d6-b604b897c0b2\") " pod="openshift-lws-operator/lws-controller-manager-686947f9c6-78h2b" Jun 02 19:10:10.064497 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:10.064413 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/994c8bcd-c37e-4511-86d6-b604b897c0b2-metrics-cert\") pod \"lws-controller-manager-686947f9c6-78h2b\" (UID: \"994c8bcd-c37e-4511-86d6-b604b897c0b2\") " pod="openshift-lws-operator/lws-controller-manager-686947f9c6-78h2b" Jun 02 19:10:10.065074 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:10.065049 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/994c8bcd-c37e-4511-86d6-b604b897c0b2-manager-config\") pod \"lws-controller-manager-686947f9c6-78h2b\" (UID: \"994c8bcd-c37e-4511-86d6-b604b897c0b2\") " pod="openshift-lws-operator/lws-controller-manager-686947f9c6-78h2b" Jun 02 19:10:10.066830 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:10.066803 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/994c8bcd-c37e-4511-86d6-b604b897c0b2-metrics-cert\") pod \"lws-controller-manager-686947f9c6-78h2b\" (UID: \"994c8bcd-c37e-4511-86d6-b604b897c0b2\") " pod="openshift-lws-operator/lws-controller-manager-686947f9c6-78h2b" Jun 02 19:10:10.066929 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:10.066861 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/994c8bcd-c37e-4511-86d6-b604b897c0b2-cert\") pod \"lws-controller-manager-686947f9c6-78h2b\" (UID: \"994c8bcd-c37e-4511-86d6-b604b897c0b2\") " pod="openshift-lws-operator/lws-controller-manager-686947f9c6-78h2b" Jun 02 19:10:10.073178 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:10.073149 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lrqb\" (UniqueName: \"kubernetes.io/projected/994c8bcd-c37e-4511-86d6-b604b897c0b2-kube-api-access-4lrqb\") pod \"lws-controller-manager-686947f9c6-78h2b\" (UID: \"994c8bcd-c37e-4511-86d6-b604b897c0b2\") " pod="openshift-lws-operator/lws-controller-manager-686947f9c6-78h2b" Jun 02 19:10:10.241562 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:10.241535 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-686947f9c6-78h2b" Jun 02 19:10:10.392703 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:10.392630 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-686947f9c6-78h2b"] Jun 02 19:10:10.395181 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:10:10.395154 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod994c8bcd_c37e_4511_86d6_b604b897c0b2.slice/crio-333ebdc4cf62a8e1b131afef85e2be98b32739d627688a2e0c3a574c2ea995db WatchSource:0}: Error finding container 333ebdc4cf62a8e1b131afef85e2be98b32739d627688a2e0c3a574c2ea995db: Status 404 returned error can't find the container with id 333ebdc4cf62a8e1b131afef85e2be98b32739d627688a2e0c3a574c2ea995db Jun 02 19:10:11.361099 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:11.361059 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-686947f9c6-78h2b" event={"ID":"994c8bcd-c37e-4511-86d6-b604b897c0b2","Type":"ContainerStarted","Data":"333ebdc4cf62a8e1b131afef85e2be98b32739d627688a2e0c3a574c2ea995db"} Jun 02 19:10:13.369548 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:13.369491 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-686947f9c6-78h2b" event={"ID":"994c8bcd-c37e-4511-86d6-b604b897c0b2","Type":"ContainerStarted","Data":"b99629147c81482ca8ef8315b21dad32d9656fad7455827773163acf57061a05"} Jun 02 19:10:13.369996 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:13.369590 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-686947f9c6-78h2b" Jun 02 19:10:13.389917 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:13.389863 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-686947f9c6-78h2b" podStartSLOduration=1.537443284 podStartE2EDuration="4.389849009s" podCreationTimestamp="2026-06-02 19:10:09 +0000 UTC" firstStartedPulling="2026-06-02 19:10:10.396770478 +0000 UTC m=+400.957573358" lastFinishedPulling="2026-06-02 19:10:13.249176191 +0000 UTC m=+403.809979083" observedRunningTime="2026-06-02 19:10:13.387362315 +0000 UTC m=+403.948165216" watchObservedRunningTime="2026-06-02 19:10:13.389849009 +0000 UTC m=+403.950651910" Jun 02 19:10:14.322419 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:14.322386 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf"] Jun 02 19:10:14.325994 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:14.325970 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf" Jun 02 19:10:14.329649 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:14.329620 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xpjmn\"" Jun 02 19:10:14.329782 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:14.329691 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 19:10:14.330036 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:14.330014 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 19:10:14.330157 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:14.330101 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 19:10:14.330430 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:14.330413 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 19:10:14.348057 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:14.348029 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf"] Jun 02 19:10:14.402214 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:14.402186 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ed2c2f8-2a47-4250-98e1-6bb5c62044c2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7548bb679b-mhzqf\" (UID: \"5ed2c2f8-2a47-4250-98e1-6bb5c62044c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf" Jun 02 19:10:14.402578 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:14.402287 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5ed2c2f8-2a47-4250-98e1-6bb5c62044c2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7548bb679b-mhzqf\" (UID: \"5ed2c2f8-2a47-4250-98e1-6bb5c62044c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf" Jun 02 19:10:14.402578 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:14.402330 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5ed2c2f8-2a47-4250-98e1-6bb5c62044c2-manifests\") pod \"opendatahub-operator-controller-manager-7548bb679b-mhzqf\" (UID: \"5ed2c2f8-2a47-4250-98e1-6bb5c62044c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf" Jun 02 19:10:14.402578 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:14.402370 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ed2c2f8-2a47-4250-98e1-6bb5c62044c2-tmp\") pod \"opendatahub-operator-controller-manager-7548bb679b-mhzqf\" (UID: \"5ed2c2f8-2a47-4250-98e1-6bb5c62044c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf" Jun 02 19:10:14.402578 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:14.402447 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqsqv\" (UniqueName: \"kubernetes.io/projected/5ed2c2f8-2a47-4250-98e1-6bb5c62044c2-kube-api-access-tqsqv\") pod \"opendatahub-operator-controller-manager-7548bb679b-mhzqf\" (UID: \"5ed2c2f8-2a47-4250-98e1-6bb5c62044c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf" Jun 02 19:10:14.502898 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:14.502867 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ed2c2f8-2a47-4250-98e1-6bb5c62044c2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7548bb679b-mhzqf\" (UID: \"5ed2c2f8-2a47-4250-98e1-6bb5c62044c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf" Jun 02 19:10:14.503069 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:14.502924 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5ed2c2f8-2a47-4250-98e1-6bb5c62044c2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7548bb679b-mhzqf\" (UID: \"5ed2c2f8-2a47-4250-98e1-6bb5c62044c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf" Jun 02 19:10:14.503069 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:14.503053 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5ed2c2f8-2a47-4250-98e1-6bb5c62044c2-manifests\") pod \"opendatahub-operator-controller-manager-7548bb679b-mhzqf\" (UID: \"5ed2c2f8-2a47-4250-98e1-6bb5c62044c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf" Jun 02 19:10:14.503139 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:14.503106 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ed2c2f8-2a47-4250-98e1-6bb5c62044c2-tmp\") pod \"opendatahub-operator-controller-manager-7548bb679b-mhzqf\" (UID: \"5ed2c2f8-2a47-4250-98e1-6bb5c62044c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf" Jun 02 19:10:14.503172 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:14.503155 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tqsqv\" (UniqueName: \"kubernetes.io/projected/5ed2c2f8-2a47-4250-98e1-6bb5c62044c2-kube-api-access-tqsqv\") pod \"opendatahub-operator-controller-manager-7548bb679b-mhzqf\" (UID: \"5ed2c2f8-2a47-4250-98e1-6bb5c62044c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf" Jun 02 19:10:14.503523 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:14.503498 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5ed2c2f8-2a47-4250-98e1-6bb5c62044c2-manifests\") pod \"opendatahub-operator-controller-manager-7548bb679b-mhzqf\" (UID: \"5ed2c2f8-2a47-4250-98e1-6bb5c62044c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf" Jun 02 19:10:14.505414 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:14.505390 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ed2c2f8-2a47-4250-98e1-6bb5c62044c2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7548bb679b-mhzqf\" (UID: \"5ed2c2f8-2a47-4250-98e1-6bb5c62044c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf" Jun 02 19:10:14.505506 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:14.505440 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ed2c2f8-2a47-4250-98e1-6bb5c62044c2-tmp\") pod \"opendatahub-operator-controller-manager-7548bb679b-mhzqf\" (UID: \"5ed2c2f8-2a47-4250-98e1-6bb5c62044c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf" Jun 02 19:10:14.505666 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:14.505649 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5ed2c2f8-2a47-4250-98e1-6bb5c62044c2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7548bb679b-mhzqf\" (UID: \"5ed2c2f8-2a47-4250-98e1-6bb5c62044c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf" Jun 02 19:10:14.511720 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:14.511700 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqsqv\" (UniqueName: \"kubernetes.io/projected/5ed2c2f8-2a47-4250-98e1-6bb5c62044c2-kube-api-access-tqsqv\") pod \"opendatahub-operator-controller-manager-7548bb679b-mhzqf\" (UID: \"5ed2c2f8-2a47-4250-98e1-6bb5c62044c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf" Jun 02 19:10:14.636528 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:14.636442 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf" Jun 02 19:10:14.802740 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:14.802651 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf"] Jun 02 19:10:14.808056 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:10:14.808027 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ed2c2f8_2a47_4250_98e1_6bb5c62044c2.slice/crio-96f68b11bc0b0a7978349939401f5093c40d5df0620bd6478a5534a59d617553 WatchSource:0}: Error finding container 96f68b11bc0b0a7978349939401f5093c40d5df0620bd6478a5534a59d617553: Status 404 returned error can't find the container with id 96f68b11bc0b0a7978349939401f5093c40d5df0620bd6478a5534a59d617553 Jun 02 19:10:15.377214 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:15.377175 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf" event={"ID":"5ed2c2f8-2a47-4250-98e1-6bb5c62044c2","Type":"ContainerStarted","Data":"96f68b11bc0b0a7978349939401f5093c40d5df0620bd6478a5534a59d617553"} Jun 02 19:10:18.390436 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:18.390392 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf" event={"ID":"5ed2c2f8-2a47-4250-98e1-6bb5c62044c2","Type":"ContainerStarted","Data":"1636ea54409f658ffe4a6b226a9206a7be89f6f833651f2862bf5274590566d9"} Jun 02 19:10:19.394595 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:19.394564 2569 generic.go:358] "Generic (PLEG): container finished" podID="5ed2c2f8-2a47-4250-98e1-6bb5c62044c2" containerID="1636ea54409f658ffe4a6b226a9206a7be89f6f833651f2862bf5274590566d9" exitCode=0 Jun 02 19:10:19.395012 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:19.394654 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf" event={"ID":"5ed2c2f8-2a47-4250-98e1-6bb5c62044c2","Type":"ContainerDied","Data":"1636ea54409f658ffe4a6b226a9206a7be89f6f833651f2862bf5274590566d9"} Jun 02 19:10:20.399555 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:20.399518 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf" event={"ID":"5ed2c2f8-2a47-4250-98e1-6bb5c62044c2","Type":"ContainerStarted","Data":"ddcdfc0312128dd2abe46ad02ede2596ff97ac8ba56d21e156396b5ad2759b15"} Jun 02 19:10:20.399943 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:20.399698 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf" Jun 02 19:10:20.420523 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:20.420473 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf" podStartSLOduration=1.444656041 podStartE2EDuration="6.420459323s" podCreationTimestamp="2026-06-02 19:10:14 +0000 UTC" firstStartedPulling="2026-06-02 19:10:14.809983343 +0000 UTC m=+405.370786227" lastFinishedPulling="2026-06-02 19:10:19.785786623 +0000 UTC m=+410.346589509" observedRunningTime="2026-06-02 19:10:20.420445413 +0000 UTC m=+410.981248317" watchObservedRunningTime="2026-06-02 19:10:20.420459323 +0000 UTC m=+410.981262225" Jun 02 19:10:24.375380 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:24.375355 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-686947f9c6-78h2b" Jun 02 19:10:31.404970 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:31.404934 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-mhzqf" Jun 02 19:10:33.466792 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:33.466759 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-79d759cb56-5db9c"] Jun 02 19:10:33.599809 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:33.599773 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79d759cb56-5db9c"] Jun 02 19:10:33.599955 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:33.599916 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79d759cb56-5db9c" Jun 02 19:10:33.601999 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:33.601976 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-kf58n\"" Jun 02 19:10:33.602109 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:33.601976 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 19:10:33.602109 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:33.601986 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 19:10:33.675428 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:33.675394 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d7510ab-c31c-47a7-b3b0-1dafd52f5457-tls-certs\") pod \"kube-auth-proxy-79d759cb56-5db9c\" (UID: \"3d7510ab-c31c-47a7-b3b0-1dafd52f5457\") " pod="openshift-ingress/kube-auth-proxy-79d759cb56-5db9c" Jun 02 19:10:33.675564 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:33.675447 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l55ww\" (UniqueName: \"kubernetes.io/projected/3d7510ab-c31c-47a7-b3b0-1dafd52f5457-kube-api-access-l55ww\") pod \"kube-auth-proxy-79d759cb56-5db9c\" (UID: \"3d7510ab-c31c-47a7-b3b0-1dafd52f5457\") " pod="openshift-ingress/kube-auth-proxy-79d759cb56-5db9c" Jun 02 19:10:33.675606 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:33.675560 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d7510ab-c31c-47a7-b3b0-1dafd52f5457-tmp\") pod \"kube-auth-proxy-79d759cb56-5db9c\" (UID: \"3d7510ab-c31c-47a7-b3b0-1dafd52f5457\") " pod="openshift-ingress/kube-auth-proxy-79d759cb56-5db9c" Jun 02 19:10:33.776059 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:33.775973 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d7510ab-c31c-47a7-b3b0-1dafd52f5457-tmp\") pod \"kube-auth-proxy-79d759cb56-5db9c\" (UID: \"3d7510ab-c31c-47a7-b3b0-1dafd52f5457\") " pod="openshift-ingress/kube-auth-proxy-79d759cb56-5db9c" Jun 02 19:10:33.776059 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:33.776021 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d7510ab-c31c-47a7-b3b0-1dafd52f5457-tls-certs\") pod \"kube-auth-proxy-79d759cb56-5db9c\" (UID: \"3d7510ab-c31c-47a7-b3b0-1dafd52f5457\") " pod="openshift-ingress/kube-auth-proxy-79d759cb56-5db9c" Jun 02 19:10:33.776225 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:10:33.776129 2569 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 02 19:10:33.776225 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:33.776135 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l55ww\" (UniqueName: \"kubernetes.io/projected/3d7510ab-c31c-47a7-b3b0-1dafd52f5457-kube-api-access-l55ww\") pod \"kube-auth-proxy-79d759cb56-5db9c\" (UID: \"3d7510ab-c31c-47a7-b3b0-1dafd52f5457\") " pod="openshift-ingress/kube-auth-proxy-79d759cb56-5db9c" Jun 02 19:10:33.776225 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:10:33.776214 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7510ab-c31c-47a7-b3b0-1dafd52f5457-tls-certs podName:3d7510ab-c31c-47a7-b3b0-1dafd52f5457 nodeName:}" failed. No retries permitted until 2026-06-02 19:10:34.276193816 +0000 UTC m=+424.836996697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3d7510ab-c31c-47a7-b3b0-1dafd52f5457-tls-certs") pod "kube-auth-proxy-79d759cb56-5db9c" (UID: "3d7510ab-c31c-47a7-b3b0-1dafd52f5457") : secret "kube-auth-proxy-tls" not found Jun 02 19:10:33.778369 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:33.778345 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d7510ab-c31c-47a7-b3b0-1dafd52f5457-tmp\") pod \"kube-auth-proxy-79d759cb56-5db9c\" (UID: \"3d7510ab-c31c-47a7-b3b0-1dafd52f5457\") " pod="openshift-ingress/kube-auth-proxy-79d759cb56-5db9c" Jun 02 19:10:33.786334 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:33.786311 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l55ww\" (UniqueName: \"kubernetes.io/projected/3d7510ab-c31c-47a7-b3b0-1dafd52f5457-kube-api-access-l55ww\") pod \"kube-auth-proxy-79d759cb56-5db9c\" (UID: \"3d7510ab-c31c-47a7-b3b0-1dafd52f5457\") " pod="openshift-ingress/kube-auth-proxy-79d759cb56-5db9c" Jun 02 19:10:34.281609 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:34.281557 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d7510ab-c31c-47a7-b3b0-1dafd52f5457-tls-certs\") pod \"kube-auth-proxy-79d759cb56-5db9c\" (UID: \"3d7510ab-c31c-47a7-b3b0-1dafd52f5457\") " pod="openshift-ingress/kube-auth-proxy-79d759cb56-5db9c" Jun 02 19:10:34.283992 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:34.283962 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d7510ab-c31c-47a7-b3b0-1dafd52f5457-tls-certs\") pod \"kube-auth-proxy-79d759cb56-5db9c\" (UID: \"3d7510ab-c31c-47a7-b3b0-1dafd52f5457\") " pod="openshift-ingress/kube-auth-proxy-79d759cb56-5db9c" Jun 02 19:10:34.509815 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:34.509780 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79d759cb56-5db9c" Jun 02 19:10:34.642753 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:34.642729 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79d759cb56-5db9c"] Jun 02 19:10:34.644486 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:10:34.644459 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d7510ab_c31c_47a7_b3b0_1dafd52f5457.slice/crio-e49585f11eb214ace64ed0059577963a69e74fda06192f30c3aeaa44ca8ef419 WatchSource:0}: Error finding container e49585f11eb214ace64ed0059577963a69e74fda06192f30c3aeaa44ca8ef419: Status 404 returned error can't find the container with id e49585f11eb214ace64ed0059577963a69e74fda06192f30c3aeaa44ca8ef419 Jun 02 19:10:35.456708 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:35.456647 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79d759cb56-5db9c" event={"ID":"3d7510ab-c31c-47a7-b3b0-1dafd52f5457","Type":"ContainerStarted","Data":"e49585f11eb214ace64ed0059577963a69e74fda06192f30c3aeaa44ca8ef419"} Jun 02 19:10:38.468597 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:38.468554 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79d759cb56-5db9c" event={"ID":"3d7510ab-c31c-47a7-b3b0-1dafd52f5457","Type":"ContainerStarted","Data":"fbd07c1faa93500808be9e2434ac2dcd7a8fce6a58e2baf2f7b7cbeebf75bfbd"} Jun 02 19:10:38.483884 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:10:38.483832 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-79d759cb56-5db9c" podStartSLOduration=2.6386811789999998 podStartE2EDuration="5.483817677s" podCreationTimestamp="2026-06-02 19:10:33 +0000 UTC" firstStartedPulling="2026-06-02 19:10:34.646171384 +0000 UTC m=+425.206974265" lastFinishedPulling="2026-06-02 19:10:37.491307883 +0000 UTC m=+428.052110763" observedRunningTime="2026-06-02 19:10:38.482501674 +0000 UTC m=+429.043304575" watchObservedRunningTime="2026-06-02 19:10:38.483817677 +0000 UTC m=+429.044620578" Jun 02 19:12:11.133774 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:11.133664 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6547d5b9-bng27"] Jun 02 19:12:16.151807 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:16.151775 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-5gdtk"] Jun 02 19:12:16.155097 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:16.155077 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5gdtk" Jun 02 19:12:16.157115 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:16.157093 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-ngl7k\"" Jun 02 19:12:16.157248 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:16.157094 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 02 19:12:16.157248 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:16.157160 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 19:12:16.157248 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:16.157093 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 19:12:16.165450 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:16.165423 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-5gdtk"] Jun 02 19:12:16.255092 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:16.255056 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnwl6\" (UniqueName: \"kubernetes.io/projected/fa522cf0-67cf-45b4-b623-7557c9a08590-kube-api-access-gnwl6\") pod \"dns-operator-controller-manager-648d5c98bc-5gdtk\" (UID: \"fa522cf0-67cf-45b4-b623-7557c9a08590\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5gdtk" Jun 02 19:12:16.356393 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:16.356358 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gnwl6\" (UniqueName: \"kubernetes.io/projected/fa522cf0-67cf-45b4-b623-7557c9a08590-kube-api-access-gnwl6\") pod \"dns-operator-controller-manager-648d5c98bc-5gdtk\" (UID: \"fa522cf0-67cf-45b4-b623-7557c9a08590\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5gdtk" Jun 02 19:12:16.394210 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:16.394178 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnwl6\" (UniqueName: \"kubernetes.io/projected/fa522cf0-67cf-45b4-b623-7557c9a08590-kube-api-access-gnwl6\") pod \"dns-operator-controller-manager-648d5c98bc-5gdtk\" (UID: \"fa522cf0-67cf-45b4-b623-7557c9a08590\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5gdtk" Jun 02 19:12:16.465733 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:16.465673 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5gdtk" Jun 02 19:12:16.600912 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:16.600886 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-5gdtk"] Jun 02 19:12:16.603402 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:12:16.603369 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa522cf0_67cf_45b4_b623_7557c9a08590.slice/crio-59733e229d93a2e42f3134790a14fc61fd147c77a2d1f1995448d4cae0f4ebce WatchSource:0}: Error finding container 59733e229d93a2e42f3134790a14fc61fd147c77a2d1f1995448d4cae0f4ebce: Status 404 returned error can't find the container with id 59733e229d93a2e42f3134790a14fc61fd147c77a2d1f1995448d4cae0f4ebce Jun 02 19:12:16.791007 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:16.790908 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5gdtk" event={"ID":"fa522cf0-67cf-45b4-b623-7557c9a08590","Type":"ContainerStarted","Data":"59733e229d93a2e42f3134790a14fc61fd147c77a2d1f1995448d4cae0f4ebce"} Jun 02 19:12:17.309274 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:17.309244 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xr2n2"] Jun 02 19:12:17.312413 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:17.312391 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xr2n2" Jun 02 19:12:17.315072 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:17.315046 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 02 19:12:17.315481 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:17.315462 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-g98bw\"" Jun 02 19:12:17.315595 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:17.315482 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 02 19:12:17.326492 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:17.326471 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xr2n2"] Jun 02 19:12:17.466108 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:17.466073 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qbr9\" (UniqueName: \"kubernetes.io/projected/c5120c43-dc24-4b11-b366-d03b44b0eb57-kube-api-access-7qbr9\") pod \"kuadrant-console-plugin-6cb54b5c86-xr2n2\" (UID: \"c5120c43-dc24-4b11-b366-d03b44b0eb57\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xr2n2" Jun 02 19:12:17.466260 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:17.466152 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c5120c43-dc24-4b11-b366-d03b44b0eb57-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-xr2n2\" (UID: \"c5120c43-dc24-4b11-b366-d03b44b0eb57\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xr2n2" Jun 02 19:12:17.466260 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:17.466233 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5120c43-dc24-4b11-b366-d03b44b0eb57-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-xr2n2\" (UID: \"c5120c43-dc24-4b11-b366-d03b44b0eb57\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xr2n2" Jun 02 19:12:17.567596 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:17.567509 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7qbr9\" (UniqueName: \"kubernetes.io/projected/c5120c43-dc24-4b11-b366-d03b44b0eb57-kube-api-access-7qbr9\") pod \"kuadrant-console-plugin-6cb54b5c86-xr2n2\" (UID: \"c5120c43-dc24-4b11-b366-d03b44b0eb57\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xr2n2" Jun 02 19:12:17.567596 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:17.567571 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c5120c43-dc24-4b11-b366-d03b44b0eb57-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-xr2n2\" (UID: \"c5120c43-dc24-4b11-b366-d03b44b0eb57\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xr2n2" Jun 02 19:12:17.567831 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:17.567789 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5120c43-dc24-4b11-b366-d03b44b0eb57-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-xr2n2\" (UID: \"c5120c43-dc24-4b11-b366-d03b44b0eb57\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xr2n2" Jun 02 19:12:17.568204 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:17.568181 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c5120c43-dc24-4b11-b366-d03b44b0eb57-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-xr2n2\" (UID: \"c5120c43-dc24-4b11-b366-d03b44b0eb57\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xr2n2" Jun 02 19:12:17.569912 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:17.569886 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5120c43-dc24-4b11-b366-d03b44b0eb57-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-xr2n2\" (UID: \"c5120c43-dc24-4b11-b366-d03b44b0eb57\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xr2n2" Jun 02 19:12:17.579899 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:17.579875 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qbr9\" (UniqueName: \"kubernetes.io/projected/c5120c43-dc24-4b11-b366-d03b44b0eb57-kube-api-access-7qbr9\") pod \"kuadrant-console-plugin-6cb54b5c86-xr2n2\" (UID: \"c5120c43-dc24-4b11-b366-d03b44b0eb57\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xr2n2" Jun 02 19:12:17.622611 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:17.622581 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xr2n2" Jun 02 19:12:17.975702 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:17.975601 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xr2n2"] Jun 02 19:12:17.978193 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:12:17.978163 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5120c43_dc24_4b11_b366_d03b44b0eb57.slice/crio-e4fd1683aef7d39a30d82730b1de10b4aa61ee8ce4d99ff1c0489031c01c4c3f WatchSource:0}: Error finding container e4fd1683aef7d39a30d82730b1de10b4aa61ee8ce4d99ff1c0489031c01c4c3f: Status 404 returned error can't find the container with id e4fd1683aef7d39a30d82730b1de10b4aa61ee8ce4d99ff1c0489031c01c4c3f Jun 02 19:12:18.799244 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:18.799213 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xr2n2" event={"ID":"c5120c43-dc24-4b11-b366-d03b44b0eb57","Type":"ContainerStarted","Data":"e4fd1683aef7d39a30d82730b1de10b4aa61ee8ce4d99ff1c0489031c01c4c3f"} Jun 02 19:12:19.804362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:19.804316 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5gdtk" event={"ID":"fa522cf0-67cf-45b4-b623-7557c9a08590","Type":"ContainerStarted","Data":"d4ea7759ca2f37d591b18d30caf1884d1a915338486b86091977e270318d132b"} Jun 02 19:12:19.804798 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:19.804486 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5gdtk" Jun 02 19:12:19.831698 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:19.831628 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5gdtk" podStartSLOduration=1.232956951 podStartE2EDuration="3.831611019s" podCreationTimestamp="2026-06-02 19:12:16 +0000 UTC" firstStartedPulling="2026-06-02 19:12:16.605330377 +0000 UTC m=+527.166133261" lastFinishedPulling="2026-06-02 19:12:19.203984449 +0000 UTC m=+529.764787329" observedRunningTime="2026-06-02 19:12:19.830348449 +0000 UTC m=+530.391151351" watchObservedRunningTime="2026-06-02 19:12:19.831611019 +0000 UTC m=+530.392413922" Jun 02 19:12:30.810134 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:30.810099 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5gdtk" Jun 02 19:12:36.154148 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:36.154075 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6547d5b9-bng27" podUID="4c8028ee-c6f2-4a2c-adbe-6091cdce849a" containerName="console" containerID="cri-o://a89c9bd81b2a3dea85054092da4740d449880f9b97cc73f2a716d4de7cd4a39d" gracePeriod=15 Jun 02 19:12:44.095425 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.095400 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6547d5b9-bng27_4c8028ee-c6f2-4a2c-adbe-6091cdce849a/console/0.log" Jun 02 19:12:44.095853 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.095474 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:12:44.116695 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.116646 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-trusted-ca-bundle\") pod \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " Jun 02 19:12:44.116825 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.116716 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-console-config\") pod \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " Jun 02 19:12:44.116825 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.116756 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-oauth-serving-cert\") pod \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " Jun 02 19:12:44.116825 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.116779 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-console-oauth-config\") pod \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " Jun 02 19:12:44.116988 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.116871 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-console-serving-cert\") pod \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " Jun 02 19:12:44.116988 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.116925 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gxw8\" (UniqueName: \"kubernetes.io/projected/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-kube-api-access-8gxw8\") pod \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " Jun 02 19:12:44.116988 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.116959 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-service-ca\") pod \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\" (UID: \"4c8028ee-c6f2-4a2c-adbe-6091cdce849a\") " Jun 02 19:12:44.117127 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.117016 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4c8028ee-c6f2-4a2c-adbe-6091cdce849a" (UID: "4c8028ee-c6f2-4a2c-adbe-6091cdce849a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:12:44.117374 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.117349 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-trusted-ca-bundle\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:12:44.117854 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.117829 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-console-config" (OuterVolumeSpecName: "console-config") pod "4c8028ee-c6f2-4a2c-adbe-6091cdce849a" (UID: "4c8028ee-c6f2-4a2c-adbe-6091cdce849a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:12:44.117967 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.117878 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4c8028ee-c6f2-4a2c-adbe-6091cdce849a" (UID: "4c8028ee-c6f2-4a2c-adbe-6091cdce849a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:12:44.118033 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.118010 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-service-ca" (OuterVolumeSpecName: "service-ca") pod "4c8028ee-c6f2-4a2c-adbe-6091cdce849a" (UID: "4c8028ee-c6f2-4a2c-adbe-6091cdce849a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:12:44.119330 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.119298 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4c8028ee-c6f2-4a2c-adbe-6091cdce849a" (UID: "4c8028ee-c6f2-4a2c-adbe-6091cdce849a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:12:44.119656 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.119628 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-kube-api-access-8gxw8" (OuterVolumeSpecName: "kube-api-access-8gxw8") pod "4c8028ee-c6f2-4a2c-adbe-6091cdce849a" (UID: "4c8028ee-c6f2-4a2c-adbe-6091cdce849a"). InnerVolumeSpecName "kube-api-access-8gxw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:12:44.119869 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.119754 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4c8028ee-c6f2-4a2c-adbe-6091cdce849a" (UID: "4c8028ee-c6f2-4a2c-adbe-6091cdce849a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:12:44.218577 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.218487 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-console-serving-cert\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:12:44.218577 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.218517 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gxw8\" (UniqueName: \"kubernetes.io/projected/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-kube-api-access-8gxw8\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:12:44.218577 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.218527 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-service-ca\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:12:44.218577 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.218536 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-console-config\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:12:44.218577 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.218544 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-oauth-serving-cert\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:12:44.218577 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.218552 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c8028ee-c6f2-4a2c-adbe-6091cdce849a-console-oauth-config\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:12:44.909166 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.909115 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xr2n2" event={"ID":"c5120c43-dc24-4b11-b366-d03b44b0eb57","Type":"ContainerStarted","Data":"e6994e32b705d57781b3b06228f85c919e2d09b497996cfe9d48959c7f9253a1"} Jun 02 19:12:44.910819 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.910796 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6547d5b9-bng27_4c8028ee-c6f2-4a2c-adbe-6091cdce849a/console/0.log" Jun 02 19:12:44.910964 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.910831 2569 generic.go:358] "Generic (PLEG): container finished" podID="4c8028ee-c6f2-4a2c-adbe-6091cdce849a" containerID="a89c9bd81b2a3dea85054092da4740d449880f9b97cc73f2a716d4de7cd4a39d" exitCode=2 Jun 02 19:12:44.910964 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.910892 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6547d5b9-bng27" event={"ID":"4c8028ee-c6f2-4a2c-adbe-6091cdce849a","Type":"ContainerDied","Data":"a89c9bd81b2a3dea85054092da4740d449880f9b97cc73f2a716d4de7cd4a39d"} Jun 02 19:12:44.910964 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.910912 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6547d5b9-bng27" event={"ID":"4c8028ee-c6f2-4a2c-adbe-6091cdce849a","Type":"ContainerDied","Data":"6fed3194adaa57a60653d23049515a0b30652b5e89fdb27f82b47245f9da48c5"} Jun 02 19:12:44.910964 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.910925 2569 scope.go:117] "RemoveContainer" containerID="a89c9bd81b2a3dea85054092da4740d449880f9b97cc73f2a716d4de7cd4a39d" Jun 02 19:12:44.911154 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.910925 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6547d5b9-bng27" Jun 02 19:12:44.919358 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.919339 2569 scope.go:117] "RemoveContainer" containerID="a89c9bd81b2a3dea85054092da4740d449880f9b97cc73f2a716d4de7cd4a39d" Jun 02 19:12:44.919599 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:12:44.919574 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a89c9bd81b2a3dea85054092da4740d449880f9b97cc73f2a716d4de7cd4a39d\": container with ID starting with a89c9bd81b2a3dea85054092da4740d449880f9b97cc73f2a716d4de7cd4a39d not found: ID does not exist" containerID="a89c9bd81b2a3dea85054092da4740d449880f9b97cc73f2a716d4de7cd4a39d" Jun 02 19:12:44.919724 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.919602 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a89c9bd81b2a3dea85054092da4740d449880f9b97cc73f2a716d4de7cd4a39d"} err="failed to get container status \"a89c9bd81b2a3dea85054092da4740d449880f9b97cc73f2a716d4de7cd4a39d\": rpc error: code = NotFound desc = could not find container \"a89c9bd81b2a3dea85054092da4740d449880f9b97cc73f2a716d4de7cd4a39d\": container with ID starting with a89c9bd81b2a3dea85054092da4740d449880f9b97cc73f2a716d4de7cd4a39d not found: ID does not exist" Jun 02 19:12:44.930998 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.930953 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xr2n2" podStartSLOduration=1.8932680670000002 podStartE2EDuration="27.930941988s" podCreationTimestamp="2026-06-02 19:12:17 +0000 UTC" firstStartedPulling="2026-06-02 19:12:17.980051064 +0000 UTC m=+528.540853948" lastFinishedPulling="2026-06-02 19:12:44.017724978 +0000 UTC m=+554.578527869" observedRunningTime="2026-06-02 19:12:44.9288166 +0000 UTC m=+555.489619501" watchObservedRunningTime="2026-06-02 19:12:44.930941988 +0000 UTC m=+555.491744869" Jun 02 19:12:44.946663 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.946635 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6547d5b9-bng27"] Jun 02 19:12:44.953726 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:44.953699 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6547d5b9-bng27"] Jun 02 19:12:46.002636 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:12:46.002603 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c8028ee-c6f2-4a2c-adbe-6091cdce849a" path="/var/lib/kubelet/pods/4c8028ee-c6f2-4a2c-adbe-6091cdce849a/volumes" Jun 02 19:13:05.158399 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:05.158361 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:13:05.158927 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:05.158889 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c8028ee-c6f2-4a2c-adbe-6091cdce849a" containerName="console" Jun 02 19:13:05.158927 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:05.158909 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c8028ee-c6f2-4a2c-adbe-6091cdce849a" containerName="console" Jun 02 19:13:05.159050 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:05.159021 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="4c8028ee-c6f2-4a2c-adbe-6091cdce849a" containerName="console" Jun 02 19:13:05.176516 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:05.176487 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:13:05.176657 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:05.176621 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-hlfbk" Jun 02 19:13:05.178622 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:05.178601 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 19:13:05.190065 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:05.190041 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:13:05.304914 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:05.304877 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tm67\" (UniqueName: \"kubernetes.io/projected/4ca43761-cfb2-426f-b2e7-90a16a473ef4-kube-api-access-4tm67\") pod \"limitador-limitador-78c99df468-hlfbk\" (UID: \"4ca43761-cfb2-426f-b2e7-90a16a473ef4\") " pod="kuadrant-system/limitador-limitador-78c99df468-hlfbk" Jun 02 19:13:05.305097 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:05.304929 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4ca43761-cfb2-426f-b2e7-90a16a473ef4-config-file\") pod \"limitador-limitador-78c99df468-hlfbk\" (UID: \"4ca43761-cfb2-426f-b2e7-90a16a473ef4\") " pod="kuadrant-system/limitador-limitador-78c99df468-hlfbk" Jun 02 19:13:05.406240 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:05.406201 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4tm67\" (UniqueName: \"kubernetes.io/projected/4ca43761-cfb2-426f-b2e7-90a16a473ef4-kube-api-access-4tm67\") pod \"limitador-limitador-78c99df468-hlfbk\" (UID: \"4ca43761-cfb2-426f-b2e7-90a16a473ef4\") " pod="kuadrant-system/limitador-limitador-78c99df468-hlfbk" Jun 02 19:13:05.406438 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:05.406248 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4ca43761-cfb2-426f-b2e7-90a16a473ef4-config-file\") pod \"limitador-limitador-78c99df468-hlfbk\" (UID: \"4ca43761-cfb2-426f-b2e7-90a16a473ef4\") " pod="kuadrant-system/limitador-limitador-78c99df468-hlfbk" Jun 02 19:13:05.406849 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:05.406830 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4ca43761-cfb2-426f-b2e7-90a16a473ef4-config-file\") pod \"limitador-limitador-78c99df468-hlfbk\" (UID: \"4ca43761-cfb2-426f-b2e7-90a16a473ef4\") " pod="kuadrant-system/limitador-limitador-78c99df468-hlfbk" Jun 02 19:13:05.416420 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:05.416375 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tm67\" (UniqueName: \"kubernetes.io/projected/4ca43761-cfb2-426f-b2e7-90a16a473ef4-kube-api-access-4tm67\") pod \"limitador-limitador-78c99df468-hlfbk\" (UID: \"4ca43761-cfb2-426f-b2e7-90a16a473ef4\") " pod="kuadrant-system/limitador-limitador-78c99df468-hlfbk" Jun 02 19:13:05.489441 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:05.489389 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-hlfbk" Jun 02 19:13:05.619442 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:05.619414 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:13:05.621598 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:13:05.621558 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ca43761_cfb2_426f_b2e7_90a16a473ef4.slice/crio-d1099c8482391a9060fd54be54c49127b1ea3bc7e09099f82439423699c2d097 WatchSource:0}: Error finding container d1099c8482391a9060fd54be54c49127b1ea3bc7e09099f82439423699c2d097: Status 404 returned error can't find the container with id d1099c8482391a9060fd54be54c49127b1ea3bc7e09099f82439423699c2d097 Jun 02 19:13:05.776474 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:05.776439 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-bcpmg"] Jun 02 19:13:05.780420 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:05.780403 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-bcpmg" Jun 02 19:13:05.782614 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:05.782569 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xqqsv\"" Jun 02 19:13:05.784746 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:05.784724 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-bcpmg"] Jun 02 19:13:05.911378 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:05.911351 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvmhx\" (UniqueName: \"kubernetes.io/projected/864d9857-e687-4047-a90b-e4fd916fb272-kube-api-access-mvmhx\") pod \"authorino-7498df8756-bcpmg\" (UID: \"864d9857-e687-4047-a90b-e4fd916fb272\") " pod="kuadrant-system/authorino-7498df8756-bcpmg" Jun 02 19:13:05.985741 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:05.985707 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-hlfbk" event={"ID":"4ca43761-cfb2-426f-b2e7-90a16a473ef4","Type":"ContainerStarted","Data":"d1099c8482391a9060fd54be54c49127b1ea3bc7e09099f82439423699c2d097"} Jun 02 19:13:06.012044 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:06.012012 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mvmhx\" (UniqueName: \"kubernetes.io/projected/864d9857-e687-4047-a90b-e4fd916fb272-kube-api-access-mvmhx\") pod \"authorino-7498df8756-bcpmg\" (UID: \"864d9857-e687-4047-a90b-e4fd916fb272\") " pod="kuadrant-system/authorino-7498df8756-bcpmg" Jun 02 19:13:06.020257 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:06.020230 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvmhx\" (UniqueName: \"kubernetes.io/projected/864d9857-e687-4047-a90b-e4fd916fb272-kube-api-access-mvmhx\") pod \"authorino-7498df8756-bcpmg\" (UID: \"864d9857-e687-4047-a90b-e4fd916fb272\") " pod="kuadrant-system/authorino-7498df8756-bcpmg" Jun 02 19:13:06.090491 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:06.090414 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-bcpmg" Jun 02 19:13:06.284582 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:06.284527 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-bcpmg"] Jun 02 19:13:06.290274 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:13:06.290229 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod864d9857_e687_4047_a90b_e4fd916fb272.slice/crio-24b93bdb430f3de8461ce70560e84f30c66d9dbd6629497e1a0edf7c555de509 WatchSource:0}: Error finding container 24b93bdb430f3de8461ce70560e84f30c66d9dbd6629497e1a0edf7c555de509: Status 404 returned error can't find the container with id 24b93bdb430f3de8461ce70560e84f30c66d9dbd6629497e1a0edf7c555de509 Jun 02 19:13:06.992117 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:06.992075 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-bcpmg" event={"ID":"864d9857-e687-4047-a90b-e4fd916fb272","Type":"ContainerStarted","Data":"24b93bdb430f3de8461ce70560e84f30c66d9dbd6629497e1a0edf7c555de509"} Jun 02 19:13:10.006992 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:10.006957 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-hlfbk" event={"ID":"4ca43761-cfb2-426f-b2e7-90a16a473ef4","Type":"ContainerStarted","Data":"0237fe49c3dfae9c554142d29cdccfd33cba9194a88014c1c0b0e046769c0e43"} Jun 02 19:13:10.007427 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:10.007060 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-hlfbk" Jun 02 19:13:10.008380 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:10.008345 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-bcpmg" event={"ID":"864d9857-e687-4047-a90b-e4fd916fb272","Type":"ContainerStarted","Data":"bf61aada0c0cabd88b6e70a14080c0f0a9070f25b50c3fee8f82ec7243d9999f"} Jun 02 19:13:10.043129 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:10.043081 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-hlfbk" podStartSLOduration=0.814864161 podStartE2EDuration="5.043070229s" podCreationTimestamp="2026-06-02 19:13:05 +0000 UTC" firstStartedPulling="2026-06-02 19:13:05.623448905 +0000 UTC m=+576.184251785" lastFinishedPulling="2026-06-02 19:13:09.851654966 +0000 UTC m=+580.412457853" observedRunningTime="2026-06-02 19:13:10.041473077 +0000 UTC m=+580.602275989" watchObservedRunningTime="2026-06-02 19:13:10.043070229 +0000 UTC m=+580.603873130" Jun 02 19:13:10.056071 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:10.056012 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-bcpmg" podStartSLOduration=1.482590076 podStartE2EDuration="5.055995502s" podCreationTimestamp="2026-06-02 19:13:05 +0000 UTC" firstStartedPulling="2026-06-02 19:13:06.292118693 +0000 UTC m=+576.852921574" lastFinishedPulling="2026-06-02 19:13:09.86552412 +0000 UTC m=+580.426327000" observedRunningTime="2026-06-02 19:13:10.055845376 +0000 UTC m=+580.616648277" watchObservedRunningTime="2026-06-02 19:13:10.055995502 +0000 UTC m=+580.616798405" Jun 02 19:13:21.014178 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:21.014139 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-hlfbk" Jun 02 19:13:29.963246 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:29.963206 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-dsq5s_3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415/console-operator/2.log" Jun 02 19:13:29.965196 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:29.965177 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-dsq5s_3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415/console-operator/2.log" Jun 02 19:13:29.965863 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:29.965842 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xz76r_6d38637d-caa3-4eb1-a749-9fe24430d039/ovn-acl-logging/0.log" Jun 02 19:13:29.967488 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:13:29.967464 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xz76r_6d38637d-caa3-4eb1-a749-9fe24430d039/ovn-acl-logging/0.log" Jun 02 19:14:31.452701 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:31.452646 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ncd6s"] Jun 02 19:14:31.455928 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:31.455911 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-ncd6s" Jun 02 19:14:31.467068 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:31.467041 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ncd6s"] Jun 02 19:14:31.550130 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:31.550093 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52jns\" (UniqueName: \"kubernetes.io/projected/78f617ce-fde0-462d-b72e-585d19b62f61-kube-api-access-52jns\") pod \"authorino-8b475cf9f-ncd6s\" (UID: \"78f617ce-fde0-462d-b72e-585d19b62f61\") " pod="kuadrant-system/authorino-8b475cf9f-ncd6s" Jun 02 19:14:31.650808 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:31.650766 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-52jns\" (UniqueName: \"kubernetes.io/projected/78f617ce-fde0-462d-b72e-585d19b62f61-kube-api-access-52jns\") pod \"authorino-8b475cf9f-ncd6s\" (UID: \"78f617ce-fde0-462d-b72e-585d19b62f61\") " pod="kuadrant-system/authorino-8b475cf9f-ncd6s" Jun 02 19:14:31.661142 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:31.661114 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52jns\" (UniqueName: \"kubernetes.io/projected/78f617ce-fde0-462d-b72e-585d19b62f61-kube-api-access-52jns\") pod \"authorino-8b475cf9f-ncd6s\" (UID: \"78f617ce-fde0-462d-b72e-585d19b62f61\") " pod="kuadrant-system/authorino-8b475cf9f-ncd6s" Jun 02 19:14:31.673004 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:31.672976 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ncd6s"] Jun 02 19:14:31.673238 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:31.673223 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-ncd6s" Jun 02 19:14:31.698301 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:31.698273 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-84ff75fb45-bbv85"] Jun 02 19:14:31.702690 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:31.702657 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84ff75fb45-bbv85" Jun 02 19:14:31.707631 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:31.707571 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84ff75fb45-bbv85"] Jun 02 19:14:31.751498 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:31.751467 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk7nm\" (UniqueName: \"kubernetes.io/projected/b06948a1-9a1a-4492-bc24-41c1cc5f6eba-kube-api-access-wk7nm\") pod \"authorino-84ff75fb45-bbv85\" (UID: \"b06948a1-9a1a-4492-bc24-41c1cc5f6eba\") " pod="kuadrant-system/authorino-84ff75fb45-bbv85" Jun 02 19:14:31.813736 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:31.813711 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ncd6s"] Jun 02 19:14:31.815573 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:14:31.815545 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78f617ce_fde0_462d_b72e_585d19b62f61.slice/crio-acfad3a734f680292cab028ccffd3395ca0ef41203f121be63f686deb036b903 WatchSource:0}: Error finding container acfad3a734f680292cab028ccffd3395ca0ef41203f121be63f686deb036b903: Status 404 returned error can't find the container with id acfad3a734f680292cab028ccffd3395ca0ef41203f121be63f686deb036b903 Jun 02 19:14:31.817221 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:31.817201 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 19:14:31.851908 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:31.851879 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wk7nm\" (UniqueName: \"kubernetes.io/projected/b06948a1-9a1a-4492-bc24-41c1cc5f6eba-kube-api-access-wk7nm\") pod \"authorino-84ff75fb45-bbv85\" (UID: \"b06948a1-9a1a-4492-bc24-41c1cc5f6eba\") " pod="kuadrant-system/authorino-84ff75fb45-bbv85" Jun 02 19:14:31.870214 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:31.870184 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk7nm\" (UniqueName: \"kubernetes.io/projected/b06948a1-9a1a-4492-bc24-41c1cc5f6eba-kube-api-access-wk7nm\") pod \"authorino-84ff75fb45-bbv85\" (UID: \"b06948a1-9a1a-4492-bc24-41c1cc5f6eba\") " pod="kuadrant-system/authorino-84ff75fb45-bbv85" Jun 02 19:14:31.918395 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:31.918353 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84ff75fb45-bbv85"] Jun 02 19:14:31.918658 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:31.918640 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84ff75fb45-bbv85" Jun 02 19:14:32.045517 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:32.045484 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84ff75fb45-bbv85"] Jun 02 19:14:32.048168 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:14:32.048145 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb06948a1_9a1a_4492_bc24_41c1cc5f6eba.slice/crio-484a628e5c454ab6a622c02c78caf86b22678b4646001ed47bd2180f77814e59 WatchSource:0}: Error finding container 484a628e5c454ab6a622c02c78caf86b22678b4646001ed47bd2180f77814e59: Status 404 returned error can't find the container with id 484a628e5c454ab6a622c02c78caf86b22678b4646001ed47bd2180f77814e59 Jun 02 19:14:32.290553 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:32.290524 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-ncd6s" event={"ID":"78f617ce-fde0-462d-b72e-585d19b62f61","Type":"ContainerStarted","Data":"acfad3a734f680292cab028ccffd3395ca0ef41203f121be63f686deb036b903"} Jun 02 19:14:32.291531 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:32.291511 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84ff75fb45-bbv85" event={"ID":"b06948a1-9a1a-4492-bc24-41c1cc5f6eba","Type":"ContainerStarted","Data":"484a628e5c454ab6a622c02c78caf86b22678b4646001ed47bd2180f77814e59"} Jun 02 19:14:33.296004 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:33.295968 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84ff75fb45-bbv85" event={"ID":"b06948a1-9a1a-4492-bc24-41c1cc5f6eba","Type":"ContainerStarted","Data":"aa0df61f537fb49a9a9a2af6bd11532123a6463e17b083d1831845bb155ccc85"} Jun 02 19:14:33.296431 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:33.296030 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-84ff75fb45-bbv85" podUID="b06948a1-9a1a-4492-bc24-41c1cc5f6eba" containerName="authorino" containerID="cri-o://aa0df61f537fb49a9a9a2af6bd11532123a6463e17b083d1831845bb155ccc85" gracePeriod=30 Jun 02 19:14:33.297411 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:33.297388 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-ncd6s" event={"ID":"78f617ce-fde0-462d-b72e-585d19b62f61","Type":"ContainerStarted","Data":"1a302275619a84f47a503dd6363afe6ed7348da1c5a822341abac55f7e9eb658"} Jun 02 19:14:33.297510 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:33.297448 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-ncd6s" podUID="78f617ce-fde0-462d-b72e-585d19b62f61" containerName="authorino" containerID="cri-o://1a302275619a84f47a503dd6363afe6ed7348da1c5a822341abac55f7e9eb658" gracePeriod=30 Jun 02 19:14:33.312268 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:33.312229 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-84ff75fb45-bbv85" podStartSLOduration=1.966321442 podStartE2EDuration="2.312217269s" podCreationTimestamp="2026-06-02 19:14:31 +0000 UTC" firstStartedPulling="2026-06-02 19:14:32.049448586 +0000 UTC m=+662.610251470" lastFinishedPulling="2026-06-02 19:14:32.395344417 +0000 UTC m=+662.956147297" observedRunningTime="2026-06-02 19:14:33.309903593 +0000 UTC m=+663.870706495" watchObservedRunningTime="2026-06-02 19:14:33.312217269 +0000 UTC m=+663.873020210" Jun 02 19:14:33.324583 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:33.324542 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-ncd6s" podStartSLOduration=1.8707558469999999 podStartE2EDuration="2.324528906s" podCreationTimestamp="2026-06-02 19:14:31 +0000 UTC" firstStartedPulling="2026-06-02 19:14:31.817329641 +0000 UTC m=+662.378132525" lastFinishedPulling="2026-06-02 19:14:32.271102704 +0000 UTC m=+662.831905584" observedRunningTime="2026-06-02 19:14:33.32329994 +0000 UTC m=+663.884102841" watchObservedRunningTime="2026-06-02 19:14:33.324528906 +0000 UTC m=+663.885331808" Jun 02 19:14:33.558061 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:33.558040 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-ncd6s" Jun 02 19:14:33.561354 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:33.561335 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84ff75fb45-bbv85" Jun 02 19:14:33.646049 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:33.646014 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-bcpmg"] Jun 02 19:14:33.646243 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:33.646206 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-bcpmg" podUID="864d9857-e687-4047-a90b-e4fd916fb272" containerName="authorino" containerID="cri-o://bf61aada0c0cabd88b6e70a14080c0f0a9070f25b50c3fee8f82ec7243d9999f" gracePeriod=30 Jun 02 19:14:33.668447 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:33.668420 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52jns\" (UniqueName: \"kubernetes.io/projected/78f617ce-fde0-462d-b72e-585d19b62f61-kube-api-access-52jns\") pod \"78f617ce-fde0-462d-b72e-585d19b62f61\" (UID: \"78f617ce-fde0-462d-b72e-585d19b62f61\") " Jun 02 19:14:33.668579 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:33.668499 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wk7nm\" (UniqueName: \"kubernetes.io/projected/b06948a1-9a1a-4492-bc24-41c1cc5f6eba-kube-api-access-wk7nm\") pod \"b06948a1-9a1a-4492-bc24-41c1cc5f6eba\" (UID: \"b06948a1-9a1a-4492-bc24-41c1cc5f6eba\") " Jun 02 19:14:33.670586 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:33.670557 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78f617ce-fde0-462d-b72e-585d19b62f61-kube-api-access-52jns" (OuterVolumeSpecName: "kube-api-access-52jns") pod "78f617ce-fde0-462d-b72e-585d19b62f61" (UID: "78f617ce-fde0-462d-b72e-585d19b62f61"). InnerVolumeSpecName "kube-api-access-52jns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:14:33.670713 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:33.670607 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b06948a1-9a1a-4492-bc24-41c1cc5f6eba-kube-api-access-wk7nm" (OuterVolumeSpecName: "kube-api-access-wk7nm") pod "b06948a1-9a1a-4492-bc24-41c1cc5f6eba" (UID: "b06948a1-9a1a-4492-bc24-41c1cc5f6eba"). InnerVolumeSpecName "kube-api-access-wk7nm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:14:33.769935 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:33.769897 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wk7nm\" (UniqueName: \"kubernetes.io/projected/b06948a1-9a1a-4492-bc24-41c1cc5f6eba-kube-api-access-wk7nm\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:14:33.770051 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:33.769939 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52jns\" (UniqueName: \"kubernetes.io/projected/78f617ce-fde0-462d-b72e-585d19b62f61-kube-api-access-52jns\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:14:33.885624 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:33.885601 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-bcpmg" Jun 02 19:14:33.971531 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:33.971495 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvmhx\" (UniqueName: \"kubernetes.io/projected/864d9857-e687-4047-a90b-e4fd916fb272-kube-api-access-mvmhx\") pod \"864d9857-e687-4047-a90b-e4fd916fb272\" (UID: \"864d9857-e687-4047-a90b-e4fd916fb272\") " Jun 02 19:14:33.973536 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:33.973507 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/864d9857-e687-4047-a90b-e4fd916fb272-kube-api-access-mvmhx" (OuterVolumeSpecName: "kube-api-access-mvmhx") pod "864d9857-e687-4047-a90b-e4fd916fb272" (UID: "864d9857-e687-4047-a90b-e4fd916fb272"). InnerVolumeSpecName "kube-api-access-mvmhx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:14:34.072837 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.072772 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvmhx\" (UniqueName: \"kubernetes.io/projected/864d9857-e687-4047-a90b-e4fd916fb272-kube-api-access-mvmhx\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:14:34.301963 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.301922 2569 generic.go:358] "Generic (PLEG): container finished" podID="b06948a1-9a1a-4492-bc24-41c1cc5f6eba" containerID="aa0df61f537fb49a9a9a2af6bd11532123a6463e17b083d1831845bb155ccc85" exitCode=0 Jun 02 19:14:34.302400 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.301988 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84ff75fb45-bbv85" Jun 02 19:14:34.302400 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.302003 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84ff75fb45-bbv85" event={"ID":"b06948a1-9a1a-4492-bc24-41c1cc5f6eba","Type":"ContainerDied","Data":"aa0df61f537fb49a9a9a2af6bd11532123a6463e17b083d1831845bb155ccc85"} Jun 02 19:14:34.302400 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.302043 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84ff75fb45-bbv85" event={"ID":"b06948a1-9a1a-4492-bc24-41c1cc5f6eba","Type":"ContainerDied","Data":"484a628e5c454ab6a622c02c78caf86b22678b4646001ed47bd2180f77814e59"} Jun 02 19:14:34.302400 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.302064 2569 scope.go:117] "RemoveContainer" containerID="aa0df61f537fb49a9a9a2af6bd11532123a6463e17b083d1831845bb155ccc85" Jun 02 19:14:34.303382 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.303124 2569 generic.go:358] "Generic (PLEG): container finished" podID="78f617ce-fde0-462d-b72e-585d19b62f61" containerID="1a302275619a84f47a503dd6363afe6ed7348da1c5a822341abac55f7e9eb658" exitCode=0 Jun 02 19:14:34.303382 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.303178 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-ncd6s" Jun 02 19:14:34.303382 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.303214 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-ncd6s" event={"ID":"78f617ce-fde0-462d-b72e-585d19b62f61","Type":"ContainerDied","Data":"1a302275619a84f47a503dd6363afe6ed7348da1c5a822341abac55f7e9eb658"} Jun 02 19:14:34.303382 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.303251 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-ncd6s" event={"ID":"78f617ce-fde0-462d-b72e-585d19b62f61","Type":"ContainerDied","Data":"acfad3a734f680292cab028ccffd3395ca0ef41203f121be63f686deb036b903"} Jun 02 19:14:34.304554 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.304522 2569 generic.go:358] "Generic (PLEG): container finished" podID="864d9857-e687-4047-a90b-e4fd916fb272" containerID="bf61aada0c0cabd88b6e70a14080c0f0a9070f25b50c3fee8f82ec7243d9999f" exitCode=0 Jun 02 19:14:34.304650 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.304550 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-bcpmg" event={"ID":"864d9857-e687-4047-a90b-e4fd916fb272","Type":"ContainerDied","Data":"bf61aada0c0cabd88b6e70a14080c0f0a9070f25b50c3fee8f82ec7243d9999f"} Jun 02 19:14:34.304650 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.304578 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-bcpmg" event={"ID":"864d9857-e687-4047-a90b-e4fd916fb272","Type":"ContainerDied","Data":"24b93bdb430f3de8461ce70560e84f30c66d9dbd6629497e1a0edf7c555de509"} Jun 02 19:14:34.304650 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.304598 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-bcpmg" Jun 02 19:14:34.311422 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.311405 2569 scope.go:117] "RemoveContainer" containerID="aa0df61f537fb49a9a9a2af6bd11532123a6463e17b083d1831845bb155ccc85" Jun 02 19:14:34.311656 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:14:34.311640 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa0df61f537fb49a9a9a2af6bd11532123a6463e17b083d1831845bb155ccc85\": container with ID starting with aa0df61f537fb49a9a9a2af6bd11532123a6463e17b083d1831845bb155ccc85 not found: ID does not exist" containerID="aa0df61f537fb49a9a9a2af6bd11532123a6463e17b083d1831845bb155ccc85" Jun 02 19:14:34.311718 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.311672 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa0df61f537fb49a9a9a2af6bd11532123a6463e17b083d1831845bb155ccc85"} err="failed to get container status \"aa0df61f537fb49a9a9a2af6bd11532123a6463e17b083d1831845bb155ccc85\": rpc error: code = NotFound desc = could not find container \"aa0df61f537fb49a9a9a2af6bd11532123a6463e17b083d1831845bb155ccc85\": container with ID starting with aa0df61f537fb49a9a9a2af6bd11532123a6463e17b083d1831845bb155ccc85 not found: ID does not exist" Jun 02 19:14:34.311718 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.311712 2569 scope.go:117] "RemoveContainer" containerID="1a302275619a84f47a503dd6363afe6ed7348da1c5a822341abac55f7e9eb658" Jun 02 19:14:34.318793 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.318778 2569 scope.go:117] "RemoveContainer" containerID="1a302275619a84f47a503dd6363afe6ed7348da1c5a822341abac55f7e9eb658" Jun 02 19:14:34.319023 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:14:34.319007 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a302275619a84f47a503dd6363afe6ed7348da1c5a822341abac55f7e9eb658\": container with ID starting with 1a302275619a84f47a503dd6363afe6ed7348da1c5a822341abac55f7e9eb658 not found: ID does not exist" containerID="1a302275619a84f47a503dd6363afe6ed7348da1c5a822341abac55f7e9eb658" Jun 02 19:14:34.319079 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.319029 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a302275619a84f47a503dd6363afe6ed7348da1c5a822341abac55f7e9eb658"} err="failed to get container status \"1a302275619a84f47a503dd6363afe6ed7348da1c5a822341abac55f7e9eb658\": rpc error: code = NotFound desc = could not find container \"1a302275619a84f47a503dd6363afe6ed7348da1c5a822341abac55f7e9eb658\": container with ID starting with 1a302275619a84f47a503dd6363afe6ed7348da1c5a822341abac55f7e9eb658 not found: ID does not exist" Jun 02 19:14:34.319079 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.319043 2569 scope.go:117] "RemoveContainer" containerID="bf61aada0c0cabd88b6e70a14080c0f0a9070f25b50c3fee8f82ec7243d9999f" Jun 02 19:14:34.326142 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.326123 2569 scope.go:117] "RemoveContainer" containerID="bf61aada0c0cabd88b6e70a14080c0f0a9070f25b50c3fee8f82ec7243d9999f" Jun 02 19:14:34.326390 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:14:34.326371 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf61aada0c0cabd88b6e70a14080c0f0a9070f25b50c3fee8f82ec7243d9999f\": container with ID starting with bf61aada0c0cabd88b6e70a14080c0f0a9070f25b50c3fee8f82ec7243d9999f not found: ID does not exist" containerID="bf61aada0c0cabd88b6e70a14080c0f0a9070f25b50c3fee8f82ec7243d9999f" Jun 02 19:14:34.326454 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.326395 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf61aada0c0cabd88b6e70a14080c0f0a9070f25b50c3fee8f82ec7243d9999f"} err="failed to get container status \"bf61aada0c0cabd88b6e70a14080c0f0a9070f25b50c3fee8f82ec7243d9999f\": rpc error: code = NotFound desc = could not find container \"bf61aada0c0cabd88b6e70a14080c0f0a9070f25b50c3fee8f82ec7243d9999f\": container with ID starting with bf61aada0c0cabd88b6e70a14080c0f0a9070f25b50c3fee8f82ec7243d9999f not found: ID does not exist" Jun 02 19:14:34.331449 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.331426 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-bcpmg"] Jun 02 19:14:34.337971 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.337951 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-bcpmg"] Jun 02 19:14:34.347748 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.347727 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ncd6s"] Jun 02 19:14:34.351968 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.351949 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ncd6s"] Jun 02 19:14:34.362818 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.362797 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84ff75fb45-bbv85"] Jun 02 19:14:34.366631 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:34.366613 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-84ff75fb45-bbv85"] Jun 02 19:14:36.003117 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:36.003083 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78f617ce-fde0-462d-b72e-585d19b62f61" path="/var/lib/kubelet/pods/78f617ce-fde0-462d-b72e-585d19b62f61/volumes" Jun 02 19:14:36.003466 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:36.003392 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="864d9857-e687-4047-a90b-e4fd916fb272" path="/var/lib/kubelet/pods/864d9857-e687-4047-a90b-e4fd916fb272/volumes" Jun 02 19:14:36.003662 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:36.003649 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b06948a1-9a1a-4492-bc24-41c1cc5f6eba" path="/var/lib/kubelet/pods/b06948a1-9a1a-4492-bc24-41c1cc5f6eba/volumes" Jun 02 19:14:36.803632 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:36.803598 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69787d9995-whhf7"] Jun 02 19:14:36.803978 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:36.803965 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="864d9857-e687-4047-a90b-e4fd916fb272" containerName="authorino" Jun 02 19:14:36.804018 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:36.803980 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="864d9857-e687-4047-a90b-e4fd916fb272" containerName="authorino" Jun 02 19:14:36.804018 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:36.803998 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b06948a1-9a1a-4492-bc24-41c1cc5f6eba" containerName="authorino" Jun 02 19:14:36.804018 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:36.804003 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b06948a1-9a1a-4492-bc24-41c1cc5f6eba" containerName="authorino" Jun 02 19:14:36.804103 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:36.804018 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78f617ce-fde0-462d-b72e-585d19b62f61" containerName="authorino" Jun 02 19:14:36.804103 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:36.804026 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="78f617ce-fde0-462d-b72e-585d19b62f61" containerName="authorino" Jun 02 19:14:36.804103 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:36.804091 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="864d9857-e687-4047-a90b-e4fd916fb272" containerName="authorino" Jun 02 19:14:36.804103 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:36.804100 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="b06948a1-9a1a-4492-bc24-41c1cc5f6eba" containerName="authorino" Jun 02 19:14:36.804216 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:36.804108 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="78f617ce-fde0-462d-b72e-585d19b62f61" containerName="authorino" Jun 02 19:14:36.808183 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:36.808165 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69787d9995-whhf7" Jun 02 19:14:36.810733 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:36.810709 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 02 19:14:36.810991 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:36.810972 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vd4lg\"" Jun 02 19:14:36.817513 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:36.817484 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69787d9995-whhf7"] Jun 02 19:14:36.894384 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:36.894353 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2bnd\" (UniqueName: \"kubernetes.io/projected/1578ae32-45c8-4361-b385-7cf8ce006bae-kube-api-access-b2bnd\") pod \"maas-controller-69787d9995-whhf7\" (UID: \"1578ae32-45c8-4361-b385-7cf8ce006bae\") " pod="opendatahub/maas-controller-69787d9995-whhf7" Jun 02 19:14:36.971456 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:36.971423 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f4b5bbc98-v6t79"] Jun 02 19:14:36.974658 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:36.974639 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f4b5bbc98-v6t79" Jun 02 19:14:36.995032 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:36.994988 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f4b5bbc98-v6t79"] Jun 02 19:14:36.995168 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:36.995081 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2bnd\" (UniqueName: \"kubernetes.io/projected/1578ae32-45c8-4361-b385-7cf8ce006bae-kube-api-access-b2bnd\") pod \"maas-controller-69787d9995-whhf7\" (UID: \"1578ae32-45c8-4361-b385-7cf8ce006bae\") " pod="opendatahub/maas-controller-69787d9995-whhf7" Jun 02 19:14:37.008546 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:37.008518 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2bnd\" (UniqueName: \"kubernetes.io/projected/1578ae32-45c8-4361-b385-7cf8ce006bae-kube-api-access-b2bnd\") pod \"maas-controller-69787d9995-whhf7\" (UID: \"1578ae32-45c8-4361-b385-7cf8ce006bae\") " pod="opendatahub/maas-controller-69787d9995-whhf7" Jun 02 19:14:37.095572 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:37.095494 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9b68\" (UniqueName: \"kubernetes.io/projected/036d09ec-fb27-493c-b6b3-d0b6386b1a13-kube-api-access-w9b68\") pod \"maas-controller-6f4b5bbc98-v6t79\" (UID: \"036d09ec-fb27-493c-b6b3-d0b6386b1a13\") " pod="opendatahub/maas-controller-6f4b5bbc98-v6t79" Jun 02 19:14:37.119207 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:37.119183 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69787d9995-whhf7" Jun 02 19:14:37.196382 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:37.196349 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w9b68\" (UniqueName: \"kubernetes.io/projected/036d09ec-fb27-493c-b6b3-d0b6386b1a13-kube-api-access-w9b68\") pod \"maas-controller-6f4b5bbc98-v6t79\" (UID: \"036d09ec-fb27-493c-b6b3-d0b6386b1a13\") " pod="opendatahub/maas-controller-6f4b5bbc98-v6t79" Jun 02 19:14:37.206356 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:37.206325 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9b68\" (UniqueName: \"kubernetes.io/projected/036d09ec-fb27-493c-b6b3-d0b6386b1a13-kube-api-access-w9b68\") pod \"maas-controller-6f4b5bbc98-v6t79\" (UID: \"036d09ec-fb27-493c-b6b3-d0b6386b1a13\") " pod="opendatahub/maas-controller-6f4b5bbc98-v6t79" Jun 02 19:14:37.251147 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:37.251098 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69787d9995-whhf7"] Jun 02 19:14:37.254655 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:14:37.254631 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1578ae32_45c8_4361_b385_7cf8ce006bae.slice/crio-aa04321e77e7db11e3c23c4f9e2574b2d54ada1062b34af748ef43a11499ff15 WatchSource:0}: Error finding container aa04321e77e7db11e3c23c4f9e2574b2d54ada1062b34af748ef43a11499ff15: Status 404 returned error can't find the container with id aa04321e77e7db11e3c23c4f9e2574b2d54ada1062b34af748ef43a11499ff15 Jun 02 19:14:37.283949 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:37.283916 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f4b5bbc98-v6t79" Jun 02 19:14:37.318985 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:37.318552 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69787d9995-whhf7" event={"ID":"1578ae32-45c8-4361-b385-7cf8ce006bae","Type":"ContainerStarted","Data":"aa04321e77e7db11e3c23c4f9e2574b2d54ada1062b34af748ef43a11499ff15"} Jun 02 19:14:37.408726 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:37.408703 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f4b5bbc98-v6t79"] Jun 02 19:14:37.410650 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:14:37.410619 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod036d09ec_fb27_493c_b6b3_d0b6386b1a13.slice/crio-1f8ae20f8082473b5e7b01d6ddb9c3f5d44e2920a206adabe215890cfade5b06 WatchSource:0}: Error finding container 1f8ae20f8082473b5e7b01d6ddb9c3f5d44e2920a206adabe215890cfade5b06: Status 404 returned error can't find the container with id 1f8ae20f8082473b5e7b01d6ddb9c3f5d44e2920a206adabe215890cfade5b06 Jun 02 19:14:38.328337 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:38.328297 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f4b5bbc98-v6t79" event={"ID":"036d09ec-fb27-493c-b6b3-d0b6386b1a13","Type":"ContainerStarted","Data":"1f8ae20f8082473b5e7b01d6ddb9c3f5d44e2920a206adabe215890cfade5b06"} Jun 02 19:14:40.339714 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:40.339664 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69787d9995-whhf7" event={"ID":"1578ae32-45c8-4361-b385-7cf8ce006bae","Type":"ContainerStarted","Data":"05fd59898005350de79f029027fe7853b0fbcce452c3ba2f0652da06d0d1344f"} Jun 02 19:14:40.340175 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:40.339817 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69787d9995-whhf7" Jun 02 19:14:40.340995 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:40.340974 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f4b5bbc98-v6t79" event={"ID":"036d09ec-fb27-493c-b6b3-d0b6386b1a13","Type":"ContainerStarted","Data":"afdc142c3a3ec1dee4761ffe34d6abc66826a112dabdddb058a4d2fc8e30cccf"} Jun 02 19:14:40.341128 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:40.341110 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f4b5bbc98-v6t79" Jun 02 19:14:40.357591 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:40.357551 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-69787d9995-whhf7" podStartSLOduration=1.720821495 podStartE2EDuration="4.357539991s" podCreationTimestamp="2026-06-02 19:14:36 +0000 UTC" firstStartedPulling="2026-06-02 19:14:37.256064946 +0000 UTC m=+667.816867826" lastFinishedPulling="2026-06-02 19:14:39.892783442 +0000 UTC m=+670.453586322" observedRunningTime="2026-06-02 19:14:40.356127107 +0000 UTC m=+670.916930009" watchObservedRunningTime="2026-06-02 19:14:40.357539991 +0000 UTC m=+670.918342890" Jun 02 19:14:40.371596 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:40.371563 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6f4b5bbc98-v6t79" podStartSLOduration=1.879981084 podStartE2EDuration="4.371552745s" podCreationTimestamp="2026-06-02 19:14:36 +0000 UTC" firstStartedPulling="2026-06-02 19:14:37.411993881 +0000 UTC m=+667.972796761" lastFinishedPulling="2026-06-02 19:14:39.903565534 +0000 UTC m=+670.464368422" observedRunningTime="2026-06-02 19:14:40.370822963 +0000 UTC m=+670.931625864" watchObservedRunningTime="2026-06-02 19:14:40.371552745 +0000 UTC m=+670.932355647" Jun 02 19:14:51.350425 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:51.350386 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69787d9995-whhf7" Jun 02 19:14:51.350882 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:51.350444 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f4b5bbc98-v6t79" Jun 02 19:14:51.402143 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:51.402105 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69787d9995-whhf7"] Jun 02 19:14:51.402415 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:51.402361 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-69787d9995-whhf7" podUID="1578ae32-45c8-4361-b385-7cf8ce006bae" containerName="manager" containerID="cri-o://05fd59898005350de79f029027fe7853b0fbcce452c3ba2f0652da06d0d1344f" gracePeriod=30 Jun 02 19:14:51.645467 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:51.645441 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69787d9995-whhf7" Jun 02 19:14:51.724326 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:51.724290 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2bnd\" (UniqueName: \"kubernetes.io/projected/1578ae32-45c8-4361-b385-7cf8ce006bae-kube-api-access-b2bnd\") pod \"1578ae32-45c8-4361-b385-7cf8ce006bae\" (UID: \"1578ae32-45c8-4361-b385-7cf8ce006bae\") " Jun 02 19:14:51.726329 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:51.726307 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1578ae32-45c8-4361-b385-7cf8ce006bae-kube-api-access-b2bnd" (OuterVolumeSpecName: "kube-api-access-b2bnd") pod "1578ae32-45c8-4361-b385-7cf8ce006bae" (UID: "1578ae32-45c8-4361-b385-7cf8ce006bae"). InnerVolumeSpecName "kube-api-access-b2bnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:14:51.825164 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:51.825121 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2bnd\" (UniqueName: \"kubernetes.io/projected/1578ae32-45c8-4361-b385-7cf8ce006bae-kube-api-access-b2bnd\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:14:52.382876 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:52.382783 2569 generic.go:358] "Generic (PLEG): container finished" podID="1578ae32-45c8-4361-b385-7cf8ce006bae" containerID="05fd59898005350de79f029027fe7853b0fbcce452c3ba2f0652da06d0d1344f" exitCode=0 Jun 02 19:14:52.382876 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:52.382857 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69787d9995-whhf7" Jun 02 19:14:52.383353 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:52.382877 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69787d9995-whhf7" event={"ID":"1578ae32-45c8-4361-b385-7cf8ce006bae","Type":"ContainerDied","Data":"05fd59898005350de79f029027fe7853b0fbcce452c3ba2f0652da06d0d1344f"} Jun 02 19:14:52.383353 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:52.382914 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69787d9995-whhf7" event={"ID":"1578ae32-45c8-4361-b385-7cf8ce006bae","Type":"ContainerDied","Data":"aa04321e77e7db11e3c23c4f9e2574b2d54ada1062b34af748ef43a11499ff15"} Jun 02 19:14:52.383353 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:52.382929 2569 scope.go:117] "RemoveContainer" containerID="05fd59898005350de79f029027fe7853b0fbcce452c3ba2f0652da06d0d1344f" Jun 02 19:14:52.391180 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:52.391166 2569 scope.go:117] "RemoveContainer" containerID="05fd59898005350de79f029027fe7853b0fbcce452c3ba2f0652da06d0d1344f" Jun 02 19:14:52.391403 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:14:52.391387 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05fd59898005350de79f029027fe7853b0fbcce452c3ba2f0652da06d0d1344f\": container with ID starting with 05fd59898005350de79f029027fe7853b0fbcce452c3ba2f0652da06d0d1344f not found: ID does not exist" containerID="05fd59898005350de79f029027fe7853b0fbcce452c3ba2f0652da06d0d1344f" Jun 02 19:14:52.391449 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:52.391409 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05fd59898005350de79f029027fe7853b0fbcce452c3ba2f0652da06d0d1344f"} err="failed to get container status \"05fd59898005350de79f029027fe7853b0fbcce452c3ba2f0652da06d0d1344f\": rpc error: code = NotFound desc = could not find container \"05fd59898005350de79f029027fe7853b0fbcce452c3ba2f0652da06d0d1344f\": container with ID starting with 05fd59898005350de79f029027fe7853b0fbcce452c3ba2f0652da06d0d1344f not found: ID does not exist" Jun 02 19:14:52.397518 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:52.397494 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69787d9995-whhf7"] Jun 02 19:14:52.399567 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:52.399548 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-69787d9995-whhf7"] Jun 02 19:14:54.002097 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:14:54.002065 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1578ae32-45c8-4361-b385-7cf8ce006bae" path="/var/lib/kubelet/pods/1578ae32-45c8-4361-b385-7cf8ce006bae/volumes" Jun 02 19:15:11.545819 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:15:11.545743 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-7mkff"] Jun 02 19:15:11.546240 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:15:11.546137 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1578ae32-45c8-4361-b385-7cf8ce006bae" containerName="manager" Jun 02 19:15:11.546240 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:15:11.546150 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1578ae32-45c8-4361-b385-7cf8ce006bae" containerName="manager" Jun 02 19:15:11.546240 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:15:11.546206 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="1578ae32-45c8-4361-b385-7cf8ce006bae" containerName="manager" Jun 02 19:15:11.548997 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:15:11.548973 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-7mkff" Jun 02 19:15:11.552561 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:15:11.552528 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 02 19:15:11.552853 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:15:11.552838 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-cvf86\"" Jun 02 19:15:11.564221 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:15:11.564195 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-7mkff"] Jun 02 19:15:11.593897 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:15:11.593868 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r84nv\" (UniqueName: \"kubernetes.io/projected/9e194e80-70fa-46da-949d-eae8b00922be-kube-api-access-r84nv\") pod \"payload-processing-58b6c8fdc7-7mkff\" (UID: \"9e194e80-70fa-46da-949d-eae8b00922be\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-7mkff" Jun 02 19:15:11.694557 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:15:11.694504 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r84nv\" (UniqueName: \"kubernetes.io/projected/9e194e80-70fa-46da-949d-eae8b00922be-kube-api-access-r84nv\") pod \"payload-processing-58b6c8fdc7-7mkff\" (UID: \"9e194e80-70fa-46da-949d-eae8b00922be\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-7mkff" Jun 02 19:15:11.706964 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:15:11.706927 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r84nv\" (UniqueName: \"kubernetes.io/projected/9e194e80-70fa-46da-949d-eae8b00922be-kube-api-access-r84nv\") pod \"payload-processing-58b6c8fdc7-7mkff\" (UID: \"9e194e80-70fa-46da-949d-eae8b00922be\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-7mkff" Jun 02 19:15:11.744387 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:15:11.744357 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:15:11.859312 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:15:11.859223 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-7mkff" Jun 02 19:15:11.991743 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:15:11.991721 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-7mkff"] Jun 02 19:15:11.994051 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:15:11.994018 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e194e80_70fa_46da_949d_eae8b00922be.slice/crio-fe17f347c9df8b6c5439ca9aa0e220c6f3f463ea5fafd14fd03f7a86282b6d6d WatchSource:0}: Error finding container fe17f347c9df8b6c5439ca9aa0e220c6f3f463ea5fafd14fd03f7a86282b6d6d: Status 404 returned error can't find the container with id fe17f347c9df8b6c5439ca9aa0e220c6f3f463ea5fafd14fd03f7a86282b6d6d Jun 02 19:15:12.456743 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:15:12.456705 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-7mkff" event={"ID":"9e194e80-70fa-46da-949d-eae8b00922be","Type":"ContainerStarted","Data":"fe17f347c9df8b6c5439ca9aa0e220c6f3f463ea5fafd14fd03f7a86282b6d6d"} Jun 02 19:15:14.465779 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:15:14.465664 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-7mkff" event={"ID":"9e194e80-70fa-46da-949d-eae8b00922be","Type":"ContainerStarted","Data":"ce4cbdeb6585352978203d5b22f02de1eb0f71892df4c51387a935dcb4804eed"} Jun 02 19:15:14.466202 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:15:14.465814 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-7mkff" Jun 02 19:15:14.482262 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:15:14.482001 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-7mkff" podStartSLOduration=1.285624562 podStartE2EDuration="3.481984276s" podCreationTimestamp="2026-06-02 19:15:11 +0000 UTC" firstStartedPulling="2026-06-02 19:15:11.995935115 +0000 UTC m=+702.556737995" lastFinishedPulling="2026-06-02 19:15:14.192294826 +0000 UTC m=+704.753097709" observedRunningTime="2026-06-02 19:15:14.481796743 +0000 UTC m=+705.042599676" watchObservedRunningTime="2026-06-02 19:15:14.481984276 +0000 UTC m=+705.042787180" Jun 02 19:15:25.472103 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:15:25.472069 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-7mkff" Jun 02 19:16:00.174074 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:00.174035 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59dffc6ddc-wvtst"] Jun 02 19:16:00.181465 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:00.181441 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59dffc6ddc-wvtst" Jun 02 19:16:00.183768 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:00.183737 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xqqsv\"" Jun 02 19:16:00.184388 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:00.184256 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 02 19:16:00.184388 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:00.184265 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 02 19:16:00.185106 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:00.185087 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59dffc6ddc-wvtst"] Jun 02 19:16:00.217089 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:00.217062 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d49d505-cae8-44af-97ef-42e6dd81425a-tls-cert\") pod \"authorino-59dffc6ddc-wvtst\" (UID: \"1d49d505-cae8-44af-97ef-42e6dd81425a\") " pod="kuadrant-system/authorino-59dffc6ddc-wvtst" Jun 02 19:16:00.217195 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:00.217095 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1d49d505-cae8-44af-97ef-42e6dd81425a-oidc-ca\") pod \"authorino-59dffc6ddc-wvtst\" (UID: \"1d49d505-cae8-44af-97ef-42e6dd81425a\") " pod="kuadrant-system/authorino-59dffc6ddc-wvtst" Jun 02 19:16:00.217195 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:00.217113 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6lz7\" (UniqueName: \"kubernetes.io/projected/1d49d505-cae8-44af-97ef-42e6dd81425a-kube-api-access-x6lz7\") pod \"authorino-59dffc6ddc-wvtst\" (UID: \"1d49d505-cae8-44af-97ef-42e6dd81425a\") " pod="kuadrant-system/authorino-59dffc6ddc-wvtst" Jun 02 19:16:00.318136 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:00.318099 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d49d505-cae8-44af-97ef-42e6dd81425a-tls-cert\") pod \"authorino-59dffc6ddc-wvtst\" (UID: \"1d49d505-cae8-44af-97ef-42e6dd81425a\") " pod="kuadrant-system/authorino-59dffc6ddc-wvtst" Jun 02 19:16:00.318322 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:00.318147 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1d49d505-cae8-44af-97ef-42e6dd81425a-oidc-ca\") pod \"authorino-59dffc6ddc-wvtst\" (UID: \"1d49d505-cae8-44af-97ef-42e6dd81425a\") " pod="kuadrant-system/authorino-59dffc6ddc-wvtst" Jun 02 19:16:00.318322 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:00.318174 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x6lz7\" (UniqueName: \"kubernetes.io/projected/1d49d505-cae8-44af-97ef-42e6dd81425a-kube-api-access-x6lz7\") pod \"authorino-59dffc6ddc-wvtst\" (UID: \"1d49d505-cae8-44af-97ef-42e6dd81425a\") " pod="kuadrant-system/authorino-59dffc6ddc-wvtst" Jun 02 19:16:00.318740 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:00.318719 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1d49d505-cae8-44af-97ef-42e6dd81425a-oidc-ca\") pod \"authorino-59dffc6ddc-wvtst\" (UID: \"1d49d505-cae8-44af-97ef-42e6dd81425a\") " pod="kuadrant-system/authorino-59dffc6ddc-wvtst" Jun 02 19:16:00.320572 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:00.320550 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d49d505-cae8-44af-97ef-42e6dd81425a-tls-cert\") pod \"authorino-59dffc6ddc-wvtst\" (UID: \"1d49d505-cae8-44af-97ef-42e6dd81425a\") " pod="kuadrant-system/authorino-59dffc6ddc-wvtst" Jun 02 19:16:00.325388 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:00.325371 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6lz7\" (UniqueName: \"kubernetes.io/projected/1d49d505-cae8-44af-97ef-42e6dd81425a-kube-api-access-x6lz7\") pod \"authorino-59dffc6ddc-wvtst\" (UID: \"1d49d505-cae8-44af-97ef-42e6dd81425a\") " pod="kuadrant-system/authorino-59dffc6ddc-wvtst" Jun 02 19:16:00.491381 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:00.491342 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59dffc6ddc-wvtst" Jun 02 19:16:00.617608 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:00.617583 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59dffc6ddc-wvtst"] Jun 02 19:16:00.620222 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:16:00.620182 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d49d505_cae8_44af_97ef_42e6dd81425a.slice/crio-0ca0cc470684d122d62307480d3c9ad3dba31e5c857ddd287d398f7c5889e7dc WatchSource:0}: Error finding container 0ca0cc470684d122d62307480d3c9ad3dba31e5c857ddd287d398f7c5889e7dc: Status 404 returned error can't find the container with id 0ca0cc470684d122d62307480d3c9ad3dba31e5c857ddd287d398f7c5889e7dc Jun 02 19:16:00.626954 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:00.626920 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59dffc6ddc-wvtst" event={"ID":"1d49d505-cae8-44af-97ef-42e6dd81425a","Type":"ContainerStarted","Data":"0ca0cc470684d122d62307480d3c9ad3dba31e5c857ddd287d398f7c5889e7dc"} Jun 02 19:16:01.637280 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:01.637245 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59dffc6ddc-wvtst" event={"ID":"1d49d505-cae8-44af-97ef-42e6dd81425a","Type":"ContainerStarted","Data":"29b48b34f72470720479a4c884c44174cac4cea724f89691864a30f666b71b2b"} Jun 02 19:16:01.652266 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:01.652221 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-59dffc6ddc-wvtst" podStartSLOduration=1.202467582 podStartE2EDuration="1.652208588s" podCreationTimestamp="2026-06-02 19:16:00 +0000 UTC" firstStartedPulling="2026-06-02 19:16:00.621365174 +0000 UTC m=+751.182168058" lastFinishedPulling="2026-06-02 19:16:01.071106181 +0000 UTC m=+751.631909064" observedRunningTime="2026-06-02 19:16:01.65154503 +0000 UTC m=+752.212347925" watchObservedRunningTime="2026-06-02 19:16:01.652208588 +0000 UTC m=+752.213011490" Jun 02 19:16:10.731355 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:10.731317 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:16:27.147474 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:27.147444 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:16:30.828971 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:30.828935 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:16:44.540885 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:44.540797 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:16:53.945315 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:53.945279 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:16:58.653651 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:16:58.653611 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:18:00.897507 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:00.897475 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6fc4d6898b-cqznr"] Jun 02 19:18:00.900761 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:00.900742 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fc4d6898b-cqznr" Jun 02 19:18:00.907592 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:00.907534 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6fc4d6898b-cqznr"] Jun 02 19:18:00.949743 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:00.949667 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f4a196da-ca98-4b6d-a2a9-e40a288f1899-oidc-ca\") pod \"authorino-6fc4d6898b-cqznr\" (UID: \"f4a196da-ca98-4b6d-a2a9-e40a288f1899\") " pod="kuadrant-system/authorino-6fc4d6898b-cqznr" Jun 02 19:18:00.949916 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:00.949806 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57p25\" (UniqueName: \"kubernetes.io/projected/f4a196da-ca98-4b6d-a2a9-e40a288f1899-kube-api-access-57p25\") pod \"authorino-6fc4d6898b-cqznr\" (UID: \"f4a196da-ca98-4b6d-a2a9-e40a288f1899\") " pod="kuadrant-system/authorino-6fc4d6898b-cqznr" Jun 02 19:18:00.949976 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:00.949915 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f4a196da-ca98-4b6d-a2a9-e40a288f1899-tls-cert\") pod \"authorino-6fc4d6898b-cqznr\" (UID: \"f4a196da-ca98-4b6d-a2a9-e40a288f1899\") " pod="kuadrant-system/authorino-6fc4d6898b-cqznr" Jun 02 19:18:01.050670 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:01.050636 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-57p25\" (UniqueName: \"kubernetes.io/projected/f4a196da-ca98-4b6d-a2a9-e40a288f1899-kube-api-access-57p25\") pod \"authorino-6fc4d6898b-cqznr\" (UID: \"f4a196da-ca98-4b6d-a2a9-e40a288f1899\") " pod="kuadrant-system/authorino-6fc4d6898b-cqznr" Jun 02 19:18:01.050851 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:01.050761 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f4a196da-ca98-4b6d-a2a9-e40a288f1899-tls-cert\") pod \"authorino-6fc4d6898b-cqznr\" (UID: \"f4a196da-ca98-4b6d-a2a9-e40a288f1899\") " pod="kuadrant-system/authorino-6fc4d6898b-cqznr" Jun 02 19:18:01.050952 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:01.050924 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f4a196da-ca98-4b6d-a2a9-e40a288f1899-oidc-ca\") pod \"authorino-6fc4d6898b-cqznr\" (UID: \"f4a196da-ca98-4b6d-a2a9-e40a288f1899\") " pod="kuadrant-system/authorino-6fc4d6898b-cqznr" Jun 02 19:18:01.051662 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:01.051643 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f4a196da-ca98-4b6d-a2a9-e40a288f1899-oidc-ca\") pod \"authorino-6fc4d6898b-cqznr\" (UID: \"f4a196da-ca98-4b6d-a2a9-e40a288f1899\") " pod="kuadrant-system/authorino-6fc4d6898b-cqznr" Jun 02 19:18:01.053598 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:01.053572 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f4a196da-ca98-4b6d-a2a9-e40a288f1899-tls-cert\") pod \"authorino-6fc4d6898b-cqznr\" (UID: \"f4a196da-ca98-4b6d-a2a9-e40a288f1899\") " pod="kuadrant-system/authorino-6fc4d6898b-cqznr" Jun 02 19:18:01.058387 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:01.058369 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57p25\" (UniqueName: \"kubernetes.io/projected/f4a196da-ca98-4b6d-a2a9-e40a288f1899-kube-api-access-57p25\") pod \"authorino-6fc4d6898b-cqznr\" (UID: \"f4a196da-ca98-4b6d-a2a9-e40a288f1899\") " pod="kuadrant-system/authorino-6fc4d6898b-cqznr" Jun 02 19:18:01.210365 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:01.210339 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fc4d6898b-cqznr" Jun 02 19:18:01.335083 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:01.334956 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6fc4d6898b-cqznr"] Jun 02 19:18:01.337746 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:18:01.337724 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4a196da_ca98_4b6d_a2a9_e40a288f1899.slice/crio-58151dc19164c6942f5f20f9c000e23bb7b67762fa031a74dbb6edf56a05ea0e WatchSource:0}: Error finding container 58151dc19164c6942f5f20f9c000e23bb7b67762fa031a74dbb6edf56a05ea0e: Status 404 returned error can't find the container with id 58151dc19164c6942f5f20f9c000e23bb7b67762fa031a74dbb6edf56a05ea0e Jun 02 19:18:02.052383 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:02.052298 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fc4d6898b-cqznr" event={"ID":"f4a196da-ca98-4b6d-a2a9-e40a288f1899","Type":"ContainerStarted","Data":"7172a87cfc0a149864961c7e6d82c941fcaa1e32a86bc74b50eef94a1c1abb3f"} Jun 02 19:18:02.052383 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:02.052341 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fc4d6898b-cqznr" event={"ID":"f4a196da-ca98-4b6d-a2a9-e40a288f1899","Type":"ContainerStarted","Data":"58151dc19164c6942f5f20f9c000e23bb7b67762fa031a74dbb6edf56a05ea0e"} Jun 02 19:18:02.071541 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:02.071491 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-6fc4d6898b-cqznr" podStartSLOduration=1.648566133 podStartE2EDuration="2.07147476s" podCreationTimestamp="2026-06-02 19:18:00 +0000 UTC" firstStartedPulling="2026-06-02 19:18:01.339002562 +0000 UTC m=+871.899805442" lastFinishedPulling="2026-06-02 19:18:01.761911189 +0000 UTC m=+872.322714069" observedRunningTime="2026-06-02 19:18:02.069180465 +0000 UTC m=+872.629983359" watchObservedRunningTime="2026-06-02 19:18:02.07147476 +0000 UTC m=+872.632277659" Jun 02 19:18:02.098883 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:02.098844 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59dffc6ddc-wvtst"] Jun 02 19:18:02.099118 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:02.099092 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-59dffc6ddc-wvtst" podUID="1d49d505-cae8-44af-97ef-42e6dd81425a" containerName="authorino" containerID="cri-o://29b48b34f72470720479a4c884c44174cac4cea724f89691864a30f666b71b2b" gracePeriod=30 Jun 02 19:18:02.369533 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:02.369509 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59dffc6ddc-wvtst" Jun 02 19:18:02.463618 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:02.463580 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6lz7\" (UniqueName: \"kubernetes.io/projected/1d49d505-cae8-44af-97ef-42e6dd81425a-kube-api-access-x6lz7\") pod \"1d49d505-cae8-44af-97ef-42e6dd81425a\" (UID: \"1d49d505-cae8-44af-97ef-42e6dd81425a\") " Jun 02 19:18:02.463809 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:02.463631 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1d49d505-cae8-44af-97ef-42e6dd81425a-oidc-ca\") pod \"1d49d505-cae8-44af-97ef-42e6dd81425a\" (UID: \"1d49d505-cae8-44af-97ef-42e6dd81425a\") " Jun 02 19:18:02.463809 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:02.463732 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d49d505-cae8-44af-97ef-42e6dd81425a-tls-cert\") pod \"1d49d505-cae8-44af-97ef-42e6dd81425a\" (UID: \"1d49d505-cae8-44af-97ef-42e6dd81425a\") " Jun 02 19:18:02.465632 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:02.465600 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d49d505-cae8-44af-97ef-42e6dd81425a-kube-api-access-x6lz7" (OuterVolumeSpecName: "kube-api-access-x6lz7") pod "1d49d505-cae8-44af-97ef-42e6dd81425a" (UID: "1d49d505-cae8-44af-97ef-42e6dd81425a"). InnerVolumeSpecName "kube-api-access-x6lz7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:18:02.469911 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:02.469877 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d49d505-cae8-44af-97ef-42e6dd81425a-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "1d49d505-cae8-44af-97ef-42e6dd81425a" (UID: "1d49d505-cae8-44af-97ef-42e6dd81425a"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:18:02.473552 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:02.473521 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d49d505-cae8-44af-97ef-42e6dd81425a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1d49d505-cae8-44af-97ef-42e6dd81425a" (UID: "1d49d505-cae8-44af-97ef-42e6dd81425a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:18:02.565066 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:02.565019 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6lz7\" (UniqueName: \"kubernetes.io/projected/1d49d505-cae8-44af-97ef-42e6dd81425a-kube-api-access-x6lz7\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:18:02.565066 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:02.565059 2569 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1d49d505-cae8-44af-97ef-42e6dd81425a-oidc-ca\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:18:02.565066 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:02.565072 2569 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d49d505-cae8-44af-97ef-42e6dd81425a-tls-cert\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:18:03.058063 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:03.058012 2569 generic.go:358] "Generic (PLEG): container finished" podID="1d49d505-cae8-44af-97ef-42e6dd81425a" containerID="29b48b34f72470720479a4c884c44174cac4cea724f89691864a30f666b71b2b" exitCode=0 Jun 02 19:18:03.058510 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:03.058123 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59dffc6ddc-wvtst" Jun 02 19:18:03.058510 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:03.058152 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59dffc6ddc-wvtst" event={"ID":"1d49d505-cae8-44af-97ef-42e6dd81425a","Type":"ContainerDied","Data":"29b48b34f72470720479a4c884c44174cac4cea724f89691864a30f666b71b2b"} Jun 02 19:18:03.058510 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:03.058192 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59dffc6ddc-wvtst" event={"ID":"1d49d505-cae8-44af-97ef-42e6dd81425a","Type":"ContainerDied","Data":"0ca0cc470684d122d62307480d3c9ad3dba31e5c857ddd287d398f7c5889e7dc"} Jun 02 19:18:03.058510 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:03.058211 2569 scope.go:117] "RemoveContainer" containerID="29b48b34f72470720479a4c884c44174cac4cea724f89691864a30f666b71b2b" Jun 02 19:18:03.069567 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:03.069543 2569 scope.go:117] "RemoveContainer" containerID="29b48b34f72470720479a4c884c44174cac4cea724f89691864a30f666b71b2b" Jun 02 19:18:03.069865 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:18:03.069843 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29b48b34f72470720479a4c884c44174cac4cea724f89691864a30f666b71b2b\": container with ID starting with 29b48b34f72470720479a4c884c44174cac4cea724f89691864a30f666b71b2b not found: ID does not exist" containerID="29b48b34f72470720479a4c884c44174cac4cea724f89691864a30f666b71b2b" Jun 02 19:18:03.069943 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:03.069876 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29b48b34f72470720479a4c884c44174cac4cea724f89691864a30f666b71b2b"} err="failed to get container status \"29b48b34f72470720479a4c884c44174cac4cea724f89691864a30f666b71b2b\": rpc error: code = NotFound desc = could not find container \"29b48b34f72470720479a4c884c44174cac4cea724f89691864a30f666b71b2b\": container with ID starting with 29b48b34f72470720479a4c884c44174cac4cea724f89691864a30f666b71b2b not found: ID does not exist" Jun 02 19:18:03.101861 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:03.101836 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59dffc6ddc-wvtst"] Jun 02 19:18:03.107538 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:03.107515 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59dffc6ddc-wvtst"] Jun 02 19:18:04.002455 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:04.002419 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d49d505-cae8-44af-97ef-42e6dd81425a" path="/var/lib/kubelet/pods/1d49d505-cae8-44af-97ef-42e6dd81425a/volumes" Jun 02 19:18:29.989521 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:29.989447 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-dsq5s_3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415/console-operator/2.log" Jun 02 19:18:29.992136 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:29.992113 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xz76r_6d38637d-caa3-4eb1-a749-9fe24430d039/ovn-acl-logging/0.log" Jun 02 19:18:29.992469 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:29.992451 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-dsq5s_3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415/console-operator/2.log" Jun 02 19:18:29.994806 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:29.994787 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xz76r_6d38637d-caa3-4eb1-a749-9fe24430d039/ovn-acl-logging/0.log" Jun 02 19:18:32.739578 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:32.739541 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:18:43.846028 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:43.845990 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:18:51.938546 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:18:51.938505 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:19:03.026908 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:03.026866 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:19:11.433597 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:11.433550 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:19:22.332282 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:22.332251 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:19:28.005188 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:28.005154 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f4b5bbc98-v6t79"] Jun 02 19:19:28.354565 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:28.354475 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-6f4b5bbc98-v6t79" podUID="036d09ec-fb27-493c-b6b3-d0b6386b1a13" containerName="manager" containerID="cri-o://afdc142c3a3ec1dee4761ffe34d6abc66826a112dabdddb058a4d2fc8e30cccf" gracePeriod=30 Jun 02 19:19:28.597954 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:28.597930 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f4b5bbc98-v6t79" Jun 02 19:19:28.697503 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:28.697469 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9b68\" (UniqueName: \"kubernetes.io/projected/036d09ec-fb27-493c-b6b3-d0b6386b1a13-kube-api-access-w9b68\") pod \"036d09ec-fb27-493c-b6b3-d0b6386b1a13\" (UID: \"036d09ec-fb27-493c-b6b3-d0b6386b1a13\") " Jun 02 19:19:28.699595 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:28.699561 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/036d09ec-fb27-493c-b6b3-d0b6386b1a13-kube-api-access-w9b68" (OuterVolumeSpecName: "kube-api-access-w9b68") pod "036d09ec-fb27-493c-b6b3-d0b6386b1a13" (UID: "036d09ec-fb27-493c-b6b3-d0b6386b1a13"). InnerVolumeSpecName "kube-api-access-w9b68". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:19:28.798390 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:28.798359 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9b68\" (UniqueName: \"kubernetes.io/projected/036d09ec-fb27-493c-b6b3-d0b6386b1a13-kube-api-access-w9b68\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:19:29.358664 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:29.358633 2569 generic.go:358] "Generic (PLEG): container finished" podID="036d09ec-fb27-493c-b6b3-d0b6386b1a13" containerID="afdc142c3a3ec1dee4761ffe34d6abc66826a112dabdddb058a4d2fc8e30cccf" exitCode=0 Jun 02 19:19:29.359067 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:29.358705 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f4b5bbc98-v6t79" Jun 02 19:19:29.359067 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:29.358710 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f4b5bbc98-v6t79" event={"ID":"036d09ec-fb27-493c-b6b3-d0b6386b1a13","Type":"ContainerDied","Data":"afdc142c3a3ec1dee4761ffe34d6abc66826a112dabdddb058a4d2fc8e30cccf"} Jun 02 19:19:29.359067 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:29.358759 2569 scope.go:117] "RemoveContainer" containerID="afdc142c3a3ec1dee4761ffe34d6abc66826a112dabdddb058a4d2fc8e30cccf" Jun 02 19:19:29.359203 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:29.358749 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f4b5bbc98-v6t79" event={"ID":"036d09ec-fb27-493c-b6b3-d0b6386b1a13","Type":"ContainerDied","Data":"1f8ae20f8082473b5e7b01d6ddb9c3f5d44e2920a206adabe215890cfade5b06"} Jun 02 19:19:29.370436 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:29.370413 2569 scope.go:117] "RemoveContainer" containerID="afdc142c3a3ec1dee4761ffe34d6abc66826a112dabdddb058a4d2fc8e30cccf" Jun 02 19:19:29.370692 ip-10-0-131-50 kubenswrapper[2569]: E0602 19:19:29.370657 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afdc142c3a3ec1dee4761ffe34d6abc66826a112dabdddb058a4d2fc8e30cccf\": container with ID starting with afdc142c3a3ec1dee4761ffe34d6abc66826a112dabdddb058a4d2fc8e30cccf not found: ID does not exist" containerID="afdc142c3a3ec1dee4761ffe34d6abc66826a112dabdddb058a4d2fc8e30cccf" Jun 02 19:19:29.370847 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:29.370816 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afdc142c3a3ec1dee4761ffe34d6abc66826a112dabdddb058a4d2fc8e30cccf"} err="failed to get container status \"afdc142c3a3ec1dee4761ffe34d6abc66826a112dabdddb058a4d2fc8e30cccf\": rpc error: code = NotFound desc = could not find container \"afdc142c3a3ec1dee4761ffe34d6abc66826a112dabdddb058a4d2fc8e30cccf\": container with ID starting with afdc142c3a3ec1dee4761ffe34d6abc66826a112dabdddb058a4d2fc8e30cccf not found: ID does not exist" Jun 02 19:19:29.384976 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:29.384954 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f4b5bbc98-v6t79"] Jun 02 19:19:29.386560 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:29.386536 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6f4b5bbc98-v6t79"] Jun 02 19:19:30.003992 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:30.003960 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="036d09ec-fb27-493c-b6b3-d0b6386b1a13" path="/var/lib/kubelet/pods/036d09ec-fb27-493c-b6b3-d0b6386b1a13/volumes" Jun 02 19:19:30.143978 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:30.143947 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f4b5bbc98-mwp2m"] Jun 02 19:19:30.144375 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:30.144357 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="036d09ec-fb27-493c-b6b3-d0b6386b1a13" containerName="manager" Jun 02 19:19:30.144375 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:30.144374 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="036d09ec-fb27-493c-b6b3-d0b6386b1a13" containerName="manager" Jun 02 19:19:30.144526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:30.144390 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d49d505-cae8-44af-97ef-42e6dd81425a" containerName="authorino" Jun 02 19:19:30.144526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:30.144398 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d49d505-cae8-44af-97ef-42e6dd81425a" containerName="authorino" Jun 02 19:19:30.144526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:30.144489 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="036d09ec-fb27-493c-b6b3-d0b6386b1a13" containerName="manager" Jun 02 19:19:30.144526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:30.144499 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="1d49d505-cae8-44af-97ef-42e6dd81425a" containerName="authorino" Jun 02 19:19:30.148981 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:30.148959 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f4b5bbc98-mwp2m" Jun 02 19:19:30.152931 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:30.152909 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 02 19:19:30.153299 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:30.153281 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vd4lg\"" Jun 02 19:19:30.156823 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:30.156797 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f4b5bbc98-mwp2m"] Jun 02 19:19:30.209788 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:30.209758 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrwkz\" (UniqueName: \"kubernetes.io/projected/c6fb7a93-c02a-4296-b170-3d993d5c23d3-kube-api-access-zrwkz\") pod \"maas-controller-6f4b5bbc98-mwp2m\" (UID: \"c6fb7a93-c02a-4296-b170-3d993d5c23d3\") " pod="opendatahub/maas-controller-6f4b5bbc98-mwp2m" Jun 02 19:19:30.310779 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:30.310691 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zrwkz\" (UniqueName: \"kubernetes.io/projected/c6fb7a93-c02a-4296-b170-3d993d5c23d3-kube-api-access-zrwkz\") pod \"maas-controller-6f4b5bbc98-mwp2m\" (UID: \"c6fb7a93-c02a-4296-b170-3d993d5c23d3\") " pod="opendatahub/maas-controller-6f4b5bbc98-mwp2m" Jun 02 19:19:30.318334 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:30.318309 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrwkz\" (UniqueName: \"kubernetes.io/projected/c6fb7a93-c02a-4296-b170-3d993d5c23d3-kube-api-access-zrwkz\") pod \"maas-controller-6f4b5bbc98-mwp2m\" (UID: \"c6fb7a93-c02a-4296-b170-3d993d5c23d3\") " pod="opendatahub/maas-controller-6f4b5bbc98-mwp2m" Jun 02 19:19:30.464773 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:30.464736 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f4b5bbc98-mwp2m" Jun 02 19:19:30.596611 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:30.596586 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f4b5bbc98-mwp2m"] Jun 02 19:19:30.598662 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:19:30.598629 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6fb7a93_c02a_4296_b170_3d993d5c23d3.slice/crio-695eaa748a4e5cd195dfb5d9e2f6bc5acdebbac83c3ae89159bee6d3231b827c WatchSource:0}: Error finding container 695eaa748a4e5cd195dfb5d9e2f6bc5acdebbac83c3ae89159bee6d3231b827c: Status 404 returned error can't find the container with id 695eaa748a4e5cd195dfb5d9e2f6bc5acdebbac83c3ae89159bee6d3231b827c Jun 02 19:19:31.365957 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:31.365871 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f4b5bbc98-mwp2m" event={"ID":"c6fb7a93-c02a-4296-b170-3d993d5c23d3","Type":"ContainerStarted","Data":"0a4d2899792da91b12806f1684000564237bffb477c29d0d39c6cbeaa7f839c4"} Jun 02 19:19:31.365957 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:31.365906 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f4b5bbc98-mwp2m" event={"ID":"c6fb7a93-c02a-4296-b170-3d993d5c23d3","Type":"ContainerStarted","Data":"695eaa748a4e5cd195dfb5d9e2f6bc5acdebbac83c3ae89159bee6d3231b827c"} Jun 02 19:19:31.366295 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:31.366009 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f4b5bbc98-mwp2m" Jun 02 19:19:31.381966 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:31.381912 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6f4b5bbc98-mwp2m" podStartSLOduration=0.939436717 podStartE2EDuration="1.381897337s" podCreationTimestamp="2026-06-02 19:19:30 +0000 UTC" firstStartedPulling="2026-06-02 19:19:30.599875901 +0000 UTC m=+961.160678781" lastFinishedPulling="2026-06-02 19:19:31.04233652 +0000 UTC m=+961.603139401" observedRunningTime="2026-06-02 19:19:31.380571317 +0000 UTC m=+961.941374270" watchObservedRunningTime="2026-06-02 19:19:31.381897337 +0000 UTC m=+961.942700267" Jun 02 19:19:42.375120 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:42.375088 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f4b5bbc98-mwp2m" Jun 02 19:19:54.422465 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:19:54.422418 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:20:00.238116 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:20:00.238082 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:20:34.939788 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:20:34.939747 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:20:51.233222 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:20:51.233189 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:21:30.257080 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:21:30.256999 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:21:46.739751 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:21:46.739712 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:22:01.056848 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:22:01.056816 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:22:17.506312 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:22:17.506274 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:22:49.976936 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:22:49.976848 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:22:57.273305 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:22:57.273268 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:23:19.151332 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:23:19.151294 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:23:26.157477 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:23:26.157434 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:23:30.015323 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:23:30.015294 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-dsq5s_3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415/console-operator/2.log" Jun 02 19:23:30.017771 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:23:30.017749 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xz76r_6d38637d-caa3-4eb1-a749-9fe24430d039/ovn-acl-logging/0.log" Jun 02 19:23:30.019252 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:23:30.019234 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-dsq5s_3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415/console-operator/2.log" Jun 02 19:23:30.021636 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:23:30.021621 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xz76r_6d38637d-caa3-4eb1-a749-9fe24430d039/ovn-acl-logging/0.log" Jun 02 19:23:44.362496 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:23:44.362461 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:23:53.586655 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:23:53.586614 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:24:10.263367 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:24:10.263289 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:24:16.475460 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:24:16.475417 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:24:50.749361 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:24:50.749317 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:24:58.695580 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:24:58.695540 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:25:06.745230 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:25:06.745196 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:25:15.751743 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:25:15.751707 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:25:23.887155 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:25:23.887112 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:25:40.835966 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:25:40.835889 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:25:54.645733 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:25:54.645699 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:26:43.249938 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:26:43.249900 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:26:50.839298 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:26:50.839262 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:26:56.655642 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:26:56.655605 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:27:03.364560 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:27:03.364522 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:27:14.936928 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:27:14.936839 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:27:21.337937 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:27:21.337897 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:27:31.653951 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:27:31.653910 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:27:40.442568 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:27:40.442529 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:27:49.439347 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:27:49.439310 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:27:56.744732 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:27:56.744694 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:28:07.364107 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:28:07.364068 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:28:14.669030 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:28:14.668990 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:28:25.143852 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:28:25.143808 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:28:30.043977 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:28:30.043948 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-dsq5s_3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415/console-operator/2.log" Jun 02 19:28:30.046411 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:28:30.046388 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xz76r_6d38637d-caa3-4eb1-a749-9fe24430d039/ovn-acl-logging/0.log" Jun 02 19:28:30.052353 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:28:30.052333 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-dsq5s_3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415/console-operator/2.log" Jun 02 19:28:30.054646 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:28:30.054630 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xz76r_6d38637d-caa3-4eb1-a749-9fe24430d039/ovn-acl-logging/0.log" Jun 02 19:28:34.467317 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:28:34.467275 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:28:41.238814 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:28:41.238733 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:28:51.941152 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:28:51.941117 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:28:58.945091 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:28:58.945055 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:29:08.643842 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:29:08.643800 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:30:00.351484 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:30:00.351444 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29673810-5bb2b"] Jun 02 19:30:00.354727 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:30:00.354710 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673810-5bb2b" Jun 02 19:30:00.359538 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:30:00.359518 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2926t\"" Jun 02 19:30:00.371438 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:30:00.371413 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s86vv\" (UniqueName: \"kubernetes.io/projected/325ac009-4f70-4375-96f7-713cd69982fd-kube-api-access-s86vv\") pod \"maas-api-key-cleanup-29673810-5bb2b\" (UID: \"325ac009-4f70-4375-96f7-713cd69982fd\") " pod="opendatahub/maas-api-key-cleanup-29673810-5bb2b" Jun 02 19:30:00.372047 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:30:00.372030 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29673810-5bb2b"] Jun 02 19:30:00.472416 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:30:00.472384 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s86vv\" (UniqueName: \"kubernetes.io/projected/325ac009-4f70-4375-96f7-713cd69982fd-kube-api-access-s86vv\") pod \"maas-api-key-cleanup-29673810-5bb2b\" (UID: \"325ac009-4f70-4375-96f7-713cd69982fd\") " pod="opendatahub/maas-api-key-cleanup-29673810-5bb2b" Jun 02 19:30:00.483751 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:30:00.483722 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s86vv\" (UniqueName: \"kubernetes.io/projected/325ac009-4f70-4375-96f7-713cd69982fd-kube-api-access-s86vv\") pod \"maas-api-key-cleanup-29673810-5bb2b\" (UID: \"325ac009-4f70-4375-96f7-713cd69982fd\") " pod="opendatahub/maas-api-key-cleanup-29673810-5bb2b" Jun 02 19:30:00.664519 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:30:00.664437 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673810-5bb2b" Jun 02 19:30:00.803735 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:30:00.803704 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29673810-5bb2b"] Jun 02 19:30:00.807113 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:30:00.807087 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod325ac009_4f70_4375_96f7_713cd69982fd.slice/crio-8a13cbd8c350105f5cc33b6c098897a20637a43e4eed4bdf8510216901c59f14 WatchSource:0}: Error finding container 8a13cbd8c350105f5cc33b6c098897a20637a43e4eed4bdf8510216901c59f14: Status 404 returned error can't find the container with id 8a13cbd8c350105f5cc33b6c098897a20637a43e4eed4bdf8510216901c59f14 Jun 02 19:30:00.809322 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:30:00.809307 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 19:30:01.572889 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:30:01.572857 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673810-5bb2b" event={"ID":"325ac009-4f70-4375-96f7-713cd69982fd","Type":"ContainerStarted","Data":"8a13cbd8c350105f5cc33b6c098897a20637a43e4eed4bdf8510216901c59f14"} Jun 02 19:30:17.631435 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:30:17.631339 2569 generic.go:358] "Generic (PLEG): container finished" podID="325ac009-4f70-4375-96f7-713cd69982fd" containerID="eab3bc2e5335d5f75409d654bd3ae359e66f32d815e54c858e512a3fc71ac154" exitCode=0 Jun 02 19:30:17.631435 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:30:17.631401 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673810-5bb2b" event={"ID":"325ac009-4f70-4375-96f7-713cd69982fd","Type":"ContainerDied","Data":"eab3bc2e5335d5f75409d654bd3ae359e66f32d815e54c858e512a3fc71ac154"} Jun 02 19:30:18.761424 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:30:18.761401 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673810-5bb2b" Jun 02 19:30:18.837365 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:30:18.837317 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s86vv\" (UniqueName: \"kubernetes.io/projected/325ac009-4f70-4375-96f7-713cd69982fd-kube-api-access-s86vv\") pod \"325ac009-4f70-4375-96f7-713cd69982fd\" (UID: \"325ac009-4f70-4375-96f7-713cd69982fd\") " Jun 02 19:30:18.839423 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:30:18.839404 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/325ac009-4f70-4375-96f7-713cd69982fd-kube-api-access-s86vv" (OuterVolumeSpecName: "kube-api-access-s86vv") pod "325ac009-4f70-4375-96f7-713cd69982fd" (UID: "325ac009-4f70-4375-96f7-713cd69982fd"). InnerVolumeSpecName "kube-api-access-s86vv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:30:18.939056 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:30:18.939029 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s86vv\" (UniqueName: \"kubernetes.io/projected/325ac009-4f70-4375-96f7-713cd69982fd-kube-api-access-s86vv\") on node \"ip-10-0-131-50.ec2.internal\" DevicePath \"\"" Jun 02 19:30:19.640189 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:30:19.640151 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673810-5bb2b" event={"ID":"325ac009-4f70-4375-96f7-713cd69982fd","Type":"ContainerDied","Data":"8a13cbd8c350105f5cc33b6c098897a20637a43e4eed4bdf8510216901c59f14"} Jun 02 19:30:19.640189 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:30:19.640187 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673810-5bb2b" Jun 02 19:30:19.640189 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:30:19.640192 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a13cbd8c350105f5cc33b6c098897a20637a43e4eed4bdf8510216901c59f14" Jun 02 19:31:24.578987 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:31:24.571875 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:31:30.974520 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:31:30.974484 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:31:56.355140 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:31:56.355106 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:32:03.159665 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:32:03.154471 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:32:13.742996 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:32:13.742961 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:32:23.338999 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:32:23.338955 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:32:33.090597 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:32:33.090551 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:32:42.765594 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:32:42.765556 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:32:51.541044 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:32:51.541003 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:33:02.457609 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:33:02.457566 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:33:11.574938 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:33:11.574835 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:33:20.948880 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:33:20.948841 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:33:30.069929 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:33:30.069896 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-dsq5s_3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415/console-operator/2.log" Jun 02 19:33:30.072488 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:33:30.072465 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xz76r_6d38637d-caa3-4eb1-a749-9fe24430d039/ovn-acl-logging/0.log" Jun 02 19:33:30.078498 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:33:30.078480 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-dsq5s_3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415/console-operator/2.log" Jun 02 19:33:30.080744 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:33:30.080729 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xz76r_6d38637d-caa3-4eb1-a749-9fe24430d039/ovn-acl-logging/0.log" Jun 02 19:33:30.754094 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:33:30.754054 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:34:06.052187 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:34:06.052153 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:34:49.449622 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:34:49.449534 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:34:58.264865 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:34:58.264829 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:35:06.861896 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:35:06.861855 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:35:13.967116 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:35:13.967073 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:35:22.843033 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:35:22.842997 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:35:35.652387 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:35:35.652353 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:35:45.460161 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:35:45.460117 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:35:54.052239 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:35:54.052201 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:36:04.557420 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:36:04.557381 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:36:11.662582 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:36:11.662488 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:36:19.643655 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:36:19.643618 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:36:31.264809 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:36:31.264773 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:36:48.556462 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:36:48.556426 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:36:57.851710 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:36:57.851660 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:37:06.658083 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:37:06.658047 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:37:13.341489 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:37:13.341457 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:37:30.249377 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:37:30.249343 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:37:38.551611 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:37:38.551571 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:37:48.372123 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:37:48.372084 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:37:57.467991 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:37:57.467956 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:38:06.354787 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:38:06.354749 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:38:13.150362 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:38:13.150322 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:38:23.460930 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:38:23.460889 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:38:30.097346 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:38:30.097313 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-dsq5s_3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415/console-operator/2.log" Jun 02 19:38:30.099855 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:38:30.099834 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xz76r_6d38637d-caa3-4eb1-a749-9fe24430d039/ovn-acl-logging/0.log" Jun 02 19:38:30.104529 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:38:30.104508 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-dsq5s_3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415/console-operator/2.log" Jun 02 19:38:30.106836 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:38:30.106820 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xz76r_6d38637d-caa3-4eb1-a749-9fe24430d039/ovn-acl-logging/0.log" Jun 02 19:38:36.351599 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:38:36.351560 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:38:44.454961 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:38:44.454921 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:38:57.763386 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:38:57.763345 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:39:06.551706 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:39:06.550947 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:39:14.775547 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:39:14.775463 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:39:25.399058 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:39:25.399023 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:39:33.448225 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:39:33.448192 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:39:50.446373 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:39:50.446340 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:39:59.852294 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:39:59.852260 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:40:09.673578 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:40:09.673544 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:40:17.060095 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:40:17.060061 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:40:42.759168 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:40:42.759079 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:40:55.542998 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:40:55.542954 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-hlfbk"] Jun 02 19:41:01.398340 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:01.398309 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6fc4d6898b-cqznr_f4a196da-ca98-4b6d-a2a9-e40a288f1899/authorino/0.log" Jun 02 19:41:06.539801 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:06.539769 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29673810-5bb2b_325ac009-4f70-4375-96f7-713cd69982fd/cleanup/0.log" Jun 02 19:41:06.654631 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:06.654600 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6f4b5bbc98-mwp2m_c6fb7a93-c02a-4296-b170-3d993d5c23d3/manager/0.log" Jun 02 19:41:07.144926 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:07.144897 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7548bb679b-mhzqf_5ed2c2f8-2a47-4250-98e1-6bb5c62044c2/manager/0.log" Jun 02 19:41:07.155334 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:07.155312 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7548bb679b-mhzqf_5ed2c2f8-2a47-4250-98e1-6bb5c62044c2/copy-manifests/0.log" Jun 02 19:41:08.714950 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:08.714926 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6fc4d6898b-cqznr_f4a196da-ca98-4b6d-a2a9-e40a288f1899/authorino/0.log" Jun 02 19:41:08.953053 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:08.953028 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-5gdtk_fa522cf0-67cf-45b4-b623-7557c9a08590/manager/0.log" Jun 02 19:41:09.069473 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:09.069400 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-xr2n2_c5120c43-dc24-4b11-b366-d03b44b0eb57/kuadrant-console-plugin/0.log" Jun 02 19:41:09.447612 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:09.447591 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-hlfbk_4ca43761-cfb2-426f-b2e7-90a16a473ef4/limitador/0.log" Jun 02 19:41:10.137786 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:10.137763 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79d759cb56-5db9c_3d7510ab-c31c-47a7-b3b0-1dafd52f5457/kube-auth-proxy/0.log" Jun 02 19:41:10.487217 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:10.487183 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-7mkff_9e194e80-70fa-46da-949d-eae8b00922be/payload-processing/0.log" Jun 02 19:41:10.601154 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:10.601124 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5df97bddf-525zw_fccebb43-30c1-4fee-a112-ecd9e9dd2f8d/router/0.log" Jun 02 19:41:15.192341 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:15.192307 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d8wrw/must-gather-t54jw"] Jun 02 19:41:15.192809 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:15.192655 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="325ac009-4f70-4375-96f7-713cd69982fd" containerName="cleanup" Jun 02 19:41:15.192809 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:15.192665 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="325ac009-4f70-4375-96f7-713cd69982fd" containerName="cleanup" Jun 02 19:41:15.192809 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:15.192740 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="325ac009-4f70-4375-96f7-713cd69982fd" containerName="cleanup" Jun 02 19:41:15.195978 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:15.195959 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d8wrw/must-gather-t54jw" Jun 02 19:41:15.199591 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:15.199572 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d8wrw\"/\"openshift-service-ca.crt\"" Jun 02 19:41:15.199728 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:15.199627 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d8wrw\"/\"kube-root-ca.crt\"" Jun 02 19:41:15.199888 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:15.199868 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d8wrw\"/\"default-dockercfg-pd7s2\"" Jun 02 19:41:15.230831 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:15.230806 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d8wrw/must-gather-t54jw"] Jun 02 19:41:15.363210 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:15.363166 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bbcfa260-880d-4a4c-b7c9-1d130ccb4631-must-gather-output\") pod \"must-gather-t54jw\" (UID: \"bbcfa260-880d-4a4c-b7c9-1d130ccb4631\") " pod="openshift-must-gather-d8wrw/must-gather-t54jw" Jun 02 19:41:15.363386 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:15.363218 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tttz\" (UniqueName: \"kubernetes.io/projected/bbcfa260-880d-4a4c-b7c9-1d130ccb4631-kube-api-access-4tttz\") pod \"must-gather-t54jw\" (UID: \"bbcfa260-880d-4a4c-b7c9-1d130ccb4631\") " pod="openshift-must-gather-d8wrw/must-gather-t54jw" Jun 02 19:41:15.464083 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:15.464006 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bbcfa260-880d-4a4c-b7c9-1d130ccb4631-must-gather-output\") pod \"must-gather-t54jw\" (UID: \"bbcfa260-880d-4a4c-b7c9-1d130ccb4631\") " pod="openshift-must-gather-d8wrw/must-gather-t54jw" Jun 02 19:41:15.464083 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:15.464043 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4tttz\" (UniqueName: \"kubernetes.io/projected/bbcfa260-880d-4a4c-b7c9-1d130ccb4631-kube-api-access-4tttz\") pod \"must-gather-t54jw\" (UID: \"bbcfa260-880d-4a4c-b7c9-1d130ccb4631\") " pod="openshift-must-gather-d8wrw/must-gather-t54jw" Jun 02 19:41:15.464330 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:15.464309 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bbcfa260-880d-4a4c-b7c9-1d130ccb4631-must-gather-output\") pod \"must-gather-t54jw\" (UID: \"bbcfa260-880d-4a4c-b7c9-1d130ccb4631\") " pod="openshift-must-gather-d8wrw/must-gather-t54jw" Jun 02 19:41:15.472989 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:15.472965 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tttz\" (UniqueName: \"kubernetes.io/projected/bbcfa260-880d-4a4c-b7c9-1d130ccb4631-kube-api-access-4tttz\") pod \"must-gather-t54jw\" (UID: \"bbcfa260-880d-4a4c-b7c9-1d130ccb4631\") " pod="openshift-must-gather-d8wrw/must-gather-t54jw" Jun 02 19:41:15.504844 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:15.504813 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d8wrw/must-gather-t54jw" Jun 02 19:41:15.639232 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:15.639205 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d8wrw/must-gather-t54jw"] Jun 02 19:41:15.641766 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:41:15.641733 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbcfa260_880d_4a4c_b7c9_1d130ccb4631.slice/crio-825636416a5394e1121c8829a535a782403fcf278837c19ffedd17074f08f408 WatchSource:0}: Error finding container 825636416a5394e1121c8829a535a782403fcf278837c19ffedd17074f08f408: Status 404 returned error can't find the container with id 825636416a5394e1121c8829a535a782403fcf278837c19ffedd17074f08f408 Jun 02 19:41:15.643894 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:15.643876 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 19:41:15.959712 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:15.959664 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d8wrw/must-gather-t54jw" event={"ID":"bbcfa260-880d-4a4c-b7c9-1d130ccb4631","Type":"ContainerStarted","Data":"825636416a5394e1121c8829a535a782403fcf278837c19ffedd17074f08f408"} Jun 02 19:41:16.965761 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:16.965217 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d8wrw/must-gather-t54jw" event={"ID":"bbcfa260-880d-4a4c-b7c9-1d130ccb4631","Type":"ContainerStarted","Data":"c06d7d158f8458bd875ba8b453e030ad6849dee2d6f22e6614ca1e3d1312ab77"} Jun 02 19:41:16.965761 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:16.965264 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d8wrw/must-gather-t54jw" event={"ID":"bbcfa260-880d-4a4c-b7c9-1d130ccb4631","Type":"ContainerStarted","Data":"096e010191a8391b34d8e18fa42d43d83109cd4043d613160fb6c15260e723dd"} Jun 02 19:41:16.984738 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:16.984660 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-d8wrw/must-gather-t54jw" podStartSLOduration=1.082636884 podStartE2EDuration="1.984640553s" podCreationTimestamp="2026-06-02 19:41:15 +0000 UTC" firstStartedPulling="2026-06-02 19:41:15.644033756 +0000 UTC m=+2266.204836637" lastFinishedPulling="2026-06-02 19:41:16.546037426 +0000 UTC m=+2267.106840306" observedRunningTime="2026-06-02 19:41:16.982870897 +0000 UTC m=+2267.543673799" watchObservedRunningTime="2026-06-02 19:41:16.984640553 +0000 UTC m=+2267.545443457" Jun 02 19:41:18.578296 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:18.578183 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zzdxq_094221b7-ebed-49a8-b6bb-19635956bceb/global-pull-secret-syncer/0.log" Jun 02 19:41:18.635320 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:18.635287 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fdb42_d1ae20d8-d6b8-4375-8568-94b4accc60a3/konnectivity-agent/0.log" Jun 02 19:41:18.740487 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:18.740457 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-50.ec2.internal_0f9e61bb920547c421ae35a4490f954e/haproxy/0.log" Jun 02 19:41:23.135078 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:23.135036 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6fc4d6898b-cqznr_f4a196da-ca98-4b6d-a2a9-e40a288f1899/authorino/0.log" Jun 02 19:41:23.202927 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:23.202895 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-5gdtk_fa522cf0-67cf-45b4-b623-7557c9a08590/manager/0.log" Jun 02 19:41:23.246830 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:23.246800 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-xr2n2_c5120c43-dc24-4b11-b366-d03b44b0eb57/kuadrant-console-plugin/0.log" Jun 02 19:41:23.397631 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:23.397551 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-hlfbk_4ca43761-cfb2-426f-b2e7-90a16a473ef4/limitador/0.log" Jun 02 19:41:24.671386 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:24.671358 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d9d3eee5-eb3d-441e-a2a6-61c1531e3bba/alertmanager/0.log" Jun 02 19:41:24.701140 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:24.701112 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d9d3eee5-eb3d-441e-a2a6-61c1531e3bba/config-reloader/0.log" Jun 02 19:41:24.731878 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:24.731838 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d9d3eee5-eb3d-441e-a2a6-61c1531e3bba/kube-rbac-proxy-web/0.log" Jun 02 19:41:24.759125 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:24.759089 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d9d3eee5-eb3d-441e-a2a6-61c1531e3bba/kube-rbac-proxy/0.log" Jun 02 19:41:24.793051 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:24.793018 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d9d3eee5-eb3d-441e-a2a6-61c1531e3bba/kube-rbac-proxy-metric/0.log" Jun 02 19:41:24.824988 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:24.824964 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d9d3eee5-eb3d-441e-a2a6-61c1531e3bba/prom-label-proxy/0.log" Jun 02 19:41:24.850355 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:24.850314 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d9d3eee5-eb3d-441e-a2a6-61c1531e3bba/init-config-reloader/0.log" Jun 02 19:41:24.936328 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:24.936297 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-v7n6c_fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81/kube-state-metrics/0.log" Jun 02 19:41:24.966307 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:24.966257 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-v7n6c_fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81/kube-rbac-proxy-main/0.log" Jun 02 19:41:24.996334 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:24.996288 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-v7n6c_fb8c6e28-1a36-40eb-9c1f-b3a250ea7a81/kube-rbac-proxy-self/0.log" Jun 02 19:41:25.033841 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:25.033816 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-78566d6c6f-vrlx7_1b252c60-fca2-49ac-bc65-dc7d857cc14f/metrics-server/0.log" Jun 02 19:41:25.129940 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:25.129903 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8z8jx_2a957dfd-069e-4f27-ae0f-7ea78ee397cf/node-exporter/0.log" Jun 02 19:41:25.175065 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:25.175040 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8z8jx_2a957dfd-069e-4f27-ae0f-7ea78ee397cf/kube-rbac-proxy/0.log" Jun 02 19:41:25.211666 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:25.211598 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8z8jx_2a957dfd-069e-4f27-ae0f-7ea78ee397cf/init-textfile/0.log" Jun 02 19:41:25.918898 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:25.918868 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-m4nkj_13e74629-9f61-4dd7-a90f-728c800c91bd/prometheus-operator-admission-webhook/0.log" Jun 02 19:41:27.884306 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:27.884278 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-dsq5s_3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415/console-operator/2.log" Jun 02 19:41:27.888548 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:27.888525 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-dsq5s_3c4d756d-6bf1-4ad4-b7cc-a06e10ac9415/console-operator/3.log" Jun 02 19:41:28.649197 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:28.649153 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d8wrw/perf-node-gather-daemonset-w9gcq"] Jun 02 19:41:28.656614 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:28.656583 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-w9gcq" Jun 02 19:41:28.661988 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:28.661959 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d8wrw/perf-node-gather-daemonset-w9gcq"] Jun 02 19:41:28.700731 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:28.700673 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a39dab8a-374f-4ac1-afde-7ec0a22900fd-lib-modules\") pod \"perf-node-gather-daemonset-w9gcq\" (UID: \"a39dab8a-374f-4ac1-afde-7ec0a22900fd\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-w9gcq" Jun 02 19:41:28.700925 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:28.700740 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a39dab8a-374f-4ac1-afde-7ec0a22900fd-sys\") pod \"perf-node-gather-daemonset-w9gcq\" (UID: \"a39dab8a-374f-4ac1-afde-7ec0a22900fd\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-w9gcq" Jun 02 19:41:28.700925 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:28.700783 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhjv6\" (UniqueName: \"kubernetes.io/projected/a39dab8a-374f-4ac1-afde-7ec0a22900fd-kube-api-access-fhjv6\") pod \"perf-node-gather-daemonset-w9gcq\" (UID: \"a39dab8a-374f-4ac1-afde-7ec0a22900fd\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-w9gcq" Jun 02 19:41:28.700925 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:28.700835 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a39dab8a-374f-4ac1-afde-7ec0a22900fd-podres\") pod \"perf-node-gather-daemonset-w9gcq\" (UID: \"a39dab8a-374f-4ac1-afde-7ec0a22900fd\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-w9gcq" Jun 02 19:41:28.700925 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:28.700871 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a39dab8a-374f-4ac1-afde-7ec0a22900fd-proc\") pod \"perf-node-gather-daemonset-w9gcq\" (UID: \"a39dab8a-374f-4ac1-afde-7ec0a22900fd\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-w9gcq" Jun 02 19:41:28.801565 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:28.801525 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a39dab8a-374f-4ac1-afde-7ec0a22900fd-lib-modules\") pod \"perf-node-gather-daemonset-w9gcq\" (UID: \"a39dab8a-374f-4ac1-afde-7ec0a22900fd\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-w9gcq" Jun 02 19:41:28.802043 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:28.802019 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a39dab8a-374f-4ac1-afde-7ec0a22900fd-sys\") pod \"perf-node-gather-daemonset-w9gcq\" (UID: \"a39dab8a-374f-4ac1-afde-7ec0a22900fd\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-w9gcq" Jun 02 19:41:28.802278 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:28.802257 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fhjv6\" (UniqueName: \"kubernetes.io/projected/a39dab8a-374f-4ac1-afde-7ec0a22900fd-kube-api-access-fhjv6\") pod \"perf-node-gather-daemonset-w9gcq\" (UID: \"a39dab8a-374f-4ac1-afde-7ec0a22900fd\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-w9gcq" Jun 02 19:41:28.802760 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:28.802739 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a39dab8a-374f-4ac1-afde-7ec0a22900fd-podres\") pod \"perf-node-gather-daemonset-w9gcq\" (UID: \"a39dab8a-374f-4ac1-afde-7ec0a22900fd\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-w9gcq" Jun 02 19:41:28.803056 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:28.803039 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a39dab8a-374f-4ac1-afde-7ec0a22900fd-proc\") pod \"perf-node-gather-daemonset-w9gcq\" (UID: \"a39dab8a-374f-4ac1-afde-7ec0a22900fd\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-w9gcq" Jun 02 19:41:28.803298 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:28.802211 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a39dab8a-374f-4ac1-afde-7ec0a22900fd-sys\") pod \"perf-node-gather-daemonset-w9gcq\" (UID: \"a39dab8a-374f-4ac1-afde-7ec0a22900fd\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-w9gcq" Jun 02 19:41:28.803416 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:28.802969 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a39dab8a-374f-4ac1-afde-7ec0a22900fd-podres\") pod \"perf-node-gather-daemonset-w9gcq\" (UID: \"a39dab8a-374f-4ac1-afde-7ec0a22900fd\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-w9gcq" Jun 02 19:41:28.803416 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:28.801745 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a39dab8a-374f-4ac1-afde-7ec0a22900fd-lib-modules\") pod \"perf-node-gather-daemonset-w9gcq\" (UID: \"a39dab8a-374f-4ac1-afde-7ec0a22900fd\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-w9gcq" Jun 02 19:41:28.803416 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:28.803201 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a39dab8a-374f-4ac1-afde-7ec0a22900fd-proc\") pod \"perf-node-gather-daemonset-w9gcq\" (UID: \"a39dab8a-374f-4ac1-afde-7ec0a22900fd\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-w9gcq" Jun 02 19:41:28.812594 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:28.812565 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhjv6\" (UniqueName: \"kubernetes.io/projected/a39dab8a-374f-4ac1-afde-7ec0a22900fd-kube-api-access-fhjv6\") pod \"perf-node-gather-daemonset-w9gcq\" (UID: \"a39dab8a-374f-4ac1-afde-7ec0a22900fd\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-w9gcq" Jun 02 19:41:28.970292 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:28.970257 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-w9gcq" Jun 02 19:41:29.119287 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:29.119256 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d8wrw/perf-node-gather-daemonset-w9gcq"] Jun 02 19:41:29.123123 ip-10-0-131-50 kubenswrapper[2569]: W0602 19:41:29.123093 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda39dab8a_374f_4ac1_afde_7ec0a22900fd.slice/crio-ea1e6a2e530ec7cc8576a68863596c06a4a3ffdf2f5fc13b2555e8913ace76a5 WatchSource:0}: Error finding container ea1e6a2e530ec7cc8576a68863596c06a4a3ffdf2f5fc13b2555e8913ace76a5: Status 404 returned error can't find the container with id ea1e6a2e530ec7cc8576a68863596c06a4a3ffdf2f5fc13b2555e8913ace76a5 Jun 02 19:41:29.765745 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:29.765713 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kjwpj_37654fa6-9127-48c7-8517-c221330b4460/dns/0.log" Jun 02 19:41:29.790302 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:29.790273 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kjwpj_37654fa6-9127-48c7-8517-c221330b4460/kube-rbac-proxy/0.log" Jun 02 19:41:29.920005 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:29.919978 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rrknd_597d1a89-5f63-4e9e-9c43-6d841864384a/dns-node-resolver/0.log" Jun 02 19:41:30.047044 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:30.046944 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-w9gcq" event={"ID":"a39dab8a-374f-4ac1-afde-7ec0a22900fd","Type":"ContainerStarted","Data":"b091fa04c0b31ceda51218120d5999d662179ef5d507efc44410d4c254506b9a"} Jun 02 19:41:30.047044 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:30.046988 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-w9gcq" event={"ID":"a39dab8a-374f-4ac1-afde-7ec0a22900fd","Type":"ContainerStarted","Data":"ea1e6a2e530ec7cc8576a68863596c06a4a3ffdf2f5fc13b2555e8913ace76a5"} Jun 02 19:41:30.047949 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:30.047923 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-w9gcq" Jun 02 19:41:30.064623 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:30.064564 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-w9gcq" podStartSLOduration=2.064548569 podStartE2EDuration="2.064548569s" podCreationTimestamp="2026-06-02 19:41:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:41:30.063917799 +0000 UTC m=+2280.624720693" watchObservedRunningTime="2026-06-02 19:41:30.064548569 +0000 UTC m=+2280.625351472" Jun 02 19:41:30.533611 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:30.533581 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nqr8d_a534831c-1da1-4acc-85ae-6e089da15b9c/node-ca/0.log" Jun 02 19:41:31.832607 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:31.832579 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79d759cb56-5db9c_3d7510ab-c31c-47a7-b3b0-1dafd52f5457/kube-auth-proxy/0.log" Jun 02 19:41:32.042525 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:32.042481 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-7mkff_9e194e80-70fa-46da-949d-eae8b00922be/payload-processing/0.log" Jun 02 19:41:32.069997 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:32.069974 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5df97bddf-525zw_fccebb43-30c1-4fee-a112-ecd9e9dd2f8d/router/0.log" Jun 02 19:41:32.625156 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:32.625129 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gdqng_e722091f-abf8-4361-9442-9a0c103355dc/serve-healthcheck-canary/0.log" Jun 02 19:41:33.211838 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:33.211799 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-9gswq_975a5e94-6791-4548-8945-a3085447e0d2/insights-operator/0.log" Jun 02 19:41:33.212253 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:33.212019 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-9gswq_975a5e94-6791-4548-8945-a3085447e0d2/insights-operator/1.log" Jun 02 19:41:33.426889 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:33.426857 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zvcv5_2a4b3d60-909a-4ddd-8d93-6f0c9689abf1/kube-rbac-proxy/0.log" Jun 02 19:41:33.456996 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:33.456970 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zvcv5_2a4b3d60-909a-4ddd-8d93-6f0c9689abf1/exporter/0.log" Jun 02 19:41:33.486814 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:33.486752 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zvcv5_2a4b3d60-909a-4ddd-8d93-6f0c9689abf1/extractor/0.log" Jun 02 19:41:35.720145 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:35.720118 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29673810-5bb2b_325ac009-4f70-4375-96f7-713cd69982fd/cleanup/0.log" Jun 02 19:41:35.807643 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:35.807606 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6f4b5bbc98-mwp2m_c6fb7a93-c02a-4296-b170-3d993d5c23d3/manager/0.log" Jun 02 19:41:35.969590 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:35.969562 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7548bb679b-mhzqf_5ed2c2f8-2a47-4250-98e1-6bb5c62044c2/manager/0.log" Jun 02 19:41:35.995277 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:35.995193 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7548bb679b-mhzqf_5ed2c2f8-2a47-4250-98e1-6bb5c62044c2/copy-manifests/0.log" Jun 02 19:41:37.065455 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:37.065428 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-w9gcq" Jun 02 19:41:37.558288 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:37.558258 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-686947f9c6-78h2b_994c8bcd-c37e-4511-86d6-b604b897c0b2/manager/0.log" Jun 02 19:41:42.508570 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:42.508539 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-mg8wz_24835e19-dac8-49b1-b946-a65ee150f15f/migrator/0.log" Jun 02 19:41:42.533665 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:42.533637 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-mg8wz_24835e19-dac8-49b1-b946-a65ee150f15f/graceful-termination/0.log" Jun 02 19:41:42.935307 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:42.935283 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-vxtdt_fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924/kube-storage-version-migrator-operator/1.log" Jun 02 19:41:42.936222 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:42.936187 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-vxtdt_fb2d9d03-4df2-4e9c-8982-2b4c7b4c7924/kube-storage-version-migrator-operator/0.log" Jun 02 19:41:44.202147 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:44.202123 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7k55l_a574bbc7-9afe-4c8a-9319-39c5a32a63b9/kube-multus-additional-cni-plugins/0.log" Jun 02 19:41:44.234526 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:44.234499 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7k55l_a574bbc7-9afe-4c8a-9319-39c5a32a63b9/egress-router-binary-copy/0.log" Jun 02 19:41:44.262478 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:44.262455 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7k55l_a574bbc7-9afe-4c8a-9319-39c5a32a63b9/cni-plugins/0.log" Jun 02 19:41:44.297219 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:44.297193 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7k55l_a574bbc7-9afe-4c8a-9319-39c5a32a63b9/bond-cni-plugin/0.log" Jun 02 19:41:44.327407 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:44.327381 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7k55l_a574bbc7-9afe-4c8a-9319-39c5a32a63b9/routeoverride-cni/0.log" Jun 02 19:41:44.356760 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:44.356735 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7k55l_a574bbc7-9afe-4c8a-9319-39c5a32a63b9/whereabouts-cni-bincopy/0.log" Jun 02 19:41:44.390616 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:44.390586 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7k55l_a574bbc7-9afe-4c8a-9319-39c5a32a63b9/whereabouts-cni/0.log" Jun 02 19:41:44.706939 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:44.706909 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xbtzq_26230ee1-9ed4-472f-9b1c-26724eddd354/kube-multus/0.log" Jun 02 19:41:44.733023 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:44.732999 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4vsd7_18ce0d3d-f461-41fa-95fa-9bb77c484d5d/network-metrics-daemon/0.log" Jun 02 19:41:44.786059 ip-10-0-131-50 kubenswrapper[2569]: I0602 19:41:44.786034 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4vsd7_18ce0d3d-f461-41fa-95fa-9bb77c484d5d/kube-rbac-proxy/0.log"