Jun 03 22:47:44.415310 ip-10-0-140-99 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 22:47:44.415323 ip-10-0-140-99 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 22:47:44.415330 ip-10-0-140-99 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 22:47:44.415499 ip-10-0-140-99 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 22:47:54.604832 ip-10-0-140-99 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 22:47:54.604850 ip-10-0-140-99 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 23f5ac9c082a43c6ad3c41788e5c8af1 -- Jun 03 22:50:21.521955 ip-10-0-140-99 systemd[1]: Starting Kubernetes Kubelet... Jun 03 22:50:21.962677 ip-10-0-140-99 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 22:50:21.962677 ip-10-0-140-99 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 22:50:21.962677 ip-10-0-140-99 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 22:50:21.962677 ip-10-0-140-99 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 22:50:21.962677 ip-10-0-140-99 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 22:50:21.963348 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.962774 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 22:50:21.968542 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968487 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 22:50:21.968542 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968519 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 22:50:21.968542 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968523 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 22:50:21.968542 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968526 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 22:50:21.968542 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968529 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 22:50:21.968542 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968531 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 22:50:21.968542 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968537 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 22:50:21.968542 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968541 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 22:50:21.968542 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968544 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 22:50:21.968542 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968548 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 22:50:21.968803 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968551 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 22:50:21.968803 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968554 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 22:50:21.968803 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968557 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 22:50:21.968803 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968561 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 22:50:21.968803 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968573 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 22:50:21.968803 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968576 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 22:50:21.968803 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968580 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 22:50:21.968803 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968583 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 22:50:21.968803 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968586 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 22:50:21.968803 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968588 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 22:50:21.968803 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968591 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 03 22:50:21.968803 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968594 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 22:50:21.968803 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968598 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 22:50:21.968803 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968602 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 22:50:21.968803 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968605 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 22:50:21.968803 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968608 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 22:50:21.968803 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968610 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 22:50:21.968803 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968613 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 22:50:21.968803 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968616 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 22:50:21.969262 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968618 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 22:50:21.969262 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968621 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 22:50:21.969262 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968624 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 22:50:21.969262 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968626 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 22:50:21.969262 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968630 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 22:50:21.969262 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968632 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 22:50:21.969262 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968636 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 22:50:21.969262 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968638 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 22:50:21.969262 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968641 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 22:50:21.969262 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968644 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 22:50:21.969262 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968656 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 22:50:21.969262 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968659 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 22:50:21.969262 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968661 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 22:50:21.969262 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968664 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 22:50:21.969262 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968668 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 22:50:21.969262 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968671 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 22:50:21.969262 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968674 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 22:50:21.969262 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968676 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 22:50:21.969262 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968679 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 22:50:21.969782 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968682 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 22:50:21.969782 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968685 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 22:50:21.969782 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968688 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 22:50:21.969782 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968690 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 22:50:21.969782 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968693 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 22:50:21.969782 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968695 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 22:50:21.969782 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968698 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 22:50:21.969782 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968701 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 22:50:21.969782 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968703 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 22:50:21.969782 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968706 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 22:50:21.969782 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968709 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 22:50:21.969782 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968712 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 22:50:21.969782 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968714 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 22:50:21.969782 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968716 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 22:50:21.969782 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968720 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 22:50:21.969782 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968722 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 22:50:21.969782 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968725 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 22:50:21.969782 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968728 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 22:50:21.969782 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968730 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 22:50:21.969782 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968734 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 22:50:21.970263 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968737 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 22:50:21.970263 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968739 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 22:50:21.970263 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968742 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 22:50:21.970263 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968744 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 22:50:21.970263 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968748 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 22:50:21.970263 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968750 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 22:50:21.970263 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968753 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 22:50:21.970263 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968757 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 22:50:21.970263 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968760 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 22:50:21.970263 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968762 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 22:50:21.970263 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968765 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 22:50:21.970263 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968768 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 22:50:21.970263 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968770 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 22:50:21.970263 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968773 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 22:50:21.970263 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968776 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 22:50:21.970263 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968778 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 22:50:21.970263 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968781 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 22:50:21.970263 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968783 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 22:50:21.970263 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968786 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 22:50:21.970263 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968788 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 22:50:21.970769 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968791 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 22:50:21.970769 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968794 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 22:50:21.970769 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968796 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 22:50:21.970769 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968799 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 22:50:21.970769 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968801 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 22:50:21.970769 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968804 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 22:50:21.970769 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968807 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 22:50:21.970769 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968810 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 22:50:21.970769 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968813 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 22:50:21.970769 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.968815 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 22:50:21.971055 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971041 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 22:50:21.971055 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971054 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 22:50:21.971111 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971058 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 22:50:21.971111 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971062 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 03 22:50:21.971111 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971065 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 22:50:21.971111 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971067 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 22:50:21.971111 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971070 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 22:50:21.971111 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971074 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 22:50:21.971111 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971077 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 22:50:21.971111 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971080 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 22:50:21.971111 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971083 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 22:50:21.971111 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971085 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 22:50:21.971111 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971088 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 22:50:21.971111 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971091 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 22:50:21.971111 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971093 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 22:50:21.971111 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971096 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 22:50:21.971111 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971099 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 22:50:21.971111 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971101 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 22:50:21.971111 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971104 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 22:50:21.971111 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971106 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 22:50:21.971111 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971109 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 22:50:21.971111 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971111 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 22:50:21.971717 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971114 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 22:50:21.971717 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971117 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 22:50:21.971717 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971120 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 22:50:21.971717 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971123 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 22:50:21.971717 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971126 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 22:50:21.971717 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971128 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 22:50:21.971717 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971131 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 22:50:21.971717 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971133 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 22:50:21.971717 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971136 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 22:50:21.971717 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971138 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 22:50:21.971717 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971141 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 22:50:21.971717 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971143 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 22:50:21.971717 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971146 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 22:50:21.971717 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971148 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 22:50:21.971717 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971151 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 22:50:21.971717 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971153 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 22:50:21.971717 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971158 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 22:50:21.971717 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971161 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 22:50:21.971717 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971165 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 22:50:21.971717 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971167 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 22:50:21.972270 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971171 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 22:50:21.972270 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971174 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 22:50:21.972270 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971178 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 22:50:21.972270 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971180 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 22:50:21.972270 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971183 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 22:50:21.972270 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971186 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 22:50:21.972270 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971189 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 22:50:21.972270 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971192 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 22:50:21.972270 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971194 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 22:50:21.972270 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971197 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 22:50:21.972270 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971200 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 22:50:21.972270 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971202 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 22:50:21.972270 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971205 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 22:50:21.972270 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971208 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 22:50:21.972270 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971211 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 22:50:21.972270 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971214 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 22:50:21.972270 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971217 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 22:50:21.972270 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971220 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 22:50:21.972270 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971222 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 22:50:21.972767 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971225 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 22:50:21.972767 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971227 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 22:50:21.972767 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971230 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 22:50:21.972767 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971232 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 22:50:21.972767 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971235 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 22:50:21.972767 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971237 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 22:50:21.972767 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971241 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 22:50:21.972767 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971245 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 22:50:21.972767 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971250 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 22:50:21.972767 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971253 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 22:50:21.972767 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971256 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 22:50:21.972767 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971258 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 22:50:21.972767 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971261 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 22:50:21.972767 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971264 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 22:50:21.972767 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971266 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 22:50:21.972767 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971269 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 22:50:21.972767 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971271 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 22:50:21.972767 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971274 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 22:50:21.972767 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971277 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 22:50:21.972767 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971280 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 22:50:21.973259 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971283 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 22:50:21.973259 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971285 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 22:50:21.973259 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971288 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 22:50:21.973259 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971290 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 22:50:21.973259 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971293 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 22:50:21.973259 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971296 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 22:50:21.973259 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971298 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 22:50:21.973259 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971301 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 22:50:21.973259 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971304 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 22:50:21.973259 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971307 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 22:50:21.973259 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971309 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 22:50:21.973259 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971312 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 22:50:21.973259 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971314 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 22:50:21.973259 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971317 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 22:50:21.973259 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971320 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 22:50:21.973259 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971322 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 22:50:21.973259 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971325 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 22:50:21.973259 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971723 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 22:50:21.973259 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971729 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 22:50:21.973259 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971731 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 22:50:21.973766 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971736 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 22:50:21.973766 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971740 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 22:50:21.973766 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971743 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 22:50:21.973766 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971746 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 22:50:21.973766 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971749 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 22:50:21.973766 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971752 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 22:50:21.973766 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971755 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 22:50:21.973766 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971758 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 22:50:21.973766 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971761 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 22:50:21.973766 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971763 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 22:50:21.973766 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971766 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 22:50:21.973766 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971769 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 22:50:21.973766 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971771 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 22:50:21.973766 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971774 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 22:50:21.973766 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971777 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 22:50:21.973766 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971779 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 22:50:21.973766 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971786 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 22:50:21.973766 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971789 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 22:50:21.973766 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971791 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 22:50:21.974229 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971794 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 22:50:21.974229 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971796 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 22:50:21.974229 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971799 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 22:50:21.974229 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971802 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 22:50:21.974229 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971804 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 22:50:21.974229 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971807 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 22:50:21.974229 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971810 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 22:50:21.974229 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971813 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 22:50:21.974229 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971815 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 22:50:21.974229 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971818 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 22:50:21.974229 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971822 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 22:50:21.974229 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971825 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 22:50:21.974229 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971828 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 22:50:21.974229 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971833 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 22:50:21.974229 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971836 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 22:50:21.974229 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971839 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 22:50:21.974229 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971842 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 22:50:21.974229 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971845 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 22:50:21.974229 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971848 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 22:50:21.974229 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971851 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 22:50:21.974751 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971854 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 22:50:21.974751 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971857 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 22:50:21.974751 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971860 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 22:50:21.974751 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971862 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 22:50:21.974751 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971865 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 22:50:21.974751 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971868 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 22:50:21.974751 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971870 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 22:50:21.974751 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971873 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 22:50:21.974751 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971875 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 22:50:21.974751 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971880 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 22:50:21.974751 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971882 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 22:50:21.974751 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971885 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 22:50:21.974751 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971888 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 22:50:21.974751 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971890 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 22:50:21.974751 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971893 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 22:50:21.974751 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971896 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 22:50:21.974751 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971898 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 22:50:21.974751 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971901 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 03 22:50:21.974751 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971904 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 22:50:21.975198 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971906 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 22:50:21.975198 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971909 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 22:50:21.975198 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971911 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 22:50:21.975198 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971914 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 22:50:21.975198 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971917 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 22:50:21.975198 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971919 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 22:50:21.975198 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971922 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 22:50:21.975198 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971924 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 22:50:21.975198 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971926 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 22:50:21.975198 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971929 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 22:50:21.975198 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971931 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 22:50:21.975198 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971934 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 22:50:21.975198 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971937 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 22:50:21.975198 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971939 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 22:50:21.975198 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971942 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 22:50:21.975198 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971944 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 22:50:21.975198 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971947 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 22:50:21.975198 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971950 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 22:50:21.975198 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971953 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 22:50:21.975198 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971955 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 22:50:21.975689 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971957 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 22:50:21.975689 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971960 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 22:50:21.975689 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971964 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 22:50:21.975689 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971966 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 22:50:21.975689 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971969 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 22:50:21.975689 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971972 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 22:50:21.975689 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971974 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 22:50:21.975689 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971977 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 22:50:21.975689 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971979 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 22:50:21.975689 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971982 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 22:50:21.975689 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971985 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 22:50:21.975689 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971988 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 22:50:21.975689 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971990 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 22:50:21.975689 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971993 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 22:50:21.975689 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971995 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 22:50:21.975689 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.971998 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 22:50:21.975689 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972001 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 22:50:21.975689 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972078 2576 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 22:50:21.975689 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972085 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 22:50:21.975689 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972091 2576 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 22:50:21.975689 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972096 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 22:50:21.976229 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972102 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 22:50:21.976229 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972107 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 22:50:21.976229 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972113 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 22:50:21.976229 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972119 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 22:50:21.976229 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972125 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 22:50:21.976229 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972130 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 22:50:21.976229 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972134 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 22:50:21.976229 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972137 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 22:50:21.976229 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972141 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 22:50:21.976229 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972144 2576 flags.go:64] FLAG: --cgroup-root="" Jun 03 22:50:21.976229 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972147 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 22:50:21.976229 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972150 2576 flags.go:64] FLAG: --client-ca-file="" Jun 03 22:50:21.976229 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972153 2576 flags.go:64] FLAG: --cloud-provider="external" Jun 03 22:50:21.976229 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972158 2576 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 22:50:21.976229 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972161 2576 flags.go:64] FLAG: --cluster-domain="" Jun 03 22:50:21.976229 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972164 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 22:50:21.976229 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972167 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 03 22:50:21.976229 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972170 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 22:50:21.976229 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972174 2576 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 22:50:21.976229 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972178 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 22:50:21.976229 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972181 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 22:50:21.976229 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972184 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 22:50:21.976229 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972187 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 22:50:21.976801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972191 2576 flags.go:64] FLAG: --contention-profiling="false" Jun 03 22:50:21.976801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972193 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 22:50:21.976801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972197 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 22:50:21.976801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972201 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 22:50:21.976801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972204 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 22:50:21.976801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972208 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 22:50:21.976801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972211 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 22:50:21.976801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972214 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 22:50:21.976801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972218 2576 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 22:50:21.976801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972221 2576 flags.go:64] FLAG: --enable-server="true" Jun 03 22:50:21.976801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972223 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 22:50:21.976801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972227 2576 flags.go:64] FLAG: --event-burst="100" Jun 03 22:50:21.976801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972231 2576 flags.go:64] FLAG: --event-qps="50" Jun 03 22:50:21.976801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972233 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 22:50:21.976801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972237 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 22:50:21.976801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972240 2576 flags.go:64] FLAG: --eviction-hard="" Jun 03 22:50:21.976801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972244 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 22:50:21.976801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972247 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 22:50:21.976801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972250 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 22:50:21.976801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972253 2576 flags.go:64] FLAG: --eviction-soft="" Jun 03 22:50:21.976801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972256 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 22:50:21.976801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972259 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 22:50:21.976801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972263 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 22:50:21.976801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972266 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 22:50:21.976801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972269 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 22:50:21.977419 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972272 2576 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 22:50:21.977419 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972279 2576 flags.go:64] FLAG: --feature-gates="" Jun 03 22:50:21.977419 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972284 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 22:50:21.977419 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972287 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 22:50:21.977419 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972290 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 22:50:21.977419 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972293 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 22:50:21.977419 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972298 2576 flags.go:64] FLAG: --healthz-port="10248" Jun 03 22:50:21.977419 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972301 2576 flags.go:64] FLAG: --help="false" Jun 03 22:50:21.977419 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972305 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-140-99.ec2.internal" Jun 03 22:50:21.977419 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972308 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 22:50:21.977419 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972311 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 22:50:21.977419 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972314 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 22:50:21.977419 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972317 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 22:50:21.977419 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972321 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 22:50:21.977419 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972324 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 22:50:21.977419 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972326 2576 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 22:50:21.977419 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972330 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 22:50:21.977419 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972332 2576 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 22:50:21.977419 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972335 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 22:50:21.977419 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972338 2576 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 22:50:21.977419 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972342 2576 flags.go:64] FLAG: --kube-reserved="" Jun 03 22:50:21.977419 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972344 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 22:50:21.977419 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972348 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 22:50:21.977419 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972351 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 22:50:21.978036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972354 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 22:50:21.978036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972357 2576 flags.go:64] FLAG: --lock-file="" Jun 03 22:50:21.978036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972360 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 22:50:21.978036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972363 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 22:50:21.978036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972366 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 22:50:21.978036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972372 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 22:50:21.978036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972375 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 22:50:21.978036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972378 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 22:50:21.978036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972380 2576 flags.go:64] FLAG: --logging-format="text" Jun 03 22:50:21.978036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972383 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 22:50:21.978036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972386 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 22:50:21.978036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972389 2576 flags.go:64] FLAG: --manifest-url="" Jun 03 22:50:21.978036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972392 2576 flags.go:64] FLAG: --manifest-url-header="" Jun 03 22:50:21.978036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972396 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 22:50:21.978036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972404 2576 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 22:50:21.978036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972408 2576 flags.go:64] FLAG: --max-pods="110" Jun 03 22:50:21.978036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972411 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 22:50:21.978036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972414 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 22:50:21.978036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972417 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 22:50:21.978036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972420 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 22:50:21.978036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972423 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 22:50:21.978036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972425 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 22:50:21.978036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972429 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 22:50:21.978036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972436 2576 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 22:50:21.978036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972439 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 22:50:21.978660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972442 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 22:50:21.978660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972445 2576 flags.go:64] FLAG: --pod-cidr="" Jun 03 22:50:21.978660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972448 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 03 22:50:21.978660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972454 2576 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 22:50:21.978660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972457 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 22:50:21.978660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972461 2576 flags.go:64] FLAG: --pods-per-core="0" Jun 03 22:50:21.978660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972464 2576 flags.go:64] FLAG: --port="10250" Jun 03 22:50:21.978660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972467 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 22:50:21.978660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972470 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06d1a7e4bab6e5722" Jun 03 22:50:21.978660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972473 2576 flags.go:64] FLAG: --qos-reserved="" Jun 03 22:50:21.978660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972476 2576 flags.go:64] FLAG: --read-only-port="10255" Jun 03 22:50:21.978660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972479 2576 flags.go:64] FLAG: --register-node="true" Jun 03 22:50:21.978660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972482 2576 flags.go:64] FLAG: --register-with-taints="" Jun 03 22:50:21.978660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972486 2576 flags.go:64] FLAG: --registry-burst="10" Jun 03 22:50:21.978660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972489 2576 flags.go:64] FLAG: --registry-qps="5" Jun 03 22:50:21.978660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972491 2576 flags.go:64] FLAG: --reserved-cpus="" Jun 03 22:50:21.978660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972494 2576 flags.go:64] FLAG: --reserved-memory="" Jun 03 22:50:21.978660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972499 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 22:50:21.978660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972502 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 22:50:21.978660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972517 2576 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 22:50:21.978660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972520 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 22:50:21.978660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972526 2576 flags.go:64] FLAG: --runonce="false" Jun 03 22:50:21.978660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972529 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 22:50:21.978660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972532 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 22:50:21.978660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972535 2576 flags.go:64] FLAG: --seccomp-default="false" Jun 03 22:50:21.979324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972538 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 22:50:21.979324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972541 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 22:50:21.979324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972544 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 22:50:21.979324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972547 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 22:50:21.979324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972550 2576 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 22:50:21.979324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972553 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 22:50:21.979324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972556 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 22:50:21.979324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972559 2576 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 22:50:21.979324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972562 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 22:50:21.979324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972565 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 22:50:21.979324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972568 2576 flags.go:64] FLAG: --system-cgroups="" Jun 03 22:50:21.979324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972571 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 22:50:21.979324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972576 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 22:50:21.979324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972579 2576 flags.go:64] FLAG: --tls-cert-file="" Jun 03 22:50:21.979324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972582 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 22:50:21.979324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972586 2576 flags.go:64] FLAG: --tls-min-version="" Jun 03 22:50:21.979324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972588 2576 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 22:50:21.979324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972591 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 22:50:21.979324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972594 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 22:50:21.979324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972597 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 22:50:21.979324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972600 2576 flags.go:64] FLAG: --v="2" Jun 03 22:50:21.979324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972604 2576 flags.go:64] FLAG: --version="false" Jun 03 22:50:21.979324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972608 2576 flags.go:64] FLAG: --vmodule="" Jun 03 22:50:21.979324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972611 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 22:50:21.979324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.972615 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 22:50:21.980017 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972732 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 22:50:21.980017 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972736 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 22:50:21.980017 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972739 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 22:50:21.980017 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972744 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 22:50:21.980017 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972747 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 22:50:21.980017 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972749 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 22:50:21.980017 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972753 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 22:50:21.980017 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972757 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 22:50:21.980017 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972760 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 22:50:21.980017 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972763 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 22:50:21.980017 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972766 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 22:50:21.980017 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972769 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 22:50:21.980017 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972771 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 22:50:21.980017 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972774 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 22:50:21.980017 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972777 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 22:50:21.980017 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972779 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 22:50:21.980017 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972782 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 22:50:21.980017 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972785 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 22:50:21.980017 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972787 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 22:50:21.980792 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972790 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 22:50:21.980792 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972793 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 22:50:21.980792 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972795 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 22:50:21.980792 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972799 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 22:50:21.980792 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972801 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 22:50:21.980792 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972804 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 22:50:21.980792 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972806 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 22:50:21.980792 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972809 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 03 22:50:21.980792 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972811 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 22:50:21.980792 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972814 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 22:50:21.980792 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972816 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 22:50:21.980792 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972819 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 22:50:21.980792 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972821 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 22:50:21.980792 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972825 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 22:50:21.980792 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972828 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 22:50:21.980792 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972831 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 22:50:21.980792 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972835 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 22:50:21.980792 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972837 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 22:50:21.980792 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972840 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 22:50:21.981412 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972843 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 22:50:21.981412 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972845 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 22:50:21.981412 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972848 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 22:50:21.981412 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972850 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 22:50:21.981412 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972853 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 22:50:21.981412 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972855 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 22:50:21.981412 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972858 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 22:50:21.981412 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972860 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 22:50:21.981412 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972863 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 22:50:21.981412 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972865 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 22:50:21.981412 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972868 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 22:50:21.981412 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972870 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 22:50:21.981412 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972873 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 22:50:21.981412 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972875 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 22:50:21.981412 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972878 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 22:50:21.981412 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972880 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 22:50:21.981412 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972883 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 22:50:21.981412 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972886 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 22:50:21.981412 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972888 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 22:50:21.981412 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972891 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 22:50:21.981926 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972895 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 22:50:21.981926 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972897 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 22:50:21.981926 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972900 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 22:50:21.981926 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972902 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 22:50:21.981926 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972905 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 22:50:21.981926 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972907 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 22:50:21.981926 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972910 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 22:50:21.981926 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972913 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 22:50:21.981926 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972916 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 22:50:21.981926 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972919 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 22:50:21.981926 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972922 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 22:50:21.981926 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972924 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 22:50:21.981926 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972927 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 22:50:21.981926 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972931 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 22:50:21.981926 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972934 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 22:50:21.981926 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972937 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 22:50:21.981926 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972940 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 22:50:21.981926 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972943 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 22:50:21.981926 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972946 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 22:50:21.981926 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972949 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 22:50:21.982455 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972951 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 22:50:21.982455 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972954 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 22:50:21.982455 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972956 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 22:50:21.982455 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972959 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 22:50:21.982455 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972961 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 22:50:21.982455 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972964 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 22:50:21.982455 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972966 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 22:50:21.982455 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972969 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 22:50:21.982455 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972971 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 22:50:21.982455 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972974 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 22:50:21.982455 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972977 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 22:50:21.982455 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972979 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 22:50:21.982455 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972983 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 22:50:21.982455 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972986 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 22:50:21.982455 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972988 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 22:50:21.982455 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972991 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 22:50:21.982455 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972993 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 22:50:21.982455 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972996 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 22:50:21.982455 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.972998 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 22:50:21.982455 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.973001 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 22:50:21.982954 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.973599 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 22:50:21.982954 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.981616 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 03 22:50:21.982954 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.981633 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 22:50:21.982954 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.981648 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 03 22:50:21.982954 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.981654 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 22:50:21.982954 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981713 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 03 22:50:21.982954 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981717 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 22:50:21.982954 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981721 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 22:50:21.982954 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981724 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 22:50:21.982954 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981728 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 22:50:21.982954 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981732 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 22:50:21.982954 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981735 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 22:50:21.982954 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981737 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 22:50:21.982954 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981740 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 22:50:21.982954 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981743 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 22:50:21.983326 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981746 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 22:50:21.983326 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981750 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 22:50:21.983326 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981754 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 22:50:21.983326 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981758 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 22:50:21.983326 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981760 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 22:50:21.983326 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981763 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 22:50:21.983326 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981766 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 22:50:21.983326 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981769 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 22:50:21.983326 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981772 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 22:50:21.983326 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981775 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 22:50:21.983326 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981779 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 22:50:21.983326 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981782 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 22:50:21.983326 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981785 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 22:50:21.983326 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981788 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 22:50:21.983326 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981791 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 22:50:21.983326 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981793 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 22:50:21.983326 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981796 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 22:50:21.983326 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981799 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 22:50:21.983326 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981812 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 22:50:21.983326 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981815 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 22:50:21.983831 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981818 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 22:50:21.983831 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981821 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 22:50:21.983831 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981823 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 22:50:21.983831 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981826 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 22:50:21.983831 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981829 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 22:50:21.983831 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981831 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 22:50:21.983831 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981834 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 22:50:21.983831 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981837 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 22:50:21.983831 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981839 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 22:50:21.983831 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981844 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 22:50:21.983831 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981847 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 22:50:21.983831 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981850 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 22:50:21.983831 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981854 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 22:50:21.983831 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981857 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 22:50:21.983831 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981860 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 22:50:21.983831 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981863 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 22:50:21.983831 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981865 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 22:50:21.983831 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981868 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 22:50:21.983831 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981871 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 22:50:21.984283 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981874 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 22:50:21.984283 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981877 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 22:50:21.984283 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981880 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 22:50:21.984283 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981883 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 22:50:21.984283 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981885 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 22:50:21.984283 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981889 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 22:50:21.984283 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981891 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 22:50:21.984283 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981894 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 22:50:21.984283 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981897 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 22:50:21.984283 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981899 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 22:50:21.984283 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981902 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 22:50:21.984283 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981906 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 22:50:21.984283 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981910 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 22:50:21.984283 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981913 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 22:50:21.984283 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981916 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 22:50:21.984283 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981919 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 22:50:21.984283 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981921 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 22:50:21.984283 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981924 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 22:50:21.984283 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981926 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 22:50:21.984283 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981929 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 22:50:21.984861 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981932 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 22:50:21.984861 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981935 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 22:50:21.984861 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981938 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 22:50:21.984861 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981941 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 22:50:21.984861 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981944 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 22:50:21.984861 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981946 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 22:50:21.984861 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981949 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 22:50:21.984861 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981952 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 22:50:21.984861 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981955 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 22:50:21.984861 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981957 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 22:50:21.984861 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981960 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 22:50:21.984861 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981963 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 22:50:21.984861 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981966 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 22:50:21.984861 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981969 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 22:50:21.984861 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981971 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 22:50:21.984861 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981974 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 22:50:21.984861 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981977 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 22:50:21.984861 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981980 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 22:50:21.984861 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981982 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 22:50:21.985327 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981985 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 22:50:21.985327 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981988 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 22:50:21.985327 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981990 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 22:50:21.985327 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981993 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 22:50:21.985327 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981996 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 22:50:21.985327 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.981998 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 22:50:21.985327 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982001 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 22:50:21.985327 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982003 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 22:50:21.985327 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982006 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 22:50:21.985327 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982009 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 22:50:21.985327 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.982014 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 22:50:21.985327 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982132 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 22:50:21.985327 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982138 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 22:50:21.985327 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982140 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 22:50:21.985327 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982144 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 22:50:21.985722 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982146 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 22:50:21.985722 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982149 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 22:50:21.985722 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982152 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 22:50:21.985722 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982154 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 22:50:21.985722 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982157 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 22:50:21.985722 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982160 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 22:50:21.985722 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982162 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 22:50:21.985722 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982165 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 22:50:21.985722 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982167 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 22:50:21.985722 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982171 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 22:50:21.985722 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982173 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 22:50:21.985722 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982176 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 22:50:21.985722 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982179 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 22:50:21.985722 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982182 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 22:50:21.985722 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982185 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 22:50:21.985722 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982187 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 22:50:21.985722 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982190 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 22:50:21.985722 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982193 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 22:50:21.985722 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982195 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 22:50:21.985722 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982198 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 22:50:21.986202 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982200 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 22:50:21.986202 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982203 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 22:50:21.986202 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982206 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 22:50:21.986202 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982208 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 22:50:21.986202 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982211 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 22:50:21.986202 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982213 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 22:50:21.986202 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982216 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 22:50:21.986202 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982218 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 22:50:21.986202 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982221 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 22:50:21.986202 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982224 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 22:50:21.986202 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982226 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 22:50:21.986202 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982229 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 22:50:21.986202 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982232 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 22:50:21.986202 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982234 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 22:50:21.986202 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982237 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 22:50:21.986202 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982239 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 22:50:21.986202 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982242 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 22:50:21.986202 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982244 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 22:50:21.986202 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982247 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 22:50:21.986202 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982249 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 22:50:21.986691 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982252 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 22:50:21.986691 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982255 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 22:50:21.986691 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982258 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 22:50:21.986691 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982261 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 22:50:21.986691 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982264 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 22:50:21.986691 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982267 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 22:50:21.986691 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982270 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 22:50:21.986691 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982272 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 22:50:21.986691 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982275 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 22:50:21.986691 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982277 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 22:50:21.986691 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982280 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 22:50:21.986691 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982282 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 22:50:21.986691 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982285 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 22:50:21.986691 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982289 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 22:50:21.986691 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982292 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 22:50:21.986691 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982295 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 22:50:21.986691 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982298 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 03 22:50:21.986691 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982301 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 22:50:21.986691 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982303 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 22:50:21.987154 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982306 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 22:50:21.987154 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982310 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 22:50:21.987154 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982313 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 22:50:21.987154 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982316 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 22:50:21.987154 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982319 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 22:50:21.987154 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982321 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 22:50:21.987154 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982324 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 22:50:21.987154 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982327 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 22:50:21.987154 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982329 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 22:50:21.987154 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982333 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 22:50:21.987154 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982337 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 22:50:21.987154 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982340 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 22:50:21.987154 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982343 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 22:50:21.987154 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982345 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 22:50:21.987154 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982348 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 22:50:21.987154 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982350 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 22:50:21.987154 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982353 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 22:50:21.987154 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982358 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 22:50:21.987154 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982361 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 22:50:21.987627 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982365 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 22:50:21.987627 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982368 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 22:50:21.987627 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982371 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 22:50:21.987627 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982374 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 22:50:21.987627 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982377 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 22:50:21.987627 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982380 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 22:50:21.987627 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982383 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 22:50:21.987627 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982386 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 22:50:21.987627 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982389 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 22:50:21.987627 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982392 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 22:50:21.987627 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982395 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 22:50:21.987627 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982397 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 22:50:21.987627 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982400 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 22:50:21.987627 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982403 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 22:50:21.987627 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982406 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 22:50:21.987627 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:21.982409 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 22:50:21.988057 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.982414 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 22:50:21.988057 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.982552 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 22:50:21.988057 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.985390 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 22:50:21.988057 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.986888 2576 server.go:1019] "Starting client certificate rotation" Jun 03 22:50:21.988057 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.986982 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 22:50:21.988057 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.987021 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 22:50:21.989345 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.989331 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 22:50:21.990490 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.990471 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 22:50:21.996727 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.996710 2576 log.go:25] "Validated CRI v1 runtime API" Jun 03 22:50:21.999808 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:21.999795 2576 log.go:25] "Validated CRI v1 image API" Jun 03 22:50:22.000658 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.000643 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 22:50:22.004754 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.004716 2576 fs.go:135] Filesystem UUIDs: map[0f9de69a-dea6-4e28-9dd3-6bf3fc8c8a71:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b6bd47bf-a374-4cdb-aa19-a70852f7382b:/dev/nvme0n1p4] Jun 03 22:50:22.004831 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.004750 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 22:50:22.011064 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.010937 2576 manager.go:216] Machine: {Timestamp:2026-06-03 22:50:22.00953934 +0000 UTC m=+0.348191821 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099775 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25740346018f47a61f256a57c71121 SystemUUID:ec257403-4601-8f47-a61f-256a57c71121 BootID:23f5ac9c-082a-43c6-ad3c-41788e5c8af1 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e7:86:a7:db:45 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e7:86:a7:db:45 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:c0:cd:9b:fb:ac Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 22:50:22.011064 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.011057 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 22:50:22.011188 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.011173 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 22:50:22.014253 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.014226 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 22:50:22.014769 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.014257 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-99.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 22:50:22.015285 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.015275 2576 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 22:50:22.015319 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.015288 2576 container_manager_linux.go:309] "Creating device plugin manager" Jun 03 22:50:22.015319 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.015296 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 22:50:22.015836 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.015825 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 22:50:22.017142 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.017132 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 03 22:50:22.020205 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.020192 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 03 22:50:22.020316 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.020306 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 03 22:50:22.020354 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.020334 2576 kubelet.go:486] "Attempting to sync node with API server" Jun 03 22:50:22.020354 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.020344 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 22:50:22.020423 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.020358 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 22:50:22.020423 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.020370 2576 kubelet.go:398] "Adding apiserver pod source" Jun 03 22:50:22.020423 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.020380 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 22:50:22.021025 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.020994 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 22:50:22.021124 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.021038 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 22:50:22.022105 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.022083 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 22:50:22.024402 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.024379 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 03 22:50:22.025787 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.025773 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 22:50:22.025841 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.025803 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 03 22:50:22.026925 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.026912 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 22:50:22.027000 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.026929 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 22:50:22.027000 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.026935 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 22:50:22.027000 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.026941 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 22:50:22.027000 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.026950 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 22:50:22.027000 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.026956 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 22:50:22.027000 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.026964 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 22:50:22.027000 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.026970 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 22:50:22.027000 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.026977 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 22:50:22.027000 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.026982 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 22:50:22.027000 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.026990 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 22:50:22.027000 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.026995 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 22:50:22.027710 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.027699 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 22:50:22.027710 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.027711 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 22:50:22.031176 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.031162 2576 server.go:1268] "Started kubelet" Jun 03 22:50:22.031300 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.031247 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 22:50:22.031356 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.031269 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 22:50:22.031356 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.031328 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 03 22:50:22.031740 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:22.031712 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 22:50:22.031841 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:22.031779 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-99.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 22:50:22.031841 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.031810 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-99.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 22:50:22.032124 ip-10-0-140-99 systemd[1]: Started Kubernetes Kubelet. Jun 03 22:50:22.032702 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.032559 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 22:50:22.033469 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.033457 2576 server.go:310] "Adding debug handlers to kubelet server" Jun 03 22:50:22.038835 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:22.038797 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 22:50:22.039200 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.039180 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 22:50:22.039200 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.039191 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 22:50:22.039351 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:22.039251 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-99.ec2.internal\" not found" Jun 03 22:50:22.039966 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.039842 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 03 22:50:22.039966 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.039859 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 03 22:50:22.039966 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.039870 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 03 22:50:22.040142 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.039969 2576 reconstruct.go:97] "Volume reconstruction finished" Jun 03 22:50:22.040142 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.039981 2576 reconciler.go:29] "Reconciler: start to sync state" Jun 03 22:50:22.040142 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:22.039110 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-99.ec2.internal.18b5b3e495265be0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-99.ec2.internal,UID:ip-10-0-140-99.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-99.ec2.internal,},FirstTimestamp:2026-06-03 22:50:22.031133664 +0000 UTC m=+0.369786143,LastTimestamp:2026-06-03 22:50:22.031133664 +0000 UTC m=+0.369786143,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-99.ec2.internal,}" Jun 03 22:50:22.040291 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.040192 2576 factory.go:55] Registering systemd factory Jun 03 22:50:22.040291 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.040244 2576 factory.go:223] Registration of the systemd container factory successfully Jun 03 22:50:22.040476 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.040458 2576 factory.go:153] Registering CRI-O factory Jun 03 22:50:22.040476 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.040480 2576 factory.go:223] Registration of the crio container factory successfully Jun 03 22:50:22.040655 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.040545 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 22:50:22.040655 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.040566 2576 factory.go:103] Registering Raw factory Jun 03 22:50:22.040655 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.040577 2576 manager.go:1196] Started watching for new ooms in manager Jun 03 22:50:22.040914 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.040899 2576 manager.go:349] Starting recovery of all containers Jun 03 22:50:22.042167 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:22.042145 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 22:50:22.042255 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:22.042230 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-99.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 22:50:22.049013 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.048975 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rdz4v" Jun 03 22:50:22.052113 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.052095 2576 manager.go:354] Recovery completed Jun 03 22:50:22.055407 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.055289 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rdz4v" Jun 03 22:50:22.056608 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.056592 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 22:50:22.058557 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.058537 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-99.ec2.internal" event="NodeHasSufficientMemory" Jun 03 22:50:22.058634 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.058569 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-99.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 22:50:22.058634 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.058579 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-99.ec2.internal" event="NodeHasSufficientPID" Jun 03 22:50:22.059165 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.059141 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 22:50:22.059165 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.059153 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 22:50:22.059165 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.059157 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 22:50:22.059269 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.059174 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 03 22:50:22.059825 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.059811 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-99.ec2.internal" event="NodeHasSufficientMemory" Jun 03 22:50:22.059875 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.059836 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-99.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 22:50:22.059875 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.059848 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-99.ec2.internal" event="NodeHasSufficientPID" Jun 03 22:50:22.060331 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.060320 2576 policy_none.go:49] "None policy: Start" Jun 03 22:50:22.060364 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.060336 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 03 22:50:22.060364 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.060346 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 03 22:50:22.060761 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:22.060698 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-99.ec2.internal.18b5b3e496c8c6a2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-99.ec2.internal,UID:ip-10-0-140-99.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-99.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-99.ec2.internal,},FirstTimestamp:2026-06-03 22:50:22.058555042 +0000 UTC m=+0.397207520,LastTimestamp:2026-06-03 22:50:22.058555042 +0000 UTC m=+0.397207520,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-99.ec2.internal,}" Jun 03 22:50:22.061347 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.061334 2576 policy_none.go:47] "Start" Jun 03 22:50:22.097362 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.097344 2576 manager.go:337] "Starting Device Plugin manager" Jun 03 22:50:22.112062 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:22.097385 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 22:50:22.112062 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.097398 2576 server.go:87] "Starting device plugin registration server" Jun 03 22:50:22.112062 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.097718 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 22:50:22.112062 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.097734 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 22:50:22.112062 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.097822 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 22:50:22.112062 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.097907 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 22:50:22.112062 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.097916 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 22:50:22.112062 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:22.098575 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 22:50:22.112062 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:22.098629 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-99.ec2.internal\" not found" Jun 03 22:50:22.112062 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.109321 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 03 22:50:22.112062 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.110583 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 03 22:50:22.112062 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.110620 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 03 22:50:22.112062 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.110641 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jun 03 22:50:22.112062 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:22.110675 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 22:50:22.112942 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.112919 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 22:50:22.198827 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.198797 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 22:50:22.200259 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.200244 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-99.ec2.internal" event="NodeHasSufficientMemory" Jun 03 22:50:22.200330 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.200276 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-99.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 22:50:22.200330 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.200290 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-99.ec2.internal" event="NodeHasSufficientPID" Jun 03 22:50:22.200330 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.200319 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-99.ec2.internal" Jun 03 22:50:22.210483 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.210456 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-99.ec2.internal" Jun 03 22:50:22.210483 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:22.210485 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-99.ec2.internal\": node \"ip-10-0-140-99.ec2.internal\" not found" Jun 03 22:50:22.211680 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.211662 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-99.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-99.ec2.internal"] Jun 03 22:50:22.211733 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.211724 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 22:50:22.213184 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.213132 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-99.ec2.internal" event="NodeHasSufficientMemory" Jun 03 22:50:22.213184 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.213163 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-99.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 22:50:22.213184 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.213178 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-99.ec2.internal" event="NodeHasSufficientPID" Jun 03 22:50:22.214573 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.214558 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 22:50:22.214668 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.214650 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-99.ec2.internal" Jun 03 22:50:22.214724 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.214691 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 22:50:22.215191 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.215175 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-99.ec2.internal" event="NodeHasSufficientMemory" Jun 03 22:50:22.215270 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.215205 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-99.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 22:50:22.215270 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.215220 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-99.ec2.internal" event="NodeHasSufficientPID" Jun 03 22:50:22.215270 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.215266 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-99.ec2.internal" event="NodeHasSufficientMemory" Jun 03 22:50:22.215365 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.215290 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-99.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 22:50:22.215365 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.215302 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-99.ec2.internal" event="NodeHasSufficientPID" Jun 03 22:50:22.216403 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.216389 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-99.ec2.internal" Jun 03 22:50:22.216471 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.216414 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 22:50:22.217057 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.217043 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-99.ec2.internal" event="NodeHasSufficientMemory" Jun 03 22:50:22.217122 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.217070 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-99.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 22:50:22.217122 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.217080 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-99.ec2.internal" event="NodeHasSufficientPID" Jun 03 22:50:22.231088 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:22.231067 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-99.ec2.internal\" not found" Jun 03 22:50:22.241160 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.241135 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/035ccae58eace2196efa696fcb7949ab-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-99.ec2.internal\" (UID: \"035ccae58eace2196efa696fcb7949ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-99.ec2.internal" Jun 03 22:50:22.241236 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.241170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/035ccae58eace2196efa696fcb7949ab-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-99.ec2.internal\" (UID: \"035ccae58eace2196efa696fcb7949ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-99.ec2.internal" Jun 03 22:50:22.241236 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.241212 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4aed52c4997e28f083b4c99b8beb1110-config\") pod \"kube-apiserver-proxy-ip-10-0-140-99.ec2.internal\" (UID: \"4aed52c4997e28f083b4c99b8beb1110\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-99.ec2.internal" Jun 03 22:50:22.241320 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:22.241281 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-99.ec2.internal\" not found" node="ip-10-0-140-99.ec2.internal" Jun 03 22:50:22.245685 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:22.245667 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-99.ec2.internal\" not found" node="ip-10-0-140-99.ec2.internal" Jun 03 22:50:22.331845 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:22.331811 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-99.ec2.internal\" not found" Jun 03 22:50:22.341734 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.341698 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/035ccae58eace2196efa696fcb7949ab-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-99.ec2.internal\" (UID: \"035ccae58eace2196efa696fcb7949ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-99.ec2.internal" Jun 03 22:50:22.341825 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.341737 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/035ccae58eace2196efa696fcb7949ab-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-99.ec2.internal\" (UID: \"035ccae58eace2196efa696fcb7949ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-99.ec2.internal" Jun 03 22:50:22.341825 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.341763 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4aed52c4997e28f083b4c99b8beb1110-config\") pod \"kube-apiserver-proxy-ip-10-0-140-99.ec2.internal\" (UID: \"4aed52c4997e28f083b4c99b8beb1110\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-99.ec2.internal" Jun 03 22:50:22.341825 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.341791 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4aed52c4997e28f083b4c99b8beb1110-config\") pod \"kube-apiserver-proxy-ip-10-0-140-99.ec2.internal\" (UID: \"4aed52c4997e28f083b4c99b8beb1110\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-99.ec2.internal" Jun 03 22:50:22.341825 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.341792 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/035ccae58eace2196efa696fcb7949ab-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-99.ec2.internal\" (UID: \"035ccae58eace2196efa696fcb7949ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-99.ec2.internal" Jun 03 22:50:22.341825 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.341799 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/035ccae58eace2196efa696fcb7949ab-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-99.ec2.internal\" (UID: \"035ccae58eace2196efa696fcb7949ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-99.ec2.internal" Jun 03 22:50:22.432444 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:22.432411 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-99.ec2.internal\" not found" Jun 03 22:50:22.533253 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:22.533182 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-99.ec2.internal\" not found" Jun 03 22:50:22.544686 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.544659 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-99.ec2.internal" Jun 03 22:50:22.549378 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.549360 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-99.ec2.internal" Jun 03 22:50:22.633989 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:22.633951 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-99.ec2.internal\" not found" Jun 03 22:50:22.734526 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:22.734479 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-99.ec2.internal\" not found" Jun 03 22:50:22.835108 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:22.835024 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-99.ec2.internal\" not found" Jun 03 22:50:22.935568 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:22.935528 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-99.ec2.internal\" not found" Jun 03 22:50:22.987030 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.987002 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 22:50:22.987686 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.987167 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 22:50:22.996599 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:22.996576 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 22:50:23.036171 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:23.036099 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-99.ec2.internal\" not found" Jun 03 22:50:23.043185 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:23.043158 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aed52c4997e28f083b4c99b8beb1110.slice/crio-0ad571d4e925d5ba68224c706c2d76d75d62d5202ef497cd51cfc827b803a2ee WatchSource:0}: Error finding container 0ad571d4e925d5ba68224c706c2d76d75d62d5202ef497cd51cfc827b803a2ee: Status 404 returned error can't find the container with id 0ad571d4e925d5ba68224c706c2d76d75d62d5202ef497cd51cfc827b803a2ee Jun 03 22:50:23.043589 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:23.043565 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod035ccae58eace2196efa696fcb7949ab.slice/crio-4d3df94ea800fc6489e6ba27addf6ad93c1676dd600ca460c349a86209f2cdf8 WatchSource:0}: Error finding container 4d3df94ea800fc6489e6ba27addf6ad93c1676dd600ca460c349a86209f2cdf8: Status 404 returned error can't find the container with id 4d3df94ea800fc6489e6ba27addf6ad93c1676dd600ca460c349a86209f2cdf8 Jun 03 22:50:23.048060 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:23.048046 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 22:50:23.057977 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:23.057946 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 22:45:22 +0000 UTC" deadline="2027-12-26 11:12:48.704831416 +0000 UTC" Jun 03 22:50:23.057977 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:23.057971 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13692h22m25.646863478s" Jun 03 22:50:23.114171 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:23.114045 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-99.ec2.internal" event={"ID":"4aed52c4997e28f083b4c99b8beb1110","Type":"ContainerStarted","Data":"0ad571d4e925d5ba68224c706c2d76d75d62d5202ef497cd51cfc827b803a2ee"} Jun 03 22:50:23.115131 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:23.115111 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-99.ec2.internal" event={"ID":"035ccae58eace2196efa696fcb7949ab","Type":"ContainerStarted","Data":"4d3df94ea800fc6489e6ba27addf6ad93c1676dd600ca460c349a86209f2cdf8"} Jun 03 22:50:23.136232 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:23.136208 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-99.ec2.internal\" not found" Jun 03 22:50:23.236739 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:23.236691 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-99.ec2.internal\" not found" Jun 03 22:50:23.337274 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:23.337241 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-99.ec2.internal\" not found" Jun 03 22:50:23.437832 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:23.437752 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-99.ec2.internal\" not found" Jun 03 22:50:23.443684 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:23.443655 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 22:50:23.498292 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:23.498258 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 22:50:23.539484 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:23.539458 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-99.ec2.internal" Jun 03 22:50:23.550164 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:23.550137 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 22:50:23.551450 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:23.551425 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-99.ec2.internal" Jun 03 22:50:23.559632 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:23.559606 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 22:50:24.021289 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.021256 2576 apiserver.go:52] "Watching apiserver" Jun 03 22:50:24.025641 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.025615 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 22:50:24.026107 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.026076 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-dzl52","kube-system/kube-apiserver-proxy-ip-10-0-140-99.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt","openshift-dns/node-resolver-6bxfb","openshift-network-diagnostics/network-check-target-k4kx4","openshift-network-operator/iptables-alerter-c9lkz","openshift-ovn-kubernetes/ovnkube-node-vvqlh","kube-system/global-pull-secret-syncer-qd98z","kube-system/konnectivity-agent-qm7pj","openshift-cluster-node-tuning-operator/tuned-2tgsj","openshift-image-registry/node-ca-8s2cb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-99.ec2.internal","openshift-multus/multus-additional-cni-plugins-bspfc","openshift-multus/multus-z5qwm"] Jun 03 22:50:24.027918 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.027897 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.029185 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.029164 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.029903 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.029782 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 22:50:24.029903 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.029832 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g5knq\"" Jun 03 22:50:24.029903 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.029879 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 22:50:24.030117 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.029895 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 22:50:24.030293 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.030275 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 22:50:24.030386 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.030280 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 22:50:24.030656 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.030632 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 22:50:24.030970 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.030949 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 22:50:24.030970 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.030965 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" Jun 03 22:50:24.031190 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.031117 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 22:50:24.031575 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.031556 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 22:50:24.031706 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.031618 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zm4pp\"" Jun 03 22:50:24.031706 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.031689 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 22:50:24.031830 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.031756 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 22:50:24.032334 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.032313 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 22:50:24.032583 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.032566 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6bxfb" Jun 03 22:50:24.033094 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.033059 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 22:50:24.033094 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.033088 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 22:50:24.033237 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.033169 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 22:50:24.033237 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.033212 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8vslx\"" Jun 03 22:50:24.033932 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.033913 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:24.034027 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:24.033989 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k4kx4" podUID="dd58224f-f136-457b-b321-cec8434f3ef4" Jun 03 22:50:24.034093 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.034081 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 22:50:24.034275 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.034255 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 22:50:24.034433 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.034415 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gxqlv\"" Jun 03 22:50:24.035190 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.035170 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c9lkz" Jun 03 22:50:24.036475 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.036432 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qm7pj" Jun 03 22:50:24.038186 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.038161 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 22:50:24.038299 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.038161 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 22:50:24.038357 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.038303 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mjrzd\"" Jun 03 22:50:24.038357 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.038333 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 22:50:24.040106 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.040086 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 22:50:24.040272 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.040253 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 22:50:24.040335 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.040089 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gngxr\"" Jun 03 22:50:24.040867 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.040474 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 22:50:24.040867 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.040568 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:24.040867 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:24.040670 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzl52" podUID="5ba98357-42a7-4e6d-a783-7f58dd6c5ced" Jun 03 22:50:24.041777 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.041753 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.043472 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.043453 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hzwwk\"" Jun 03 22:50:24.043472 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.043462 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 22:50:24.043938 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.043910 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.045274 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.045253 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8r8pj\"" Jun 03 22:50:24.045417 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.045401 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 22:50:24.045565 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.045480 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8s2cb" Jun 03 22:50:24.045898 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.045882 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 22:50:24.046792 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.046773 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:24.046889 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:24.046841 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd98z" podUID="5151c00d-51e2-445a-9ef4-0ee9bf2ac678" Jun 03 22:50:24.046974 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.046956 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 22:50:24.047073 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.047054 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 22:50:24.047223 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.047208 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mjqq4\"" Jun 03 22:50:24.047462 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.047440 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 22:50:24.048776 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.048756 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 22:50:24.051142 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051047 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21456fc8-e4fa-4ff0-8940-b460142a32ae-cni-binary-copy\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.051142 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051083 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-host-var-lib-cni-multus\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.051142 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051112 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1797d0cf-3a7e-47d4-a235-3bc54df20f2b-system-cni-dir\") pod \"multus-additional-cni-plugins-bspfc\" (UID: \"1797d0cf-3a7e-47d4-a235-3bc54df20f2b\") " pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.051325 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051156 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1797d0cf-3a7e-47d4-a235-3bc54df20f2b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bspfc\" (UID: \"1797d0cf-3a7e-47d4-a235-3bc54df20f2b\") " pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.051325 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051190 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c1356fb0-4884-41e6-8d59-fed020dd7a80-ovnkube-script-lib\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.051325 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051214 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5a63252-f62d-4fa6-9514-cac24485d072-tmp-dir\") pod \"node-resolver-6bxfb\" (UID: \"b5a63252-f62d-4fa6-9514-cac24485d072\") " pod="openshift-dns/node-resolver-6bxfb" Jun 03 22:50:24.051325 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051230 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2bef29c-c5da-41c2-b54a-dba7dffd5063-host-slash\") pod \"iptables-alerter-c9lkz\" (UID: \"f2bef29c-c5da-41c2-b54a-dba7dffd5063\") " pod="openshift-network-operator/iptables-alerter-c9lkz" Jun 03 22:50:24.051325 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051251 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-host-run-ovn-kubernetes\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.051325 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051275 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1797d0cf-3a7e-47d4-a235-3bc54df20f2b-cnibin\") pod \"multus-additional-cni-plugins-bspfc\" (UID: \"1797d0cf-3a7e-47d4-a235-3bc54df20f2b\") " pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.051325 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051296 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpmnx\" (UniqueName: \"kubernetes.io/projected/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-kube-api-access-hpmnx\") pod \"network-metrics-daemon-dzl52\" (UID: \"5ba98357-42a7-4e6d-a783-7f58dd6c5ced\") " pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:24.051325 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051317 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-systemd-units\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.051678 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051333 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.051678 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051348 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1797d0cf-3a7e-47d4-a235-3bc54df20f2b-cni-binary-copy\") pod \"multus-additional-cni-plugins-bspfc\" (UID: \"1797d0cf-3a7e-47d4-a235-3bc54df20f2b\") " pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.051678 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051364 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-host-kubelet\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.051678 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051383 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-host-slash\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.051678 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051397 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-var-lib-openvswitch\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.051678 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051411 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-run-openvswitch\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.051678 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051433 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-host-cni-bin\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.051678 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051455 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-cnibin\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.051678 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051473 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/62e72520-69b0-4f77-8c80-e58d0722e825-registration-dir\") pod \"aws-ebs-csi-driver-node-6b7bt\" (UID: \"62e72520-69b0-4f77-8c80-e58d0722e825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" Jun 03 22:50:24.051678 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051488 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9msm\" (UniqueName: \"kubernetes.io/projected/62e72520-69b0-4f77-8c80-e58d0722e825-kube-api-access-c9msm\") pod \"aws-ebs-csi-driver-node-6b7bt\" (UID: \"62e72520-69b0-4f77-8c80-e58d0722e825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" Jun 03 22:50:24.051678 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051502 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-system-cni-dir\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.051678 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051571 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjw4m\" (UniqueName: \"kubernetes.io/projected/b5a63252-f62d-4fa6-9514-cac24485d072-kube-api-access-mjw4m\") pod \"node-resolver-6bxfb\" (UID: \"b5a63252-f62d-4fa6-9514-cac24485d072\") " pod="openshift-dns/node-resolver-6bxfb" Jun 03 22:50:24.051678 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051600 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fe1864d1-7354-440f-b41d-10a0b679eae7-konnectivity-ca\") pod \"konnectivity-agent-qm7pj\" (UID: \"fe1864d1-7354-440f-b41d-10a0b679eae7\") " pod="kube-system/konnectivity-agent-qm7pj" Jun 03 22:50:24.051678 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051636 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs\") pod \"network-metrics-daemon-dzl52\" (UID: \"5ba98357-42a7-4e6d-a783-7f58dd6c5ced\") " pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:24.051678 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051661 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-run-ovn\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.051678 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-log-socket\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.052367 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051717 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-multus-conf-dir\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.052367 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051756 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-etc-kubernetes\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.052367 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051781 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-etc-openvswitch\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.052367 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051804 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21456fc8-e4fa-4ff0-8940-b460142a32ae-multus-daemon-config\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.052367 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051829 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-node-log\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.052367 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051852 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-os-release\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.052367 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051876 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-host-run-netns\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.052367 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051900 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1797d0cf-3a7e-47d4-a235-3bc54df20f2b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bspfc\" (UID: \"1797d0cf-3a7e-47d4-a235-3bc54df20f2b\") " pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.052367 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051944 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-host-cni-netd\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.052367 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.051977 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/62e72520-69b0-4f77-8c80-e58d0722e825-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6b7bt\" (UID: \"62e72520-69b0-4f77-8c80-e58d0722e825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" Jun 03 22:50:24.052367 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052001 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/62e72520-69b0-4f77-8c80-e58d0722e825-socket-dir\") pod \"aws-ebs-csi-driver-node-6b7bt\" (UID: \"62e72520-69b0-4f77-8c80-e58d0722e825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" Jun 03 22:50:24.052367 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052024 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/62e72520-69b0-4f77-8c80-e58d0722e825-device-dir\") pod \"aws-ebs-csi-driver-node-6b7bt\" (UID: \"62e72520-69b0-4f77-8c80-e58d0722e825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" Jun 03 22:50:24.052367 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052047 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-host-run-multus-certs\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.052367 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052073 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1797d0cf-3a7e-47d4-a235-3bc54df20f2b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bspfc\" (UID: \"1797d0cf-3a7e-47d4-a235-3bc54df20f2b\") " pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.052367 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052097 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2mfg\" (UniqueName: \"kubernetes.io/projected/f2bef29c-c5da-41c2-b54a-dba7dffd5063-kube-api-access-f2mfg\") pod \"iptables-alerter-c9lkz\" (UID: \"f2bef29c-c5da-41c2-b54a-dba7dffd5063\") " pod="openshift-network-operator/iptables-alerter-c9lkz" Jun 03 22:50:24.052367 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052120 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccr6f\" (UniqueName: \"kubernetes.io/projected/c1356fb0-4884-41e6-8d59-fed020dd7a80-kube-api-access-ccr6f\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.053128 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052142 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-multus-socket-dir-parent\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.053128 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052164 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-host-var-lib-kubelet\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.053128 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052188 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf8n9\" (UniqueName: \"kubernetes.io/projected/1797d0cf-3a7e-47d4-a235-3bc54df20f2b-kube-api-access-nf8n9\") pod \"multus-additional-cni-plugins-bspfc\" (UID: \"1797d0cf-3a7e-47d4-a235-3bc54df20f2b\") " pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.053128 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052212 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/62e72520-69b0-4f77-8c80-e58d0722e825-sys-fs\") pod \"aws-ebs-csi-driver-node-6b7bt\" (UID: \"62e72520-69b0-4f77-8c80-e58d0722e825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" Jun 03 22:50:24.053128 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052235 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-host-var-lib-cni-bin\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.053128 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052258 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-hostroot\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.053128 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052281 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1797d0cf-3a7e-47d4-a235-3bc54df20f2b-os-release\") pod \"multus-additional-cni-plugins-bspfc\" (UID: \"1797d0cf-3a7e-47d4-a235-3bc54df20f2b\") " pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.053128 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052307 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-host-run-k8s-cni-cncf-io\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.053128 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052330 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnzfv\" (UniqueName: \"kubernetes.io/projected/21456fc8-e4fa-4ff0-8940-b460142a32ae-kube-api-access-fnzfv\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.053128 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052354 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f2bef29c-c5da-41c2-b54a-dba7dffd5063-iptables-alerter-script\") pod \"iptables-alerter-c9lkz\" (UID: \"f2bef29c-c5da-41c2-b54a-dba7dffd5063\") " pod="openshift-network-operator/iptables-alerter-c9lkz" Jun 03 22:50:24.053128 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b5a63252-f62d-4fa6-9514-cac24485d072-hosts-file\") pod \"node-resolver-6bxfb\" (UID: \"b5a63252-f62d-4fa6-9514-cac24485d072\") " pod="openshift-dns/node-resolver-6bxfb" Jun 03 22:50:24.053128 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052401 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fe1864d1-7354-440f-b41d-10a0b679eae7-agent-certs\") pod \"konnectivity-agent-qm7pj\" (UID: \"fe1864d1-7354-440f-b41d-10a0b679eae7\") " pod="kube-system/konnectivity-agent-qm7pj" Jun 03 22:50:24.053128 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052449 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-host-run-netns\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.053128 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052480 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c1356fb0-4884-41e6-8d59-fed020dd7a80-ovnkube-config\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.053128 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052539 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c1356fb0-4884-41e6-8d59-fed020dd7a80-env-overrides\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.053128 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052576 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfmvb\" (UniqueName: \"kubernetes.io/projected/dd58224f-f136-457b-b321-cec8434f3ef4-kube-api-access-qfmvb\") pod \"network-check-target-k4kx4\" (UID: \"dd58224f-f136-457b-b321-cec8434f3ef4\") " pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:24.053896 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052599 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-multus-cni-dir\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.053896 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052619 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-run-systemd\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.053896 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052655 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c1356fb0-4884-41e6-8d59-fed020dd7a80-ovn-node-metrics-cert\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.053896 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.052677 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/62e72520-69b0-4f77-8c80-e58d0722e825-etc-selinux\") pod \"aws-ebs-csi-driver-node-6b7bt\" (UID: \"62e72520-69b0-4f77-8c80-e58d0722e825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" Jun 03 22:50:24.080738 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.080709 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jrvgc" Jun 03 22:50:24.088801 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.088777 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jrvgc" Jun 03 22:50:24.140354 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.140328 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 03 22:50:24.153277 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.153245 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2mfg\" (UniqueName: \"kubernetes.io/projected/f2bef29c-c5da-41c2-b54a-dba7dffd5063-kube-api-access-f2mfg\") pod \"iptables-alerter-c9lkz\" (UID: \"f2bef29c-c5da-41c2-b54a-dba7dffd5063\") " pod="openshift-network-operator/iptables-alerter-c9lkz" Jun 03 22:50:24.153442 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.153290 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccr6f\" (UniqueName: \"kubernetes.io/projected/c1356fb0-4884-41e6-8d59-fed020dd7a80-kube-api-access-ccr6f\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.153442 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.153316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-multus-socket-dir-parent\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.153442 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.153337 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-host-var-lib-kubelet\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.153442 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.153362 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf8n9\" (UniqueName: \"kubernetes.io/projected/1797d0cf-3a7e-47d4-a235-3bc54df20f2b-kube-api-access-nf8n9\") pod \"multus-additional-cni-plugins-bspfc\" (UID: \"1797d0cf-3a7e-47d4-a235-3bc54df20f2b\") " pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.153442 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.153395 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-etc-modprobe-d\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.153694 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.153451 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-host-var-lib-kubelet\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.153694 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.153473 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-multus-socket-dir-parent\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.153694 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.153478 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-etc-kubernetes\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.153694 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.153554 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-host\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.153694 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.153606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/62e72520-69b0-4f77-8c80-e58d0722e825-sys-fs\") pod \"aws-ebs-csi-driver-node-6b7bt\" (UID: \"62e72520-69b0-4f77-8c80-e58d0722e825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" Jun 03 22:50:24.153694 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.153647 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-host-var-lib-cni-bin\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.153694 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.153658 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/62e72520-69b0-4f77-8c80-e58d0722e825-sys-fs\") pod \"aws-ebs-csi-driver-node-6b7bt\" (UID: \"62e72520-69b0-4f77-8c80-e58d0722e825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" Jun 03 22:50:24.153694 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.153685 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-hostroot\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.154049 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.153705 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-host-var-lib-cni-bin\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.154049 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.153713 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1797d0cf-3a7e-47d4-a235-3bc54df20f2b-os-release\") pod \"multus-additional-cni-plugins-bspfc\" (UID: \"1797d0cf-3a7e-47d4-a235-3bc54df20f2b\") " pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.154049 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.153743 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-hostroot\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.154049 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.153749 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-run\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.154049 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.153781 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1797d0cf-3a7e-47d4-a235-3bc54df20f2b-os-release\") pod \"multus-additional-cni-plugins-bspfc\" (UID: \"1797d0cf-3a7e-47d4-a235-3bc54df20f2b\") " pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.154049 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.153784 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-host-run-k8s-cni-cncf-io\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.154049 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.153813 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnzfv\" (UniqueName: \"kubernetes.io/projected/21456fc8-e4fa-4ff0-8940-b460142a32ae-kube-api-access-fnzfv\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.154049 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.153853 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-host-run-k8s-cni-cncf-io\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.154049 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.153913 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f2bef29c-c5da-41c2-b54a-dba7dffd5063-iptables-alerter-script\") pod \"iptables-alerter-c9lkz\" (UID: \"f2bef29c-c5da-41c2-b54a-dba7dffd5063\") " pod="openshift-network-operator/iptables-alerter-c9lkz" Jun 03 22:50:24.154049 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.153945 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-lib-modules\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.154049 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.153982 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdntb\" (UniqueName: \"kubernetes.io/projected/80fb391f-a331-493b-8ad0-bcda65353ff7-kube-api-access-wdntb\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.154472 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154053 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d5941858-6ad4-439b-acf6-adf174570012-host\") pod \"node-ca-8s2cb\" (UID: \"d5941858-6ad4-439b-acf6-adf174570012\") " pod="openshift-image-registry/node-ca-8s2cb" Jun 03 22:50:24.154472 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154096 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b5a63252-f62d-4fa6-9514-cac24485d072-hosts-file\") pod \"node-resolver-6bxfb\" (UID: \"b5a63252-f62d-4fa6-9514-cac24485d072\") " pod="openshift-dns/node-resolver-6bxfb" Jun 03 22:50:24.154472 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fe1864d1-7354-440f-b41d-10a0b679eae7-agent-certs\") pod \"konnectivity-agent-qm7pj\" (UID: \"fe1864d1-7354-440f-b41d-10a0b679eae7\") " pod="kube-system/konnectivity-agent-qm7pj" Jun 03 22:50:24.154472 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154145 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-etc-sysconfig\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.154472 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154156 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b5a63252-f62d-4fa6-9514-cac24485d072-hosts-file\") pod \"node-resolver-6bxfb\" (UID: \"b5a63252-f62d-4fa6-9514-cac24485d072\") " pod="openshift-dns/node-resolver-6bxfb" Jun 03 22:50:24.154472 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154171 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-kubelet-config\") pod \"global-pull-secret-syncer-qd98z\" (UID: \"5151c00d-51e2-445a-9ef4-0ee9bf2ac678\") " pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:24.154472 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154198 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-host-run-netns\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.154472 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154220 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c1356fb0-4884-41e6-8d59-fed020dd7a80-ovnkube-config\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.154472 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154242 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c1356fb0-4884-41e6-8d59-fed020dd7a80-env-overrides\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.154472 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154269 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-host-run-netns\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.154472 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154345 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfmvb\" (UniqueName: \"kubernetes.io/projected/dd58224f-f136-457b-b321-cec8434f3ef4-kube-api-access-qfmvb\") pod \"network-check-target-k4kx4\" (UID: \"dd58224f-f136-457b-b321-cec8434f3ef4\") " pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:24.154472 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154373 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-multus-cni-dir\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.154472 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154396 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-var-lib-kubelet\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.154472 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-run-systemd\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.154472 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154479 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c1356fb0-4884-41e6-8d59-fed020dd7a80-ovn-node-metrics-cert\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.155115 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154484 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-multus-cni-dir\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.155115 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154483 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 22:50:24.155115 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154540 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-run-systemd\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.155115 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154552 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f2bef29c-c5da-41c2-b54a-dba7dffd5063-iptables-alerter-script\") pod \"iptables-alerter-c9lkz\" (UID: \"f2bef29c-c5da-41c2-b54a-dba7dffd5063\") " pod="openshift-network-operator/iptables-alerter-c9lkz" Jun 03 22:50:24.155115 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154673 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/62e72520-69b0-4f77-8c80-e58d0722e825-etc-selinux\") pod \"aws-ebs-csi-driver-node-6b7bt\" (UID: \"62e72520-69b0-4f77-8c80-e58d0722e825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" Jun 03 22:50:24.155115 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21456fc8-e4fa-4ff0-8940-b460142a32ae-cni-binary-copy\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.155115 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154725 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-host-var-lib-cni-multus\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.155115 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154748 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1797d0cf-3a7e-47d4-a235-3bc54df20f2b-system-cni-dir\") pod \"multus-additional-cni-plugins-bspfc\" (UID: \"1797d0cf-3a7e-47d4-a235-3bc54df20f2b\") " pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.155115 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154754 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c1356fb0-4884-41e6-8d59-fed020dd7a80-env-overrides\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.155115 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154770 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1797d0cf-3a7e-47d4-a235-3bc54df20f2b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bspfc\" (UID: \"1797d0cf-3a7e-47d4-a235-3bc54df20f2b\") " pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.155115 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154799 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-etc-sysctl-d\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.155115 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154803 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-host-var-lib-cni-multus\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.155115 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154821 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/62e72520-69b0-4f77-8c80-e58d0722e825-etc-selinux\") pod \"aws-ebs-csi-driver-node-6b7bt\" (UID: \"62e72520-69b0-4f77-8c80-e58d0722e825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" Jun 03 22:50:24.155115 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154825 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjrxc\" (UniqueName: \"kubernetes.io/projected/d5941858-6ad4-439b-acf6-adf174570012-kube-api-access-mjrxc\") pod \"node-ca-8s2cb\" (UID: \"d5941858-6ad4-439b-acf6-adf174570012\") " pod="openshift-image-registry/node-ca-8s2cb" Jun 03 22:50:24.155115 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154852 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c1356fb0-4884-41e6-8d59-fed020dd7a80-ovnkube-script-lib\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.155115 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154876 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5a63252-f62d-4fa6-9514-cac24485d072-tmp-dir\") pod \"node-resolver-6bxfb\" (UID: \"b5a63252-f62d-4fa6-9514-cac24485d072\") " pod="openshift-dns/node-resolver-6bxfb" Jun 03 22:50:24.155115 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154879 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c1356fb0-4884-41e6-8d59-fed020dd7a80-ovnkube-config\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.155115 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154900 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2bef29c-c5da-41c2-b54a-dba7dffd5063-host-slash\") pod \"iptables-alerter-c9lkz\" (UID: \"f2bef29c-c5da-41c2-b54a-dba7dffd5063\") " pod="openshift-network-operator/iptables-alerter-c9lkz" Jun 03 22:50:24.155780 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154923 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-etc-sysctl-conf\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.155780 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154934 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1797d0cf-3a7e-47d4-a235-3bc54df20f2b-system-cni-dir\") pod \"multus-additional-cni-plugins-bspfc\" (UID: \"1797d0cf-3a7e-47d4-a235-3bc54df20f2b\") " pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.155780 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154949 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-host-run-ovn-kubernetes\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.155780 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.154975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1797d0cf-3a7e-47d4-a235-3bc54df20f2b-cnibin\") pod \"multus-additional-cni-plugins-bspfc\" (UID: \"1797d0cf-3a7e-47d4-a235-3bc54df20f2b\") " pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.155780 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155001 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpmnx\" (UniqueName: \"kubernetes.io/projected/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-kube-api-access-hpmnx\") pod \"network-metrics-daemon-dzl52\" (UID: \"5ba98357-42a7-4e6d-a783-7f58dd6c5ced\") " pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:24.155780 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155024 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-dbus\") pod \"global-pull-secret-syncer-qd98z\" (UID: \"5151c00d-51e2-445a-9ef4-0ee9bf2ac678\") " pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:24.155780 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155047 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-systemd-units\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.155780 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155074 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.155780 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155098 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1797d0cf-3a7e-47d4-a235-3bc54df20f2b-cni-binary-copy\") pod \"multus-additional-cni-plugins-bspfc\" (UID: \"1797d0cf-3a7e-47d4-a235-3bc54df20f2b\") " pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.155780 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155122 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-original-pull-secret\") pod \"global-pull-secret-syncer-qd98z\" (UID: \"5151c00d-51e2-445a-9ef4-0ee9bf2ac678\") " pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:24.155780 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155147 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-host-kubelet\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.155780 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155172 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-host-slash\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.155780 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155196 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-var-lib-openvswitch\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.155780 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155222 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-run-openvswitch\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.155780 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155246 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-host-cni-bin\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.155780 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155270 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-cnibin\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.155780 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155294 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-sys\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.156479 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155327 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/62e72520-69b0-4f77-8c80-e58d0722e825-registration-dir\") pod \"aws-ebs-csi-driver-node-6b7bt\" (UID: \"62e72520-69b0-4f77-8c80-e58d0722e825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" Jun 03 22:50:24.156479 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155339 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1797d0cf-3a7e-47d4-a235-3bc54df20f2b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bspfc\" (UID: \"1797d0cf-3a7e-47d4-a235-3bc54df20f2b\") " pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.156479 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155353 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9msm\" (UniqueName: \"kubernetes.io/projected/62e72520-69b0-4f77-8c80-e58d0722e825-kube-api-access-c9msm\") pod \"aws-ebs-csi-driver-node-6b7bt\" (UID: \"62e72520-69b0-4f77-8c80-e58d0722e825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" Jun 03 22:50:24.156479 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155388 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-system-cni-dir\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.156479 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155401 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c1356fb0-4884-41e6-8d59-fed020dd7a80-ovnkube-script-lib\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.156479 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjw4m\" (UniqueName: \"kubernetes.io/projected/b5a63252-f62d-4fa6-9514-cac24485d072-kube-api-access-mjw4m\") pod \"node-resolver-6bxfb\" (UID: \"b5a63252-f62d-4fa6-9514-cac24485d072\") " pod="openshift-dns/node-resolver-6bxfb" Jun 03 22:50:24.156479 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155444 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fe1864d1-7354-440f-b41d-10a0b679eae7-konnectivity-ca\") pod \"konnectivity-agent-qm7pj\" (UID: \"fe1864d1-7354-440f-b41d-10a0b679eae7\") " pod="kube-system/konnectivity-agent-qm7pj" Jun 03 22:50:24.156479 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155470 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs\") pod \"network-metrics-daemon-dzl52\" (UID: \"5ba98357-42a7-4e6d-a783-7f58dd6c5ced\") " pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:24.156479 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155480 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1797d0cf-3a7e-47d4-a235-3bc54df20f2b-cnibin\") pod \"multus-additional-cni-plugins-bspfc\" (UID: \"1797d0cf-3a7e-47d4-a235-3bc54df20f2b\") " pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.156479 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155496 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80fb391f-a331-493b-8ad0-bcda65353ff7-tmp\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.156479 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155541 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-run-ovn\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.156479 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155545 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2bef29c-c5da-41c2-b54a-dba7dffd5063-host-slash\") pod \"iptables-alerter-c9lkz\" (UID: \"f2bef29c-c5da-41c2-b54a-dba7dffd5063\") " pod="openshift-network-operator/iptables-alerter-c9lkz" Jun 03 22:50:24.156479 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155339 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21456fc8-e4fa-4ff0-8940-b460142a32ae-cni-binary-copy\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.156479 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155575 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-log-socket\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.156479 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155613 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5a63252-f62d-4fa6-9514-cac24485d072-tmp-dir\") pod \"node-resolver-6bxfb\" (UID: \"b5a63252-f62d-4fa6-9514-cac24485d072\") " pod="openshift-dns/node-resolver-6bxfb" Jun 03 22:50:24.156479 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155625 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-system-cni-dir\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.156479 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155631 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-run-ovn\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.157206 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155695 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-run-openvswitch\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.157206 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155706 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.157206 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155744 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-host-cni-bin\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.157206 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155761 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-cnibin\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.157206 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155793 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-host-slash\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.157206 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155824 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/62e72520-69b0-4f77-8c80-e58d0722e825-registration-dir\") pod \"aws-ebs-csi-driver-node-6b7bt\" (UID: \"62e72520-69b0-4f77-8c80-e58d0722e825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" Jun 03 22:50:24.157206 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155834 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-var-lib-openvswitch\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.157206 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155879 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-multus-conf-dir\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.157206 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:24.155891 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:24.157206 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155910 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-etc-kubernetes\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.157206 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155922 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-systemd-units\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.157206 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155955 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/80fb391f-a331-493b-8ad0-bcda65353ff7-etc-tuned\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.157206 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155983 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d5941858-6ad4-439b-acf6-adf174570012-serviceca\") pod \"node-ca-8s2cb\" (UID: \"d5941858-6ad4-439b-acf6-adf174570012\") " pod="openshift-image-registry/node-ca-8s2cb" Jun 03 22:50:24.157206 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156011 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-log-socket\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.157206 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155956 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-multus-conf-dir\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.157206 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156011 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-etc-openvswitch\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.157206 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156054 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21456fc8-e4fa-4ff0-8940-b460142a32ae-multus-daemon-config\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.157206 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156082 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-node-log\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.157745 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.155983 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-etc-kubernetes\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.157745 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:24.156132 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs podName:5ba98357-42a7-4e6d-a783-7f58dd6c5ced nodeName:}" failed. No retries permitted until 2026-06-03 22:50:24.6560928 +0000 UTC m=+2.994745277 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs") pod "network-metrics-daemon-dzl52" (UID: "5ba98357-42a7-4e6d-a783-7f58dd6c5ced") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:24.157745 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156152 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-os-release\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.157745 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156182 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-host-run-netns\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.157745 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156210 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1797d0cf-3a7e-47d4-a235-3bc54df20f2b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bspfc\" (UID: \"1797d0cf-3a7e-47d4-a235-3bc54df20f2b\") " pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.157745 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156221 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fe1864d1-7354-440f-b41d-10a0b679eae7-konnectivity-ca\") pod \"konnectivity-agent-qm7pj\" (UID: \"fe1864d1-7354-440f-b41d-10a0b679eae7\") " pod="kube-system/konnectivity-agent-qm7pj" Jun 03 22:50:24.157745 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156056 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-etc-openvswitch\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.157745 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156280 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-etc-systemd\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.157745 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156292 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1797d0cf-3a7e-47d4-a235-3bc54df20f2b-cni-binary-copy\") pod \"multus-additional-cni-plugins-bspfc\" (UID: \"1797d0cf-3a7e-47d4-a235-3bc54df20f2b\") " pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.157745 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156308 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-host-cni-netd\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.157745 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156333 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/62e72520-69b0-4f77-8c80-e58d0722e825-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6b7bt\" (UID: \"62e72520-69b0-4f77-8c80-e58d0722e825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" Jun 03 22:50:24.157745 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156336 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-host-run-ovn-kubernetes\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.157745 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156359 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/62e72520-69b0-4f77-8c80-e58d0722e825-socket-dir\") pod \"aws-ebs-csi-driver-node-6b7bt\" (UID: \"62e72520-69b0-4f77-8c80-e58d0722e825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" Jun 03 22:50:24.157745 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156375 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-node-log\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.157745 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156386 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/62e72520-69b0-4f77-8c80-e58d0722e825-device-dir\") pod \"aws-ebs-csi-driver-node-6b7bt\" (UID: \"62e72520-69b0-4f77-8c80-e58d0722e825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" Jun 03 22:50:24.157745 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156438 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-host-run-multus-certs\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.158331 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156448 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/62e72520-69b0-4f77-8c80-e58d0722e825-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6b7bt\" (UID: \"62e72520-69b0-4f77-8c80-e58d0722e825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" Jun 03 22:50:24.158331 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156464 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1797d0cf-3a7e-47d4-a235-3bc54df20f2b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bspfc\" (UID: \"1797d0cf-3a7e-47d4-a235-3bc54df20f2b\") " pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.158331 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156493 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-host-run-netns\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.158331 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156544 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21456fc8-e4fa-4ff0-8940-b460142a32ae-multus-daemon-config\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.158331 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156570 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-os-release\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.158331 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156587 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-host-cni-netd\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.158331 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156605 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1356fb0-4884-41e6-8d59-fed020dd7a80-host-kubelet\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.158331 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156671 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1797d0cf-3a7e-47d4-a235-3bc54df20f2b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bspfc\" (UID: \"1797d0cf-3a7e-47d4-a235-3bc54df20f2b\") " pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.158331 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156703 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/62e72520-69b0-4f77-8c80-e58d0722e825-socket-dir\") pod \"aws-ebs-csi-driver-node-6b7bt\" (UID: \"62e72520-69b0-4f77-8c80-e58d0722e825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" Jun 03 22:50:24.158331 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156718 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/62e72520-69b0-4f77-8c80-e58d0722e825-device-dir\") pod \"aws-ebs-csi-driver-node-6b7bt\" (UID: \"62e72520-69b0-4f77-8c80-e58d0722e825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" Jun 03 22:50:24.158331 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156739 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21456fc8-e4fa-4ff0-8940-b460142a32ae-host-run-multus-certs\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.158331 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.156848 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1797d0cf-3a7e-47d4-a235-3bc54df20f2b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bspfc\" (UID: \"1797d0cf-3a7e-47d4-a235-3bc54df20f2b\") " pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.158857 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.158641 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c1356fb0-4884-41e6-8d59-fed020dd7a80-ovn-node-metrics-cert\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.158857 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.158643 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fe1864d1-7354-440f-b41d-10a0b679eae7-agent-certs\") pod \"konnectivity-agent-qm7pj\" (UID: \"fe1864d1-7354-440f-b41d-10a0b679eae7\") " pod="kube-system/konnectivity-agent-qm7pj" Jun 03 22:50:24.161326 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.161303 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnzfv\" (UniqueName: \"kubernetes.io/projected/21456fc8-e4fa-4ff0-8940-b460142a32ae-kube-api-access-fnzfv\") pod \"multus-z5qwm\" (UID: \"21456fc8-e4fa-4ff0-8940-b460142a32ae\") " pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.161457 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:24.161415 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 22:50:24.161457 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:24.161441 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 22:50:24.161457 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:24.161456 2576 projected.go:196] Error preparing data for projected volume kube-api-access-qfmvb for pod openshift-network-diagnostics/network-check-target-k4kx4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:24.161699 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:24.161551 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd58224f-f136-457b-b321-cec8434f3ef4-kube-api-access-qfmvb podName:dd58224f-f136-457b-b321-cec8434f3ef4 nodeName:}" failed. No retries permitted until 2026-06-03 22:50:24.661532352 +0000 UTC m=+3.000184837 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qfmvb" (UniqueName: "kubernetes.io/projected/dd58224f-f136-457b-b321-cec8434f3ef4-kube-api-access-qfmvb") pod "network-check-target-k4kx4" (UID: "dd58224f-f136-457b-b321-cec8434f3ef4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:24.163561 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.163540 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2mfg\" (UniqueName: \"kubernetes.io/projected/f2bef29c-c5da-41c2-b54a-dba7dffd5063-kube-api-access-f2mfg\") pod \"iptables-alerter-c9lkz\" (UID: \"f2bef29c-c5da-41c2-b54a-dba7dffd5063\") " pod="openshift-network-operator/iptables-alerter-c9lkz" Jun 03 22:50:24.164048 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.163988 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf8n9\" (UniqueName: \"kubernetes.io/projected/1797d0cf-3a7e-47d4-a235-3bc54df20f2b-kube-api-access-nf8n9\") pod \"multus-additional-cni-plugins-bspfc\" (UID: \"1797d0cf-3a7e-47d4-a235-3bc54df20f2b\") " pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.164556 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.164534 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjw4m\" (UniqueName: \"kubernetes.io/projected/b5a63252-f62d-4fa6-9514-cac24485d072-kube-api-access-mjw4m\") pod \"node-resolver-6bxfb\" (UID: \"b5a63252-f62d-4fa6-9514-cac24485d072\") " pod="openshift-dns/node-resolver-6bxfb" Jun 03 22:50:24.165106 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.165086 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpmnx\" (UniqueName: \"kubernetes.io/projected/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-kube-api-access-hpmnx\") pod \"network-metrics-daemon-dzl52\" (UID: \"5ba98357-42a7-4e6d-a783-7f58dd6c5ced\") " pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:24.165214 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.165199 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccr6f\" (UniqueName: \"kubernetes.io/projected/c1356fb0-4884-41e6-8d59-fed020dd7a80-kube-api-access-ccr6f\") pod \"ovnkube-node-vvqlh\" (UID: \"c1356fb0-4884-41e6-8d59-fed020dd7a80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.165558 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.165543 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9msm\" (UniqueName: \"kubernetes.io/projected/62e72520-69b0-4f77-8c80-e58d0722e825-kube-api-access-c9msm\") pod \"aws-ebs-csi-driver-node-6b7bt\" (UID: \"62e72520-69b0-4f77-8c80-e58d0722e825\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" Jun 03 22:50:24.256936 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.256906 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-etc-sysconfig\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.256936 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.256938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-kubelet-config\") pod \"global-pull-secret-syncer-qd98z\" (UID: \"5151c00d-51e2-445a-9ef4-0ee9bf2ac678\") " pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:24.257169 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.256975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-var-lib-kubelet\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.257169 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257008 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-etc-sysctl-d\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.257169 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257033 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjrxc\" (UniqueName: \"kubernetes.io/projected/d5941858-6ad4-439b-acf6-adf174570012-kube-api-access-mjrxc\") pod \"node-ca-8s2cb\" (UID: \"d5941858-6ad4-439b-acf6-adf174570012\") " pod="openshift-image-registry/node-ca-8s2cb" Jun 03 22:50:24.257169 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257045 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-etc-sysconfig\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.257169 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257059 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-etc-sysctl-conf\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.257169 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257045 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-kubelet-config\") pod \"global-pull-secret-syncer-qd98z\" (UID: \"5151c00d-51e2-445a-9ef4-0ee9bf2ac678\") " pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:24.257169 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257080 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-dbus\") pod \"global-pull-secret-syncer-qd98z\" (UID: \"5151c00d-51e2-445a-9ef4-0ee9bf2ac678\") " pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:24.257169 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257080 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-var-lib-kubelet\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.257169 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-original-pull-secret\") pod \"global-pull-secret-syncer-qd98z\" (UID: \"5151c00d-51e2-445a-9ef4-0ee9bf2ac678\") " pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:24.257169 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257164 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-etc-sysctl-d\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.257650 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257172 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-sys\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.257650 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257191 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-etc-sysctl-conf\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.257650 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257218 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-sys\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.257650 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257219 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-dbus\") pod \"global-pull-secret-syncer-qd98z\" (UID: \"5151c00d-51e2-445a-9ef4-0ee9bf2ac678\") " pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:24.257650 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:24.257222 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:24.257650 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257224 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80fb391f-a331-493b-8ad0-bcda65353ff7-tmp\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.257650 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:24.257305 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-original-pull-secret podName:5151c00d-51e2-445a-9ef4-0ee9bf2ac678 nodeName:}" failed. No retries permitted until 2026-06-03 22:50:24.757282453 +0000 UTC m=+3.095934936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-original-pull-secret") pod "global-pull-secret-syncer-qd98z" (UID: "5151c00d-51e2-445a-9ef4-0ee9bf2ac678") : object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:24.257650 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257340 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/80fb391f-a331-493b-8ad0-bcda65353ff7-etc-tuned\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.257650 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257365 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d5941858-6ad4-439b-acf6-adf174570012-serviceca\") pod \"node-ca-8s2cb\" (UID: \"d5941858-6ad4-439b-acf6-adf174570012\") " pod="openshift-image-registry/node-ca-8s2cb" Jun 03 22:50:24.257650 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257392 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-etc-systemd\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.257650 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257447 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-etc-modprobe-d\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.257650 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257472 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-etc-kubernetes\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.257650 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257495 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-host\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.257650 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257552 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-run\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.257650 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257580 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-lib-modules\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.257650 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257585 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-etc-systemd\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.257650 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257602 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdntb\" (UniqueName: \"kubernetes.io/projected/80fb391f-a331-493b-8ad0-bcda65353ff7-kube-api-access-wdntb\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.257650 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257626 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d5941858-6ad4-439b-acf6-adf174570012-host\") pod \"node-ca-8s2cb\" (UID: \"d5941858-6ad4-439b-acf6-adf174570012\") " pod="openshift-image-registry/node-ca-8s2cb" Jun 03 22:50:24.258404 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257669 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-etc-modprobe-d\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.258404 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257691 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d5941858-6ad4-439b-acf6-adf174570012-host\") pod \"node-ca-8s2cb\" (UID: \"d5941858-6ad4-439b-acf6-adf174570012\") " pod="openshift-image-registry/node-ca-8s2cb" Jun 03 22:50:24.258404 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257761 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-lib-modules\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.258404 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257806 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-run\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.258404 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.257583 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-host\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.258404 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.258011 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80fb391f-a331-493b-8ad0-bcda65353ff7-etc-kubernetes\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.258404 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.258240 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d5941858-6ad4-439b-acf6-adf174570012-serviceca\") pod \"node-ca-8s2cb\" (UID: \"d5941858-6ad4-439b-acf6-adf174570012\") " pod="openshift-image-registry/node-ca-8s2cb" Jun 03 22:50:24.259673 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.259646 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80fb391f-a331-493b-8ad0-bcda65353ff7-tmp\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.259792 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.259730 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/80fb391f-a331-493b-8ad0-bcda65353ff7-etc-tuned\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.266387 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.266360 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjrxc\" (UniqueName: \"kubernetes.io/projected/d5941858-6ad4-439b-acf6-adf174570012-kube-api-access-mjrxc\") pod \"node-ca-8s2cb\" (UID: \"d5941858-6ad4-439b-acf6-adf174570012\") " pod="openshift-image-registry/node-ca-8s2cb" Jun 03 22:50:24.266568 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.266548 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdntb\" (UniqueName: \"kubernetes.io/projected/80fb391f-a331-493b-8ad0-bcda65353ff7-kube-api-access-wdntb\") pod \"tuned-2tgsj\" (UID: \"80fb391f-a331-493b-8ad0-bcda65353ff7\") " pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.339536 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.339444 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:24.348878 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.348854 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bspfc" Jun 03 22:50:24.356914 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.356881 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" Jun 03 22:50:24.362157 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.362135 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6bxfb" Jun 03 22:50:24.369803 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.369784 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c9lkz" Jun 03 22:50:24.378169 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.378144 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qm7pj" Jun 03 22:50:24.385209 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.385187 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z5qwm" Jun 03 22:50:24.392019 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.391992 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" Jun 03 22:50:24.396776 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.396756 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8s2cb" Jun 03 22:50:24.660179 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.660093 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs\") pod \"network-metrics-daemon-dzl52\" (UID: \"5ba98357-42a7-4e6d-a783-7f58dd6c5ced\") " pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:24.660339 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:24.660236 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:24.660339 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:24.660293 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs podName:5ba98357-42a7-4e6d-a783-7f58dd6c5ced nodeName:}" failed. No retries permitted until 2026-06-03 22:50:25.66027532 +0000 UTC m=+3.998927796 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs") pod "network-metrics-daemon-dzl52" (UID: "5ba98357-42a7-4e6d-a783-7f58dd6c5ced") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:24.761109 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.761083 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfmvb\" (UniqueName: \"kubernetes.io/projected/dd58224f-f136-457b-b321-cec8434f3ef4-kube-api-access-qfmvb\") pod \"network-check-target-k4kx4\" (UID: \"dd58224f-f136-457b-b321-cec8434f3ef4\") " pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:24.761259 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:24.761120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-original-pull-secret\") pod \"global-pull-secret-syncer-qd98z\" (UID: \"5151c00d-51e2-445a-9ef4-0ee9bf2ac678\") " pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:24.761259 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:24.761213 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:24.761259 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:24.761243 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 22:50:24.761259 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:24.761260 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-original-pull-secret podName:5151c00d-51e2-445a-9ef4-0ee9bf2ac678 nodeName:}" failed. No retries permitted until 2026-06-03 22:50:25.761248321 +0000 UTC m=+4.099900787 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-original-pull-secret") pod "global-pull-secret-syncer-qd98z" (UID: "5151c00d-51e2-445a-9ef4-0ee9bf2ac678") : object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:24.761392 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:24.761262 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 22:50:24.761392 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:24.761273 2576 projected.go:196] Error preparing data for projected volume kube-api-access-qfmvb for pod openshift-network-diagnostics/network-check-target-k4kx4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:24.761392 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:24.761311 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd58224f-f136-457b-b321-cec8434f3ef4-kube-api-access-qfmvb podName:dd58224f-f136-457b-b321-cec8434f3ef4 nodeName:}" failed. No retries permitted until 2026-06-03 22:50:25.761299362 +0000 UTC m=+4.099951833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qfmvb" (UniqueName: "kubernetes.io/projected/dd58224f-f136-457b-b321-cec8434f3ef4-kube-api-access-qfmvb") pod "network-check-target-k4kx4" (UID: "dd58224f-f136-457b-b321-cec8434f3ef4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:24.798458 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:24.798377 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5a63252_f62d_4fa6_9514_cac24485d072.slice/crio-666c066c802750d672fb1514c88b95d325f4a47e46bf98e0b3e77299e401f6a4 WatchSource:0}: Error finding container 666c066c802750d672fb1514c88b95d325f4a47e46bf98e0b3e77299e401f6a4: Status 404 returned error can't find the container with id 666c066c802750d672fb1514c88b95d325f4a47e46bf98e0b3e77299e401f6a4 Jun 03 22:50:24.801155 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:24.801128 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1356fb0_4884_41e6_8d59_fed020dd7a80.slice/crio-90ffc3d0559a02f1004c7f2324a831890898acfc3d791a2f8bc5d4c026954008 WatchSource:0}: Error finding container 90ffc3d0559a02f1004c7f2324a831890898acfc3d791a2f8bc5d4c026954008: Status 404 returned error can't find the container with id 90ffc3d0559a02f1004c7f2324a831890898acfc3d791a2f8bc5d4c026954008 Jun 03 22:50:24.804539 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:24.803579 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21456fc8_e4fa_4ff0_8940_b460142a32ae.slice/crio-3f67a51ea8d6f9eeeca8545937f9806204f46c667c8fd95852722036f1dc479a WatchSource:0}: Error finding container 3f67a51ea8d6f9eeeca8545937f9806204f46c667c8fd95852722036f1dc479a: Status 404 returned error can't find the container with id 3f67a51ea8d6f9eeeca8545937f9806204f46c667c8fd95852722036f1dc479a Jun 03 22:50:25.091916 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:25.091722 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 22:45:24 +0000 UTC" deadline="2028-02-23 19:56:43.078148614 +0000 UTC" Jun 03 22:50:25.091916 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:25.091912 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15117h6m17.986241019s" Jun 03 22:50:25.111162 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:25.111129 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:25.111311 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:25.111233 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd98z" podUID="5151c00d-51e2-445a-9ef4-0ee9bf2ac678" Jun 03 22:50:25.122048 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:25.122008 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-99.ec2.internal" event={"ID":"4aed52c4997e28f083b4c99b8beb1110","Type":"ContainerStarted","Data":"c490464a052df776b4631f59717cace521e3c4b66d9d7f6a83fac16736ca427b"} Jun 03 22:50:25.124432 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:25.124354 2576 generic.go:356] "Generic (PLEG): container finished" podID="035ccae58eace2196efa696fcb7949ab" containerID="b737f6029963fe8d50dab01b0d5db232442d507763bcf354d825e9959573fa54" exitCode=0 Jun 03 22:50:25.124605 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:25.124435 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-99.ec2.internal" event={"ID":"035ccae58eace2196efa696fcb7949ab","Type":"ContainerDied","Data":"b737f6029963fe8d50dab01b0d5db232442d507763bcf354d825e9959573fa54"} Jun 03 22:50:25.125808 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:25.125785 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qm7pj" event={"ID":"fe1864d1-7354-440f-b41d-10a0b679eae7","Type":"ContainerStarted","Data":"c97a36e0bd42fc78348d2171626de0dd8ef6cff0173263c94924717577412568"} Jun 03 22:50:25.127148 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:25.127117 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bspfc" event={"ID":"1797d0cf-3a7e-47d4-a235-3bc54df20f2b","Type":"ContainerStarted","Data":"73fe4cfa9dab6c28fdb3b78ad064c094c533be38a93fb23af014d6eec1a988bf"} Jun 03 22:50:25.128544 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:25.128499 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" event={"ID":"80fb391f-a331-493b-8ad0-bcda65353ff7","Type":"ContainerStarted","Data":"d93ff418d48cb1ff89e66e675d0d9fefc6093dfef63895ebb53dcb4322010da0"} Jun 03 22:50:25.129901 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:25.129877 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" event={"ID":"62e72520-69b0-4f77-8c80-e58d0722e825","Type":"ContainerStarted","Data":"2728a8b025f2ce7a20d66f71f2567ef94f3152aa277bb474abc7b8b8c9f68426"} Jun 03 22:50:25.131061 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:25.131038 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8s2cb" event={"ID":"d5941858-6ad4-439b-acf6-adf174570012","Type":"ContainerStarted","Data":"4639b895c5b042d46e6048ace9add0ad2884dd4c92140def77eb4b6aa206f5f1"} Jun 03 22:50:25.132720 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:25.132695 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" event={"ID":"c1356fb0-4884-41e6-8d59-fed020dd7a80","Type":"ContainerStarted","Data":"90ffc3d0559a02f1004c7f2324a831890898acfc3d791a2f8bc5d4c026954008"} Jun 03 22:50:25.134741 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:25.134718 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c9lkz" event={"ID":"f2bef29c-c5da-41c2-b54a-dba7dffd5063","Type":"ContainerStarted","Data":"22ffaee84869edf1a3fec5d587148fa5f288abfa34b131dbe1464532bbb596c0"} Jun 03 22:50:25.134901 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:25.134863 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-99.ec2.internal" podStartSLOduration=2.134851834 podStartE2EDuration="2.134851834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:50:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:50:25.134560729 +0000 UTC m=+3.473213220" watchObservedRunningTime="2026-06-03 22:50:25.134851834 +0000 UTC m=+3.473504322" Jun 03 22:50:25.136000 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:25.135955 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z5qwm" event={"ID":"21456fc8-e4fa-4ff0-8940-b460142a32ae","Type":"ContainerStarted","Data":"3f67a51ea8d6f9eeeca8545937f9806204f46c667c8fd95852722036f1dc479a"} Jun 03 22:50:25.137298 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:25.137275 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6bxfb" event={"ID":"b5a63252-f62d-4fa6-9514-cac24485d072","Type":"ContainerStarted","Data":"666c066c802750d672fb1514c88b95d325f4a47e46bf98e0b3e77299e401f6a4"} Jun 03 22:50:25.667990 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:25.667899 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs\") pod \"network-metrics-daemon-dzl52\" (UID: \"5ba98357-42a7-4e6d-a783-7f58dd6c5ced\") " pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:25.668167 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:25.668105 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:25.668230 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:25.668178 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs podName:5ba98357-42a7-4e6d-a783-7f58dd6c5ced nodeName:}" failed. No retries permitted until 2026-06-03 22:50:27.668157172 +0000 UTC m=+6.006809859 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs") pod "network-metrics-daemon-dzl52" (UID: "5ba98357-42a7-4e6d-a783-7f58dd6c5ced") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:25.769078 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:25.769031 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfmvb\" (UniqueName: \"kubernetes.io/projected/dd58224f-f136-457b-b321-cec8434f3ef4-kube-api-access-qfmvb\") pod \"network-check-target-k4kx4\" (UID: \"dd58224f-f136-457b-b321-cec8434f3ef4\") " pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:25.769271 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:25.769094 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-original-pull-secret\") pod \"global-pull-secret-syncer-qd98z\" (UID: \"5151c00d-51e2-445a-9ef4-0ee9bf2ac678\") " pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:25.769271 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:25.769220 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:25.769384 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:25.769291 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-original-pull-secret podName:5151c00d-51e2-445a-9ef4-0ee9bf2ac678 nodeName:}" failed. No retries permitted until 2026-06-03 22:50:27.769270668 +0000 UTC m=+6.107923137 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-original-pull-secret") pod "global-pull-secret-syncer-qd98z" (UID: "5151c00d-51e2-445a-9ef4-0ee9bf2ac678") : object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:25.769738 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:25.769706 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 22:50:25.769738 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:25.769731 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 22:50:25.769892 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:25.769744 2576 projected.go:196] Error preparing data for projected volume kube-api-access-qfmvb for pod openshift-network-diagnostics/network-check-target-k4kx4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:25.769892 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:25.769788 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd58224f-f136-457b-b321-cec8434f3ef4-kube-api-access-qfmvb podName:dd58224f-f136-457b-b321-cec8434f3ef4 nodeName:}" failed. No retries permitted until 2026-06-03 22:50:27.769773916 +0000 UTC m=+6.108426388 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qfmvb" (UniqueName: "kubernetes.io/projected/dd58224f-f136-457b-b321-cec8434f3ef4-kube-api-access-qfmvb") pod "network-check-target-k4kx4" (UID: "dd58224f-f136-457b-b321-cec8434f3ef4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:26.092793 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:26.092671 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 22:45:24 +0000 UTC" deadline="2027-12-27 22:40:40.849923734 +0000 UTC" Jun 03 22:50:26.092793 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:26.092711 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13727h50m14.757217525s" Jun 03 22:50:26.111771 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:26.111243 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:26.111771 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:26.111253 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:26.111771 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:26.111375 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k4kx4" podUID="dd58224f-f136-457b-b321-cec8434f3ef4" Jun 03 22:50:26.111771 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:26.111485 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzl52" podUID="5ba98357-42a7-4e6d-a783-7f58dd6c5ced" Jun 03 22:50:26.145646 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:26.145576 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-99.ec2.internal" event={"ID":"035ccae58eace2196efa696fcb7949ab","Type":"ContainerStarted","Data":"40741e6e469ef724691eca4e8ba729f9f3b8ce350dec50c3a0988f1c69bdd508"} Jun 03 22:50:26.161601 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:26.161326 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-99.ec2.internal" podStartSLOduration=3.161305947 podStartE2EDuration="3.161305947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:50:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:50:26.160477627 +0000 UTC m=+4.499130117" watchObservedRunningTime="2026-06-03 22:50:26.161305947 +0000 UTC m=+4.499958436" Jun 03 22:50:27.111043 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:27.111003 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:27.111560 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:27.111144 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd98z" podUID="5151c00d-51e2-445a-9ef4-0ee9bf2ac678" Jun 03 22:50:27.690535 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:27.687024 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs\") pod \"network-metrics-daemon-dzl52\" (UID: \"5ba98357-42a7-4e6d-a783-7f58dd6c5ced\") " pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:27.690535 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:27.687172 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:27.690535 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:27.687239 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs podName:5ba98357-42a7-4e6d-a783-7f58dd6c5ced nodeName:}" failed. No retries permitted until 2026-06-03 22:50:31.687221719 +0000 UTC m=+10.025874188 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs") pod "network-metrics-daemon-dzl52" (UID: "5ba98357-42a7-4e6d-a783-7f58dd6c5ced") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:27.787448 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:27.787410 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfmvb\" (UniqueName: \"kubernetes.io/projected/dd58224f-f136-457b-b321-cec8434f3ef4-kube-api-access-qfmvb\") pod \"network-check-target-k4kx4\" (UID: \"dd58224f-f136-457b-b321-cec8434f3ef4\") " pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:27.787693 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:27.787474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-original-pull-secret\") pod \"global-pull-secret-syncer-qd98z\" (UID: \"5151c00d-51e2-445a-9ef4-0ee9bf2ac678\") " pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:27.787693 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:27.787651 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:27.787890 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:27.787721 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-original-pull-secret podName:5151c00d-51e2-445a-9ef4-0ee9bf2ac678 nodeName:}" failed. No retries permitted until 2026-06-03 22:50:31.787701432 +0000 UTC m=+10.126353921 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-original-pull-secret") pod "global-pull-secret-syncer-qd98z" (UID: "5151c00d-51e2-445a-9ef4-0ee9bf2ac678") : object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:27.788165 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:27.788143 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 22:50:27.788253 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:27.788171 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 22:50:27.788253 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:27.788196 2576 projected.go:196] Error preparing data for projected volume kube-api-access-qfmvb for pod openshift-network-diagnostics/network-check-target-k4kx4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:27.788253 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:27.788242 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd58224f-f136-457b-b321-cec8434f3ef4-kube-api-access-qfmvb podName:dd58224f-f136-457b-b321-cec8434f3ef4 nodeName:}" failed. No retries permitted until 2026-06-03 22:50:31.788227048 +0000 UTC m=+10.126879528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qfmvb" (UniqueName: "kubernetes.io/projected/dd58224f-f136-457b-b321-cec8434f3ef4-kube-api-access-qfmvb") pod "network-check-target-k4kx4" (UID: "dd58224f-f136-457b-b321-cec8434f3ef4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:28.111587 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:28.111473 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:28.112046 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:28.111640 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzl52" podUID="5ba98357-42a7-4e6d-a783-7f58dd6c5ced" Jun 03 22:50:28.112046 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:28.111986 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:28.112130 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:28.112058 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k4kx4" podUID="dd58224f-f136-457b-b321-cec8434f3ef4" Jun 03 22:50:29.111279 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:29.111241 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:29.111497 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:29.111378 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd98z" podUID="5151c00d-51e2-445a-9ef4-0ee9bf2ac678" Jun 03 22:50:30.113220 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:30.113186 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:30.113795 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:30.113340 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzl52" podUID="5ba98357-42a7-4e6d-a783-7f58dd6c5ced" Jun 03 22:50:30.113795 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:30.113741 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:30.114016 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:30.113837 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k4kx4" podUID="dd58224f-f136-457b-b321-cec8434f3ef4" Jun 03 22:50:31.111050 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:31.111013 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:31.111235 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:31.111170 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd98z" podUID="5151c00d-51e2-445a-9ef4-0ee9bf2ac678" Jun 03 22:50:31.724603 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:31.724562 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs\") pod \"network-metrics-daemon-dzl52\" (UID: \"5ba98357-42a7-4e6d-a783-7f58dd6c5ced\") " pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:31.725198 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:31.724724 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:31.725198 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:31.724811 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs podName:5ba98357-42a7-4e6d-a783-7f58dd6c5ced nodeName:}" failed. No retries permitted until 2026-06-03 22:50:39.724790641 +0000 UTC m=+18.063443110 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs") pod "network-metrics-daemon-dzl52" (UID: "5ba98357-42a7-4e6d-a783-7f58dd6c5ced") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:31.826103 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:31.825501 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-original-pull-secret\") pod \"global-pull-secret-syncer-qd98z\" (UID: \"5151c00d-51e2-445a-9ef4-0ee9bf2ac678\") " pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:31.826103 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:31.825620 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfmvb\" (UniqueName: \"kubernetes.io/projected/dd58224f-f136-457b-b321-cec8434f3ef4-kube-api-access-qfmvb\") pod \"network-check-target-k4kx4\" (UID: \"dd58224f-f136-457b-b321-cec8434f3ef4\") " pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:31.826103 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:31.825767 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 22:50:31.826103 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:31.825786 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 22:50:31.826103 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:31.825799 2576 projected.go:196] Error preparing data for projected volume kube-api-access-qfmvb for pod openshift-network-diagnostics/network-check-target-k4kx4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:31.826103 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:31.825861 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd58224f-f136-457b-b321-cec8434f3ef4-kube-api-access-qfmvb podName:dd58224f-f136-457b-b321-cec8434f3ef4 nodeName:}" failed. No retries permitted until 2026-06-03 22:50:39.825841873 +0000 UTC m=+18.164494367 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qfmvb" (UniqueName: "kubernetes.io/projected/dd58224f-f136-457b-b321-cec8434f3ef4-kube-api-access-qfmvb") pod "network-check-target-k4kx4" (UID: "dd58224f-f136-457b-b321-cec8434f3ef4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:31.826103 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:31.825953 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:31.826103 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:31.826009 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-original-pull-secret podName:5151c00d-51e2-445a-9ef4-0ee9bf2ac678 nodeName:}" failed. No retries permitted until 2026-06-03 22:50:39.825995653 +0000 UTC m=+18.164648133 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-original-pull-secret") pod "global-pull-secret-syncer-qd98z" (UID: "5151c00d-51e2-445a-9ef4-0ee9bf2ac678") : object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:32.113703 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:32.113163 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:32.113703 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:32.113182 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:32.113703 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:32.113280 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzl52" podUID="5ba98357-42a7-4e6d-a783-7f58dd6c5ced" Jun 03 22:50:32.113962 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:32.113725 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k4kx4" podUID="dd58224f-f136-457b-b321-cec8434f3ef4" Jun 03 22:50:33.111749 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:33.111715 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:33.112219 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:33.111840 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd98z" podUID="5151c00d-51e2-445a-9ef4-0ee9bf2ac678" Jun 03 22:50:34.111266 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:34.111232 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:34.111449 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:34.111389 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzl52" podUID="5ba98357-42a7-4e6d-a783-7f58dd6c5ced" Jun 03 22:50:34.111499 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:34.111440 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:34.111593 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:34.111570 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k4kx4" podUID="dd58224f-f136-457b-b321-cec8434f3ef4" Jun 03 22:50:35.111603 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:35.111501 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:35.112050 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:35.111634 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd98z" podUID="5151c00d-51e2-445a-9ef4-0ee9bf2ac678" Jun 03 22:50:36.111431 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:36.111387 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:36.111627 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:36.111566 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzl52" podUID="5ba98357-42a7-4e6d-a783-7f58dd6c5ced" Jun 03 22:50:36.111959 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:36.111639 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:36.111959 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:36.111773 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k4kx4" podUID="dd58224f-f136-457b-b321-cec8434f3ef4" Jun 03 22:50:37.110838 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:37.110808 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:37.111019 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:37.110923 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd98z" podUID="5151c00d-51e2-445a-9ef4-0ee9bf2ac678" Jun 03 22:50:38.110887 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:38.110856 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:38.111404 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:38.110861 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:38.111404 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:38.110983 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzl52" podUID="5ba98357-42a7-4e6d-a783-7f58dd6c5ced" Jun 03 22:50:38.111404 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:38.111025 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k4kx4" podUID="dd58224f-f136-457b-b321-cec8434f3ef4" Jun 03 22:50:39.111018 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:39.110980 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:39.111452 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:39.111108 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd98z" podUID="5151c00d-51e2-445a-9ef4-0ee9bf2ac678" Jun 03 22:50:39.784998 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:39.784953 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs\") pod \"network-metrics-daemon-dzl52\" (UID: \"5ba98357-42a7-4e6d-a783-7f58dd6c5ced\") " pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:39.785151 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:39.785129 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:39.785212 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:39.785200 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs podName:5ba98357-42a7-4e6d-a783-7f58dd6c5ced nodeName:}" failed. No retries permitted until 2026-06-03 22:50:55.785181179 +0000 UTC m=+34.123833645 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs") pod "network-metrics-daemon-dzl52" (UID: "5ba98357-42a7-4e6d-a783-7f58dd6c5ced") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:39.885932 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:39.885897 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfmvb\" (UniqueName: \"kubernetes.io/projected/dd58224f-f136-457b-b321-cec8434f3ef4-kube-api-access-qfmvb\") pod \"network-check-target-k4kx4\" (UID: \"dd58224f-f136-457b-b321-cec8434f3ef4\") " pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:39.885932 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:39.885945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-original-pull-secret\") pod \"global-pull-secret-syncer-qd98z\" (UID: \"5151c00d-51e2-445a-9ef4-0ee9bf2ac678\") " pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:39.886184 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:39.886059 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:39.886184 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:39.886062 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 22:50:39.886184 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:39.886085 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 22:50:39.886184 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:39.886096 2576 projected.go:196] Error preparing data for projected volume kube-api-access-qfmvb for pod openshift-network-diagnostics/network-check-target-k4kx4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:39.886184 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:39.886116 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-original-pull-secret podName:5151c00d-51e2-445a-9ef4-0ee9bf2ac678 nodeName:}" failed. No retries permitted until 2026-06-03 22:50:55.886099345 +0000 UTC m=+34.224751815 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-original-pull-secret") pod "global-pull-secret-syncer-qd98z" (UID: "5151c00d-51e2-445a-9ef4-0ee9bf2ac678") : object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:39.886184 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:39.886146 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd58224f-f136-457b-b321-cec8434f3ef4-kube-api-access-qfmvb podName:dd58224f-f136-457b-b321-cec8434f3ef4 nodeName:}" failed. No retries permitted until 2026-06-03 22:50:55.886127947 +0000 UTC m=+34.224780435 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qfmvb" (UniqueName: "kubernetes.io/projected/dd58224f-f136-457b-b321-cec8434f3ef4-kube-api-access-qfmvb") pod "network-check-target-k4kx4" (UID: "dd58224f-f136-457b-b321-cec8434f3ef4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:40.111091 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:40.111050 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:40.111594 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:40.111056 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:40.111594 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:40.111195 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k4kx4" podUID="dd58224f-f136-457b-b321-cec8434f3ef4" Jun 03 22:50:40.111594 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:40.111289 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzl52" podUID="5ba98357-42a7-4e6d-a783-7f58dd6c5ced" Jun 03 22:50:41.111642 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:41.111603 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:41.112018 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:41.111743 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd98z" podUID="5151c00d-51e2-445a-9ef4-0ee9bf2ac678" Jun 03 22:50:42.111726 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:42.111690 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:42.112189 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:42.111839 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzl52" podUID="5ba98357-42a7-4e6d-a783-7f58dd6c5ced" Jun 03 22:50:42.112189 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:42.111933 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:42.112189 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:42.112037 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k4kx4" podUID="dd58224f-f136-457b-b321-cec8434f3ef4" Jun 03 22:50:43.111804 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:43.111776 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:43.112164 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:43.111874 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd98z" podUID="5151c00d-51e2-445a-9ef4-0ee9bf2ac678" Jun 03 22:50:44.111826 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:44.111364 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:44.112553 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:44.111420 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:44.112553 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:44.111948 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzl52" podUID="5ba98357-42a7-4e6d-a783-7f58dd6c5ced" Jun 03 22:50:44.112553 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:44.112053 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k4kx4" podUID="dd58224f-f136-457b-b321-cec8434f3ef4" Jun 03 22:50:44.186366 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:44.186334 2576 generic.go:356] "Generic (PLEG): container finished" podID="1797d0cf-3a7e-47d4-a235-3bc54df20f2b" containerID="9b263dc5364887a13dfd7f54e6a9371a6c26a901192194fb57cb0171a5b6dce6" exitCode=0 Jun 03 22:50:44.186538 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:44.186405 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bspfc" event={"ID":"1797d0cf-3a7e-47d4-a235-3bc54df20f2b","Type":"ContainerDied","Data":"9b263dc5364887a13dfd7f54e6a9371a6c26a901192194fb57cb0171a5b6dce6"} Jun 03 22:50:44.187880 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:44.187859 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" event={"ID":"80fb391f-a331-493b-8ad0-bcda65353ff7","Type":"ContainerStarted","Data":"3bf7767e20dacec89ab7533e52870f8153fad71f0099448b94580702995128aa"} Jun 03 22:50:44.189209 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:44.189184 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" event={"ID":"62e72520-69b0-4f77-8c80-e58d0722e825","Type":"ContainerStarted","Data":"75496d1f0703699703a2ca10e044975a1efdbf4388ceec69481cf68a44d5e84f"} Jun 03 22:50:44.190544 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:44.190500 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8s2cb" event={"ID":"d5941858-6ad4-439b-acf6-adf174570012","Type":"ContainerStarted","Data":"bb7c98ec10bd612b490a98595f80fe454bd78cf237a9c0aca81681c42de39d3c"} Jun 03 22:50:44.195669 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:44.195649 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvqlh_c1356fb0-4884-41e6-8d59-fed020dd7a80/ovn-acl-logging/0.log" Jun 03 22:50:44.195988 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:44.195964 2576 generic.go:356] "Generic (PLEG): container finished" podID="c1356fb0-4884-41e6-8d59-fed020dd7a80" containerID="d5591d4b0a971a857ccbdadf809556f02614adc5c50ac25e8faf9d5f80440873" exitCode=1 Jun 03 22:50:44.196078 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:44.196035 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" event={"ID":"c1356fb0-4884-41e6-8d59-fed020dd7a80","Type":"ContainerStarted","Data":"e787ec40a585a8baca15c35e345bd98911e2d26b24ba36d48077d0cb8fb84aa4"} Jun 03 22:50:44.196140 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:44.196112 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" event={"ID":"c1356fb0-4884-41e6-8d59-fed020dd7a80","Type":"ContainerStarted","Data":"50eeeb92584a36fbe448e67986e0f215ca063c9a7c877eb3a676897e75862687"} Jun 03 22:50:44.196194 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:44.196144 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" event={"ID":"c1356fb0-4884-41e6-8d59-fed020dd7a80","Type":"ContainerStarted","Data":"fcc9cbf6c1b40b42a2b85ca19a0f7ebe5c481b70ac35e77d72b612bd180dd821"} Jun 03 22:50:44.196194 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:44.196172 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" event={"ID":"c1356fb0-4884-41e6-8d59-fed020dd7a80","Type":"ContainerStarted","Data":"8dee56ba4ce15f1848cc2187580a2c492b665c887d7ebd681b72e4b1543c1871"} Jun 03 22:50:44.196265 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:44.196206 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" event={"ID":"c1356fb0-4884-41e6-8d59-fed020dd7a80","Type":"ContainerDied","Data":"d5591d4b0a971a857ccbdadf809556f02614adc5c50ac25e8faf9d5f80440873"} Jun 03 22:50:44.196265 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:44.196235 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" event={"ID":"c1356fb0-4884-41e6-8d59-fed020dd7a80","Type":"ContainerStarted","Data":"5fc334ec187be51d973193631bcb971611c475efdae385b9ff585fe48e4e7e29"} Jun 03 22:50:44.197335 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:44.197316 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z5qwm" event={"ID":"21456fc8-e4fa-4ff0-8940-b460142a32ae","Type":"ContainerStarted","Data":"feb0ea33c63048d06de72c8f4d3ede9fff505c005d386a65f828a31b97338e0f"} Jun 03 22:50:44.198611 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:44.198591 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6bxfb" event={"ID":"b5a63252-f62d-4fa6-9514-cac24485d072","Type":"ContainerStarted","Data":"8d4950fc436bd0abe0b21a0efa6b1262d4604e50d6ef727da162d459ace26ac3"} Jun 03 22:50:44.199798 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:44.199777 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qm7pj" event={"ID":"fe1864d1-7354-440f-b41d-10a0b679eae7","Type":"ContainerStarted","Data":"862201398abc5bd3484ff0b3d4d6ba1669ddd7bf8ccb36db8c5f575d34e017cc"} Jun 03 22:50:44.230844 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:44.230796 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z5qwm" podStartSLOduration=3.88828622 podStartE2EDuration="22.230776209s" totalImagesPullingTime="18.342489989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:50:44.230072791 +0000 UTC m=+22.568725278" watchObservedRunningTime="2026-06-03 22:50:44.230776209 +0000 UTC m=+22.569428699" Jun 03 22:50:44.275894 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:44.275849 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2tgsj" podStartSLOduration=3.955391528 podStartE2EDuration="22.275836696s" totalImagesPullingTime="18.320445168s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:50:44.252659569 +0000 UTC m=+22.591312060" watchObservedRunningTime="2026-06-03 22:50:44.275836696 +0000 UTC m=+22.614489191" Jun 03 22:50:44.276028 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:44.275940 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8s2cb" podStartSLOduration=3.953709207 podStartE2EDuration="22.275935537s" totalImagesPullingTime="18.32222633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:50:44.275351759 +0000 UTC m=+22.614004248" watchObservedRunningTime="2026-06-03 22:50:44.275935537 +0000 UTC m=+22.614588024" Jun 03 22:50:44.291022 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:44.290982 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6bxfb" podStartSLOduration=3.9597004399999998 podStartE2EDuration="22.290972069s" totalImagesPullingTime="18.331271629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:50:44.290454342 +0000 UTC m=+22.629106830" watchObservedRunningTime="2026-06-03 22:50:44.290972069 +0000 UTC m=+22.629624556" Jun 03 22:50:44.311961 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:44.311926 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qm7pj" podStartSLOduration=8.772078587 podStartE2EDuration="22.311911273s" totalImagesPullingTime="13.539832686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:50:44.31097869 +0000 UTC m=+22.649631190" watchObservedRunningTime="2026-06-03 22:50:44.311911273 +0000 UTC m=+22.650563761" Jun 03 22:50:44.357091 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:44.357054 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 22:50:45.110901 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:45.110866 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:45.111095 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:45.111011 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd98z" podUID="5151c00d-51e2-445a-9ef4-0ee9bf2ac678" Jun 03 22:50:45.111391 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:45.111272 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T22:50:44.357077808Z","UUID":"2eda8924-1059-49e6-8e4f-883180c694dc","Handler":null,"Name":"","Endpoint":""} Jun 03 22:50:45.113598 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:45.113572 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 22:50:45.114078 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:45.113617 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 22:50:45.204071 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:45.204032 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" event={"ID":"62e72520-69b0-4f77-8c80-e58d0722e825","Type":"ContainerStarted","Data":"86b93ea64a5fb4bb16fc302ef7b286cff853d7e0d5fc8ab5af4d51e1d2c91c06"} Jun 03 22:50:45.205785 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:45.205749 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c9lkz" event={"ID":"f2bef29c-c5da-41c2-b54a-dba7dffd5063","Type":"ContainerStarted","Data":"c441914e89472b54d5b84159ce44eb46512515a1be275f1a8fad72ef1408e08a"} Jun 03 22:50:46.111550 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:46.111478 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:46.111720 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:46.111620 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k4kx4" podUID="dd58224f-f136-457b-b321-cec8434f3ef4" Jun 03 22:50:46.112199 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:46.112172 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:46.112335 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:46.112307 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzl52" podUID="5ba98357-42a7-4e6d-a783-7f58dd6c5ced" Jun 03 22:50:46.211833 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:46.211749 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvqlh_c1356fb0-4884-41e6-8d59-fed020dd7a80/ovn-acl-logging/0.log" Jun 03 22:50:46.212260 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:46.212213 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" event={"ID":"c1356fb0-4884-41e6-8d59-fed020dd7a80","Type":"ContainerStarted","Data":"a44683b5547a91342df4d53f55eafa2e3a738bbc361c468a85adc6747f5cfbc6"} Jun 03 22:50:46.214595 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:46.214569 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" event={"ID":"62e72520-69b0-4f77-8c80-e58d0722e825","Type":"ContainerStarted","Data":"c8a7f35e47d666d3842fcbed4df0560438393f7e0c472418af9462c79c57936e"} Jun 03 22:50:46.233077 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:46.233022 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c9lkz" podStartSLOduration=5.913662578 podStartE2EDuration="24.233002733s" totalImagesPullingTime="18.319340155s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:50:45.217958897 +0000 UTC m=+23.556611400" watchObservedRunningTime="2026-06-03 22:50:46.233002733 +0000 UTC m=+24.571655214" Jun 03 22:50:46.233802 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:46.233769 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6b7bt" podStartSLOduration=4.121470687 podStartE2EDuration="24.233755192s" totalImagesPullingTime="20.112284505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:50:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:50:46.232966981 +0000 UTC m=+24.571619469" watchObservedRunningTime="2026-06-03 22:50:46.233755192 +0000 UTC m=+24.572407680" Jun 03 22:50:46.600486 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:46.600453 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qm7pj" Jun 03 22:50:46.601023 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:46.601001 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qm7pj" Jun 03 22:50:47.111984 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:47.111783 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:47.112179 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:47.112068 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd98z" podUID="5151c00d-51e2-445a-9ef4-0ee9bf2ac678" Jun 03 22:50:47.216673 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:47.216639 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qm7pj" Jun 03 22:50:47.217128 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:47.217008 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qm7pj" Jun 03 22:50:48.111752 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:48.111715 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:48.111752 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:48.111750 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:48.111974 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:48.111841 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k4kx4" podUID="dd58224f-f136-457b-b321-cec8434f3ef4" Jun 03 22:50:48.112033 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:48.112003 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzl52" podUID="5ba98357-42a7-4e6d-a783-7f58dd6c5ced" Jun 03 22:50:49.111476 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:49.111302 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:49.112138 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:49.111577 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd98z" podUID="5151c00d-51e2-445a-9ef4-0ee9bf2ac678" Jun 03 22:50:49.222879 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:49.222844 2576 generic.go:356] "Generic (PLEG): container finished" podID="1797d0cf-3a7e-47d4-a235-3bc54df20f2b" containerID="f26aab3e4938a0b465ba61aa702e6753a34d8e0d6bbc236925088482b7759752" exitCode=0 Jun 03 22:50:49.223026 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:49.222911 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bspfc" event={"ID":"1797d0cf-3a7e-47d4-a235-3bc54df20f2b","Type":"ContainerDied","Data":"f26aab3e4938a0b465ba61aa702e6753a34d8e0d6bbc236925088482b7759752"} Jun 03 22:50:49.226480 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:49.226461 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvqlh_c1356fb0-4884-41e6-8d59-fed020dd7a80/ovn-acl-logging/0.log" Jun 03 22:50:49.226891 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:49.226860 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" event={"ID":"c1356fb0-4884-41e6-8d59-fed020dd7a80","Type":"ContainerStarted","Data":"159a0816e261e863b30e39b84ad37122f1c6bf42ca53528b00435d74d054b203"} Jun 03 22:50:49.227172 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:49.227153 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:49.227285 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:49.227224 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:49.227366 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:49.227347 2576 scope.go:117] "RemoveContainer" containerID="d5591d4b0a971a857ccbdadf809556f02614adc5c50ac25e8faf9d5f80440873" Jun 03 22:50:49.243045 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:49.242939 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:50.111709 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:50.111679 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:50.111709 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:50.111680 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:50.112164 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:50.111837 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzl52" podUID="5ba98357-42a7-4e6d-a783-7f58dd6c5ced" Jun 03 22:50:50.112164 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:50.111924 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k4kx4" podUID="dd58224f-f136-457b-b321-cec8434f3ef4" Jun 03 22:50:50.201789 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:50.201678 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dzl52"] Jun 03 22:50:50.202392 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:50.202348 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qd98z"] Jun 03 22:50:50.202522 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:50.202492 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:50.202680 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:50.202648 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd98z" podUID="5151c00d-51e2-445a-9ef4-0ee9bf2ac678" Jun 03 22:50:50.203548 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:50.203525 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k4kx4"] Jun 03 22:50:50.234012 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:50.233954 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvqlh_c1356fb0-4884-41e6-8d59-fed020dd7a80/ovn-acl-logging/0.log" Jun 03 22:50:50.234378 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:50.234357 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:50.234483 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:50.234375 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" event={"ID":"c1356fb0-4884-41e6-8d59-fed020dd7a80","Type":"ContainerStarted","Data":"aab4d80d7a19726c758a11a41fb7afa41963c04990b5d70d0f178c99e52e9d84"} Jun 03 22:50:50.234483 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:50.234479 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:50.234616 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:50.234475 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k4kx4" podUID="dd58224f-f136-457b-b321-cec8434f3ef4" Jun 03 22:50:50.234706 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:50.234687 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:50.234824 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:50.234806 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzl52" podUID="5ba98357-42a7-4e6d-a783-7f58dd6c5ced" Jun 03 22:50:50.255523 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:50.255485 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:50:50.262652 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:50.262602 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" podStartSLOduration=9.8792931 podStartE2EDuration="28.2625825s" totalImagesPullingTime="18.3832894s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:50:50.261417288 +0000 UTC m=+28.600069778" watchObservedRunningTime="2026-06-03 22:50:50.2625825 +0000 UTC m=+28.601234990" Jun 03 22:50:51.238652 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:51.238452 2576 generic.go:356] "Generic (PLEG): container finished" podID="1797d0cf-3a7e-47d4-a235-3bc54df20f2b" containerID="171692e425c937879d08d7af6b04eb067497d99003fdf1570da2c58cdb2e5e04" exitCode=0 Jun 03 22:50:51.239122 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:51.238534 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bspfc" event={"ID":"1797d0cf-3a7e-47d4-a235-3bc54df20f2b","Type":"ContainerDied","Data":"171692e425c937879d08d7af6b04eb067497d99003fdf1570da2c58cdb2e5e04"} Jun 03 22:50:52.116640 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:52.116614 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:52.116834 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:52.116785 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzl52" podUID="5ba98357-42a7-4e6d-a783-7f58dd6c5ced" Jun 03 22:50:52.116902 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:52.116863 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:52.116996 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:52.116978 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd98z" podUID="5151c00d-51e2-445a-9ef4-0ee9bf2ac678" Jun 03 22:50:52.117053 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:52.117034 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:52.117146 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:52.117129 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k4kx4" podUID="dd58224f-f136-457b-b321-cec8434f3ef4" Jun 03 22:50:53.245494 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:53.245411 2576 generic.go:356] "Generic (PLEG): container finished" podID="1797d0cf-3a7e-47d4-a235-3bc54df20f2b" containerID="d651289c58226ddc16672389513cfd7ec152b752feec0d9f99c33b8c651b39b2" exitCode=0 Jun 03 22:50:53.245494 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:53.245465 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bspfc" event={"ID":"1797d0cf-3a7e-47d4-a235-3bc54df20f2b","Type":"ContainerDied","Data":"d651289c58226ddc16672389513cfd7ec152b752feec0d9f99c33b8c651b39b2"} Jun 03 22:50:54.111139 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:54.111108 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:54.111331 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:54.111108 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:54.111331 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:54.111254 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd98z" podUID="5151c00d-51e2-445a-9ef4-0ee9bf2ac678" Jun 03 22:50:54.111331 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:54.111108 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:54.111523 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:54.111328 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k4kx4" podUID="dd58224f-f136-457b-b321-cec8434f3ef4" Jun 03 22:50:54.111523 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:54.111414 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzl52" podUID="5ba98357-42a7-4e6d-a783-7f58dd6c5ced" Jun 03 22:50:55.805622 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:55.805583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs\") pod \"network-metrics-daemon-dzl52\" (UID: \"5ba98357-42a7-4e6d-a783-7f58dd6c5ced\") " pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:55.806223 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:55.805721 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:55.806223 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:55.805776 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs podName:5ba98357-42a7-4e6d-a783-7f58dd6c5ced nodeName:}" failed. No retries permitted until 2026-06-03 22:51:27.80576254 +0000 UTC m=+66.144415006 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs") pod "network-metrics-daemon-dzl52" (UID: "5ba98357-42a7-4e6d-a783-7f58dd6c5ced") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:55.906874 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:55.906834 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-original-pull-secret\") pod \"global-pull-secret-syncer-qd98z\" (UID: \"5151c00d-51e2-445a-9ef4-0ee9bf2ac678\") " pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:55.907052 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:55.906906 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfmvb\" (UniqueName: \"kubernetes.io/projected/dd58224f-f136-457b-b321-cec8434f3ef4-kube-api-access-qfmvb\") pod \"network-check-target-k4kx4\" (UID: \"dd58224f-f136-457b-b321-cec8434f3ef4\") " pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:55.907052 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:55.907039 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 22:50:55.907160 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:55.907064 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 22:50:55.907160 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:55.907079 2576 projected.go:196] Error preparing data for projected volume kube-api-access-qfmvb for pod openshift-network-diagnostics/network-check-target-k4kx4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:55.907160 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:55.907126 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd58224f-f136-457b-b321-cec8434f3ef4-kube-api-access-qfmvb podName:dd58224f-f136-457b-b321-cec8434f3ef4 nodeName:}" failed. No retries permitted until 2026-06-03 22:51:27.907111319 +0000 UTC m=+66.245763786 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qfmvb" (UniqueName: "kubernetes.io/projected/dd58224f-f136-457b-b321-cec8434f3ef4-kube-api-access-qfmvb") pod "network-check-target-k4kx4" (UID: "dd58224f-f136-457b-b321-cec8434f3ef4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:55.907160 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:55.907037 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:55.907325 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:55.907207 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-original-pull-secret podName:5151c00d-51e2-445a-9ef4-0ee9bf2ac678 nodeName:}" failed. No retries permitted until 2026-06-03 22:51:27.907186487 +0000 UTC m=+66.245838955 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-original-pull-secret") pod "global-pull-secret-syncer-qd98z" (UID: "5151c00d-51e2-445a-9ef4-0ee9bf2ac678") : object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:56.111533 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:56.111426 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:56.111533 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:56.111427 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:56.111756 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:56.111595 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzl52" podUID="5ba98357-42a7-4e6d-a783-7f58dd6c5ced" Jun 03 22:50:56.111756 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:56.111650 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:56.111854 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:56.111769 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd98z" podUID="5151c00d-51e2-445a-9ef4-0ee9bf2ac678" Jun 03 22:50:56.111912 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:56.111864 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k4kx4" podUID="dd58224f-f136-457b-b321-cec8434f3ef4" Jun 03 22:50:57.008315 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.008286 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-99.ec2.internal" event="NodeReady" Jun 03 22:50:57.008803 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.008453 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 03 22:50:57.054105 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.054062 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rx252"] Jun 03 22:50:57.069206 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.069158 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-v97ll"] Jun 03 22:50:57.069376 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.069302 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rx252" Jun 03 22:50:57.071433 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.071405 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bfmtg\"" Jun 03 22:50:57.071624 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.071597 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 22:50:57.071745 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.071732 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 22:50:57.079353 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.079331 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v97ll"] Jun 03 22:50:57.079461 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.079365 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rx252"] Jun 03 22:50:57.079461 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.079453 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v97ll" Jun 03 22:50:57.081177 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.081156 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 22:50:57.081288 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.081203 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 22:50:57.081521 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.081427 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nr74v\"" Jun 03 22:50:57.081521 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.081478 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 22:50:57.217174 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.217084 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95bd52c6-e259-4780-b114-f7de0eb8745c-cert\") pod \"ingress-canary-v97ll\" (UID: \"95bd52c6-e259-4780-b114-f7de0eb8745c\") " pod="openshift-ingress-canary/ingress-canary-v97ll" Jun 03 22:50:57.217174 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.217134 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/45947991-d774-45e0-9345-7a0eef712d69-config-volume\") pod \"dns-default-rx252\" (UID: \"45947991-d774-45e0-9345-7a0eef712d69\") " pod="openshift-dns/dns-default-rx252" Jun 03 22:50:57.217174 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.217159 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls\") pod \"dns-default-rx252\" (UID: \"45947991-d774-45e0-9345-7a0eef712d69\") " pod="openshift-dns/dns-default-rx252" Jun 03 22:50:57.217448 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.217181 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45947991-d774-45e0-9345-7a0eef712d69-tmp-dir\") pod \"dns-default-rx252\" (UID: \"45947991-d774-45e0-9345-7a0eef712d69\") " pod="openshift-dns/dns-default-rx252" Jun 03 22:50:57.217448 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.217207 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5vjw\" (UniqueName: \"kubernetes.io/projected/45947991-d774-45e0-9345-7a0eef712d69-kube-api-access-p5vjw\") pod \"dns-default-rx252\" (UID: \"45947991-d774-45e0-9345-7a0eef712d69\") " pod="openshift-dns/dns-default-rx252" Jun 03 22:50:57.217448 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.217234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx87r\" (UniqueName: \"kubernetes.io/projected/95bd52c6-e259-4780-b114-f7de0eb8745c-kube-api-access-mx87r\") pod \"ingress-canary-v97ll\" (UID: \"95bd52c6-e259-4780-b114-f7de0eb8745c\") " pod="openshift-ingress-canary/ingress-canary-v97ll" Jun 03 22:50:57.317969 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.317934 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95bd52c6-e259-4780-b114-f7de0eb8745c-cert\") pod \"ingress-canary-v97ll\" (UID: \"95bd52c6-e259-4780-b114-f7de0eb8745c\") " pod="openshift-ingress-canary/ingress-canary-v97ll" Jun 03 22:50:57.317969 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.317976 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/45947991-d774-45e0-9345-7a0eef712d69-config-volume\") pod \"dns-default-rx252\" (UID: \"45947991-d774-45e0-9345-7a0eef712d69\") " pod="openshift-dns/dns-default-rx252" Jun 03 22:50:57.318215 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.317993 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls\") pod \"dns-default-rx252\" (UID: \"45947991-d774-45e0-9345-7a0eef712d69\") " pod="openshift-dns/dns-default-rx252" Jun 03 22:50:57.318215 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.318012 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45947991-d774-45e0-9345-7a0eef712d69-tmp-dir\") pod \"dns-default-rx252\" (UID: \"45947991-d774-45e0-9345-7a0eef712d69\") " pod="openshift-dns/dns-default-rx252" Jun 03 22:50:57.318215 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.318035 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5vjw\" (UniqueName: \"kubernetes.io/projected/45947991-d774-45e0-9345-7a0eef712d69-kube-api-access-p5vjw\") pod \"dns-default-rx252\" (UID: \"45947991-d774-45e0-9345-7a0eef712d69\") " pod="openshift-dns/dns-default-rx252" Jun 03 22:50:57.318215 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.318061 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx87r\" (UniqueName: \"kubernetes.io/projected/95bd52c6-e259-4780-b114-f7de0eb8745c-kube-api-access-mx87r\") pod \"ingress-canary-v97ll\" (UID: \"95bd52c6-e259-4780-b114-f7de0eb8745c\") " pod="openshift-ingress-canary/ingress-canary-v97ll" Jun 03 22:50:57.318215 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:57.318117 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:50:57.318215 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:57.318185 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls podName:45947991-d774-45e0-9345-7a0eef712d69 nodeName:}" failed. No retries permitted until 2026-06-03 22:50:57.818165349 +0000 UTC m=+36.156817828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls") pod "dns-default-rx252" (UID: "45947991-d774-45e0-9345-7a0eef712d69") : secret "dns-default-metrics-tls" not found Jun 03 22:50:57.318588 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.318399 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45947991-d774-45e0-9345-7a0eef712d69-tmp-dir\") pod \"dns-default-rx252\" (UID: \"45947991-d774-45e0-9345-7a0eef712d69\") " pod="openshift-dns/dns-default-rx252" Jun 03 22:50:57.318706 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.318684 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/45947991-d774-45e0-9345-7a0eef712d69-config-volume\") pod \"dns-default-rx252\" (UID: \"45947991-d774-45e0-9345-7a0eef712d69\") " pod="openshift-dns/dns-default-rx252" Jun 03 22:50:57.321963 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.321945 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95bd52c6-e259-4780-b114-f7de0eb8745c-cert\") pod \"ingress-canary-v97ll\" (UID: \"95bd52c6-e259-4780-b114-f7de0eb8745c\") " pod="openshift-ingress-canary/ingress-canary-v97ll" Jun 03 22:50:57.327540 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.327493 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5vjw\" (UniqueName: \"kubernetes.io/projected/45947991-d774-45e0-9345-7a0eef712d69-kube-api-access-p5vjw\") pod \"dns-default-rx252\" (UID: \"45947991-d774-45e0-9345-7a0eef712d69\") " pod="openshift-dns/dns-default-rx252" Jun 03 22:50:57.327645 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.327602 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx87r\" (UniqueName: \"kubernetes.io/projected/95bd52c6-e259-4780-b114-f7de0eb8745c-kube-api-access-mx87r\") pod \"ingress-canary-v97ll\" (UID: \"95bd52c6-e259-4780-b114-f7de0eb8745c\") " pod="openshift-ingress-canary/ingress-canary-v97ll" Jun 03 22:50:57.390956 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.390905 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v97ll" Jun 03 22:50:57.747704 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.747450 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v97ll"] Jun 03 22:50:57.751882 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:50:57.751855 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95bd52c6_e259_4780_b114_f7de0eb8745c.slice/crio-b5350332aba6a057acc68a61fa9109fe811d9c3a5dded8d065cdfdb7c87c1490 WatchSource:0}: Error finding container b5350332aba6a057acc68a61fa9109fe811d9c3a5dded8d065cdfdb7c87c1490: Status 404 returned error can't find the container with id b5350332aba6a057acc68a61fa9109fe811d9c3a5dded8d065cdfdb7c87c1490 Jun 03 22:50:57.821378 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:57.821352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls\") pod \"dns-default-rx252\" (UID: \"45947991-d774-45e0-9345-7a0eef712d69\") " pod="openshift-dns/dns-default-rx252" Jun 03 22:50:57.821559 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:57.821541 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:50:57.821621 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:57.821612 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls podName:45947991-d774-45e0-9345-7a0eef712d69 nodeName:}" failed. No retries permitted until 2026-06-03 22:50:58.82159056 +0000 UTC m=+37.160243049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls") pod "dns-default-rx252" (UID: "45947991-d774-45e0-9345-7a0eef712d69") : secret "dns-default-metrics-tls" not found Jun 03 22:50:58.111078 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:58.110996 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:50:58.111583 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:58.110999 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:50:58.111583 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:58.111155 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:50:58.114057 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:58.114033 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 22:50:58.114195 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:58.114059 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 22:50:58.114195 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:58.114037 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 22:50:58.114195 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:58.114112 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 22:50:58.114441 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:58.114421 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zbfkl\"" Jun 03 22:50:58.114561 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:58.114452 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2ckpr\"" Jun 03 22:50:58.260042 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:58.260006 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v97ll" event={"ID":"95bd52c6-e259-4780-b114-f7de0eb8745c","Type":"ContainerStarted","Data":"b5350332aba6a057acc68a61fa9109fe811d9c3a5dded8d065cdfdb7c87c1490"} Jun 03 22:50:58.263268 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:58.263229 2576 generic.go:356] "Generic (PLEG): container finished" podID="1797d0cf-3a7e-47d4-a235-3bc54df20f2b" containerID="eccef42e1d97e1f6eeb7962ea484d1bf46d345428d2c33531a2071b6491d88e7" exitCode=0 Jun 03 22:50:58.263405 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:58.263295 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bspfc" event={"ID":"1797d0cf-3a7e-47d4-a235-3bc54df20f2b","Type":"ContainerDied","Data":"eccef42e1d97e1f6eeb7962ea484d1bf46d345428d2c33531a2071b6491d88e7"} Jun 03 22:50:58.829000 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:58.828962 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls\") pod \"dns-default-rx252\" (UID: \"45947991-d774-45e0-9345-7a0eef712d69\") " pod="openshift-dns/dns-default-rx252" Jun 03 22:50:58.829160 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:58.829141 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:50:58.829223 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:50:58.829213 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls podName:45947991-d774-45e0-9345-7a0eef712d69 nodeName:}" failed. No retries permitted until 2026-06-03 22:51:00.829196624 +0000 UTC m=+39.167849090 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls") pod "dns-default-rx252" (UID: "45947991-d774-45e0-9345-7a0eef712d69") : secret "dns-default-metrics-tls" not found Jun 03 22:50:59.269694 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:59.269521 2576 generic.go:356] "Generic (PLEG): container finished" podID="1797d0cf-3a7e-47d4-a235-3bc54df20f2b" containerID="7dcf5acacb205342aa26f789899336ea8fd61988377c835a14a2a5deea18567c" exitCode=0 Jun 03 22:50:59.270066 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:50:59.269566 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bspfc" event={"ID":"1797d0cf-3a7e-47d4-a235-3bc54df20f2b","Type":"ContainerDied","Data":"7dcf5acacb205342aa26f789899336ea8fd61988377c835a14a2a5deea18567c"} Jun 03 22:51:00.275733 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:00.275689 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bspfc" event={"ID":"1797d0cf-3a7e-47d4-a235-3bc54df20f2b","Type":"ContainerStarted","Data":"1f3651acc46ea48953de31047e3824fd7563148abd9d5a4cbf1d2f2f80555128"} Jun 03 22:51:00.277146 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:00.277126 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v97ll" event={"ID":"95bd52c6-e259-4780-b114-f7de0eb8745c","Type":"ContainerStarted","Data":"1a699421844c3e245624a5a801d092de76ca21fbddec7f4404b9d81360c2de48"} Jun 03 22:51:00.294804 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:00.294756 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bspfc" podStartSLOduration=9.486037887 podStartE2EDuration="38.294740429s" totalImagesPullingTime="28.808702542s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:50:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:51:00.294393526 +0000 UTC m=+38.633046013" watchObservedRunningTime="2026-06-03 22:51:00.294740429 +0000 UTC m=+38.633392916" Jun 03 22:51:00.319113 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:00.319070 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-v97ll" podStartSLOduration=1.841762465 podStartE2EDuration="3.319056503s" totalImagesPullingTime="1.477294038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:50:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:51:00.318052899 +0000 UTC m=+38.656705392" watchObservedRunningTime="2026-06-03 22:51:00.319056503 +0000 UTC m=+38.657708991" Jun 03 22:51:00.841816 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:00.841772 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls\") pod \"dns-default-rx252\" (UID: \"45947991-d774-45e0-9345-7a0eef712d69\") " pod="openshift-dns/dns-default-rx252" Jun 03 22:51:00.841996 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:51:00.841934 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:51:00.842037 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:51:00.842015 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls podName:45947991-d774-45e0-9345-7a0eef712d69 nodeName:}" failed. No retries permitted until 2026-06-03 22:51:04.841996957 +0000 UTC m=+43.180649427 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls") pod "dns-default-rx252" (UID: "45947991-d774-45e0-9345-7a0eef712d69") : secret "dns-default-metrics-tls" not found Jun 03 22:51:04.872675 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:04.872627 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls\") pod \"dns-default-rx252\" (UID: \"45947991-d774-45e0-9345-7a0eef712d69\") " pod="openshift-dns/dns-default-rx252" Jun 03 22:51:04.873134 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:51:04.872806 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:51:04.873134 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:51:04.872870 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls podName:45947991-d774-45e0-9345-7a0eef712d69 nodeName:}" failed. No retries permitted until 2026-06-03 22:51:12.872854485 +0000 UTC m=+51.211506952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls") pod "dns-default-rx252" (UID: "45947991-d774-45e0-9345-7a0eef712d69") : secret "dns-default-metrics-tls" not found Jun 03 22:51:12.932128 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:12.932089 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls\") pod \"dns-default-rx252\" (UID: \"45947991-d774-45e0-9345-7a0eef712d69\") " pod="openshift-dns/dns-default-rx252" Jun 03 22:51:12.932632 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:51:12.932195 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:51:12.932632 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:51:12.932257 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls podName:45947991-d774-45e0-9345-7a0eef712d69 nodeName:}" failed. No retries permitted until 2026-06-03 22:51:28.932243592 +0000 UTC m=+67.270896059 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls") pod "dns-default-rx252" (UID: "45947991-d774-45e0-9345-7a0eef712d69") : secret "dns-default-metrics-tls" not found Jun 03 22:51:22.251763 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:22.251733 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vvqlh" Jun 03 22:51:27.839084 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:27.839032 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs\") pod \"network-metrics-daemon-dzl52\" (UID: \"5ba98357-42a7-4e6d-a783-7f58dd6c5ced\") " pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:51:27.841020 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:27.840999 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 22:51:27.849416 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:51:27.849392 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 22:51:27.849537 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:51:27.849462 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs podName:5ba98357-42a7-4e6d-a783-7f58dd6c5ced nodeName:}" failed. No retries permitted until 2026-06-03 22:52:31.849442271 +0000 UTC m=+130.188094737 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs") pod "network-metrics-daemon-dzl52" (UID: "5ba98357-42a7-4e6d-a783-7f58dd6c5ced") : secret "metrics-daemon-secret" not found Jun 03 22:51:27.940292 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:27.940254 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfmvb\" (UniqueName: \"kubernetes.io/projected/dd58224f-f136-457b-b321-cec8434f3ef4-kube-api-access-qfmvb\") pod \"network-check-target-k4kx4\" (UID: \"dd58224f-f136-457b-b321-cec8434f3ef4\") " pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:51:27.940448 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:27.940309 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-original-pull-secret\") pod \"global-pull-secret-syncer-qd98z\" (UID: \"5151c00d-51e2-445a-9ef4-0ee9bf2ac678\") " pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:51:27.942387 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:27.942363 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 22:51:27.942464 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:27.942366 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 22:51:27.952090 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:27.952068 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 22:51:27.954487 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:27.954454 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5151c00d-51e2-445a-9ef4-0ee9bf2ac678-original-pull-secret\") pod \"global-pull-secret-syncer-qd98z\" (UID: \"5151c00d-51e2-445a-9ef4-0ee9bf2ac678\") " pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:51:27.963352 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:27.963329 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfmvb\" (UniqueName: \"kubernetes.io/projected/dd58224f-f136-457b-b321-cec8434f3ef4-kube-api-access-qfmvb\") pod \"network-check-target-k4kx4\" (UID: \"dd58224f-f136-457b-b321-cec8434f3ef4\") " pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:51:28.124001 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:28.123921 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd98z" Jun 03 22:51:28.132852 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:28.132827 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2ckpr\"" Jun 03 22:51:28.141381 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:28.141355 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:51:28.258629 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:28.258596 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qd98z"] Jun 03 22:51:28.262796 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:51:28.262771 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5151c00d_51e2_445a_9ef4_0ee9bf2ac678.slice/crio-fcb7f8d680e4694d1e9674dcda62f7f0a94e6c6169ad03fe3373b0f8ba57ede7 WatchSource:0}: Error finding container fcb7f8d680e4694d1e9674dcda62f7f0a94e6c6169ad03fe3373b0f8ba57ede7: Status 404 returned error can't find the container with id fcb7f8d680e4694d1e9674dcda62f7f0a94e6c6169ad03fe3373b0f8ba57ede7 Jun 03 22:51:28.269568 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:28.269538 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k4kx4"] Jun 03 22:51:28.272659 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:51:28.272635 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd58224f_f136_457b_b321_cec8434f3ef4.slice/crio-bb76e6ace611cd4917831cbd50906da57a544120329a0a954e28c9a949105643 WatchSource:0}: Error finding container bb76e6ace611cd4917831cbd50906da57a544120329a0a954e28c9a949105643: Status 404 returned error can't find the container with id bb76e6ace611cd4917831cbd50906da57a544120329a0a954e28c9a949105643 Jun 03 22:51:28.341639 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:28.341604 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k4kx4" event={"ID":"dd58224f-f136-457b-b321-cec8434f3ef4","Type":"ContainerStarted","Data":"bb76e6ace611cd4917831cbd50906da57a544120329a0a954e28c9a949105643"} Jun 03 22:51:28.342617 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:28.342588 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qd98z" event={"ID":"5151c00d-51e2-445a-9ef4-0ee9bf2ac678","Type":"ContainerStarted","Data":"fcb7f8d680e4694d1e9674dcda62f7f0a94e6c6169ad03fe3373b0f8ba57ede7"} Jun 03 22:51:28.946756 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:28.946722 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls\") pod \"dns-default-rx252\" (UID: \"45947991-d774-45e0-9345-7a0eef712d69\") " pod="openshift-dns/dns-default-rx252" Jun 03 22:51:28.947215 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:51:28.946905 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:51:28.947215 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:51:28.946989 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls podName:45947991-d774-45e0-9345-7a0eef712d69 nodeName:}" failed. No retries permitted until 2026-06-03 22:52:00.946967352 +0000 UTC m=+99.285619833 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls") pod "dns-default-rx252" (UID: "45947991-d774-45e0-9345-7a0eef712d69") : secret "dns-default-metrics-tls" not found Jun 03 22:51:33.358114 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:33.358072 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k4kx4" event={"ID":"dd58224f-f136-457b-b321-cec8434f3ef4","Type":"ContainerStarted","Data":"ed88d5131bd82628cbcd996f0369c4b5ec9c456902c4485b59753402fc962721"} Jun 03 22:51:33.358608 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:33.358204 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:51:33.359575 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:33.359552 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qd98z" event={"ID":"5151c00d-51e2-445a-9ef4-0ee9bf2ac678","Type":"ContainerStarted","Data":"72e6fa0a421abe2acd2a2368b9878ff85cf8823d5af942d9a2321637dcfbb06c"} Jun 03 22:51:33.373418 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:33.373372 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-k4kx4" podStartSLOduration=67.159522336 podStartE2EDuration="1m11.373358875s" totalImagesPullingTime="4.213836539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:51:33.372586264 +0000 UTC m=+71.711238752" watchObservedRunningTime="2026-06-03 22:51:33.373358875 +0000 UTC m=+71.712011393" Jun 03 22:51:33.388729 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:51:33.388686 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qd98z" podStartSLOduration=67.161776835 podStartE2EDuration="1m11.388672525s" totalImagesPullingTime="4.22689569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:51:33.387585815 +0000 UTC m=+71.726238303" watchObservedRunningTime="2026-06-03 22:51:33.388672525 +0000 UTC m=+71.727325013" Jun 03 22:52:00.962169 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:52:00.962116 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls\") pod \"dns-default-rx252\" (UID: \"45947991-d774-45e0-9345-7a0eef712d69\") " pod="openshift-dns/dns-default-rx252" Jun 03 22:52:00.962643 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:52:00.962269 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:52:00.962643 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:52:00.962346 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls podName:45947991-d774-45e0-9345-7a0eef712d69 nodeName:}" failed. No retries permitted until 2026-06-03 22:53:04.962330168 +0000 UTC m=+163.300982634 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls") pod "dns-default-rx252" (UID: "45947991-d774-45e0-9345-7a0eef712d69") : secret "dns-default-metrics-tls" not found Jun 03 22:52:04.363970 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:52:04.363942 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k4kx4" Jun 03 22:52:31.872392 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:52:31.872354 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs\") pod \"network-metrics-daemon-dzl52\" (UID: \"5ba98357-42a7-4e6d-a783-7f58dd6c5ced\") " pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:52:31.872895 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:52:31.872525 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 22:52:31.872895 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:52:31.872611 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs podName:5ba98357-42a7-4e6d-a783-7f58dd6c5ced nodeName:}" failed. No retries permitted until 2026-06-03 22:54:33.872593645 +0000 UTC m=+252.211246110 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs") pod "network-metrics-daemon-dzl52" (UID: "5ba98357-42a7-4e6d-a783-7f58dd6c5ced") : secret "metrics-daemon-secret" not found Jun 03 22:53:00.081393 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:53:00.081352 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rx252" podUID="45947991-d774-45e0-9345-7a0eef712d69" Jun 03 22:53:00.557636 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:00.557611 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rx252" Jun 03 22:53:01.137463 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:53:01.137427 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dzl52" podUID="5ba98357-42a7-4e6d-a783-7f58dd6c5ced" Jun 03 22:53:05.010099 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:05.010050 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls\") pod \"dns-default-rx252\" (UID: \"45947991-d774-45e0-9345-7a0eef712d69\") " pod="openshift-dns/dns-default-rx252" Jun 03 22:53:05.010628 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:53:05.010212 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:53:05.010628 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:53:05.010285 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls podName:45947991-d774-45e0-9345-7a0eef712d69 nodeName:}" failed. No retries permitted until 2026-06-03 22:55:07.010267888 +0000 UTC m=+285.348920354 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls") pod "dns-default-rx252" (UID: "45947991-d774-45e0-9345-7a0eef712d69") : secret "dns-default-metrics-tls" not found Jun 03 22:53:16.111453 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:16.111414 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:53:54.264645 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.264612 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dlxgt"] Jun 03 22:53:54.266912 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.266891 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dlxgt" Jun 03 22:53:54.268774 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.268753 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 03 22:53:54.268874 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.268791 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-qjzbt\"" Jun 03 22:53:54.269167 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.269153 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 03 22:53:54.271411 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.271384 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-69684796bc-lglv6"] Jun 03 22:53:54.273212 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.273191 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-69684796bc-lglv6" Jun 03 22:53:54.275545 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.275526 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 03 22:53:54.275647 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.275595 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 22:53:54.275714 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.275568 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 03 22:53:54.275714 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.275550 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 22:53:54.275976 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.275961 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-grnxt\"" Jun 03 22:53:54.278896 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.278873 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dlxgt"] Jun 03 22:53:54.283429 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.283408 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 03 22:53:54.289518 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.289487 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-69684796bc-lglv6"] Jun 03 22:53:54.336113 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.336078 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90e6c068-c987-41bc-a0a3-596ce3834b50-serving-cert\") pod \"insights-operator-69684796bc-lglv6\" (UID: \"90e6c068-c987-41bc-a0a3-596ce3834b50\") " pod="openshift-insights/insights-operator-69684796bc-lglv6" Jun 03 22:53:54.336278 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.336124 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90e6c068-c987-41bc-a0a3-596ce3834b50-service-ca-bundle\") pod \"insights-operator-69684796bc-lglv6\" (UID: \"90e6c068-c987-41bc-a0a3-596ce3834b50\") " pod="openshift-insights/insights-operator-69684796bc-lglv6" Jun 03 22:53:54.336278 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.336144 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90e6c068-c987-41bc-a0a3-596ce3834b50-trusted-ca-bundle\") pod \"insights-operator-69684796bc-lglv6\" (UID: \"90e6c068-c987-41bc-a0a3-596ce3834b50\") " pod="openshift-insights/insights-operator-69684796bc-lglv6" Jun 03 22:53:54.336278 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.336171 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9dss\" (UniqueName: \"kubernetes.io/projected/90e6c068-c987-41bc-a0a3-596ce3834b50-kube-api-access-w9dss\") pod \"insights-operator-69684796bc-lglv6\" (UID: \"90e6c068-c987-41bc-a0a3-596ce3834b50\") " pod="openshift-insights/insights-operator-69684796bc-lglv6" Jun 03 22:53:54.336278 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.336211 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90e6c068-c987-41bc-a0a3-596ce3834b50-tmp\") pod \"insights-operator-69684796bc-lglv6\" (UID: \"90e6c068-c987-41bc-a0a3-596ce3834b50\") " pod="openshift-insights/insights-operator-69684796bc-lglv6" Jun 03 22:53:54.336278 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.336235 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/90e6c068-c987-41bc-a0a3-596ce3834b50-snapshots\") pod \"insights-operator-69684796bc-lglv6\" (UID: \"90e6c068-c987-41bc-a0a3-596ce3834b50\") " pod="openshift-insights/insights-operator-69684796bc-lglv6" Jun 03 22:53:54.336278 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.336259 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9swws\" (UniqueName: \"kubernetes.io/projected/2a41c46f-e965-4cdc-b3da-940c477e04e3-kube-api-access-9swws\") pod \"volume-data-source-validator-78dd696465-dlxgt\" (UID: \"2a41c46f-e965-4cdc-b3da-940c477e04e3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dlxgt" Jun 03 22:53:54.358797 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.358765 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-8swxw"] Jun 03 22:53:54.360434 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.360419 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8swxw" Jun 03 22:53:54.362101 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.362083 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hh8m8\"" Jun 03 22:53:54.364909 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.364807 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-54nbm"] Jun 03 22:53:54.366867 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.366848 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-xggwn"] Jun 03 22:53:54.366997 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.366980 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-54nbm" Jun 03 22:53:54.368550 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.368534 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-75df67dd47-pr8cf"] Jun 03 22:53:54.368650 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.368583 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xggwn" Jun 03 22:53:54.368650 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.368631 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-p8pxm\"" Jun 03 22:53:54.368782 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.368759 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 03 22:53:54.368841 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.368789 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 03 22:53:54.368977 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.368951 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 03 22:53:54.369244 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.369229 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 03 22:53:54.370058 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.370041 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-449jt"] Jun 03 22:53:54.370143 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.370129 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:53:54.370970 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.370950 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 03 22:53:54.371079 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.370982 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 22:53:54.371079 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.370988 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rpq4x\"" Jun 03 22:53:54.371079 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.371011 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 22:53:54.371230 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.371099 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 03 22:53:54.371577 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.371563 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-q45qs\"" Jun 03 22:53:54.371987 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.371840 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-449jt" Jun 03 22:53:54.372253 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.372232 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 03 22:53:54.372346 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.372242 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 22:53:54.372410 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.372344 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 22:53:54.372410 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.372354 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 03 22:53:54.372653 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.372635 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 03 22:53:54.372835 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.372771 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 03 22:53:54.373279 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.373261 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-8swxw"] Jun 03 22:53:54.373375 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.373358 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 03 22:53:54.373529 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.373428 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 03 22:53:54.373928 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.373910 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 03 22:53:54.374196 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.373610 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 03 22:53:54.375115 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.375094 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-86tbl\"" Jun 03 22:53:54.381767 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.381745 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-449jt"] Jun 03 22:53:54.382667 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.382644 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-xggwn"] Jun 03 22:53:54.383349 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.383331 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-54nbm"] Jun 03 22:53:54.384056 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.384036 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-75df67dd47-pr8cf"] Jun 03 22:53:54.436915 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.436885 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jb4h\" (UniqueName: \"kubernetes.io/projected/11ac8b95-ee98-48d9-897f-3d43d69cf0d7-kube-api-access-6jb4h\") pod \"service-ca-operator-5bc4cf794b-54nbm\" (UID: \"11ac8b95-ee98-48d9-897f-3d43d69cf0d7\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-54nbm" Jun 03 22:53:54.436915 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.436914 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/222cdbeb-74e5-4b5d-af08-013b734867d0-stats-auth\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:53:54.437123 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.436937 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/90e6c068-c987-41bc-a0a3-596ce3834b50-snapshots\") pod \"insights-operator-69684796bc-lglv6\" (UID: \"90e6c068-c987-41bc-a0a3-596ce3834b50\") " pod="openshift-insights/insights-operator-69684796bc-lglv6" Jun 03 22:53:54.437123 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.436955 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bbac7faa-a131-4ec6-b3cb-09a3c00e69f7-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-449jt\" (UID: \"bbac7faa-a131-4ec6-b3cb-09a3c00e69f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-449jt" Jun 03 22:53:54.437123 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.436994 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/423754b4-98a4-4a39-aee0-ea4457a1d03f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xggwn\" (UID: \"423754b4-98a4-4a39-aee0-ea4457a1d03f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xggwn" Jun 03 22:53:54.437123 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.437082 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/222cdbeb-74e5-4b5d-af08-013b734867d0-service-ca-bundle\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:53:54.437123 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.437108 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/222cdbeb-74e5-4b5d-af08-013b734867d0-metrics-certs\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:53:54.437123 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.437126 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqpb5\" (UniqueName: \"kubernetes.io/projected/423754b4-98a4-4a39-aee0-ea4457a1d03f-kube-api-access-zqpb5\") pod \"cluster-monitoring-operator-57769895dd-xggwn\" (UID: \"423754b4-98a4-4a39-aee0-ea4457a1d03f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xggwn" Jun 03 22:53:54.437338 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.437148 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90e6c068-c987-41bc-a0a3-596ce3834b50-trusted-ca-bundle\") pod \"insights-operator-69684796bc-lglv6\" (UID: \"90e6c068-c987-41bc-a0a3-596ce3834b50\") " pod="openshift-insights/insights-operator-69684796bc-lglv6" Jun 03 22:53:54.437338 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.437164 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11ac8b95-ee98-48d9-897f-3d43d69cf0d7-serving-cert\") pod \"service-ca-operator-5bc4cf794b-54nbm\" (UID: \"11ac8b95-ee98-48d9-897f-3d43d69cf0d7\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-54nbm" Jun 03 22:53:54.437338 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.437182 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9dss\" (UniqueName: \"kubernetes.io/projected/90e6c068-c987-41bc-a0a3-596ce3834b50-kube-api-access-w9dss\") pod \"insights-operator-69684796bc-lglv6\" (UID: \"90e6c068-c987-41bc-a0a3-596ce3834b50\") " pod="openshift-insights/insights-operator-69684796bc-lglv6" Jun 03 22:53:54.437338 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.437204 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bbac7faa-a131-4ec6-b3cb-09a3c00e69f7-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-449jt\" (UID: \"bbac7faa-a131-4ec6-b3cb-09a3c00e69f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-449jt" Jun 03 22:53:54.437338 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.437226 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/423754b4-98a4-4a39-aee0-ea4457a1d03f-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-xggwn\" (UID: \"423754b4-98a4-4a39-aee0-ea4457a1d03f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xggwn" Jun 03 22:53:54.437338 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.437257 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/222cdbeb-74e5-4b5d-af08-013b734867d0-default-certificate\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:53:54.437338 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.437278 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11ac8b95-ee98-48d9-897f-3d43d69cf0d7-config\") pod \"service-ca-operator-5bc4cf794b-54nbm\" (UID: \"11ac8b95-ee98-48d9-897f-3d43d69cf0d7\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-54nbm" Jun 03 22:53:54.437338 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.437316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90e6c068-c987-41bc-a0a3-596ce3834b50-tmp\") pod \"insights-operator-69684796bc-lglv6\" (UID: \"90e6c068-c987-41bc-a0a3-596ce3834b50\") " pod="openshift-insights/insights-operator-69684796bc-lglv6" Jun 03 22:53:54.437746 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.437354 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkw97\" (UniqueName: \"kubernetes.io/projected/222cdbeb-74e5-4b5d-af08-013b734867d0-kube-api-access-fkw97\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:53:54.437746 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.437380 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90e6c068-c987-41bc-a0a3-596ce3834b50-service-ca-bundle\") pod \"insights-operator-69684796bc-lglv6\" (UID: \"90e6c068-c987-41bc-a0a3-596ce3834b50\") " pod="openshift-insights/insights-operator-69684796bc-lglv6" Jun 03 22:53:54.437746 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.437432 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9swws\" (UniqueName: \"kubernetes.io/projected/2a41c46f-e965-4cdc-b3da-940c477e04e3-kube-api-access-9swws\") pod \"volume-data-source-validator-78dd696465-dlxgt\" (UID: \"2a41c46f-e965-4cdc-b3da-940c477e04e3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dlxgt" Jun 03 22:53:54.437746 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.437464 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90e6c068-c987-41bc-a0a3-596ce3834b50-serving-cert\") pod \"insights-operator-69684796bc-lglv6\" (UID: \"90e6c068-c987-41bc-a0a3-596ce3834b50\") " pod="openshift-insights/insights-operator-69684796bc-lglv6" Jun 03 22:53:54.437746 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.437531 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrgrw\" (UniqueName: \"kubernetes.io/projected/07f3e932-e1f1-42fa-bc82-12ca0decd499-kube-api-access-wrgrw\") pod \"network-check-source-dbd9cf844-8swxw\" (UID: \"07f3e932-e1f1-42fa-bc82-12ca0decd499\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8swxw" Jun 03 22:53:54.437746 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.437566 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqdf5\" (UniqueName: \"kubernetes.io/projected/bbac7faa-a131-4ec6-b3cb-09a3c00e69f7-kube-api-access-fqdf5\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-449jt\" (UID: \"bbac7faa-a131-4ec6-b3cb-09a3c00e69f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-449jt" Jun 03 22:53:54.437746 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.437614 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/90e6c068-c987-41bc-a0a3-596ce3834b50-snapshots\") pod \"insights-operator-69684796bc-lglv6\" (UID: \"90e6c068-c987-41bc-a0a3-596ce3834b50\") " pod="openshift-insights/insights-operator-69684796bc-lglv6" Jun 03 22:53:54.437746 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.437658 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90e6c068-c987-41bc-a0a3-596ce3834b50-tmp\") pod \"insights-operator-69684796bc-lglv6\" (UID: \"90e6c068-c987-41bc-a0a3-596ce3834b50\") " pod="openshift-insights/insights-operator-69684796bc-lglv6" Jun 03 22:53:54.438124 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.437975 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90e6c068-c987-41bc-a0a3-596ce3834b50-service-ca-bundle\") pod \"insights-operator-69684796bc-lglv6\" (UID: \"90e6c068-c987-41bc-a0a3-596ce3834b50\") " pod="openshift-insights/insights-operator-69684796bc-lglv6" Jun 03 22:53:54.438124 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.438013 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90e6c068-c987-41bc-a0a3-596ce3834b50-trusted-ca-bundle\") pod \"insights-operator-69684796bc-lglv6\" (UID: \"90e6c068-c987-41bc-a0a3-596ce3834b50\") " pod="openshift-insights/insights-operator-69684796bc-lglv6" Jun 03 22:53:54.439884 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.439865 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90e6c068-c987-41bc-a0a3-596ce3834b50-serving-cert\") pod \"insights-operator-69684796bc-lglv6\" (UID: \"90e6c068-c987-41bc-a0a3-596ce3834b50\") " pod="openshift-insights/insights-operator-69684796bc-lglv6" Jun 03 22:53:54.444207 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.444183 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9swws\" (UniqueName: \"kubernetes.io/projected/2a41c46f-e965-4cdc-b3da-940c477e04e3-kube-api-access-9swws\") pod \"volume-data-source-validator-78dd696465-dlxgt\" (UID: \"2a41c46f-e965-4cdc-b3da-940c477e04e3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dlxgt" Jun 03 22:53:54.444995 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.444976 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9dss\" (UniqueName: \"kubernetes.io/projected/90e6c068-c987-41bc-a0a3-596ce3834b50-kube-api-access-w9dss\") pod \"insights-operator-69684796bc-lglv6\" (UID: \"90e6c068-c987-41bc-a0a3-596ce3834b50\") " pod="openshift-insights/insights-operator-69684796bc-lglv6" Jun 03 22:53:54.538804 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.538713 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jb4h\" (UniqueName: \"kubernetes.io/projected/11ac8b95-ee98-48d9-897f-3d43d69cf0d7-kube-api-access-6jb4h\") pod \"service-ca-operator-5bc4cf794b-54nbm\" (UID: \"11ac8b95-ee98-48d9-897f-3d43d69cf0d7\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-54nbm" Jun 03 22:53:54.538804 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.538748 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/222cdbeb-74e5-4b5d-af08-013b734867d0-stats-auth\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:53:54.538804 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.538770 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bbac7faa-a131-4ec6-b3cb-09a3c00e69f7-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-449jt\" (UID: \"bbac7faa-a131-4ec6-b3cb-09a3c00e69f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-449jt" Jun 03 22:53:54.538804 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.538793 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/423754b4-98a4-4a39-aee0-ea4457a1d03f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xggwn\" (UID: \"423754b4-98a4-4a39-aee0-ea4457a1d03f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xggwn" Jun 03 22:53:54.538804 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.538812 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/222cdbeb-74e5-4b5d-af08-013b734867d0-service-ca-bundle\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:53:54.539201 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.538830 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/222cdbeb-74e5-4b5d-af08-013b734867d0-metrics-certs\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:53:54.539201 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.538846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqpb5\" (UniqueName: \"kubernetes.io/projected/423754b4-98a4-4a39-aee0-ea4457a1d03f-kube-api-access-zqpb5\") pod \"cluster-monitoring-operator-57769895dd-xggwn\" (UID: \"423754b4-98a4-4a39-aee0-ea4457a1d03f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xggwn" Jun 03 22:53:54.539201 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.538871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11ac8b95-ee98-48d9-897f-3d43d69cf0d7-serving-cert\") pod \"service-ca-operator-5bc4cf794b-54nbm\" (UID: \"11ac8b95-ee98-48d9-897f-3d43d69cf0d7\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-54nbm" Jun 03 22:53:54.539201 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.538903 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bbac7faa-a131-4ec6-b3cb-09a3c00e69f7-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-449jt\" (UID: \"bbac7faa-a131-4ec6-b3cb-09a3c00e69f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-449jt" Jun 03 22:53:54.539201 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:53:54.538917 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 22:53:54.539201 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.538928 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/423754b4-98a4-4a39-aee0-ea4457a1d03f-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-xggwn\" (UID: \"423754b4-98a4-4a39-aee0-ea4457a1d03f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xggwn" Jun 03 22:53:54.539201 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:53:54.538944 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/222cdbeb-74e5-4b5d-af08-013b734867d0-service-ca-bundle podName:222cdbeb-74e5-4b5d-af08-013b734867d0 nodeName:}" failed. No retries permitted until 2026-06-03 22:53:55.038922669 +0000 UTC m=+213.377575166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/222cdbeb-74e5-4b5d-af08-013b734867d0-service-ca-bundle") pod "router-default-75df67dd47-pr8cf" (UID: "222cdbeb-74e5-4b5d-af08-013b734867d0") : configmap references non-existent config key: service-ca.crt Jun 03 22:53:54.539201 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:53:54.538985 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/222cdbeb-74e5-4b5d-af08-013b734867d0-metrics-certs podName:222cdbeb-74e5-4b5d-af08-013b734867d0 nodeName:}" failed. No retries permitted until 2026-06-03 22:53:55.038968775 +0000 UTC m=+213.377621242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/222cdbeb-74e5-4b5d-af08-013b734867d0-metrics-certs") pod "router-default-75df67dd47-pr8cf" (UID: "222cdbeb-74e5-4b5d-af08-013b734867d0") : secret "router-metrics-certs-default" not found Jun 03 22:53:54.539201 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.539033 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/222cdbeb-74e5-4b5d-af08-013b734867d0-default-certificate\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:53:54.539201 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.539061 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11ac8b95-ee98-48d9-897f-3d43d69cf0d7-config\") pod \"service-ca-operator-5bc4cf794b-54nbm\" (UID: \"11ac8b95-ee98-48d9-897f-3d43d69cf0d7\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-54nbm" Jun 03 22:53:54.539201 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.539089 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkw97\" (UniqueName: \"kubernetes.io/projected/222cdbeb-74e5-4b5d-af08-013b734867d0-kube-api-access-fkw97\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:53:54.539201 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.539159 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrgrw\" (UniqueName: \"kubernetes.io/projected/07f3e932-e1f1-42fa-bc82-12ca0decd499-kube-api-access-wrgrw\") pod \"network-check-source-dbd9cf844-8swxw\" (UID: \"07f3e932-e1f1-42fa-bc82-12ca0decd499\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8swxw" Jun 03 22:53:54.539201 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.539194 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqdf5\" (UniqueName: \"kubernetes.io/projected/bbac7faa-a131-4ec6-b3cb-09a3c00e69f7-kube-api-access-fqdf5\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-449jt\" (UID: \"bbac7faa-a131-4ec6-b3cb-09a3c00e69f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-449jt" Jun 03 22:53:54.539889 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:53:54.539318 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 22:53:54.539889 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:53:54.539384 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/423754b4-98a4-4a39-aee0-ea4457a1d03f-cluster-monitoring-operator-tls podName:423754b4-98a4-4a39-aee0-ea4457a1d03f nodeName:}" failed. No retries permitted until 2026-06-03 22:53:55.039367818 +0000 UTC m=+213.378020298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/423754b4-98a4-4a39-aee0-ea4457a1d03f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-xggwn" (UID: "423754b4-98a4-4a39-aee0-ea4457a1d03f") : secret "cluster-monitoring-operator-tls" not found Jun 03 22:53:54.539889 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.539721 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/423754b4-98a4-4a39-aee0-ea4457a1d03f-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-xggwn\" (UID: \"423754b4-98a4-4a39-aee0-ea4457a1d03f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xggwn" Jun 03 22:53:54.539889 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.539813 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11ac8b95-ee98-48d9-897f-3d43d69cf0d7-config\") pod \"service-ca-operator-5bc4cf794b-54nbm\" (UID: \"11ac8b95-ee98-48d9-897f-3d43d69cf0d7\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-54nbm" Jun 03 22:53:54.540102 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.539999 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bbac7faa-a131-4ec6-b3cb-09a3c00e69f7-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-449jt\" (UID: \"bbac7faa-a131-4ec6-b3cb-09a3c00e69f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-449jt" Jun 03 22:53:54.541376 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.541350 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bbac7faa-a131-4ec6-b3cb-09a3c00e69f7-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-449jt\" (UID: \"bbac7faa-a131-4ec6-b3cb-09a3c00e69f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-449jt" Jun 03 22:53:54.541531 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.541496 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/222cdbeb-74e5-4b5d-af08-013b734867d0-stats-auth\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:53:54.541615 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.541600 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11ac8b95-ee98-48d9-897f-3d43d69cf0d7-serving-cert\") pod \"service-ca-operator-5bc4cf794b-54nbm\" (UID: \"11ac8b95-ee98-48d9-897f-3d43d69cf0d7\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-54nbm" Jun 03 22:53:54.541889 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.541870 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/222cdbeb-74e5-4b5d-af08-013b734867d0-default-certificate\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:53:54.547135 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.547103 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrgrw\" (UniqueName: \"kubernetes.io/projected/07f3e932-e1f1-42fa-bc82-12ca0decd499-kube-api-access-wrgrw\") pod \"network-check-source-dbd9cf844-8swxw\" (UID: \"07f3e932-e1f1-42fa-bc82-12ca0decd499\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8swxw" Jun 03 22:53:54.547383 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.547360 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqdf5\" (UniqueName: \"kubernetes.io/projected/bbac7faa-a131-4ec6-b3cb-09a3c00e69f7-kube-api-access-fqdf5\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-449jt\" (UID: \"bbac7faa-a131-4ec6-b3cb-09a3c00e69f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-449jt" Jun 03 22:53:54.547647 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.547625 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jb4h\" (UniqueName: \"kubernetes.io/projected/11ac8b95-ee98-48d9-897f-3d43d69cf0d7-kube-api-access-6jb4h\") pod \"service-ca-operator-5bc4cf794b-54nbm\" (UID: \"11ac8b95-ee98-48d9-897f-3d43d69cf0d7\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-54nbm" Jun 03 22:53:54.547960 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.547904 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqpb5\" (UniqueName: \"kubernetes.io/projected/423754b4-98a4-4a39-aee0-ea4457a1d03f-kube-api-access-zqpb5\") pod \"cluster-monitoring-operator-57769895dd-xggwn\" (UID: \"423754b4-98a4-4a39-aee0-ea4457a1d03f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xggwn" Jun 03 22:53:54.548043 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.548028 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkw97\" (UniqueName: \"kubernetes.io/projected/222cdbeb-74e5-4b5d-af08-013b734867d0-kube-api-access-fkw97\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:53:54.576068 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.576035 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dlxgt" Jun 03 22:53:54.583900 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.583877 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-69684796bc-lglv6" Jun 03 22:53:54.670806 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.670779 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8swxw" Jun 03 22:53:54.683731 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.683703 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-54nbm" Jun 03 22:53:54.701995 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.701968 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-449jt" Jun 03 22:53:54.709433 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.709368 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dlxgt"] Jun 03 22:53:54.713337 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:53:54.713308 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a41c46f_e965_4cdc_b3da_940c477e04e3.slice/crio-339fb9aad8a0c9ba68d7f3be1b1562443c2cf3d413ecde4ac20737d9173fd066 WatchSource:0}: Error finding container 339fb9aad8a0c9ba68d7f3be1b1562443c2cf3d413ecde4ac20737d9173fd066: Status 404 returned error can't find the container with id 339fb9aad8a0c9ba68d7f3be1b1562443c2cf3d413ecde4ac20737d9173fd066 Jun 03 22:53:54.730093 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.730018 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-69684796bc-lglv6"] Jun 03 22:53:54.739351 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:53:54.739320 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90e6c068_c987_41bc_a0a3_596ce3834b50.slice/crio-5edc4b7ca22fa371f35e60ca4952ddf144f7f64768b5b96ca5540dc70227b48a WatchSource:0}: Error finding container 5edc4b7ca22fa371f35e60ca4952ddf144f7f64768b5b96ca5540dc70227b48a: Status 404 returned error can't find the container with id 5edc4b7ca22fa371f35e60ca4952ddf144f7f64768b5b96ca5540dc70227b48a Jun 03 22:53:54.821839 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.821787 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-8swxw"] Jun 03 22:53:54.825218 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:53:54.825182 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07f3e932_e1f1_42fa_bc82_12ca0decd499.slice/crio-913f76cd32fb25f2cb89e3c82886a825acadedd4808eb383119e88a01aeca54c WatchSource:0}: Error finding container 913f76cd32fb25f2cb89e3c82886a825acadedd4808eb383119e88a01aeca54c: Status 404 returned error can't find the container with id 913f76cd32fb25f2cb89e3c82886a825acadedd4808eb383119e88a01aeca54c Jun 03 22:53:54.835935 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.835904 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-54nbm"] Jun 03 22:53:54.841779 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:53:54.841739 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11ac8b95_ee98_48d9_897f_3d43d69cf0d7.slice/crio-587396c12bf6d0e3739cc3233f5ad08eeac5b3c8ad49a72de0985887a6c707ff WatchSource:0}: Error finding container 587396c12bf6d0e3739cc3233f5ad08eeac5b3c8ad49a72de0985887a6c707ff: Status 404 returned error can't find the container with id 587396c12bf6d0e3739cc3233f5ad08eeac5b3c8ad49a72de0985887a6c707ff Jun 03 22:53:54.854878 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:54.854850 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-449jt"] Jun 03 22:53:54.859530 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:53:54.859492 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbac7faa_a131_4ec6_b3cb_09a3c00e69f7.slice/crio-4d18cef388da036e0b4e4a2ace7653d908af76bcc54abf773788845485c64e1c WatchSource:0}: Error finding container 4d18cef388da036e0b4e4a2ace7653d908af76bcc54abf773788845485c64e1c: Status 404 returned error can't find the container with id 4d18cef388da036e0b4e4a2ace7653d908af76bcc54abf773788845485c64e1c Jun 03 22:53:55.043857 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:55.043759 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/423754b4-98a4-4a39-aee0-ea4457a1d03f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xggwn\" (UID: \"423754b4-98a4-4a39-aee0-ea4457a1d03f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xggwn" Jun 03 22:53:55.043857 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:55.043811 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/222cdbeb-74e5-4b5d-af08-013b734867d0-service-ca-bundle\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:53:55.043857 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:55.043831 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/222cdbeb-74e5-4b5d-af08-013b734867d0-metrics-certs\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:53:55.044106 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:53:55.043934 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 22:53:55.044106 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:53:55.043970 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/222cdbeb-74e5-4b5d-af08-013b734867d0-service-ca-bundle podName:222cdbeb-74e5-4b5d-af08-013b734867d0 nodeName:}" failed. No retries permitted until 2026-06-03 22:53:56.043948225 +0000 UTC m=+214.382600706 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/222cdbeb-74e5-4b5d-af08-013b734867d0-service-ca-bundle") pod "router-default-75df67dd47-pr8cf" (UID: "222cdbeb-74e5-4b5d-af08-013b734867d0") : configmap references non-existent config key: service-ca.crt Jun 03 22:53:55.044106 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:53:55.043939 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 22:53:55.044106 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:53:55.043996 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/423754b4-98a4-4a39-aee0-ea4457a1d03f-cluster-monitoring-operator-tls podName:423754b4-98a4-4a39-aee0-ea4457a1d03f nodeName:}" failed. No retries permitted until 2026-06-03 22:53:56.043986443 +0000 UTC m=+214.382638922 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/423754b4-98a4-4a39-aee0-ea4457a1d03f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-xggwn" (UID: "423754b4-98a4-4a39-aee0-ea4457a1d03f") : secret "cluster-monitoring-operator-tls" not found Jun 03 22:53:55.044106 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:53:55.044018 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/222cdbeb-74e5-4b5d-af08-013b734867d0-metrics-certs podName:222cdbeb-74e5-4b5d-af08-013b734867d0 nodeName:}" failed. No retries permitted until 2026-06-03 22:53:56.044002731 +0000 UTC m=+214.382655206 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/222cdbeb-74e5-4b5d-af08-013b734867d0-metrics-certs") pod "router-default-75df67dd47-pr8cf" (UID: "222cdbeb-74e5-4b5d-af08-013b734867d0") : secret "router-metrics-certs-default" not found Jun 03 22:53:55.691591 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:55.691546 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-449jt" event={"ID":"bbac7faa-a131-4ec6-b3cb-09a3c00e69f7","Type":"ContainerStarted","Data":"4d18cef388da036e0b4e4a2ace7653d908af76bcc54abf773788845485c64e1c"} Jun 03 22:53:55.694938 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:55.694860 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dlxgt" event={"ID":"2a41c46f-e965-4cdc-b3da-940c477e04e3","Type":"ContainerStarted","Data":"339fb9aad8a0c9ba68d7f3be1b1562443c2cf3d413ecde4ac20737d9173fd066"} Jun 03 22:53:55.696993 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:55.696925 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-54nbm" event={"ID":"11ac8b95-ee98-48d9-897f-3d43d69cf0d7","Type":"ContainerStarted","Data":"587396c12bf6d0e3739cc3233f5ad08eeac5b3c8ad49a72de0985887a6c707ff"} Jun 03 22:53:55.699014 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:55.698993 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8swxw" event={"ID":"07f3e932-e1f1-42fa-bc82-12ca0decd499","Type":"ContainerStarted","Data":"9349bdd2003a39503a41097aff811b7714af1184fae864bcaff3d8a0bc5fa7df"} Jun 03 22:53:55.699121 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:55.699041 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8swxw" event={"ID":"07f3e932-e1f1-42fa-bc82-12ca0decd499","Type":"ContainerStarted","Data":"913f76cd32fb25f2cb89e3c82886a825acadedd4808eb383119e88a01aeca54c"} Jun 03 22:53:55.701288 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:55.701262 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-lglv6" event={"ID":"90e6c068-c987-41bc-a0a3-596ce3834b50","Type":"ContainerStarted","Data":"5edc4b7ca22fa371f35e60ca4952ddf144f7f64768b5b96ca5540dc70227b48a"} Jun 03 22:53:55.713185 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:55.713133 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8swxw" podStartSLOduration=1.7131116830000002 podStartE2EDuration="1.713111683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:53:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:53:55.712288798 +0000 UTC m=+214.050941287" watchObservedRunningTime="2026-06-03 22:53:55.713111683 +0000 UTC m=+214.051764151" Jun 03 22:53:56.052427 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:56.052368 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/423754b4-98a4-4a39-aee0-ea4457a1d03f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xggwn\" (UID: \"423754b4-98a4-4a39-aee0-ea4457a1d03f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xggwn" Jun 03 22:53:56.052427 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:56.052404 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/222cdbeb-74e5-4b5d-af08-013b734867d0-service-ca-bundle\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:53:56.052427 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:56.052428 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/222cdbeb-74e5-4b5d-af08-013b734867d0-metrics-certs\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:53:56.052739 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:53:56.052539 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 22:53:56.052739 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:53:56.052603 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/222cdbeb-74e5-4b5d-af08-013b734867d0-metrics-certs podName:222cdbeb-74e5-4b5d-af08-013b734867d0 nodeName:}" failed. No retries permitted until 2026-06-03 22:53:58.052583678 +0000 UTC m=+216.391236149 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/222cdbeb-74e5-4b5d-af08-013b734867d0-metrics-certs") pod "router-default-75df67dd47-pr8cf" (UID: "222cdbeb-74e5-4b5d-af08-013b734867d0") : secret "router-metrics-certs-default" not found Jun 03 22:53:56.052873 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:53:56.052755 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/222cdbeb-74e5-4b5d-af08-013b734867d0-service-ca-bundle podName:222cdbeb-74e5-4b5d-af08-013b734867d0 nodeName:}" failed. No retries permitted until 2026-06-03 22:53:58.052724839 +0000 UTC m=+216.391377311 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/222cdbeb-74e5-4b5d-af08-013b734867d0-service-ca-bundle") pod "router-default-75df67dd47-pr8cf" (UID: "222cdbeb-74e5-4b5d-af08-013b734867d0") : configmap references non-existent config key: service-ca.crt Jun 03 22:53:56.052873 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:53:56.052838 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 22:53:56.052980 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:53:56.052880 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/423754b4-98a4-4a39-aee0-ea4457a1d03f-cluster-monitoring-operator-tls podName:423754b4-98a4-4a39-aee0-ea4457a1d03f nodeName:}" failed. No retries permitted until 2026-06-03 22:53:58.05286932 +0000 UTC m=+216.391521792 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/423754b4-98a4-4a39-aee0-ea4457a1d03f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-xggwn" (UID: "423754b4-98a4-4a39-aee0-ea4457a1d03f") : secret "cluster-monitoring-operator-tls" not found Jun 03 22:53:56.706549 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:56.706460 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dlxgt" event={"ID":"2a41c46f-e965-4cdc-b3da-940c477e04e3","Type":"ContainerStarted","Data":"95ee8119950b9f2976050ec4384f1530e1a56cf6eabf4ca1d7788ef2f6c3030a"} Jun 03 22:53:56.724660 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:56.724603 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dlxgt" podStartSLOduration=1.543442923 podStartE2EDuration="2.724584729s" totalImagesPullingTime="1.181141806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:53:56.724535795 +0000 UTC m=+215.063188275" watchObservedRunningTime="2026-06-03 22:53:56.724584729 +0000 UTC m=+215.063237216" Jun 03 22:53:58.069193 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:58.069101 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/423754b4-98a4-4a39-aee0-ea4457a1d03f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xggwn\" (UID: \"423754b4-98a4-4a39-aee0-ea4457a1d03f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xggwn" Jun 03 22:53:58.069193 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:58.069148 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/222cdbeb-74e5-4b5d-af08-013b734867d0-service-ca-bundle\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:53:58.069193 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:58.069173 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/222cdbeb-74e5-4b5d-af08-013b734867d0-metrics-certs\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:53:58.069689 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:53:58.069275 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 22:53:58.069689 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:53:58.069304 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/222cdbeb-74e5-4b5d-af08-013b734867d0-service-ca-bundle podName:222cdbeb-74e5-4b5d-af08-013b734867d0 nodeName:}" failed. No retries permitted until 2026-06-03 22:54:02.069283677 +0000 UTC m=+220.407936150 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/222cdbeb-74e5-4b5d-af08-013b734867d0-service-ca-bundle") pod "router-default-75df67dd47-pr8cf" (UID: "222cdbeb-74e5-4b5d-af08-013b734867d0") : configmap references non-existent config key: service-ca.crt Jun 03 22:53:58.069689 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:53:58.069343 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/423754b4-98a4-4a39-aee0-ea4457a1d03f-cluster-monitoring-operator-tls podName:423754b4-98a4-4a39-aee0-ea4457a1d03f nodeName:}" failed. No retries permitted until 2026-06-03 22:54:02.069326715 +0000 UTC m=+220.407979187 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/423754b4-98a4-4a39-aee0-ea4457a1d03f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-xggwn" (UID: "423754b4-98a4-4a39-aee0-ea4457a1d03f") : secret "cluster-monitoring-operator-tls" not found Jun 03 22:53:58.069689 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:53:58.069280 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 22:53:58.069689 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:53:58.069389 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/222cdbeb-74e5-4b5d-af08-013b734867d0-metrics-certs podName:222cdbeb-74e5-4b5d-af08-013b734867d0 nodeName:}" failed. No retries permitted until 2026-06-03 22:54:02.06937491 +0000 UTC m=+220.408027380 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/222cdbeb-74e5-4b5d-af08-013b734867d0-metrics-certs") pod "router-default-75df67dd47-pr8cf" (UID: "222cdbeb-74e5-4b5d-af08-013b734867d0") : secret "router-metrics-certs-default" not found Jun 03 22:53:58.714867 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:58.714833 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-449jt" event={"ID":"bbac7faa-a131-4ec6-b3cb-09a3c00e69f7","Type":"ContainerStarted","Data":"e82fee59391ab197f9bad2fad118999ea6580924cbbdf3bf734a40c5cff7d13a"} Jun 03 22:53:58.716369 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:58.716337 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-54nbm" event={"ID":"11ac8b95-ee98-48d9-897f-3d43d69cf0d7","Type":"ContainerStarted","Data":"884206a3d749e339830d8c61b34816f774d10e8f97d02d29a4740483e05cf67e"} Jun 03 22:53:58.717873 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:58.717844 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-lglv6" event={"ID":"90e6c068-c987-41bc-a0a3-596ce3834b50","Type":"ContainerStarted","Data":"668c41d04687f6dc7df43eb7218caabc2ca43862822b13fd97ac0155fb5c3212"} Jun 03 22:53:58.729427 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:58.729376 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-449jt" podStartSLOduration=1.774079162 podStartE2EDuration="4.729362491s" totalImagesPullingTime="2.955283329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:53:58.728356874 +0000 UTC m=+217.067009362" watchObservedRunningTime="2026-06-03 22:53:58.729362491 +0000 UTC m=+217.068015015" Jun 03 22:53:58.743142 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:58.743087 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-54nbm" podStartSLOduration=1.763738408 podStartE2EDuration="4.743068599s" totalImagesPullingTime="2.979330191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:53:58.741691646 +0000 UTC m=+217.080344128" watchObservedRunningTime="2026-06-03 22:53:58.743068599 +0000 UTC m=+217.081721085" Jun 03 22:53:58.758059 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:53:58.758007 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-69684796bc-lglv6" podStartSLOduration=1.677922666 podStartE2EDuration="4.757986373s" totalImagesPullingTime="3.080063707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:53:58.756630212 +0000 UTC m=+217.095282701" watchObservedRunningTime="2026-06-03 22:53:58.757986373 +0000 UTC m=+217.096638862" Jun 03 22:54:00.891100 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:00.891073 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6bxfb_b5a63252-f62d-4fa6-9514-cac24485d072/dns-node-resolver/0.log" Jun 03 22:54:01.889187 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:01.889160 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8s2cb_d5941858-6ad4-439b-acf6-adf174570012/node-ca/0.log" Jun 03 22:54:02.103133 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:02.103077 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/423754b4-98a4-4a39-aee0-ea4457a1d03f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xggwn\" (UID: \"423754b4-98a4-4a39-aee0-ea4457a1d03f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xggwn" Jun 03 22:54:02.103133 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:02.103141 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/222cdbeb-74e5-4b5d-af08-013b734867d0-service-ca-bundle\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:54:02.103574 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:02.103173 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/222cdbeb-74e5-4b5d-af08-013b734867d0-metrics-certs\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:54:02.103574 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:54:02.103241 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 22:54:02.103574 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:54:02.103308 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/423754b4-98a4-4a39-aee0-ea4457a1d03f-cluster-monitoring-operator-tls podName:423754b4-98a4-4a39-aee0-ea4457a1d03f nodeName:}" failed. No retries permitted until 2026-06-03 22:54:10.103289226 +0000 UTC m=+228.441941702 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/423754b4-98a4-4a39-aee0-ea4457a1d03f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-xggwn" (UID: "423754b4-98a4-4a39-aee0-ea4457a1d03f") : secret "cluster-monitoring-operator-tls" not found Jun 03 22:54:02.103574 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:54:02.103320 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 22:54:02.103574 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:54:02.103343 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/222cdbeb-74e5-4b5d-af08-013b734867d0-service-ca-bundle podName:222cdbeb-74e5-4b5d-af08-013b734867d0 nodeName:}" failed. No retries permitted until 2026-06-03 22:54:10.10332591 +0000 UTC m=+228.441978377 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/222cdbeb-74e5-4b5d-af08-013b734867d0-service-ca-bundle") pod "router-default-75df67dd47-pr8cf" (UID: "222cdbeb-74e5-4b5d-af08-013b734867d0") : configmap references non-existent config key: service-ca.crt Jun 03 22:54:02.103574 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:54:02.103370 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/222cdbeb-74e5-4b5d-af08-013b734867d0-metrics-certs podName:222cdbeb-74e5-4b5d-af08-013b734867d0 nodeName:}" failed. No retries permitted until 2026-06-03 22:54:10.103360123 +0000 UTC m=+228.442012593 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/222cdbeb-74e5-4b5d-af08-013b734867d0-metrics-certs") pod "router-default-75df67dd47-pr8cf" (UID: "222cdbeb-74e5-4b5d-af08-013b734867d0") : secret "router-metrics-certs-default" not found Jun 03 22:54:03.087280 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:03.087255 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v97ll_95bd52c6-e259-4780-b114-f7de0eb8745c/serve-healthcheck-canary/0.log" Jun 03 22:54:10.170549 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:10.170491 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/423754b4-98a4-4a39-aee0-ea4457a1d03f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xggwn\" (UID: \"423754b4-98a4-4a39-aee0-ea4457a1d03f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xggwn" Jun 03 22:54:10.170963 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:10.170557 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/222cdbeb-74e5-4b5d-af08-013b734867d0-service-ca-bundle\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:54:10.170963 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:10.170586 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/222cdbeb-74e5-4b5d-af08-013b734867d0-metrics-certs\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:54:10.170963 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:54:10.170650 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 22:54:10.170963 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:54:10.170740 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/423754b4-98a4-4a39-aee0-ea4457a1d03f-cluster-monitoring-operator-tls podName:423754b4-98a4-4a39-aee0-ea4457a1d03f nodeName:}" failed. No retries permitted until 2026-06-03 22:54:26.170719226 +0000 UTC m=+244.509371696 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/423754b4-98a4-4a39-aee0-ea4457a1d03f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-xggwn" (UID: "423754b4-98a4-4a39-aee0-ea4457a1d03f") : secret "cluster-monitoring-operator-tls" not found Jun 03 22:54:10.170963 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:54:10.170759 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/222cdbeb-74e5-4b5d-af08-013b734867d0-service-ca-bundle podName:222cdbeb-74e5-4b5d-af08-013b734867d0 nodeName:}" failed. No retries permitted until 2026-06-03 22:54:26.170750941 +0000 UTC m=+244.509403409 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/222cdbeb-74e5-4b5d-af08-013b734867d0-service-ca-bundle") pod "router-default-75df67dd47-pr8cf" (UID: "222cdbeb-74e5-4b5d-af08-013b734867d0") : configmap references non-existent config key: service-ca.crt Jun 03 22:54:10.172967 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:10.172948 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/222cdbeb-74e5-4b5d-af08-013b734867d0-metrics-certs\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:54:24.392391 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.392356 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6xqpt"] Jun 03 22:54:24.395126 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.395106 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6xqpt" Jun 03 22:54:24.396906 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.396887 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 22:54:24.397003 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.396976 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 22:54:24.397047 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.397032 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gvchp\"" Jun 03 22:54:24.409543 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.409499 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6xqpt"] Jun 03 22:54:24.483410 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.483371 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/002cfe94-9ba8-4670-8560-57d74669b4ab-crio-socket\") pod \"insights-runtime-extractor-6xqpt\" (UID: \"002cfe94-9ba8-4670-8560-57d74669b4ab\") " pod="openshift-insights/insights-runtime-extractor-6xqpt" Jun 03 22:54:24.483410 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.483412 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/002cfe94-9ba8-4670-8560-57d74669b4ab-data-volume\") pod \"insights-runtime-extractor-6xqpt\" (UID: \"002cfe94-9ba8-4670-8560-57d74669b4ab\") " pod="openshift-insights/insights-runtime-extractor-6xqpt" Jun 03 22:54:24.483628 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.483532 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/002cfe94-9ba8-4670-8560-57d74669b4ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6xqpt\" (UID: \"002cfe94-9ba8-4670-8560-57d74669b4ab\") " pod="openshift-insights/insights-runtime-extractor-6xqpt" Jun 03 22:54:24.483628 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.483581 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjh4f\" (UniqueName: \"kubernetes.io/projected/002cfe94-9ba8-4670-8560-57d74669b4ab-kube-api-access-tjh4f\") pod \"insights-runtime-extractor-6xqpt\" (UID: \"002cfe94-9ba8-4670-8560-57d74669b4ab\") " pod="openshift-insights/insights-runtime-extractor-6xqpt" Jun 03 22:54:24.483691 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.483630 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/002cfe94-9ba8-4670-8560-57d74669b4ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6xqpt\" (UID: \"002cfe94-9ba8-4670-8560-57d74669b4ab\") " pod="openshift-insights/insights-runtime-extractor-6xqpt" Jun 03 22:54:24.504122 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.504089 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59499b698b-s4qwc"] Jun 03 22:54:24.506060 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.506044 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.508125 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.508103 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 22:54:24.508341 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.508322 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 22:54:24.508449 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.508381 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zb5l7\"" Jun 03 22:54:24.508520 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.508492 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 22:54:24.514380 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.514358 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 22:54:24.522650 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.522622 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59499b698b-s4qwc"] Jun 03 22:54:24.584443 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.584406 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/002cfe94-9ba8-4670-8560-57d74669b4ab-data-volume\") pod \"insights-runtime-extractor-6xqpt\" (UID: \"002cfe94-9ba8-4670-8560-57d74669b4ab\") " pod="openshift-insights/insights-runtime-extractor-6xqpt" Jun 03 22:54:24.584661 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.584478 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/002cfe94-9ba8-4670-8560-57d74669b4ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6xqpt\" (UID: \"002cfe94-9ba8-4670-8560-57d74669b4ab\") " pod="openshift-insights/insights-runtime-extractor-6xqpt" Jun 03 22:54:24.584661 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.584504 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjh4f\" (UniqueName: \"kubernetes.io/projected/002cfe94-9ba8-4670-8560-57d74669b4ab-kube-api-access-tjh4f\") pod \"insights-runtime-extractor-6xqpt\" (UID: \"002cfe94-9ba8-4670-8560-57d74669b4ab\") " pod="openshift-insights/insights-runtime-extractor-6xqpt" Jun 03 22:54:24.584661 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.584566 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/002cfe94-9ba8-4670-8560-57d74669b4ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6xqpt\" (UID: \"002cfe94-9ba8-4670-8560-57d74669b4ab\") " pod="openshift-insights/insights-runtime-extractor-6xqpt" Jun 03 22:54:24.584661 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.584612 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/002cfe94-9ba8-4670-8560-57d74669b4ab-crio-socket\") pod \"insights-runtime-extractor-6xqpt\" (UID: \"002cfe94-9ba8-4670-8560-57d74669b4ab\") " pod="openshift-insights/insights-runtime-extractor-6xqpt" Jun 03 22:54:24.584911 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.584691 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/002cfe94-9ba8-4670-8560-57d74669b4ab-crio-socket\") pod \"insights-runtime-extractor-6xqpt\" (UID: \"002cfe94-9ba8-4670-8560-57d74669b4ab\") " pod="openshift-insights/insights-runtime-extractor-6xqpt" Jun 03 22:54:24.584911 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.584862 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/002cfe94-9ba8-4670-8560-57d74669b4ab-data-volume\") pod \"insights-runtime-extractor-6xqpt\" (UID: \"002cfe94-9ba8-4670-8560-57d74669b4ab\") " pod="openshift-insights/insights-runtime-extractor-6xqpt" Jun 03 22:54:24.585652 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.585637 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/002cfe94-9ba8-4670-8560-57d74669b4ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6xqpt\" (UID: \"002cfe94-9ba8-4670-8560-57d74669b4ab\") " pod="openshift-insights/insights-runtime-extractor-6xqpt" Jun 03 22:54:24.586850 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.586833 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/002cfe94-9ba8-4670-8560-57d74669b4ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6xqpt\" (UID: \"002cfe94-9ba8-4670-8560-57d74669b4ab\") " pod="openshift-insights/insights-runtime-extractor-6xqpt" Jun 03 22:54:24.592169 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.592145 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjh4f\" (UniqueName: \"kubernetes.io/projected/002cfe94-9ba8-4670-8560-57d74669b4ab-kube-api-access-tjh4f\") pod \"insights-runtime-extractor-6xqpt\" (UID: \"002cfe94-9ba8-4670-8560-57d74669b4ab\") " pod="openshift-insights/insights-runtime-extractor-6xqpt" Jun 03 22:54:24.685157 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.685068 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6d376ca9-7879-4a2b-bb03-96741cc3c90b-trusted-ca\") pod \"image-registry-59499b698b-s4qwc\" (UID: \"6d376ca9-7879-4a2b-bb03-96741cc3c90b\") " pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.685157 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.685106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d376ca9-7879-4a2b-bb03-96741cc3c90b-registry-tls\") pod \"image-registry-59499b698b-s4qwc\" (UID: \"6d376ca9-7879-4a2b-bb03-96741cc3c90b\") " pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.685157 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.685127 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6d376ca9-7879-4a2b-bb03-96741cc3c90b-ca-trust-extracted\") pod \"image-registry-59499b698b-s4qwc\" (UID: \"6d376ca9-7879-4a2b-bb03-96741cc3c90b\") " pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.685157 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.685145 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6d376ca9-7879-4a2b-bb03-96741cc3c90b-image-registry-private-configuration\") pod \"image-registry-59499b698b-s4qwc\" (UID: \"6d376ca9-7879-4a2b-bb03-96741cc3c90b\") " pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.685394 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.685164 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrc7v\" (UniqueName: \"kubernetes.io/projected/6d376ca9-7879-4a2b-bb03-96741cc3c90b-kube-api-access-mrc7v\") pod \"image-registry-59499b698b-s4qwc\" (UID: \"6d376ca9-7879-4a2b-bb03-96741cc3c90b\") " pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.685394 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.685224 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6d376ca9-7879-4a2b-bb03-96741cc3c90b-registry-certificates\") pod \"image-registry-59499b698b-s4qwc\" (UID: \"6d376ca9-7879-4a2b-bb03-96741cc3c90b\") " pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.685394 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.685261 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d376ca9-7879-4a2b-bb03-96741cc3c90b-bound-sa-token\") pod \"image-registry-59499b698b-s4qwc\" (UID: \"6d376ca9-7879-4a2b-bb03-96741cc3c90b\") " pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.685394 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.685308 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6d376ca9-7879-4a2b-bb03-96741cc3c90b-installation-pull-secrets\") pod \"image-registry-59499b698b-s4qwc\" (UID: \"6d376ca9-7879-4a2b-bb03-96741cc3c90b\") " pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.703754 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.703728 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6xqpt" Jun 03 22:54:24.786006 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.785975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6d376ca9-7879-4a2b-bb03-96741cc3c90b-installation-pull-secrets\") pod \"image-registry-59499b698b-s4qwc\" (UID: \"6d376ca9-7879-4a2b-bb03-96741cc3c90b\") " pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.786137 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.786032 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6d376ca9-7879-4a2b-bb03-96741cc3c90b-trusted-ca\") pod \"image-registry-59499b698b-s4qwc\" (UID: \"6d376ca9-7879-4a2b-bb03-96741cc3c90b\") " pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.786207 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.786156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d376ca9-7879-4a2b-bb03-96741cc3c90b-registry-tls\") pod \"image-registry-59499b698b-s4qwc\" (UID: \"6d376ca9-7879-4a2b-bb03-96741cc3c90b\") " pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.786265 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.786208 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6d376ca9-7879-4a2b-bb03-96741cc3c90b-ca-trust-extracted\") pod \"image-registry-59499b698b-s4qwc\" (UID: \"6d376ca9-7879-4a2b-bb03-96741cc3c90b\") " pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.786371 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.786341 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6d376ca9-7879-4a2b-bb03-96741cc3c90b-image-registry-private-configuration\") pod \"image-registry-59499b698b-s4qwc\" (UID: \"6d376ca9-7879-4a2b-bb03-96741cc3c90b\") " pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.786428 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.786399 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrc7v\" (UniqueName: \"kubernetes.io/projected/6d376ca9-7879-4a2b-bb03-96741cc3c90b-kube-api-access-mrc7v\") pod \"image-registry-59499b698b-s4qwc\" (UID: \"6d376ca9-7879-4a2b-bb03-96741cc3c90b\") " pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.786484 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.786444 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6d376ca9-7879-4a2b-bb03-96741cc3c90b-registry-certificates\") pod \"image-registry-59499b698b-s4qwc\" (UID: \"6d376ca9-7879-4a2b-bb03-96741cc3c90b\") " pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.786484 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.786471 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d376ca9-7879-4a2b-bb03-96741cc3c90b-bound-sa-token\") pod \"image-registry-59499b698b-s4qwc\" (UID: \"6d376ca9-7879-4a2b-bb03-96741cc3c90b\") " pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.786676 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.786615 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6d376ca9-7879-4a2b-bb03-96741cc3c90b-ca-trust-extracted\") pod \"image-registry-59499b698b-s4qwc\" (UID: \"6d376ca9-7879-4a2b-bb03-96741cc3c90b\") " pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.787316 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.787269 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6d376ca9-7879-4a2b-bb03-96741cc3c90b-registry-certificates\") pod \"image-registry-59499b698b-s4qwc\" (UID: \"6d376ca9-7879-4a2b-bb03-96741cc3c90b\") " pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.787532 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.787491 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6d376ca9-7879-4a2b-bb03-96741cc3c90b-trusted-ca\") pod \"image-registry-59499b698b-s4qwc\" (UID: \"6d376ca9-7879-4a2b-bb03-96741cc3c90b\") " pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.788986 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.788961 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6d376ca9-7879-4a2b-bb03-96741cc3c90b-installation-pull-secrets\") pod \"image-registry-59499b698b-s4qwc\" (UID: \"6d376ca9-7879-4a2b-bb03-96741cc3c90b\") " pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.789287 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.789266 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d376ca9-7879-4a2b-bb03-96741cc3c90b-registry-tls\") pod \"image-registry-59499b698b-s4qwc\" (UID: \"6d376ca9-7879-4a2b-bb03-96741cc3c90b\") " pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.790070 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.790046 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6d376ca9-7879-4a2b-bb03-96741cc3c90b-image-registry-private-configuration\") pod \"image-registry-59499b698b-s4qwc\" (UID: \"6d376ca9-7879-4a2b-bb03-96741cc3c90b\") " pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.795180 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.795156 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrc7v\" (UniqueName: \"kubernetes.io/projected/6d376ca9-7879-4a2b-bb03-96741cc3c90b-kube-api-access-mrc7v\") pod \"image-registry-59499b698b-s4qwc\" (UID: \"6d376ca9-7879-4a2b-bb03-96741cc3c90b\") " pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.795488 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.795461 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d376ca9-7879-4a2b-bb03-96741cc3c90b-bound-sa-token\") pod \"image-registry-59499b698b-s4qwc\" (UID: \"6d376ca9-7879-4a2b-bb03-96741cc3c90b\") " pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.816579 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.816556 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:24.827931 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.827910 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6xqpt"] Jun 03 22:54:24.830580 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:54:24.830557 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod002cfe94_9ba8_4670_8560_57d74669b4ab.slice/crio-7a2615d06d49815247a88422aa441ac2c63f40e654351d4a1d65b15e5c6fab41 WatchSource:0}: Error finding container 7a2615d06d49815247a88422aa441ac2c63f40e654351d4a1d65b15e5c6fab41: Status 404 returned error can't find the container with id 7a2615d06d49815247a88422aa441ac2c63f40e654351d4a1d65b15e5c6fab41 Jun 03 22:54:24.947330 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:24.947251 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59499b698b-s4qwc"] Jun 03 22:54:24.949753 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:54:24.949726 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d376ca9_7879_4a2b_bb03_96741cc3c90b.slice/crio-e4a393a3204211f7ec5f371e342c91caaefb56ede9a606e064f72e1736586d4d WatchSource:0}: Error finding container e4a393a3204211f7ec5f371e342c91caaefb56ede9a606e064f72e1736586d4d: Status 404 returned error can't find the container with id e4a393a3204211f7ec5f371e342c91caaefb56ede9a606e064f72e1736586d4d Jun 03 22:54:25.809568 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:25.809530 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59499b698b-s4qwc" event={"ID":"6d376ca9-7879-4a2b-bb03-96741cc3c90b","Type":"ContainerStarted","Data":"57eb67ad00e43e41388ee01cdf2f5d5dc184cb1a27d91b61141d8d219ac3d44a"} Jun 03 22:54:25.810064 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:25.809620 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:54:25.810064 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:25.809644 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59499b698b-s4qwc" event={"ID":"6d376ca9-7879-4a2b-bb03-96741cc3c90b","Type":"ContainerStarted","Data":"e4a393a3204211f7ec5f371e342c91caaefb56ede9a606e064f72e1736586d4d"} Jun 03 22:54:25.811617 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:25.811594 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6xqpt" event={"ID":"002cfe94-9ba8-4670-8560-57d74669b4ab","Type":"ContainerStarted","Data":"5fc87b5d174c7c19aab1ef5922b57af5a1bbf967b1622e313dbc5c7ca4cfe9ba"} Jun 03 22:54:25.811709 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:25.811648 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6xqpt" event={"ID":"002cfe94-9ba8-4670-8560-57d74669b4ab","Type":"ContainerStarted","Data":"b1b6fb745cfbc5ee469c95ace1e96848dbffb4e825c138d15986b3fa55e257c0"} Jun 03 22:54:25.811709 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:25.811667 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6xqpt" event={"ID":"002cfe94-9ba8-4670-8560-57d74669b4ab","Type":"ContainerStarted","Data":"7a2615d06d49815247a88422aa441ac2c63f40e654351d4a1d65b15e5c6fab41"} Jun 03 22:54:25.831338 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:25.831286 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59499b698b-s4qwc" podStartSLOduration=1.831272005 podStartE2EDuration="1.831272005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:54:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:54:25.83065679 +0000 UTC m=+244.169309279" watchObservedRunningTime="2026-06-03 22:54:25.831272005 +0000 UTC m=+244.169924471" Jun 03 22:54:26.198357 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:26.198272 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/423754b4-98a4-4a39-aee0-ea4457a1d03f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xggwn\" (UID: \"423754b4-98a4-4a39-aee0-ea4457a1d03f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xggwn" Jun 03 22:54:26.198357 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:26.198316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/222cdbeb-74e5-4b5d-af08-013b734867d0-service-ca-bundle\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:54:26.198998 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:26.198974 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/222cdbeb-74e5-4b5d-af08-013b734867d0-service-ca-bundle\") pod \"router-default-75df67dd47-pr8cf\" (UID: \"222cdbeb-74e5-4b5d-af08-013b734867d0\") " pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:54:26.200896 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:26.200874 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/423754b4-98a4-4a39-aee0-ea4457a1d03f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xggwn\" (UID: \"423754b4-98a4-4a39-aee0-ea4457a1d03f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xggwn" Jun 03 22:54:26.491909 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:26.491836 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rpq4x\"" Jun 03 22:54:26.497878 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:26.497854 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-q45qs\"" Jun 03 22:54:26.500381 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:26.500366 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xggwn" Jun 03 22:54:26.506451 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:26.506424 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:54:27.123122 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:27.123094 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-75df67dd47-pr8cf"] Jun 03 22:54:27.126995 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:54:27.126960 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod222cdbeb_74e5_4b5d_af08_013b734867d0.slice/crio-fc48ba4f0a27159c9d667f6d4e259ce4434fe15a8c044cd4e85e40bf514851d5 WatchSource:0}: Error finding container fc48ba4f0a27159c9d667f6d4e259ce4434fe15a8c044cd4e85e40bf514851d5: Status 404 returned error can't find the container with id fc48ba4f0a27159c9d667f6d4e259ce4434fe15a8c044cd4e85e40bf514851d5 Jun 03 22:54:27.139234 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:27.139174 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-xggwn"] Jun 03 22:54:27.142846 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:54:27.142825 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod423754b4_98a4_4a39_aee0_ea4457a1d03f.slice/crio-90034bdec37a29cf56807ec7220598749f20856515d1bde0ce61e37447241b75 WatchSource:0}: Error finding container 90034bdec37a29cf56807ec7220598749f20856515d1bde0ce61e37447241b75: Status 404 returned error can't find the container with id 90034bdec37a29cf56807ec7220598749f20856515d1bde0ce61e37447241b75 Jun 03 22:54:27.824632 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:27.824590 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6xqpt" event={"ID":"002cfe94-9ba8-4670-8560-57d74669b4ab","Type":"ContainerStarted","Data":"7e01fca2e4ab2b0eea0b53271d279fb293843d659c0013d8c931b61f24440eed"} Jun 03 22:54:27.826324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:27.826290 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-75df67dd47-pr8cf" event={"ID":"222cdbeb-74e5-4b5d-af08-013b734867d0","Type":"ContainerStarted","Data":"34aac2cbd57f83c2652ce540f2c4e224689d2cfa743c855485f31dd3cded6fdb"} Jun 03 22:54:27.826456 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:27.826337 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-75df67dd47-pr8cf" event={"ID":"222cdbeb-74e5-4b5d-af08-013b734867d0","Type":"ContainerStarted","Data":"fc48ba4f0a27159c9d667f6d4e259ce4434fe15a8c044cd4e85e40bf514851d5"} Jun 03 22:54:27.827544 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:27.827498 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xggwn" event={"ID":"423754b4-98a4-4a39-aee0-ea4457a1d03f","Type":"ContainerStarted","Data":"90034bdec37a29cf56807ec7220598749f20856515d1bde0ce61e37447241b75"} Jun 03 22:54:27.841049 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:27.840991 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6xqpt" podStartSLOduration=1.769171319 podStartE2EDuration="3.840974921s" totalImagesPullingTime="2.071803602s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:54:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:54:27.840646459 +0000 UTC m=+246.179298948" watchObservedRunningTime="2026-06-03 22:54:27.840974921 +0000 UTC m=+246.179627409" Jun 03 22:54:27.858151 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:27.858101 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-75df67dd47-pr8cf" podStartSLOduration=33.858084876 podStartE2EDuration="33.858084876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:53:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:54:27.856446018 +0000 UTC m=+246.195098516" watchObservedRunningTime="2026-06-03 22:54:27.858084876 +0000 UTC m=+246.196737343" Jun 03 22:54:28.507015 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:28.506976 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:54:28.509977 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:28.509953 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:54:28.832275 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:28.832245 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:54:28.833493 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:28.833470 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-75df67dd47-pr8cf" Jun 03 22:54:29.272163 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:29.272112 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4js5r"] Jun 03 22:54:29.273997 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:29.273981 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4js5r" Jun 03 22:54:29.275568 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:29.275546 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 03 22:54:29.275662 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:29.275625 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-n7ch2\"" Jun 03 22:54:29.284324 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:29.284299 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4js5r"] Jun 03 22:54:29.427723 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:29.427676 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4ee03be1-6ed9-4108-98ce-5cd60fac3371-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-4js5r\" (UID: \"4ee03be1-6ed9-4108-98ce-5cd60fac3371\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4js5r" Jun 03 22:54:29.528496 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:29.528412 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4ee03be1-6ed9-4108-98ce-5cd60fac3371-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-4js5r\" (UID: \"4ee03be1-6ed9-4108-98ce-5cd60fac3371\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4js5r" Jun 03 22:54:29.528905 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:54:29.528573 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 03 22:54:29.528905 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:54:29.528641 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ee03be1-6ed9-4108-98ce-5cd60fac3371-tls-certificates podName:4ee03be1-6ed9-4108-98ce-5cd60fac3371 nodeName:}" failed. No retries permitted until 2026-06-03 22:54:30.028622833 +0000 UTC m=+248.367275318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/4ee03be1-6ed9-4108-98ce-5cd60fac3371-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-4js5r" (UID: "4ee03be1-6ed9-4108-98ce-5cd60fac3371") : secret "prometheus-operator-admission-webhook-tls" not found Jun 03 22:54:29.836804 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:29.836771 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xggwn" event={"ID":"423754b4-98a4-4a39-aee0-ea4457a1d03f","Type":"ContainerStarted","Data":"ab77a5d646f8814686a3dc7534ec798de35e7073d058a25c81744619914a41f3"} Jun 03 22:54:29.851585 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:29.851538 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xggwn" podStartSLOduration=34.218782224 podStartE2EDuration="35.851498088s" totalImagesPullingTime="1.632715864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:54:29.850607186 +0000 UTC m=+248.189259666" watchObservedRunningTime="2026-06-03 22:54:29.851498088 +0000 UTC m=+248.190150575" Jun 03 22:54:30.032737 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:30.032703 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4ee03be1-6ed9-4108-98ce-5cd60fac3371-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-4js5r\" (UID: \"4ee03be1-6ed9-4108-98ce-5cd60fac3371\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4js5r" Jun 03 22:54:30.032921 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:54:30.032818 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 03 22:54:30.032921 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:54:30.032878 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ee03be1-6ed9-4108-98ce-5cd60fac3371-tls-certificates podName:4ee03be1-6ed9-4108-98ce-5cd60fac3371 nodeName:}" failed. No retries permitted until 2026-06-03 22:54:31.032863074 +0000 UTC m=+249.371515541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/4ee03be1-6ed9-4108-98ce-5cd60fac3371-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-4js5r" (UID: "4ee03be1-6ed9-4108-98ce-5cd60fac3371") : secret "prometheus-operator-admission-webhook-tls" not found Jun 03 22:54:31.040874 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:31.040782 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4ee03be1-6ed9-4108-98ce-5cd60fac3371-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-4js5r\" (UID: \"4ee03be1-6ed9-4108-98ce-5cd60fac3371\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4js5r" Jun 03 22:54:31.043134 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:31.043110 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4ee03be1-6ed9-4108-98ce-5cd60fac3371-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-4js5r\" (UID: \"4ee03be1-6ed9-4108-98ce-5cd60fac3371\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4js5r" Jun 03 22:54:31.083170 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:31.083133 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4js5r" Jun 03 22:54:31.240647 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:31.240540 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4js5r"] Jun 03 22:54:31.243133 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:54:31.243106 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ee03be1_6ed9_4108_98ce_5cd60fac3371.slice/crio-8eb7f15e35c5e6600366828a53b6fdec9b3dee54d62be704c10702332a064aca WatchSource:0}: Error finding container 8eb7f15e35c5e6600366828a53b6fdec9b3dee54d62be704c10702332a064aca: Status 404 returned error can't find the container with id 8eb7f15e35c5e6600366828a53b6fdec9b3dee54d62be704c10702332a064aca Jun 03 22:54:31.845680 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:31.845644 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4js5r" event={"ID":"4ee03be1-6ed9-4108-98ce-5cd60fac3371","Type":"ContainerStarted","Data":"8eb7f15e35c5e6600366828a53b6fdec9b3dee54d62be704c10702332a064aca"} Jun 03 22:54:32.850791 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:32.850699 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4js5r" event={"ID":"4ee03be1-6ed9-4108-98ce-5cd60fac3371","Type":"ContainerStarted","Data":"d40f5bc9ab438e2e8284c8b2461821df8484cdba2c3c669ecca1c4d4a041fe03"} Jun 03 22:54:32.851142 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:32.850904 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4js5r" Jun 03 22:54:32.855781 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:32.855753 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4js5r" Jun 03 22:54:32.864584 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:32.864533 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4js5r" podStartSLOduration=2.508691849 podStartE2EDuration="3.864497116s" totalImagesPullingTime="1.355805267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:54:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:54:32.863988213 +0000 UTC m=+251.202640701" watchObservedRunningTime="2026-06-03 22:54:32.864497116 +0000 UTC m=+251.203149607" Jun 03 22:54:33.335171 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:33.335137 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-mw4mz"] Jun 03 22:54:33.337473 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:33.337454 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-mw4mz" Jun 03 22:54:33.339452 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:33.339428 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 03 22:54:33.339452 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:33.339441 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 22:54:33.339659 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:33.339442 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8xg2c\"" Jun 03 22:54:33.339659 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:33.339451 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 03 22:54:33.346032 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:33.346010 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-mw4mz"] Jun 03 22:54:33.460454 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:33.460413 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc0f7c7b-1081-4004-9981-248d1e266565-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-mw4mz\" (UID: \"fc0f7c7b-1081-4004-9981-248d1e266565\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mw4mz" Jun 03 22:54:33.460454 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:33.460456 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc0f7c7b-1081-4004-9981-248d1e266565-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-mw4mz\" (UID: \"fc0f7c7b-1081-4004-9981-248d1e266565\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mw4mz" Jun 03 22:54:33.460693 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:33.460590 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts5fh\" (UniqueName: \"kubernetes.io/projected/fc0f7c7b-1081-4004-9981-248d1e266565-kube-api-access-ts5fh\") pod \"prometheus-operator-7f7d445d84-mw4mz\" (UID: \"fc0f7c7b-1081-4004-9981-248d1e266565\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mw4mz" Jun 03 22:54:33.460693 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:33.460645 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc0f7c7b-1081-4004-9981-248d1e266565-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-mw4mz\" (UID: \"fc0f7c7b-1081-4004-9981-248d1e266565\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mw4mz" Jun 03 22:54:33.561232 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:33.561196 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts5fh\" (UniqueName: \"kubernetes.io/projected/fc0f7c7b-1081-4004-9981-248d1e266565-kube-api-access-ts5fh\") pod \"prometheus-operator-7f7d445d84-mw4mz\" (UID: \"fc0f7c7b-1081-4004-9981-248d1e266565\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mw4mz" Jun 03 22:54:33.561413 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:33.561251 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc0f7c7b-1081-4004-9981-248d1e266565-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-mw4mz\" (UID: \"fc0f7c7b-1081-4004-9981-248d1e266565\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mw4mz" Jun 03 22:54:33.561413 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:33.561292 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc0f7c7b-1081-4004-9981-248d1e266565-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-mw4mz\" (UID: \"fc0f7c7b-1081-4004-9981-248d1e266565\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mw4mz" Jun 03 22:54:33.561413 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:33.561311 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc0f7c7b-1081-4004-9981-248d1e266565-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-mw4mz\" (UID: \"fc0f7c7b-1081-4004-9981-248d1e266565\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mw4mz" Jun 03 22:54:33.561987 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:33.561962 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc0f7c7b-1081-4004-9981-248d1e266565-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-mw4mz\" (UID: \"fc0f7c7b-1081-4004-9981-248d1e266565\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mw4mz" Jun 03 22:54:33.563723 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:33.563696 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc0f7c7b-1081-4004-9981-248d1e266565-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-mw4mz\" (UID: \"fc0f7c7b-1081-4004-9981-248d1e266565\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mw4mz" Jun 03 22:54:33.563822 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:33.563803 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc0f7c7b-1081-4004-9981-248d1e266565-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-mw4mz\" (UID: \"fc0f7c7b-1081-4004-9981-248d1e266565\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mw4mz" Jun 03 22:54:33.568661 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:33.568640 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts5fh\" (UniqueName: \"kubernetes.io/projected/fc0f7c7b-1081-4004-9981-248d1e266565-kube-api-access-ts5fh\") pod \"prometheus-operator-7f7d445d84-mw4mz\" (UID: \"fc0f7c7b-1081-4004-9981-248d1e266565\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mw4mz" Jun 03 22:54:33.646600 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:33.646471 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-mw4mz" Jun 03 22:54:33.772372 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:33.772340 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-mw4mz"] Jun 03 22:54:33.775495 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:54:33.775468 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc0f7c7b_1081_4004_9981_248d1e266565.slice/crio-bab67123b8724c811470a6c2183a6a81d549600ca48d4c3cd7e82cab8acd7d96 WatchSource:0}: Error finding container bab67123b8724c811470a6c2183a6a81d549600ca48d4c3cd7e82cab8acd7d96: Status 404 returned error can't find the container with id bab67123b8724c811470a6c2183a6a81d549600ca48d4c3cd7e82cab8acd7d96 Jun 03 22:54:33.854935 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:33.854903 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-mw4mz" event={"ID":"fc0f7c7b-1081-4004-9981-248d1e266565","Type":"ContainerStarted","Data":"bab67123b8724c811470a6c2183a6a81d549600ca48d4c3cd7e82cab8acd7d96"} Jun 03 22:54:33.964477 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:33.964393 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs\") pod \"network-metrics-daemon-dzl52\" (UID: \"5ba98357-42a7-4e6d-a783-7f58dd6c5ced\") " pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:54:33.966659 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:33.966638 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ba98357-42a7-4e6d-a783-7f58dd6c5ced-metrics-certs\") pod \"network-metrics-daemon-dzl52\" (UID: \"5ba98357-42a7-4e6d-a783-7f58dd6c5ced\") " pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:54:34.114119 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:34.114083 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zbfkl\"" Jun 03 22:54:34.122655 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:34.122623 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzl52" Jun 03 22:54:34.246144 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:34.246071 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dzl52"] Jun 03 22:54:34.249016 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:54:34.248991 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ba98357_42a7_4e6d_a783_7f58dd6c5ced.slice/crio-7fce038959579ba5bef82037705f0f1e2388030d52dd596bbdbe8845d5717628 WatchSource:0}: Error finding container 7fce038959579ba5bef82037705f0f1e2388030d52dd596bbdbe8845d5717628: Status 404 returned error can't find the container with id 7fce038959579ba5bef82037705f0f1e2388030d52dd596bbdbe8845d5717628 Jun 03 22:54:34.859806 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:34.859772 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dzl52" event={"ID":"5ba98357-42a7-4e6d-a783-7f58dd6c5ced","Type":"ContainerStarted","Data":"7fce038959579ba5bef82037705f0f1e2388030d52dd596bbdbe8845d5717628"} Jun 03 22:54:35.869033 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:35.868993 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-mw4mz" event={"ID":"fc0f7c7b-1081-4004-9981-248d1e266565","Type":"ContainerStarted","Data":"99ef2960fe7db84087e4748965012d0512ab27b8529734e1259875293959eec8"} Jun 03 22:54:35.869491 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:35.869083 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-mw4mz" event={"ID":"fc0f7c7b-1081-4004-9981-248d1e266565","Type":"ContainerStarted","Data":"e7beda6da20e999c99317cdf776c2b6cfe9c8c3de47c69c9a277585231d703ba"} Jun 03 22:54:35.870793 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:35.870768 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dzl52" event={"ID":"5ba98357-42a7-4e6d-a783-7f58dd6c5ced","Type":"ContainerStarted","Data":"7c3beac0ef9c6ef71b94e65ad351259aa72adad48aa6b2782ffffc3613033af8"} Jun 03 22:54:35.870906 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:35.870813 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dzl52" event={"ID":"5ba98357-42a7-4e6d-a783-7f58dd6c5ced","Type":"ContainerStarted","Data":"ccedfa8bb54fc802da8ebaa6a2b584cf51e6473fd3671771eb6a925bd95c837b"} Jun 03 22:54:35.884814 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:35.884767 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-mw4mz" podStartSLOduration=1.502530125 podStartE2EDuration="2.884752561s" totalImagesPullingTime="1.382222436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:54:35.883633844 +0000 UTC m=+254.222286355" watchObservedRunningTime="2026-06-03 22:54:35.884752561 +0000 UTC m=+254.223405049" Jun 03 22:54:35.897487 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:35.897427 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dzl52" podStartSLOduration=252.985771196 podStartE2EDuration="4m13.897406202s" totalImagesPullingTime="911.635006ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:54:35.897100881 +0000 UTC m=+254.235753369" watchObservedRunningTime="2026-06-03 22:54:35.897406202 +0000 UTC m=+254.236058692" Jun 03 22:54:37.684703 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.684669 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n65xl"] Jun 03 22:54:37.686968 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.686952 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.688961 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.688940 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mxm56\"" Jun 03 22:54:37.689399 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.689380 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 22:54:37.689688 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.689673 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 22:54:37.689748 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.689678 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 22:54:37.695844 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.695824 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtq6k\" (UniqueName: \"kubernetes.io/projected/e23877fa-3edc-4434-9d29-1bd8a7d79adb-kube-api-access-vtq6k\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.695930 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.695854 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e23877fa-3edc-4434-9d29-1bd8a7d79adb-node-exporter-tls\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.695930 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.695869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e23877fa-3edc-4434-9d29-1bd8a7d79adb-node-exporter-wtmp\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.695930 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.695889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e23877fa-3edc-4434-9d29-1bd8a7d79adb-sys\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.696049 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.695996 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e23877fa-3edc-4434-9d29-1bd8a7d79adb-metrics-client-ca\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.696049 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.696041 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e23877fa-3edc-4434-9d29-1bd8a7d79adb-root\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.696110 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.696059 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e23877fa-3edc-4434-9d29-1bd8a7d79adb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.696151 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.696109 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e23877fa-3edc-4434-9d29-1bd8a7d79adb-node-exporter-textfile\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.696151 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.696129 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e23877fa-3edc-4434-9d29-1bd8a7d79adb-node-exporter-accelerators-collector-config\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.796713 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.796670 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e23877fa-3edc-4434-9d29-1bd8a7d79adb-root\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.796713 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.796711 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e23877fa-3edc-4434-9d29-1bd8a7d79adb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.796970 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.796753 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e23877fa-3edc-4434-9d29-1bd8a7d79adb-node-exporter-textfile\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.796970 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.796778 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e23877fa-3edc-4434-9d29-1bd8a7d79adb-node-exporter-accelerators-collector-config\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.796970 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.796790 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e23877fa-3edc-4434-9d29-1bd8a7d79adb-root\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.796970 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.796821 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtq6k\" (UniqueName: \"kubernetes.io/projected/e23877fa-3edc-4434-9d29-1bd8a7d79adb-kube-api-access-vtq6k\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.796970 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.796877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e23877fa-3edc-4434-9d29-1bd8a7d79adb-node-exporter-tls\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.796970 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.796903 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e23877fa-3edc-4434-9d29-1bd8a7d79adb-node-exporter-wtmp\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.796970 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.796943 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e23877fa-3edc-4434-9d29-1bd8a7d79adb-sys\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.797308 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.796986 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e23877fa-3edc-4434-9d29-1bd8a7d79adb-metrics-client-ca\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.797308 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.797165 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e23877fa-3edc-4434-9d29-1bd8a7d79adb-node-exporter-textfile\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.797308 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.797253 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e23877fa-3edc-4434-9d29-1bd8a7d79adb-sys\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.797308 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.797293 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e23877fa-3edc-4434-9d29-1bd8a7d79adb-node-exporter-wtmp\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.797572 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.797554 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e23877fa-3edc-4434-9d29-1bd8a7d79adb-metrics-client-ca\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.797680 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.797662 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e23877fa-3edc-4434-9d29-1bd8a7d79adb-node-exporter-accelerators-collector-config\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.799333 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.799317 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e23877fa-3edc-4434-9d29-1bd8a7d79adb-node-exporter-tls\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.799448 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.799428 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e23877fa-3edc-4434-9d29-1bd8a7d79adb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.803918 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.803895 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtq6k\" (UniqueName: \"kubernetes.io/projected/e23877fa-3edc-4434-9d29-1bd8a7d79adb-kube-api-access-vtq6k\") pod \"node-exporter-n65xl\" (UID: \"e23877fa-3edc-4434-9d29-1bd8a7d79adb\") " pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:37.997039 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:37.996956 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n65xl" Jun 03 22:54:38.007346 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:54:38.007316 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode23877fa_3edc_4434_9d29_1bd8a7d79adb.slice/crio-ea00e8a6e3e388a9468c7d5bfddb07094a92fe976cb093f64f1a3a6ae3a2342c WatchSource:0}: Error finding container ea00e8a6e3e388a9468c7d5bfddb07094a92fe976cb093f64f1a3a6ae3a2342c: Status 404 returned error can't find the container with id ea00e8a6e3e388a9468c7d5bfddb07094a92fe976cb093f64f1a3a6ae3a2342c Jun 03 22:54:38.775845 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.775815 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 22:54:38.779731 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.779708 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.789101 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.788916 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 22:54:38.789463 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.789414 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 22:54:38.789792 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.789774 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 22:54:38.790756 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.790734 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 22:54:38.791394 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.791243 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 22:54:38.791786 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.791637 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 22:54:38.792576 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.791885 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 22:54:38.792576 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.791968 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 22:54:38.792576 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.792348 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rtt8m\"" Jun 03 22:54:38.792909 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.792579 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 22:54:38.806674 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.806555 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-755bt\" (UniqueName: \"kubernetes.io/projected/87ecf3ef-9ac0-4914-a2e6-846654af7228-kube-api-access-755bt\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.807055 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.806687 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.807055 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.806716 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-config-volume\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.807055 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.806742 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87ecf3ef-9ac0-4914-a2e6-846654af7228-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.807055 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.806769 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.807055 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.806893 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/87ecf3ef-9ac0-4914-a2e6-846654af7228-config-out\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.807055 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.806923 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.807055 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.806951 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/87ecf3ef-9ac0-4914-a2e6-846654af7228-tls-assets\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.807055 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.806976 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.807393 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.807061 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87ecf3ef-9ac0-4914-a2e6-846654af7228-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.807393 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.807112 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-web-config\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.807393 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.807145 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.807393 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.807213 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/87ecf3ef-9ac0-4914-a2e6-846654af7228-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.815236 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.815205 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 22:54:38.883311 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.883264 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n65xl" event={"ID":"e23877fa-3edc-4434-9d29-1bd8a7d79adb","Type":"ContainerStarted","Data":"ea00e8a6e3e388a9468c7d5bfddb07094a92fe976cb093f64f1a3a6ae3a2342c"} Jun 03 22:54:38.908213 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.908149 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.908213 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.908178 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/87ecf3ef-9ac0-4914-a2e6-846654af7228-config-out\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.908213 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.908194 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.908438 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.908219 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/87ecf3ef-9ac0-4914-a2e6-846654af7228-tls-assets\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.908438 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.908243 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.908438 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.908289 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87ecf3ef-9ac0-4914-a2e6-846654af7228-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.908438 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.908327 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-web-config\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.908438 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.908352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.908438 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.908387 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/87ecf3ef-9ac0-4914-a2e6-846654af7228-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.908438 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.908415 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-755bt\" (UniqueName: \"kubernetes.io/projected/87ecf3ef-9ac0-4914-a2e6-846654af7228-kube-api-access-755bt\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.908890 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.908476 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.908890 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.908532 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-config-volume\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.908890 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.908559 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87ecf3ef-9ac0-4914-a2e6-846654af7228-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.909471 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.909259 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/87ecf3ef-9ac0-4914-a2e6-846654af7228-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.909471 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.909355 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87ecf3ef-9ac0-4914-a2e6-846654af7228-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.909852 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:54:38.909832 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/87ecf3ef-9ac0-4914-a2e6-846654af7228-alertmanager-trusted-ca-bundle podName:87ecf3ef-9ac0-4914-a2e6-846654af7228 nodeName:}" failed. No retries permitted until 2026-06-03 22:54:39.409812111 +0000 UTC m=+257.748464578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/87ecf3ef-9ac0-4914-a2e6-846654af7228-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "87ecf3ef-9ac0-4914-a2e6-846654af7228") : configmap references non-existent config key: ca-bundle.crt Jun 03 22:54:38.912456 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.912409 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.913581 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.913559 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/87ecf3ef-9ac0-4914-a2e6-846654af7228-tls-assets\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.914024 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.913694 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-config-volume\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.914024 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.913870 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-web-config\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.914024 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.913873 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/87ecf3ef-9ac0-4914-a2e6-846654af7228-config-out\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.914206 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.914082 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.914206 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.914151 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.914347 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.914281 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.915305 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.915277 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:38.916234 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:38.916210 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-755bt\" (UniqueName: \"kubernetes.io/projected/87ecf3ef-9ac0-4914-a2e6-846654af7228-kube-api-access-755bt\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:39.411906 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:39.411815 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87ecf3ef-9ac0-4914-a2e6-846654af7228-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:39.412569 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:39.412548 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87ecf3ef-9ac0-4914-a2e6-846654af7228-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:39.692314 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:39.692222 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:54:39.840450 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:39.840380 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 22:54:39.844788 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:54:39.844764 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87ecf3ef_9ac0_4914_a2e6_846654af7228.slice/crio-f1fa2be1d659bfe0949fec03033f390df9dca139299b70511b9af0083945ecce WatchSource:0}: Error finding container f1fa2be1d659bfe0949fec03033f390df9dca139299b70511b9af0083945ecce: Status 404 returned error can't find the container with id f1fa2be1d659bfe0949fec03033f390df9dca139299b70511b9af0083945ecce Jun 03 22:54:39.887776 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:39.887742 2576 generic.go:356] "Generic (PLEG): container finished" podID="e23877fa-3edc-4434-9d29-1bd8a7d79adb" containerID="cc3a0ffd3902ae0e3b99be5a194ff8c899581b9ed500a974ef526b027df4b07e" exitCode=0 Jun 03 22:54:39.887954 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:39.887813 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n65xl" event={"ID":"e23877fa-3edc-4434-9d29-1bd8a7d79adb","Type":"ContainerDied","Data":"cc3a0ffd3902ae0e3b99be5a194ff8c899581b9ed500a974ef526b027df4b07e"} Jun 03 22:54:39.889138 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:39.889113 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87ecf3ef-9ac0-4914-a2e6-846654af7228","Type":"ContainerStarted","Data":"f1fa2be1d659bfe0949fec03033f390df9dca139299b70511b9af0083945ecce"} Jun 03 22:54:40.896184 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:40.896143 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n65xl" event={"ID":"e23877fa-3edc-4434-9d29-1bd8a7d79adb","Type":"ContainerStarted","Data":"3a43049e91099938507b48a173ac014a33d65e2a8f17960878097a3f03451a73"} Jun 03 22:54:40.896594 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:40.896199 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n65xl" event={"ID":"e23877fa-3edc-4434-9d29-1bd8a7d79adb","Type":"ContainerStarted","Data":"8846ed0128d63c3d9708b86bfca5b7249c4dbacaca5b0bb64555a427fb7b82c8"} Jun 03 22:54:40.914103 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:40.914053 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n65xl" podStartSLOduration=2.950504785 podStartE2EDuration="3.91403495s" totalImagesPullingTime="893.220494ms" totalInitContainerRuntime="70.309671ms" isStatefulPod=true podCreationTimestamp="2026-06-03 22:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:54:40.913667464 +0000 UTC m=+259.252319953" watchObservedRunningTime="2026-06-03 22:54:40.91403495 +0000 UTC m=+259.252687440" Jun 03 22:54:41.901063 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:41.901029 2576 generic.go:356] "Generic (PLEG): container finished" podID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerID="2429ab13d127c12cb296a47b5ab5c5d34e3ca11483561a68fa48d1115145fd0d" exitCode=0 Jun 03 22:54:41.901446 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:41.901114 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87ecf3ef-9ac0-4914-a2e6-846654af7228","Type":"ContainerDied","Data":"2429ab13d127c12cb296a47b5ab5c5d34e3ca11483561a68fa48d1115145fd0d"} Jun 03 22:54:43.912718 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:43.912684 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87ecf3ef-9ac0-4914-a2e6-846654af7228","Type":"ContainerStarted","Data":"c534c0bef54325370912e2970598027d9d6d2b81ab5d6d5d45e3585e2ad656d2"} Jun 03 22:54:43.913179 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:43.912785 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87ecf3ef-9ac0-4914-a2e6-846654af7228","Type":"ContainerStarted","Data":"a8cf1ba2a1ea42b1c21a72d2b3cdbcd19567b758319305a0148bc1fafe2ed520"} Jun 03 22:54:43.913179 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:43.912816 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87ecf3ef-9ac0-4914-a2e6-846654af7228","Type":"ContainerStarted","Data":"d504ebc9e33ec078561ecee9c2b002f8a82ff18bf0ad55de76f7b27857cda638"} Jun 03 22:54:43.913179 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:43.912840 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87ecf3ef-9ac0-4914-a2e6-846654af7228","Type":"ContainerStarted","Data":"d3d2f52f4680ca912f5cb19f655dd1983dd8f723498b1d3722d932844d1ea139"} Jun 03 22:54:43.913179 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:43.912872 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87ecf3ef-9ac0-4914-a2e6-846654af7228","Type":"ContainerStarted","Data":"7e8bbc51f14a0c2cbe90137fb8d9f893e67e8d495edc3f7286b2f091514e6089"} Jun 03 22:54:44.821088 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:44.821053 2576 patch_prober.go:28] interesting pod/image-registry-59499b698b-s4qwc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 22:54:44.821280 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:44.821120 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59499b698b-s4qwc" podUID="6d376ca9-7879-4a2b-bb03-96741cc3c90b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 22:54:44.919562 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:44.919522 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87ecf3ef-9ac0-4914-a2e6-846654af7228","Type":"ContainerStarted","Data":"35c4856dcb4e28864772253ac2c143b86fff2ff896c3c99608347e3a39f92939"} Jun 03 22:54:44.948681 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:44.948617 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.57265049 podStartE2EDuration="6.948599759s" totalImagesPullingTime="3.35947834s" totalInitContainerRuntime="16.470929ms" isStatefulPod=false podCreationTimestamp="2026-06-03 22:54:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:54:44.946408274 +0000 UTC m=+263.285060762" watchObservedRunningTime="2026-06-03 22:54:44.948599759 +0000 UTC m=+263.287252247" Jun 03 22:54:46.820084 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:46.820039 2576 patch_prober.go:28] interesting pod/image-registry-59499b698b-s4qwc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 22:54:46.820496 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:46.820096 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59499b698b-s4qwc" podUID="6d376ca9-7879-4a2b-bb03-96741cc3c90b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 22:54:49.550785 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.550750 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cc4678bb7-p2k8k"] Jun 03 22:54:49.554310 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.554290 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:54:49.557213 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.557192 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 22:54:49.557339 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.557196 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 22:54:49.558454 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.558420 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 22:54:49.558560 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.558541 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gqd68\"" Jun 03 22:54:49.559038 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.559018 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 22:54:49.559159 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.559042 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 22:54:49.559159 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.559071 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 22:54:49.559256 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.559234 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 22:54:49.567599 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.567578 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cc4678bb7-p2k8k"] Jun 03 22:54:49.606318 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.606281 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/177e56ee-cd35-4e87-bcb9-4259f55c7658-console-oauth-config\") pod \"console-6cc4678bb7-p2k8k\" (UID: \"177e56ee-cd35-4e87-bcb9-4259f55c7658\") " pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:54:49.606318 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.606320 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/177e56ee-cd35-4e87-bcb9-4259f55c7658-console-config\") pod \"console-6cc4678bb7-p2k8k\" (UID: \"177e56ee-cd35-4e87-bcb9-4259f55c7658\") " pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:54:49.606545 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.606403 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/177e56ee-cd35-4e87-bcb9-4259f55c7658-service-ca\") pod \"console-6cc4678bb7-p2k8k\" (UID: \"177e56ee-cd35-4e87-bcb9-4259f55c7658\") " pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:54:49.606545 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.606439 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/177e56ee-cd35-4e87-bcb9-4259f55c7658-oauth-serving-cert\") pod \"console-6cc4678bb7-p2k8k\" (UID: \"177e56ee-cd35-4e87-bcb9-4259f55c7658\") " pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:54:49.606545 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.606457 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl6rt\" (UniqueName: \"kubernetes.io/projected/177e56ee-cd35-4e87-bcb9-4259f55c7658-kube-api-access-dl6rt\") pod \"console-6cc4678bb7-p2k8k\" (UID: \"177e56ee-cd35-4e87-bcb9-4259f55c7658\") " pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:54:49.606642 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.606564 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/177e56ee-cd35-4e87-bcb9-4259f55c7658-console-serving-cert\") pod \"console-6cc4678bb7-p2k8k\" (UID: \"177e56ee-cd35-4e87-bcb9-4259f55c7658\") " pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:54:49.707606 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.707567 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/177e56ee-cd35-4e87-bcb9-4259f55c7658-console-serving-cert\") pod \"console-6cc4678bb7-p2k8k\" (UID: \"177e56ee-cd35-4e87-bcb9-4259f55c7658\") " pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:54:49.707606 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.707610 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/177e56ee-cd35-4e87-bcb9-4259f55c7658-console-oauth-config\") pod \"console-6cc4678bb7-p2k8k\" (UID: \"177e56ee-cd35-4e87-bcb9-4259f55c7658\") " pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:54:49.707809 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.707633 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/177e56ee-cd35-4e87-bcb9-4259f55c7658-console-config\") pod \"console-6cc4678bb7-p2k8k\" (UID: \"177e56ee-cd35-4e87-bcb9-4259f55c7658\") " pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:54:49.708072 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.707818 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/177e56ee-cd35-4e87-bcb9-4259f55c7658-service-ca\") pod \"console-6cc4678bb7-p2k8k\" (UID: \"177e56ee-cd35-4e87-bcb9-4259f55c7658\") " pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:54:49.708072 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.707855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/177e56ee-cd35-4e87-bcb9-4259f55c7658-oauth-serving-cert\") pod \"console-6cc4678bb7-p2k8k\" (UID: \"177e56ee-cd35-4e87-bcb9-4259f55c7658\") " pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:54:49.708072 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.707872 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl6rt\" (UniqueName: \"kubernetes.io/projected/177e56ee-cd35-4e87-bcb9-4259f55c7658-kube-api-access-dl6rt\") pod \"console-6cc4678bb7-p2k8k\" (UID: \"177e56ee-cd35-4e87-bcb9-4259f55c7658\") " pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:54:49.708450 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.708427 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/177e56ee-cd35-4e87-bcb9-4259f55c7658-service-ca\") pod \"console-6cc4678bb7-p2k8k\" (UID: \"177e56ee-cd35-4e87-bcb9-4259f55c7658\") " pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:54:49.708561 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.708487 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/177e56ee-cd35-4e87-bcb9-4259f55c7658-oauth-serving-cert\") pod \"console-6cc4678bb7-p2k8k\" (UID: \"177e56ee-cd35-4e87-bcb9-4259f55c7658\") " pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:54:49.709022 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.709007 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/177e56ee-cd35-4e87-bcb9-4259f55c7658-console-config\") pod \"console-6cc4678bb7-p2k8k\" (UID: \"177e56ee-cd35-4e87-bcb9-4259f55c7658\") " pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:54:49.710096 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.710080 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/177e56ee-cd35-4e87-bcb9-4259f55c7658-console-oauth-config\") pod \"console-6cc4678bb7-p2k8k\" (UID: \"177e56ee-cd35-4e87-bcb9-4259f55c7658\") " pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:54:49.710196 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.710167 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/177e56ee-cd35-4e87-bcb9-4259f55c7658-console-serving-cert\") pod \"console-6cc4678bb7-p2k8k\" (UID: \"177e56ee-cd35-4e87-bcb9-4259f55c7658\") " pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:54:49.718226 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.718195 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl6rt\" (UniqueName: \"kubernetes.io/projected/177e56ee-cd35-4e87-bcb9-4259f55c7658-kube-api-access-dl6rt\") pod \"console-6cc4678bb7-p2k8k\" (UID: \"177e56ee-cd35-4e87-bcb9-4259f55c7658\") " pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:54:49.863421 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.863322 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:54:49.995482 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:49.995448 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cc4678bb7-p2k8k"] Jun 03 22:54:49.998183 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:54:49.998159 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod177e56ee_cd35_4e87_bcb9_4259f55c7658.slice/crio-465aeba61b385ccfd4431c4679bdfeebfeac18ed8b13dc2add4fb35368c8e5fc WatchSource:0}: Error finding container 465aeba61b385ccfd4431c4679bdfeebfeac18ed8b13dc2add4fb35368c8e5fc: Status 404 returned error can't find the container with id 465aeba61b385ccfd4431c4679bdfeebfeac18ed8b13dc2add4fb35368c8e5fc Jun 03 22:54:50.942622 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:50.942571 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc4678bb7-p2k8k" event={"ID":"177e56ee-cd35-4e87-bcb9-4259f55c7658","Type":"ContainerStarted","Data":"465aeba61b385ccfd4431c4679bdfeebfeac18ed8b13dc2add4fb35368c8e5fc"} Jun 03 22:54:53.956167 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:53.956127 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc4678bb7-p2k8k" event={"ID":"177e56ee-cd35-4e87-bcb9-4259f55c7658","Type":"ContainerStarted","Data":"622399fbb3a6fb4b010cd555881d9c16485f222a587bdf9d8a329d0589f57f92"} Jun 03 22:54:53.979854 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:53.979802 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cc4678bb7-p2k8k" podStartSLOduration=2.052588096 podStartE2EDuration="4.979784721s" totalImagesPullingTime="2.927196625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:54:53.979236094 +0000 UTC m=+272.317888603" watchObservedRunningTime="2026-06-03 22:54:53.979784721 +0000 UTC m=+272.318437208" Jun 03 22:54:54.821445 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:54.821411 2576 patch_prober.go:28] interesting pod/image-registry-59499b698b-s4qwc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 22:54:54.821703 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:54.821470 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59499b698b-s4qwc" podUID="6d376ca9-7879-4a2b-bb03-96741cc3c90b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 22:54:56.820041 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:56.820003 2576 patch_prober.go:28] interesting pod/image-registry-59499b698b-s4qwc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 22:54:56.820488 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:56.820054 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59499b698b-s4qwc" podUID="6d376ca9-7879-4a2b-bb03-96741cc3c90b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 22:54:59.864272 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:59.864230 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:54:59.864726 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:59.864487 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:54:59.865763 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:59.865744 2576 patch_prober.go:28] interesting pod/console-6cc4678bb7-p2k8k container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused" start-of-body= Jun 03 22:54:59.865817 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:59.865796 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6cc4678bb7-p2k8k" podUID="177e56ee-cd35-4e87-bcb9-4259f55c7658" containerName="console" probeResult="failure" output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused" Jun 03 22:54:59.952303 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:59.952269 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86c58b9cfb-vj6nj"] Jun 03 22:54:59.955354 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:59.955338 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:54:59.965791 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:54:59.965768 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 22:55:00.020940 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.020906 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86c58b9cfb-vj6nj"] Jun 03 22:55:00.101926 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.101887 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e61850be-42f7-4879-a692-6a5ade8c5a05-console-serving-cert\") pod \"console-86c58b9cfb-vj6nj\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:00.102126 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.102109 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e61850be-42f7-4879-a692-6a5ade8c5a05-trusted-ca-bundle\") pod \"console-86c58b9cfb-vj6nj\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:00.102176 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.102153 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e61850be-42f7-4879-a692-6a5ade8c5a05-console-config\") pod \"console-86c58b9cfb-vj6nj\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:00.102212 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.102184 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e61850be-42f7-4879-a692-6a5ade8c5a05-console-oauth-config\") pod \"console-86c58b9cfb-vj6nj\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:00.102278 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.102258 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e61850be-42f7-4879-a692-6a5ade8c5a05-service-ca\") pod \"console-86c58b9cfb-vj6nj\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:00.102390 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.102369 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48cj8\" (UniqueName: \"kubernetes.io/projected/e61850be-42f7-4879-a692-6a5ade8c5a05-kube-api-access-48cj8\") pod \"console-86c58b9cfb-vj6nj\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:00.102427 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.102409 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e61850be-42f7-4879-a692-6a5ade8c5a05-oauth-serving-cert\") pod \"console-86c58b9cfb-vj6nj\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:00.203615 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.203499 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e61850be-42f7-4879-a692-6a5ade8c5a05-service-ca\") pod \"console-86c58b9cfb-vj6nj\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:00.203615 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.203585 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48cj8\" (UniqueName: \"kubernetes.io/projected/e61850be-42f7-4879-a692-6a5ade8c5a05-kube-api-access-48cj8\") pod \"console-86c58b9cfb-vj6nj\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:00.203615 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.203607 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e61850be-42f7-4879-a692-6a5ade8c5a05-oauth-serving-cert\") pod \"console-86c58b9cfb-vj6nj\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:00.203835 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.203653 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e61850be-42f7-4879-a692-6a5ade8c5a05-console-serving-cert\") pod \"console-86c58b9cfb-vj6nj\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:00.203835 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.203669 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e61850be-42f7-4879-a692-6a5ade8c5a05-trusted-ca-bundle\") pod \"console-86c58b9cfb-vj6nj\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:00.203835 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.203727 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e61850be-42f7-4879-a692-6a5ade8c5a05-console-config\") pod \"console-86c58b9cfb-vj6nj\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:00.203835 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.203754 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e61850be-42f7-4879-a692-6a5ade8c5a05-console-oauth-config\") pod \"console-86c58b9cfb-vj6nj\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:00.204355 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.204328 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e61850be-42f7-4879-a692-6a5ade8c5a05-oauth-serving-cert\") pod \"console-86c58b9cfb-vj6nj\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:00.204473 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.204348 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e61850be-42f7-4879-a692-6a5ade8c5a05-console-config\") pod \"console-86c58b9cfb-vj6nj\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:00.204473 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.204346 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e61850be-42f7-4879-a692-6a5ade8c5a05-service-ca\") pod \"console-86c58b9cfb-vj6nj\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:00.204721 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.204699 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e61850be-42f7-4879-a692-6a5ade8c5a05-trusted-ca-bundle\") pod \"console-86c58b9cfb-vj6nj\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:00.206219 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.206200 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e61850be-42f7-4879-a692-6a5ade8c5a05-console-oauth-config\") pod \"console-86c58b9cfb-vj6nj\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:00.206299 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.206281 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e61850be-42f7-4879-a692-6a5ade8c5a05-console-serving-cert\") pod \"console-86c58b9cfb-vj6nj\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:00.214682 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.214657 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48cj8\" (UniqueName: \"kubernetes.io/projected/e61850be-42f7-4879-a692-6a5ade8c5a05-kube-api-access-48cj8\") pod \"console-86c58b9cfb-vj6nj\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:00.264216 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.264177 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:00.411392 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.411362 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86c58b9cfb-vj6nj"] Jun 03 22:55:00.414366 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:55:00.414341 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode61850be_42f7_4879_a692_6a5ade8c5a05.slice/crio-2773d7b72c8550a85c717295397d31d8dccc99eae3a6482c695e6fdae4436ae2 WatchSource:0}: Error finding container 2773d7b72c8550a85c717295397d31d8dccc99eae3a6482c695e6fdae4436ae2: Status 404 returned error can't find the container with id 2773d7b72c8550a85c717295397d31d8dccc99eae3a6482c695e6fdae4436ae2 Jun 03 22:55:00.986201 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.986171 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86c58b9cfb-vj6nj" event={"ID":"e61850be-42f7-4879-a692-6a5ade8c5a05","Type":"ContainerStarted","Data":"fb98a2f9123339c050850efdeac2ea0f6fcc9594996d707159e6b572e9193ad9"} Jun 03 22:55:00.986618 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:00.986217 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86c58b9cfb-vj6nj" event={"ID":"e61850be-42f7-4879-a692-6a5ade8c5a05","Type":"ContainerStarted","Data":"2773d7b72c8550a85c717295397d31d8dccc99eae3a6482c695e6fdae4436ae2"} Jun 03 22:55:01.008706 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:01.008659 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86c58b9cfb-vj6nj" podStartSLOduration=2.008643734 podStartE2EDuration="2.008643734s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:54:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:55:01.006777098 +0000 UTC m=+279.345429597" watchObservedRunningTime="2026-06-03 22:55:01.008643734 +0000 UTC m=+279.347296221" Jun 03 22:55:03.558925 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:55:03.558868 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rx252" podUID="45947991-d774-45e0-9345-7a0eef712d69" Jun 03 22:55:03.998635 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:03.998600 2576 generic.go:356] "Generic (PLEG): container finished" podID="11ac8b95-ee98-48d9-897f-3d43d69cf0d7" containerID="884206a3d749e339830d8c61b34816f774d10e8f97d02d29a4740483e05cf67e" exitCode=0 Jun 03 22:55:03.998802 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:03.998668 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-54nbm" event={"ID":"11ac8b95-ee98-48d9-897f-3d43d69cf0d7","Type":"ContainerDied","Data":"884206a3d749e339830d8c61b34816f774d10e8f97d02d29a4740483e05cf67e"} Jun 03 22:55:03.998802 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:03.998739 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rx252" Jun 03 22:55:03.999074 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:03.999058 2576 scope.go:117] "RemoveContainer" containerID="884206a3d749e339830d8c61b34816f774d10e8f97d02d29a4740483e05cf67e" Jun 03 22:55:04.821166 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:04.821124 2576 patch_prober.go:28] interesting pod/image-registry-59499b698b-s4qwc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 22:55:04.821642 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:04.821177 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59499b698b-s4qwc" podUID="6d376ca9-7879-4a2b-bb03-96741cc3c90b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 22:55:04.821642 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:04.821220 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:55:04.821755 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:04.821683 2576 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"57eb67ad00e43e41388ee01cdf2f5d5dc184cb1a27d91b61141d8d219ac3d44a"} pod="openshift-image-registry/image-registry-59499b698b-s4qwc" containerMessage="Container registry failed liveness probe, will be restarted" Jun 03 22:55:04.825398 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:04.825373 2576 patch_prober.go:28] interesting pod/image-registry-59499b698b-s4qwc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 22:55:04.825541 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:04.825414 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59499b698b-s4qwc" podUID="6d376ca9-7879-4a2b-bb03-96741cc3c90b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 22:55:05.004823 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:05.004787 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-54nbm" event={"ID":"11ac8b95-ee98-48d9-897f-3d43d69cf0d7","Type":"ContainerStarted","Data":"389f0923ab05b383b2da0f8794225813d08724af8c631dadfe7f0e4311c5f01e"} Jun 03 22:55:07.065901 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:07.065861 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls\") pod \"dns-default-rx252\" (UID: \"45947991-d774-45e0-9345-7a0eef712d69\") " pod="openshift-dns/dns-default-rx252" Jun 03 22:55:07.068292 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:07.068269 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45947991-d774-45e0-9345-7a0eef712d69-metrics-tls\") pod \"dns-default-rx252\" (UID: \"45947991-d774-45e0-9345-7a0eef712d69\") " pod="openshift-dns/dns-default-rx252" Jun 03 22:55:07.301771 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:07.301739 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bfmtg\"" Jun 03 22:55:07.310573 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:07.310545 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rx252" Jun 03 22:55:07.451359 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:07.451328 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rx252"] Jun 03 22:55:07.455980 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:55:07.455952 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45947991_d774_45e0_9345_7a0eef712d69.slice/crio-9e1fda38b4a53472d0d00fb09ec153ee79988464786bd109562001419d806b4a WatchSource:0}: Error finding container 9e1fda38b4a53472d0d00fb09ec153ee79988464786bd109562001419d806b4a: Status 404 returned error can't find the container with id 9e1fda38b4a53472d0d00fb09ec153ee79988464786bd109562001419d806b4a Jun 03 22:55:08.017779 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:08.017741 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rx252" event={"ID":"45947991-d774-45e0-9345-7a0eef712d69","Type":"ContainerStarted","Data":"9e1fda38b4a53472d0d00fb09ec153ee79988464786bd109562001419d806b4a"} Jun 03 22:55:09.024630 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:09.024592 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rx252" event={"ID":"45947991-d774-45e0-9345-7a0eef712d69","Type":"ContainerStarted","Data":"1a2add878c271e87fed42816d897f1abd840b10f26918ab2f520aa57991f435b"} Jun 03 22:55:09.025102 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:09.024655 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rx252" event={"ID":"45947991-d774-45e0-9345-7a0eef712d69","Type":"ContainerStarted","Data":"dbb9cfe264cf37505cccae6e87504f796450a129d0b0d5d7215c57b334a89a92"} Jun 03 22:55:09.025102 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:09.024715 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rx252" Jun 03 22:55:09.026438 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:09.026414 2576 generic.go:356] "Generic (PLEG): container finished" podID="90e6c068-c987-41bc-a0a3-596ce3834b50" containerID="668c41d04687f6dc7df43eb7218caabc2ca43862822b13fd97ac0155fb5c3212" exitCode=0 Jun 03 22:55:09.026588 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:09.026470 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-lglv6" event={"ID":"90e6c068-c987-41bc-a0a3-596ce3834b50","Type":"ContainerDied","Data":"668c41d04687f6dc7df43eb7218caabc2ca43862822b13fd97ac0155fb5c3212"} Jun 03 22:55:09.026740 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:09.026728 2576 scope.go:117] "RemoveContainer" containerID="668c41d04687f6dc7df43eb7218caabc2ca43862822b13fd97ac0155fb5c3212" Jun 03 22:55:09.046755 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:09.046715 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rx252" podStartSLOduration=250.673976994 podStartE2EDuration="4m12.046700367s" totalImagesPullingTime="1.372723373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:50:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:55:09.045850159 +0000 UTC m=+287.384502649" watchObservedRunningTime="2026-06-03 22:55:09.046700367 +0000 UTC m=+287.385352855" Jun 03 22:55:09.537764 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:09.537736 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rx252_45947991-d774-45e0-9345-7a0eef712d69/dns/0.log" Jun 03 22:55:09.737160 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:09.737126 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rx252_45947991-d774-45e0-9345-7a0eef712d69/kube-rbac-proxy/0.log" Jun 03 22:55:09.867955 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:09.867930 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:55:09.871758 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:09.871726 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:55:09.937625 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:09.937599 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6bxfb_b5a63252-f62d-4fa6-9514-cac24485d072/dns-node-resolver/0.log" Jun 03 22:55:10.032346 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:10.032317 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-lglv6" event={"ID":"90e6c068-c987-41bc-a0a3-596ce3834b50","Type":"ContainerStarted","Data":"90b48443b44bc02b6cbf29b2c001b0266b986620dd3b5877d019c0e1c529297d"} Jun 03 22:55:10.264431 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:10.264348 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:10.264431 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:10.264404 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:10.269267 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:10.269243 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:10.537758 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:10.537687 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59499b698b-s4qwc_6d376ca9-7879-4a2b-bb03-96741cc3c90b/registry/0.log" Jun 03 22:55:10.937867 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:10.937839 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8s2cb_d5941858-6ad4-439b-acf6-adf174570012/node-ca/0.log" Jun 03 22:55:11.040612 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:11.040586 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:55:11.119085 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:11.119044 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cc4678bb7-p2k8k"] Jun 03 22:55:14.825655 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:14.825626 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:55:19.034719 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:19.034687 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rx252" Jun 03 22:55:22.068462 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:22.068431 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvqlh_c1356fb0-4884-41e6-8d59-fed020dd7a80/ovn-acl-logging/0.log" Jun 03 22:55:22.069008 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:22.068711 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvqlh_c1356fb0-4884-41e6-8d59-fed020dd7a80/ovn-acl-logging/0.log" Jun 03 22:55:22.074490 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:22.074468 2576 kubelet.go:1648] "Image garbage collection succeeded" Jun 03 22:55:24.099920 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:24.099886 2576 generic.go:356] "Generic (PLEG): container finished" podID="bbac7faa-a131-4ec6-b3cb-09a3c00e69f7" containerID="e82fee59391ab197f9bad2fad118999ea6580924cbbdf3bf734a40c5cff7d13a" exitCode=0 Jun 03 22:55:24.100332 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:24.099928 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-449jt" event={"ID":"bbac7faa-a131-4ec6-b3cb-09a3c00e69f7","Type":"ContainerDied","Data":"e82fee59391ab197f9bad2fad118999ea6580924cbbdf3bf734a40c5cff7d13a"} Jun 03 22:55:24.100332 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:24.100215 2576 scope.go:117] "RemoveContainer" containerID="e82fee59391ab197f9bad2fad118999ea6580924cbbdf3bf734a40c5cff7d13a" Jun 03 22:55:25.105116 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:25.105076 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-449jt" event={"ID":"bbac7faa-a131-4ec6-b3cb-09a3c00e69f7","Type":"ContainerStarted","Data":"4a8f6135a6a2d162893261ac14021bb37bdea76cc27b4fcc3db74a8db1d9368a"} Jun 03 22:55:29.841406 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:29.841363 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59499b698b-s4qwc" podUID="6d376ca9-7879-4a2b-bb03-96741cc3c90b" containerName="registry" containerID="cri-o://57eb67ad00e43e41388ee01cdf2f5d5dc184cb1a27d91b61141d8d219ac3d44a" gracePeriod=30 Jun 03 22:55:31.134422 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:31.134387 2576 generic.go:356] "Generic (PLEG): container finished" podID="6d376ca9-7879-4a2b-bb03-96741cc3c90b" containerID="57eb67ad00e43e41388ee01cdf2f5d5dc184cb1a27d91b61141d8d219ac3d44a" exitCode=0 Jun 03 22:55:31.134836 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:31.134467 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59499b698b-s4qwc" event={"ID":"6d376ca9-7879-4a2b-bb03-96741cc3c90b","Type":"ContainerDied","Data":"57eb67ad00e43e41388ee01cdf2f5d5dc184cb1a27d91b61141d8d219ac3d44a"} Jun 03 22:55:31.134836 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:31.134577 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:55:31.134836 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:31.134596 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59499b698b-s4qwc" event={"ID":"6d376ca9-7879-4a2b-bb03-96741cc3c90b","Type":"ContainerStarted","Data":"d69054a5d146e10875c1c102c15ee975da690c6d839ec66fc1407210d8ba2d38"} Jun 03 22:55:36.142851 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:36.142801 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6cc4678bb7-p2k8k" podUID="177e56ee-cd35-4e87-bcb9-4259f55c7658" containerName="console" containerID="cri-o://622399fbb3a6fb4b010cd555881d9c16485f222a587bdf9d8a329d0589f57f92" gracePeriod=15 Jun 03 22:55:36.382031 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:36.382003 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:55:36.434368 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:36.434289 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/177e56ee-cd35-4e87-bcb9-4259f55c7658-console-config\") pod \"177e56ee-cd35-4e87-bcb9-4259f55c7658\" (UID: \"177e56ee-cd35-4e87-bcb9-4259f55c7658\") " Jun 03 22:55:36.434368 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:36.434321 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/177e56ee-cd35-4e87-bcb9-4259f55c7658-oauth-serving-cert\") pod \"177e56ee-cd35-4e87-bcb9-4259f55c7658\" (UID: \"177e56ee-cd35-4e87-bcb9-4259f55c7658\") " Jun 03 22:55:36.434368 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:36.434343 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dl6rt\" (UniqueName: \"kubernetes.io/projected/177e56ee-cd35-4e87-bcb9-4259f55c7658-kube-api-access-dl6rt\") pod \"177e56ee-cd35-4e87-bcb9-4259f55c7658\" (UID: \"177e56ee-cd35-4e87-bcb9-4259f55c7658\") " Jun 03 22:55:36.434368 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:36.434365 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/177e56ee-cd35-4e87-bcb9-4259f55c7658-console-oauth-config\") pod \"177e56ee-cd35-4e87-bcb9-4259f55c7658\" (UID: \"177e56ee-cd35-4e87-bcb9-4259f55c7658\") " Jun 03 22:55:36.434713 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:36.434384 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/177e56ee-cd35-4e87-bcb9-4259f55c7658-service-ca\") pod \"177e56ee-cd35-4e87-bcb9-4259f55c7658\" (UID: \"177e56ee-cd35-4e87-bcb9-4259f55c7658\") " Jun 03 22:55:36.434713 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:36.434416 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/177e56ee-cd35-4e87-bcb9-4259f55c7658-console-serving-cert\") pod \"177e56ee-cd35-4e87-bcb9-4259f55c7658\" (UID: \"177e56ee-cd35-4e87-bcb9-4259f55c7658\") " Jun 03 22:55:36.434869 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:36.434758 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/177e56ee-cd35-4e87-bcb9-4259f55c7658-console-config" (OuterVolumeSpecName: "console-config") pod "177e56ee-cd35-4e87-bcb9-4259f55c7658" (UID: "177e56ee-cd35-4e87-bcb9-4259f55c7658"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:55:36.434869 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:36.434807 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/177e56ee-cd35-4e87-bcb9-4259f55c7658-service-ca" (OuterVolumeSpecName: "service-ca") pod "177e56ee-cd35-4e87-bcb9-4259f55c7658" (UID: "177e56ee-cd35-4e87-bcb9-4259f55c7658"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:55:36.434995 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:36.434926 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/177e56ee-cd35-4e87-bcb9-4259f55c7658-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "177e56ee-cd35-4e87-bcb9-4259f55c7658" (UID: "177e56ee-cd35-4e87-bcb9-4259f55c7658"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:55:36.436813 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:36.436784 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/177e56ee-cd35-4e87-bcb9-4259f55c7658-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "177e56ee-cd35-4e87-bcb9-4259f55c7658" (UID: "177e56ee-cd35-4e87-bcb9-4259f55c7658"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:55:36.436916 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:36.436833 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/177e56ee-cd35-4e87-bcb9-4259f55c7658-kube-api-access-dl6rt" (OuterVolumeSpecName: "kube-api-access-dl6rt") pod "177e56ee-cd35-4e87-bcb9-4259f55c7658" (UID: "177e56ee-cd35-4e87-bcb9-4259f55c7658"). InnerVolumeSpecName "kube-api-access-dl6rt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:55:36.436916 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:36.436862 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/177e56ee-cd35-4e87-bcb9-4259f55c7658-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "177e56ee-cd35-4e87-bcb9-4259f55c7658" (UID: "177e56ee-cd35-4e87-bcb9-4259f55c7658"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:55:36.535610 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:36.535576 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/177e56ee-cd35-4e87-bcb9-4259f55c7658-console-config\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:55:36.535610 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:36.535604 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/177e56ee-cd35-4e87-bcb9-4259f55c7658-oauth-serving-cert\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:55:36.535610 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:36.535613 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dl6rt\" (UniqueName: \"kubernetes.io/projected/177e56ee-cd35-4e87-bcb9-4259f55c7658-kube-api-access-dl6rt\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:55:36.535842 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:36.535622 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/177e56ee-cd35-4e87-bcb9-4259f55c7658-console-oauth-config\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:55:36.535842 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:36.535632 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/177e56ee-cd35-4e87-bcb9-4259f55c7658-service-ca\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:55:36.535842 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:36.535641 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/177e56ee-cd35-4e87-bcb9-4259f55c7658-console-serving-cert\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:55:37.164907 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:37.164862 2576 generic.go:356] "Generic (PLEG): container finished" podID="177e56ee-cd35-4e87-bcb9-4259f55c7658" containerID="622399fbb3a6fb4b010cd555881d9c16485f222a587bdf9d8a329d0589f57f92" exitCode=0 Jun 03 22:55:37.164907 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:37.164908 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc4678bb7-p2k8k" Jun 03 22:55:37.164907 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:37.164916 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc4678bb7-p2k8k" event={"ID":"177e56ee-cd35-4e87-bcb9-4259f55c7658","Type":"ContainerDied","Data":"622399fbb3a6fb4b010cd555881d9c16485f222a587bdf9d8a329d0589f57f92"} Jun 03 22:55:37.165431 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:37.164954 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc4678bb7-p2k8k" event={"ID":"177e56ee-cd35-4e87-bcb9-4259f55c7658","Type":"ContainerDied","Data":"465aeba61b385ccfd4431c4679bdfeebfeac18ed8b13dc2add4fb35368c8e5fc"} Jun 03 22:55:37.165431 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:37.164973 2576 scope.go:117] "RemoveContainer" containerID="622399fbb3a6fb4b010cd555881d9c16485f222a587bdf9d8a329d0589f57f92" Jun 03 22:55:37.173658 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:37.173642 2576 scope.go:117] "RemoveContainer" containerID="622399fbb3a6fb4b010cd555881d9c16485f222a587bdf9d8a329d0589f57f92" Jun 03 22:55:37.173926 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:55:37.173906 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"622399fbb3a6fb4b010cd555881d9c16485f222a587bdf9d8a329d0589f57f92\": container with ID starting with 622399fbb3a6fb4b010cd555881d9c16485f222a587bdf9d8a329d0589f57f92 not found: ID does not exist" containerID="622399fbb3a6fb4b010cd555881d9c16485f222a587bdf9d8a329d0589f57f92" Jun 03 22:55:37.173968 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:37.173936 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"622399fbb3a6fb4b010cd555881d9c16485f222a587bdf9d8a329d0589f57f92"} err="failed to get container status \"622399fbb3a6fb4b010cd555881d9c16485f222a587bdf9d8a329d0589f57f92\": rpc error: code = NotFound desc = could not find container \"622399fbb3a6fb4b010cd555881d9c16485f222a587bdf9d8a329d0589f57f92\": container with ID starting with 622399fbb3a6fb4b010cd555881d9c16485f222a587bdf9d8a329d0589f57f92 not found: ID does not exist" Jun 03 22:55:37.189537 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:37.189493 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cc4678bb7-p2k8k"] Jun 03 22:55:37.192252 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:37.192230 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cc4678bb7-p2k8k"] Jun 03 22:55:38.116061 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:38.116028 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="177e56ee-cd35-4e87-bcb9-4259f55c7658" path="/var/lib/kubelet/pods/177e56ee-cd35-4e87-bcb9-4259f55c7658/volumes" Jun 03 22:55:52.143422 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:52.143394 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59499b698b-s4qwc" Jun 03 22:55:58.250298 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:58.250254 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 22:55:58.250775 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:58.250567 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="alertmanager" containerID="cri-o://7e8bbc51f14a0c2cbe90137fb8d9f893e67e8d495edc3f7286b2f091514e6089" gracePeriod=120 Jun 03 22:55:58.250775 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:58.250661 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="kube-rbac-proxy-metric" containerID="cri-o://c534c0bef54325370912e2970598027d9d6d2b81ab5d6d5d45e3585e2ad656d2" gracePeriod=120 Jun 03 22:55:58.250775 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:58.250687 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="prom-label-proxy" containerID="cri-o://35c4856dcb4e28864772253ac2c143b86fff2ff896c3c99608347e3a39f92939" gracePeriod=120 Jun 03 22:55:58.250775 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:58.250720 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="kube-rbac-proxy-web" containerID="cri-o://d504ebc9e33ec078561ecee9c2b002f8a82ff18bf0ad55de76f7b27857cda638" gracePeriod=120 Jun 03 22:55:58.250775 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:58.250755 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="kube-rbac-proxy" containerID="cri-o://a8cf1ba2a1ea42b1c21a72d2b3cdbcd19567b758319305a0148bc1fafe2ed520" gracePeriod=120 Jun 03 22:55:58.251016 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:58.250721 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="config-reloader" containerID="cri-o://d3d2f52f4680ca912f5cb19f655dd1983dd8f723498b1d3722d932844d1ea139" gracePeriod=120 Jun 03 22:55:59.266404 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.266374 2576 generic.go:356] "Generic (PLEG): container finished" podID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerID="35c4856dcb4e28864772253ac2c143b86fff2ff896c3c99608347e3a39f92939" exitCode=0 Jun 03 22:55:59.266404 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.266398 2576 generic.go:356] "Generic (PLEG): container finished" podID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerID="a8cf1ba2a1ea42b1c21a72d2b3cdbcd19567b758319305a0148bc1fafe2ed520" exitCode=0 Jun 03 22:55:59.266404 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.266407 2576 generic.go:356] "Generic (PLEG): container finished" podID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerID="d3d2f52f4680ca912f5cb19f655dd1983dd8f723498b1d3722d932844d1ea139" exitCode=0 Jun 03 22:55:59.266404 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.266415 2576 generic.go:356] "Generic (PLEG): container finished" podID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerID="7e8bbc51f14a0c2cbe90137fb8d9f893e67e8d495edc3f7286b2f091514e6089" exitCode=0 Jun 03 22:55:59.266885 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.266440 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87ecf3ef-9ac0-4914-a2e6-846654af7228","Type":"ContainerDied","Data":"35c4856dcb4e28864772253ac2c143b86fff2ff896c3c99608347e3a39f92939"} Jun 03 22:55:59.266885 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.266518 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87ecf3ef-9ac0-4914-a2e6-846654af7228","Type":"ContainerDied","Data":"a8cf1ba2a1ea42b1c21a72d2b3cdbcd19567b758319305a0148bc1fafe2ed520"} Jun 03 22:55:59.266885 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.266553 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87ecf3ef-9ac0-4914-a2e6-846654af7228","Type":"ContainerDied","Data":"d3d2f52f4680ca912f5cb19f655dd1983dd8f723498b1d3722d932844d1ea139"} Jun 03 22:55:59.266885 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.266577 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87ecf3ef-9ac0-4914-a2e6-846654af7228","Type":"ContainerDied","Data":"7e8bbc51f14a0c2cbe90137fb8d9f893e67e8d495edc3f7286b2f091514e6089"} Jun 03 22:55:59.511560 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.511529 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:55:59.535581 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.535483 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-config-volume\") pod \"87ecf3ef-9ac0-4914-a2e6-846654af7228\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " Jun 03 22:55:59.535581 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.535549 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/87ecf3ef-9ac0-4914-a2e6-846654af7228-tls-assets\") pod \"87ecf3ef-9ac0-4914-a2e6-846654af7228\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " Jun 03 22:55:59.535790 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.535587 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-755bt\" (UniqueName: \"kubernetes.io/projected/87ecf3ef-9ac0-4914-a2e6-846654af7228-kube-api-access-755bt\") pod \"87ecf3ef-9ac0-4914-a2e6-846654af7228\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " Jun 03 22:55:59.535790 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.535620 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/87ecf3ef-9ac0-4914-a2e6-846654af7228-config-out\") pod \"87ecf3ef-9ac0-4914-a2e6-846654af7228\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " Jun 03 22:55:59.535790 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.535644 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-secret-alertmanager-kube-rbac-proxy\") pod \"87ecf3ef-9ac0-4914-a2e6-846654af7228\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " Jun 03 22:55:59.535790 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.535675 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-secret-alertmanager-kube-rbac-proxy-web\") pod \"87ecf3ef-9ac0-4914-a2e6-846654af7228\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " Jun 03 22:55:59.535790 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.535704 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/87ecf3ef-9ac0-4914-a2e6-846654af7228-alertmanager-main-db\") pod \"87ecf3ef-9ac0-4914-a2e6-846654af7228\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " Jun 03 22:55:59.535790 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.535737 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-secret-alertmanager-kube-rbac-proxy-metric\") pod \"87ecf3ef-9ac0-4914-a2e6-846654af7228\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " Jun 03 22:55:59.535790 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.535765 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87ecf3ef-9ac0-4914-a2e6-846654af7228-alertmanager-trusted-ca-bundle\") pod \"87ecf3ef-9ac0-4914-a2e6-846654af7228\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " Jun 03 22:55:59.536108 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.535816 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-secret-alertmanager-main-tls\") pod \"87ecf3ef-9ac0-4914-a2e6-846654af7228\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " Jun 03 22:55:59.536108 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.535846 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-web-config\") pod \"87ecf3ef-9ac0-4914-a2e6-846654af7228\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " Jun 03 22:55:59.536108 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.535873 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87ecf3ef-9ac0-4914-a2e6-846654af7228-metrics-client-ca\") pod \"87ecf3ef-9ac0-4914-a2e6-846654af7228\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " Jun 03 22:55:59.536108 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.535901 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-cluster-tls-config\") pod \"87ecf3ef-9ac0-4914-a2e6-846654af7228\" (UID: \"87ecf3ef-9ac0-4914-a2e6-846654af7228\") " Jun 03 22:55:59.536108 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.536052 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87ecf3ef-9ac0-4914-a2e6-846654af7228-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "87ecf3ef-9ac0-4914-a2e6-846654af7228" (UID: "87ecf3ef-9ac0-4914-a2e6-846654af7228"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:55:59.536365 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.536202 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/87ecf3ef-9ac0-4914-a2e6-846654af7228-alertmanager-main-db\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:55:59.536896 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.536857 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87ecf3ef-9ac0-4914-a2e6-846654af7228-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "87ecf3ef-9ac0-4914-a2e6-846654af7228" (UID: "87ecf3ef-9ac0-4914-a2e6-846654af7228"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:55:59.537138 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.537108 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87ecf3ef-9ac0-4914-a2e6-846654af7228-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "87ecf3ef-9ac0-4914-a2e6-846654af7228" (UID: "87ecf3ef-9ac0-4914-a2e6-846654af7228"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:55:59.538466 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.538438 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "87ecf3ef-9ac0-4914-a2e6-846654af7228" (UID: "87ecf3ef-9ac0-4914-a2e6-846654af7228"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:55:59.539105 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.539065 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87ecf3ef-9ac0-4914-a2e6-846654af7228-config-out" (OuterVolumeSpecName: "config-out") pod "87ecf3ef-9ac0-4914-a2e6-846654af7228" (UID: "87ecf3ef-9ac0-4914-a2e6-846654af7228"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:55:59.539185 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.539091 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "87ecf3ef-9ac0-4914-a2e6-846654af7228" (UID: "87ecf3ef-9ac0-4914-a2e6-846654af7228"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:55:59.539257 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.539185 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-config-volume" (OuterVolumeSpecName: "config-volume") pod "87ecf3ef-9ac0-4914-a2e6-846654af7228" (UID: "87ecf3ef-9ac0-4914-a2e6-846654af7228"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:55:59.539257 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.539223 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "87ecf3ef-9ac0-4914-a2e6-846654af7228" (UID: "87ecf3ef-9ac0-4914-a2e6-846654af7228"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:55:59.540284 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.540252 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "87ecf3ef-9ac0-4914-a2e6-846654af7228" (UID: "87ecf3ef-9ac0-4914-a2e6-846654af7228"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:55:59.540370 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.540261 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87ecf3ef-9ac0-4914-a2e6-846654af7228-kube-api-access-755bt" (OuterVolumeSpecName: "kube-api-access-755bt") pod "87ecf3ef-9ac0-4914-a2e6-846654af7228" (UID: "87ecf3ef-9ac0-4914-a2e6-846654af7228"). InnerVolumeSpecName "kube-api-access-755bt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:55:59.540370 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.540334 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87ecf3ef-9ac0-4914-a2e6-846654af7228-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "87ecf3ef-9ac0-4914-a2e6-846654af7228" (UID: "87ecf3ef-9ac0-4914-a2e6-846654af7228"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:55:59.544007 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.543987 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "87ecf3ef-9ac0-4914-a2e6-846654af7228" (UID: "87ecf3ef-9ac0-4914-a2e6-846654af7228"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:55:59.552272 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.552236 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-web-config" (OuterVolumeSpecName: "web-config") pod "87ecf3ef-9ac0-4914-a2e6-846654af7228" (UID: "87ecf3ef-9ac0-4914-a2e6-846654af7228"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:55:59.636850 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.636799 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-secret-alertmanager-main-tls\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:55:59.636850 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.636846 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-web-config\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:55:59.636850 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.636856 2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87ecf3ef-9ac0-4914-a2e6-846654af7228-metrics-client-ca\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:55:59.636850 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.636864 2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-cluster-tls-config\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:55:59.637123 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.636880 2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-config-volume\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:55:59.637123 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.636889 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/87ecf3ef-9ac0-4914-a2e6-846654af7228-tls-assets\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:55:59.637123 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.636897 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-755bt\" (UniqueName: \"kubernetes.io/projected/87ecf3ef-9ac0-4914-a2e6-846654af7228-kube-api-access-755bt\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:55:59.637123 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.636906 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/87ecf3ef-9ac0-4914-a2e6-846654af7228-config-out\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:55:59.637123 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.636916 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:55:59.637123 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.636924 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:55:59.637123 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.636932 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/87ecf3ef-9ac0-4914-a2e6-846654af7228-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:55:59.637123 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:55:59.636942 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87ecf3ef-9ac0-4914-a2e6-846654af7228-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:56:00.274196 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.274162 2576 generic.go:356] "Generic (PLEG): container finished" podID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerID="c534c0bef54325370912e2970598027d9d6d2b81ab5d6d5d45e3585e2ad656d2" exitCode=0 Jun 03 22:56:00.274196 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.274192 2576 generic.go:356] "Generic (PLEG): container finished" podID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerID="d504ebc9e33ec078561ecee9c2b002f8a82ff18bf0ad55de76f7b27857cda638" exitCode=0 Jun 03 22:56:00.274636 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.274241 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87ecf3ef-9ac0-4914-a2e6-846654af7228","Type":"ContainerDied","Data":"c534c0bef54325370912e2970598027d9d6d2b81ab5d6d5d45e3585e2ad656d2"} Jun 03 22:56:00.274636 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.274313 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87ecf3ef-9ac0-4914-a2e6-846654af7228","Type":"ContainerDied","Data":"d504ebc9e33ec078561ecee9c2b002f8a82ff18bf0ad55de76f7b27857cda638"} Jun 03 22:56:00.274636 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.274252 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.274636 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.274342 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87ecf3ef-9ac0-4914-a2e6-846654af7228","Type":"ContainerDied","Data":"f1fa2be1d659bfe0949fec03033f390df9dca139299b70511b9af0083945ecce"} Jun 03 22:56:00.274636 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.274374 2576 scope.go:117] "RemoveContainer" containerID="35c4856dcb4e28864772253ac2c143b86fff2ff896c3c99608347e3a39f92939" Jun 03 22:56:00.281999 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.281979 2576 scope.go:117] "RemoveContainer" containerID="c534c0bef54325370912e2970598027d9d6d2b81ab5d6d5d45e3585e2ad656d2" Jun 03 22:56:00.289674 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.289654 2576 scope.go:117] "RemoveContainer" containerID="a8cf1ba2a1ea42b1c21a72d2b3cdbcd19567b758319305a0148bc1fafe2ed520" Jun 03 22:56:00.296863 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.296842 2576 scope.go:117] "RemoveContainer" containerID="d504ebc9e33ec078561ecee9c2b002f8a82ff18bf0ad55de76f7b27857cda638" Jun 03 22:56:00.303726 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.303700 2576 scope.go:117] "RemoveContainer" containerID="d3d2f52f4680ca912f5cb19f655dd1983dd8f723498b1d3722d932844d1ea139" Jun 03 22:56:00.307930 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.307905 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 22:56:00.311282 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.311261 2576 scope.go:117] "RemoveContainer" containerID="7e8bbc51f14a0c2cbe90137fb8d9f893e67e8d495edc3f7286b2f091514e6089" Jun 03 22:56:00.317729 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.317702 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 22:56:00.319880 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.319862 2576 scope.go:117] "RemoveContainer" containerID="2429ab13d127c12cb296a47b5ab5c5d34e3ca11483561a68fa48d1115145fd0d" Jun 03 22:56:00.327071 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.327050 2576 scope.go:117] "RemoveContainer" containerID="35c4856dcb4e28864772253ac2c143b86fff2ff896c3c99608347e3a39f92939" Jun 03 22:56:00.327363 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:56:00.327345 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35c4856dcb4e28864772253ac2c143b86fff2ff896c3c99608347e3a39f92939\": container with ID starting with 35c4856dcb4e28864772253ac2c143b86fff2ff896c3c99608347e3a39f92939 not found: ID does not exist" containerID="35c4856dcb4e28864772253ac2c143b86fff2ff896c3c99608347e3a39f92939" Jun 03 22:56:00.327439 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.327370 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35c4856dcb4e28864772253ac2c143b86fff2ff896c3c99608347e3a39f92939"} err="failed to get container status \"35c4856dcb4e28864772253ac2c143b86fff2ff896c3c99608347e3a39f92939\": rpc error: code = NotFound desc = could not find container \"35c4856dcb4e28864772253ac2c143b86fff2ff896c3c99608347e3a39f92939\": container with ID starting with 35c4856dcb4e28864772253ac2c143b86fff2ff896c3c99608347e3a39f92939 not found: ID does not exist" Jun 03 22:56:00.327439 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.327389 2576 scope.go:117] "RemoveContainer" containerID="c534c0bef54325370912e2970598027d9d6d2b81ab5d6d5d45e3585e2ad656d2" Jun 03 22:56:00.327641 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:56:00.327626 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c534c0bef54325370912e2970598027d9d6d2b81ab5d6d5d45e3585e2ad656d2\": container with ID starting with c534c0bef54325370912e2970598027d9d6d2b81ab5d6d5d45e3585e2ad656d2 not found: ID does not exist" containerID="c534c0bef54325370912e2970598027d9d6d2b81ab5d6d5d45e3585e2ad656d2" Jun 03 22:56:00.327700 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.327645 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c534c0bef54325370912e2970598027d9d6d2b81ab5d6d5d45e3585e2ad656d2"} err="failed to get container status \"c534c0bef54325370912e2970598027d9d6d2b81ab5d6d5d45e3585e2ad656d2\": rpc error: code = NotFound desc = could not find container \"c534c0bef54325370912e2970598027d9d6d2b81ab5d6d5d45e3585e2ad656d2\": container with ID starting with c534c0bef54325370912e2970598027d9d6d2b81ab5d6d5d45e3585e2ad656d2 not found: ID does not exist" Jun 03 22:56:00.327700 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.327657 2576 scope.go:117] "RemoveContainer" containerID="a8cf1ba2a1ea42b1c21a72d2b3cdbcd19567b758319305a0148bc1fafe2ed520" Jun 03 22:56:00.327899 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:56:00.327873 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8cf1ba2a1ea42b1c21a72d2b3cdbcd19567b758319305a0148bc1fafe2ed520\": container with ID starting with a8cf1ba2a1ea42b1c21a72d2b3cdbcd19567b758319305a0148bc1fafe2ed520 not found: ID does not exist" containerID="a8cf1ba2a1ea42b1c21a72d2b3cdbcd19567b758319305a0148bc1fafe2ed520" Jun 03 22:56:00.327998 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.327898 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8cf1ba2a1ea42b1c21a72d2b3cdbcd19567b758319305a0148bc1fafe2ed520"} err="failed to get container status \"a8cf1ba2a1ea42b1c21a72d2b3cdbcd19567b758319305a0148bc1fafe2ed520\": rpc error: code = NotFound desc = could not find container \"a8cf1ba2a1ea42b1c21a72d2b3cdbcd19567b758319305a0148bc1fafe2ed520\": container with ID starting with a8cf1ba2a1ea42b1c21a72d2b3cdbcd19567b758319305a0148bc1fafe2ed520 not found: ID does not exist" Jun 03 22:56:00.327998 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.327914 2576 scope.go:117] "RemoveContainer" containerID="d504ebc9e33ec078561ecee9c2b002f8a82ff18bf0ad55de76f7b27857cda638" Jun 03 22:56:00.328150 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:56:00.328129 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d504ebc9e33ec078561ecee9c2b002f8a82ff18bf0ad55de76f7b27857cda638\": container with ID starting with d504ebc9e33ec078561ecee9c2b002f8a82ff18bf0ad55de76f7b27857cda638 not found: ID does not exist" containerID="d504ebc9e33ec078561ecee9c2b002f8a82ff18bf0ad55de76f7b27857cda638" Jun 03 22:56:00.328202 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.328158 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d504ebc9e33ec078561ecee9c2b002f8a82ff18bf0ad55de76f7b27857cda638"} err="failed to get container status \"d504ebc9e33ec078561ecee9c2b002f8a82ff18bf0ad55de76f7b27857cda638\": rpc error: code = NotFound desc = could not find container \"d504ebc9e33ec078561ecee9c2b002f8a82ff18bf0ad55de76f7b27857cda638\": container with ID starting with d504ebc9e33ec078561ecee9c2b002f8a82ff18bf0ad55de76f7b27857cda638 not found: ID does not exist" Jun 03 22:56:00.328202 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.328181 2576 scope.go:117] "RemoveContainer" containerID="d3d2f52f4680ca912f5cb19f655dd1983dd8f723498b1d3722d932844d1ea139" Jun 03 22:56:00.328410 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:56:00.328394 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3d2f52f4680ca912f5cb19f655dd1983dd8f723498b1d3722d932844d1ea139\": container with ID starting with d3d2f52f4680ca912f5cb19f655dd1983dd8f723498b1d3722d932844d1ea139 not found: ID does not exist" containerID="d3d2f52f4680ca912f5cb19f655dd1983dd8f723498b1d3722d932844d1ea139" Jun 03 22:56:00.328449 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.328416 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3d2f52f4680ca912f5cb19f655dd1983dd8f723498b1d3722d932844d1ea139"} err="failed to get container status \"d3d2f52f4680ca912f5cb19f655dd1983dd8f723498b1d3722d932844d1ea139\": rpc error: code = NotFound desc = could not find container \"d3d2f52f4680ca912f5cb19f655dd1983dd8f723498b1d3722d932844d1ea139\": container with ID starting with d3d2f52f4680ca912f5cb19f655dd1983dd8f723498b1d3722d932844d1ea139 not found: ID does not exist" Jun 03 22:56:00.328449 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.328429 2576 scope.go:117] "RemoveContainer" containerID="7e8bbc51f14a0c2cbe90137fb8d9f893e67e8d495edc3f7286b2f091514e6089" Jun 03 22:56:00.328650 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:56:00.328632 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e8bbc51f14a0c2cbe90137fb8d9f893e67e8d495edc3f7286b2f091514e6089\": container with ID starting with 7e8bbc51f14a0c2cbe90137fb8d9f893e67e8d495edc3f7286b2f091514e6089 not found: ID does not exist" containerID="7e8bbc51f14a0c2cbe90137fb8d9f893e67e8d495edc3f7286b2f091514e6089" Jun 03 22:56:00.328703 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.328652 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e8bbc51f14a0c2cbe90137fb8d9f893e67e8d495edc3f7286b2f091514e6089"} err="failed to get container status \"7e8bbc51f14a0c2cbe90137fb8d9f893e67e8d495edc3f7286b2f091514e6089\": rpc error: code = NotFound desc = could not find container \"7e8bbc51f14a0c2cbe90137fb8d9f893e67e8d495edc3f7286b2f091514e6089\": container with ID starting with 7e8bbc51f14a0c2cbe90137fb8d9f893e67e8d495edc3f7286b2f091514e6089 not found: ID does not exist" Jun 03 22:56:00.328703 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.328663 2576 scope.go:117] "RemoveContainer" containerID="2429ab13d127c12cb296a47b5ab5c5d34e3ca11483561a68fa48d1115145fd0d" Jun 03 22:56:00.328843 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:56:00.328829 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2429ab13d127c12cb296a47b5ab5c5d34e3ca11483561a68fa48d1115145fd0d\": container with ID starting with 2429ab13d127c12cb296a47b5ab5c5d34e3ca11483561a68fa48d1115145fd0d not found: ID does not exist" containerID="2429ab13d127c12cb296a47b5ab5c5d34e3ca11483561a68fa48d1115145fd0d" Jun 03 22:56:00.328895 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.328844 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2429ab13d127c12cb296a47b5ab5c5d34e3ca11483561a68fa48d1115145fd0d"} err="failed to get container status \"2429ab13d127c12cb296a47b5ab5c5d34e3ca11483561a68fa48d1115145fd0d\": rpc error: code = NotFound desc = could not find container \"2429ab13d127c12cb296a47b5ab5c5d34e3ca11483561a68fa48d1115145fd0d\": container with ID starting with 2429ab13d127c12cb296a47b5ab5c5d34e3ca11483561a68fa48d1115145fd0d not found: ID does not exist" Jun 03 22:56:00.328895 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.328856 2576 scope.go:117] "RemoveContainer" containerID="35c4856dcb4e28864772253ac2c143b86fff2ff896c3c99608347e3a39f92939" Jun 03 22:56:00.329059 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.329038 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35c4856dcb4e28864772253ac2c143b86fff2ff896c3c99608347e3a39f92939"} err="failed to get container status \"35c4856dcb4e28864772253ac2c143b86fff2ff896c3c99608347e3a39f92939\": rpc error: code = NotFound desc = could not find container \"35c4856dcb4e28864772253ac2c143b86fff2ff896c3c99608347e3a39f92939\": container with ID starting with 35c4856dcb4e28864772253ac2c143b86fff2ff896c3c99608347e3a39f92939 not found: ID does not exist" Jun 03 22:56:00.329106 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.329060 2576 scope.go:117] "RemoveContainer" containerID="c534c0bef54325370912e2970598027d9d6d2b81ab5d6d5d45e3585e2ad656d2" Jun 03 22:56:00.329303 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.329283 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c534c0bef54325370912e2970598027d9d6d2b81ab5d6d5d45e3585e2ad656d2"} err="failed to get container status \"c534c0bef54325370912e2970598027d9d6d2b81ab5d6d5d45e3585e2ad656d2\": rpc error: code = NotFound desc = could not find container \"c534c0bef54325370912e2970598027d9d6d2b81ab5d6d5d45e3585e2ad656d2\": container with ID starting with c534c0bef54325370912e2970598027d9d6d2b81ab5d6d5d45e3585e2ad656d2 not found: ID does not exist" Jun 03 22:56:00.329303 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.329302 2576 scope.go:117] "RemoveContainer" containerID="a8cf1ba2a1ea42b1c21a72d2b3cdbcd19567b758319305a0148bc1fafe2ed520" Jun 03 22:56:00.329570 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.329553 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8cf1ba2a1ea42b1c21a72d2b3cdbcd19567b758319305a0148bc1fafe2ed520"} err="failed to get container status \"a8cf1ba2a1ea42b1c21a72d2b3cdbcd19567b758319305a0148bc1fafe2ed520\": rpc error: code = NotFound desc = could not find container \"a8cf1ba2a1ea42b1c21a72d2b3cdbcd19567b758319305a0148bc1fafe2ed520\": container with ID starting with a8cf1ba2a1ea42b1c21a72d2b3cdbcd19567b758319305a0148bc1fafe2ed520 not found: ID does not exist" Jun 03 22:56:00.329631 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.329571 2576 scope.go:117] "RemoveContainer" containerID="d504ebc9e33ec078561ecee9c2b002f8a82ff18bf0ad55de76f7b27857cda638" Jun 03 22:56:00.329788 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.329768 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d504ebc9e33ec078561ecee9c2b002f8a82ff18bf0ad55de76f7b27857cda638"} err="failed to get container status \"d504ebc9e33ec078561ecee9c2b002f8a82ff18bf0ad55de76f7b27857cda638\": rpc error: code = NotFound desc = could not find container \"d504ebc9e33ec078561ecee9c2b002f8a82ff18bf0ad55de76f7b27857cda638\": container with ID starting with d504ebc9e33ec078561ecee9c2b002f8a82ff18bf0ad55de76f7b27857cda638 not found: ID does not exist" Jun 03 22:56:00.329788 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.329788 2576 scope.go:117] "RemoveContainer" containerID="d3d2f52f4680ca912f5cb19f655dd1983dd8f723498b1d3722d932844d1ea139" Jun 03 22:56:00.329995 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.329972 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3d2f52f4680ca912f5cb19f655dd1983dd8f723498b1d3722d932844d1ea139"} err="failed to get container status \"d3d2f52f4680ca912f5cb19f655dd1983dd8f723498b1d3722d932844d1ea139\": rpc error: code = NotFound desc = could not find container \"d3d2f52f4680ca912f5cb19f655dd1983dd8f723498b1d3722d932844d1ea139\": container with ID starting with d3d2f52f4680ca912f5cb19f655dd1983dd8f723498b1d3722d932844d1ea139 not found: ID does not exist" Jun 03 22:56:00.329995 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.329988 2576 scope.go:117] "RemoveContainer" containerID="7e8bbc51f14a0c2cbe90137fb8d9f893e67e8d495edc3f7286b2f091514e6089" Jun 03 22:56:00.330224 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.330206 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e8bbc51f14a0c2cbe90137fb8d9f893e67e8d495edc3f7286b2f091514e6089"} err="failed to get container status \"7e8bbc51f14a0c2cbe90137fb8d9f893e67e8d495edc3f7286b2f091514e6089\": rpc error: code = NotFound desc = could not find container \"7e8bbc51f14a0c2cbe90137fb8d9f893e67e8d495edc3f7286b2f091514e6089\": container with ID starting with 7e8bbc51f14a0c2cbe90137fb8d9f893e67e8d495edc3f7286b2f091514e6089 not found: ID does not exist" Jun 03 22:56:00.330275 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.330227 2576 scope.go:117] "RemoveContainer" containerID="2429ab13d127c12cb296a47b5ab5c5d34e3ca11483561a68fa48d1115145fd0d" Jun 03 22:56:00.330456 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.330438 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2429ab13d127c12cb296a47b5ab5c5d34e3ca11483561a68fa48d1115145fd0d"} err="failed to get container status \"2429ab13d127c12cb296a47b5ab5c5d34e3ca11483561a68fa48d1115145fd0d\": rpc error: code = NotFound desc = could not find container \"2429ab13d127c12cb296a47b5ab5c5d34e3ca11483561a68fa48d1115145fd0d\": container with ID starting with 2429ab13d127c12cb296a47b5ab5c5d34e3ca11483561a68fa48d1115145fd0d not found: ID does not exist" Jun 03 22:56:00.368497 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.368458 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 22:56:00.368738 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.368726 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="kube-rbac-proxy-metric" Jun 03 22:56:00.368777 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.368739 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="kube-rbac-proxy-metric" Jun 03 22:56:00.368777 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.368748 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="177e56ee-cd35-4e87-bcb9-4259f55c7658" containerName="console" Jun 03 22:56:00.368777 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.368753 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="177e56ee-cd35-4e87-bcb9-4259f55c7658" containerName="console" Jun 03 22:56:00.368777 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.368761 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="alertmanager" Jun 03 22:56:00.368777 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.368767 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="alertmanager" Jun 03 22:56:00.368777 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.368772 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="kube-rbac-proxy-web" Jun 03 22:56:00.368777 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.368777 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="kube-rbac-proxy-web" Jun 03 22:56:00.369020 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.368787 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="config-reloader" Jun 03 22:56:00.369020 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.368792 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="config-reloader" Jun 03 22:56:00.369020 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.368805 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="kube-rbac-proxy" Jun 03 22:56:00.369020 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.368810 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="kube-rbac-proxy" Jun 03 22:56:00.369020 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.368819 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="init-config-reloader" Jun 03 22:56:00.369020 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.368824 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="init-config-reloader" Jun 03 22:56:00.369020 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.368830 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="prom-label-proxy" Jun 03 22:56:00.369020 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.368835 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="prom-label-proxy" Jun 03 22:56:00.369020 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.368885 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="kube-rbac-proxy-web" Jun 03 22:56:00.369020 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.368893 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="177e56ee-cd35-4e87-bcb9-4259f55c7658" containerName="console" Jun 03 22:56:00.369020 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.368900 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="kube-rbac-proxy" Jun 03 22:56:00.369020 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.368905 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="alertmanager" Jun 03 22:56:00.369020 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.368911 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="prom-label-proxy" Jun 03 22:56:00.369020 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.368917 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="config-reloader" Jun 03 22:56:00.369020 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.368922 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" containerName="kube-rbac-proxy-metric" Jun 03 22:56:00.373804 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.373732 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.378723 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.378676 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 22:56:00.378869 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.378762 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 22:56:00.378869 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.378844 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 22:56:00.378997 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.378929 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 22:56:00.380397 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.380001 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rtt8m\"" Jun 03 22:56:00.380397 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.380007 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 22:56:00.380397 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.380095 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 22:56:00.380397 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.380255 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 22:56:00.380397 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.380368 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 22:56:00.386215 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.386165 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 22:56:00.413034 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.413004 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 22:56:00.442602 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.442569 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/727f9d99-1975-4cca-a59a-0f7adc65620d-config-out\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.442764 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.442607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/727f9d99-1975-4cca-a59a-0f7adc65620d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.442764 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.442626 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/727f9d99-1975-4cca-a59a-0f7adc65620d-config-volume\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.442764 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.442644 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/727f9d99-1975-4cca-a59a-0f7adc65620d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.442764 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.442695 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/727f9d99-1975-4cca-a59a-0f7adc65620d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.442764 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.442749 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/727f9d99-1975-4cca-a59a-0f7adc65620d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.442920 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.442804 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cscxm\" (UniqueName: \"kubernetes.io/projected/727f9d99-1975-4cca-a59a-0f7adc65620d-kube-api-access-cscxm\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.442920 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.442829 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/727f9d99-1975-4cca-a59a-0f7adc65620d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.442920 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.442853 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/727f9d99-1975-4cca-a59a-0f7adc65620d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.442920 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.442880 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/727f9d99-1975-4cca-a59a-0f7adc65620d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.442920 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.442904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/727f9d99-1975-4cca-a59a-0f7adc65620d-web-config\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.443064 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.442928 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/727f9d99-1975-4cca-a59a-0f7adc65620d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.443064 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.442958 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/727f9d99-1975-4cca-a59a-0f7adc65620d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.544065 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.544025 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/727f9d99-1975-4cca-a59a-0f7adc65620d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.544219 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.544075 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/727f9d99-1975-4cca-a59a-0f7adc65620d-config-out\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.544219 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.544103 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/727f9d99-1975-4cca-a59a-0f7adc65620d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.544315 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.544216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/727f9d99-1975-4cca-a59a-0f7adc65620d-config-volume\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.544315 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.544249 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/727f9d99-1975-4cca-a59a-0f7adc65620d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.544315 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.544276 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/727f9d99-1975-4cca-a59a-0f7adc65620d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.544315 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.544301 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/727f9d99-1975-4cca-a59a-0f7adc65620d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.544549 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.544349 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cscxm\" (UniqueName: \"kubernetes.io/projected/727f9d99-1975-4cca-a59a-0f7adc65620d-kube-api-access-cscxm\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.544549 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.544377 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/727f9d99-1975-4cca-a59a-0f7adc65620d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.544549 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.544417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/727f9d99-1975-4cca-a59a-0f7adc65620d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.544549 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.544447 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/727f9d99-1975-4cca-a59a-0f7adc65620d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.544549 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.544475 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/727f9d99-1975-4cca-a59a-0f7adc65620d-web-config\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.544549 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.544537 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/727f9d99-1975-4cca-a59a-0f7adc65620d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.544913 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.544687 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/727f9d99-1975-4cca-a59a-0f7adc65620d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.545671 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.545314 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/727f9d99-1975-4cca-a59a-0f7adc65620d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.545671 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.545559 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/727f9d99-1975-4cca-a59a-0f7adc65620d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.547270 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.547235 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/727f9d99-1975-4cca-a59a-0f7adc65620d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.547387 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.547366 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/727f9d99-1975-4cca-a59a-0f7adc65620d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.547764 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.547700 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/727f9d99-1975-4cca-a59a-0f7adc65620d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.547865 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.547796 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/727f9d99-1975-4cca-a59a-0f7adc65620d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.547865 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.547849 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/727f9d99-1975-4cca-a59a-0f7adc65620d-config-out\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.548205 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.548177 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/727f9d99-1975-4cca-a59a-0f7adc65620d-config-volume\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.548283 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.548231 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/727f9d99-1975-4cca-a59a-0f7adc65620d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.548332 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.548278 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/727f9d99-1975-4cca-a59a-0f7adc65620d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.549432 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.549412 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/727f9d99-1975-4cca-a59a-0f7adc65620d-web-config\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.559393 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.559368 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cscxm\" (UniqueName: \"kubernetes.io/projected/727f9d99-1975-4cca-a59a-0f7adc65620d-kube-api-access-cscxm\") pod \"alertmanager-main-0\" (UID: \"727f9d99-1975-4cca-a59a-0f7adc65620d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.683201 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.683120 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:56:00.885198 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:00.885166 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 22:56:00.888274 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:56:00.888249 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod727f9d99_1975_4cca_a59a_0f7adc65620d.slice/crio-8d13c60eb366970994c10236d6cb17f3b0b7fb2dfd56e20748476c462b53a3fa WatchSource:0}: Error finding container 8d13c60eb366970994c10236d6cb17f3b0b7fb2dfd56e20748476c462b53a3fa: Status 404 returned error can't find the container with id 8d13c60eb366970994c10236d6cb17f3b0b7fb2dfd56e20748476c462b53a3fa Jun 03 22:56:01.280539 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:01.280421 2576 generic.go:356] "Generic (PLEG): container finished" podID="727f9d99-1975-4cca-a59a-0f7adc65620d" containerID="3bd473080d2c5982b925a0b3e082931ac5a9ead7d7eb89a21f81c92f650dffe8" exitCode=0 Jun 03 22:56:01.280539 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:01.280461 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"727f9d99-1975-4cca-a59a-0f7adc65620d","Type":"ContainerDied","Data":"3bd473080d2c5982b925a0b3e082931ac5a9ead7d7eb89a21f81c92f650dffe8"} Jun 03 22:56:01.281059 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:01.280546 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"727f9d99-1975-4cca-a59a-0f7adc65620d","Type":"ContainerStarted","Data":"8d13c60eb366970994c10236d6cb17f3b0b7fb2dfd56e20748476c462b53a3fa"} Jun 03 22:56:02.116476 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.116441 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87ecf3ef-9ac0-4914-a2e6-846654af7228" path="/var/lib/kubelet/pods/87ecf3ef-9ac0-4914-a2e6-846654af7228/volumes" Jun 03 22:56:02.288317 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.288285 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"727f9d99-1975-4cca-a59a-0f7adc65620d","Type":"ContainerStarted","Data":"00fcc51e0a32272fe06b45f45bb30f335ca1d949082adf47fe23a3e4126791ef"} Jun 03 22:56:02.288799 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.288364 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"727f9d99-1975-4cca-a59a-0f7adc65620d","Type":"ContainerStarted","Data":"63ed44f6b486ef3c179e482a564b3eb532032e25966345935b0db02eb09f5b91"} Jun 03 22:56:02.288799 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.288403 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"727f9d99-1975-4cca-a59a-0f7adc65620d","Type":"ContainerStarted","Data":"2af8bdc1e8c8ef4434e462b2421815b6f46b7cd13d4aa4688d1fa5df1d6b781c"} Jun 03 22:56:02.288799 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.288432 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"727f9d99-1975-4cca-a59a-0f7adc65620d","Type":"ContainerStarted","Data":"7115486e70c3d6deaa4ba50dae8e3548d5c7cc88bfff703485112bae1ea9f1d1"} Jun 03 22:56:02.288799 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.288462 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"727f9d99-1975-4cca-a59a-0f7adc65620d","Type":"ContainerStarted","Data":"92799a9adb889db4a2bd46555269efcee2d787c41df20716cc53e0d0988b3a7f"} Jun 03 22:56:02.288799 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.288488 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"727f9d99-1975-4cca-a59a-0f7adc65620d","Type":"ContainerStarted","Data":"ba62b345067e5ed1f3f330bcf840d0a01827ec9fe88bfb4bd286bde903f6d67f"} Jun 03 22:56:02.343695 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.343639 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.3264396290000002 podStartE2EDuration="2.343621864s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.182235ms" isStatefulPod=false podCreationTimestamp="2026-06-03 22:56:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:56:02.343474245 +0000 UTC m=+340.682126734" watchObservedRunningTime="2026-06-03 22:56:02.343621864 +0000 UTC m=+340.682274346" Jun 03 22:56:02.431594 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.431497 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-86857f8789-76r22"] Jun 03 22:56:02.435120 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.435102 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:02.437060 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.437038 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 03 22:56:02.437668 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.437650 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 03 22:56:02.437769 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.437691 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 03 22:56:02.437769 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.437729 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 03 22:56:02.438142 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.438125 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 03 22:56:02.438259 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.438220 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-sk9q8\"" Jun 03 22:56:02.451304 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.451264 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 03 22:56:02.462624 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.462598 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/12c16640-5436-4c40-9030-a0cf50908c94-telemeter-client-tls\") pod \"telemeter-client-86857f8789-76r22\" (UID: \"12c16640-5436-4c40-9030-a0cf50908c94\") " pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:02.462776 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.462637 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12c16640-5436-4c40-9030-a0cf50908c94-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86857f8789-76r22\" (UID: \"12c16640-5436-4c40-9030-a0cf50908c94\") " pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:02.462776 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.462665 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znmnc\" (UniqueName: \"kubernetes.io/projected/12c16640-5436-4c40-9030-a0cf50908c94-kube-api-access-znmnc\") pod \"telemeter-client-86857f8789-76r22\" (UID: \"12c16640-5436-4c40-9030-a0cf50908c94\") " pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:02.462776 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.462700 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/12c16640-5436-4c40-9030-a0cf50908c94-federate-client-tls\") pod \"telemeter-client-86857f8789-76r22\" (UID: \"12c16640-5436-4c40-9030-a0cf50908c94\") " pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:02.462776 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.462739 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12c16640-5436-4c40-9030-a0cf50908c94-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86857f8789-76r22\" (UID: \"12c16640-5436-4c40-9030-a0cf50908c94\") " pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:02.462776 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.462754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12c16640-5436-4c40-9030-a0cf50908c94-metrics-client-ca\") pod \"telemeter-client-86857f8789-76r22\" (UID: \"12c16640-5436-4c40-9030-a0cf50908c94\") " pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:02.462776 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.462775 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12c16640-5436-4c40-9030-a0cf50908c94-serving-certs-ca-bundle\") pod \"telemeter-client-86857f8789-76r22\" (UID: \"12c16640-5436-4c40-9030-a0cf50908c94\") " pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:02.463030 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.462791 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/12c16640-5436-4c40-9030-a0cf50908c94-secret-telemeter-client\") pod \"telemeter-client-86857f8789-76r22\" (UID: \"12c16640-5436-4c40-9030-a0cf50908c94\") " pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:02.491090 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.491052 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86857f8789-76r22"] Jun 03 22:56:02.563653 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.563602 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znmnc\" (UniqueName: \"kubernetes.io/projected/12c16640-5436-4c40-9030-a0cf50908c94-kube-api-access-znmnc\") pod \"telemeter-client-86857f8789-76r22\" (UID: \"12c16640-5436-4c40-9030-a0cf50908c94\") " pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:02.563653 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.563661 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/12c16640-5436-4c40-9030-a0cf50908c94-federate-client-tls\") pod \"telemeter-client-86857f8789-76r22\" (UID: \"12c16640-5436-4c40-9030-a0cf50908c94\") " pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:02.563914 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.563706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12c16640-5436-4c40-9030-a0cf50908c94-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86857f8789-76r22\" (UID: \"12c16640-5436-4c40-9030-a0cf50908c94\") " pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:02.563914 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.563733 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12c16640-5436-4c40-9030-a0cf50908c94-metrics-client-ca\") pod \"telemeter-client-86857f8789-76r22\" (UID: \"12c16640-5436-4c40-9030-a0cf50908c94\") " pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:02.563914 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.563809 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12c16640-5436-4c40-9030-a0cf50908c94-serving-certs-ca-bundle\") pod \"telemeter-client-86857f8789-76r22\" (UID: \"12c16640-5436-4c40-9030-a0cf50908c94\") " pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:02.563914 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.563847 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/12c16640-5436-4c40-9030-a0cf50908c94-secret-telemeter-client\") pod \"telemeter-client-86857f8789-76r22\" (UID: \"12c16640-5436-4c40-9030-a0cf50908c94\") " pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:02.563914 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.563910 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/12c16640-5436-4c40-9030-a0cf50908c94-telemeter-client-tls\") pod \"telemeter-client-86857f8789-76r22\" (UID: \"12c16640-5436-4c40-9030-a0cf50908c94\") " pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:02.564177 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.563953 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12c16640-5436-4c40-9030-a0cf50908c94-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86857f8789-76r22\" (UID: \"12c16640-5436-4c40-9030-a0cf50908c94\") " pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:02.564555 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.564530 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12c16640-5436-4c40-9030-a0cf50908c94-metrics-client-ca\") pod \"telemeter-client-86857f8789-76r22\" (UID: \"12c16640-5436-4c40-9030-a0cf50908c94\") " pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:02.564750 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.564726 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12c16640-5436-4c40-9030-a0cf50908c94-serving-certs-ca-bundle\") pod \"telemeter-client-86857f8789-76r22\" (UID: \"12c16640-5436-4c40-9030-a0cf50908c94\") " pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:02.565468 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.565446 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12c16640-5436-4c40-9030-a0cf50908c94-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86857f8789-76r22\" (UID: \"12c16640-5436-4c40-9030-a0cf50908c94\") " pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:02.566864 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.566757 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/12c16640-5436-4c40-9030-a0cf50908c94-secret-telemeter-client\") pod \"telemeter-client-86857f8789-76r22\" (UID: \"12c16640-5436-4c40-9030-a0cf50908c94\") " pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:02.567115 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.567087 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/12c16640-5436-4c40-9030-a0cf50908c94-federate-client-tls\") pod \"telemeter-client-86857f8789-76r22\" (UID: \"12c16640-5436-4c40-9030-a0cf50908c94\") " pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:02.567216 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.567099 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/12c16640-5436-4c40-9030-a0cf50908c94-telemeter-client-tls\") pod \"telemeter-client-86857f8789-76r22\" (UID: \"12c16640-5436-4c40-9030-a0cf50908c94\") " pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:02.567216 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.567102 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12c16640-5436-4c40-9030-a0cf50908c94-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86857f8789-76r22\" (UID: \"12c16640-5436-4c40-9030-a0cf50908c94\") " pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:02.573332 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.573308 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znmnc\" (UniqueName: \"kubernetes.io/projected/12c16640-5436-4c40-9030-a0cf50908c94-kube-api-access-znmnc\") pod \"telemeter-client-86857f8789-76r22\" (UID: \"12c16640-5436-4c40-9030-a0cf50908c94\") " pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:02.745633 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:02.745539 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86857f8789-76r22" Jun 03 22:56:03.006491 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:56:03.006452 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12c16640_5436_4c40_9030_a0cf50908c94.slice/crio-50386ab34fb572e0845f8596a244597f26badc0a1994e237cab205f72104e0a1 WatchSource:0}: Error finding container 50386ab34fb572e0845f8596a244597f26badc0a1994e237cab205f72104e0a1: Status 404 returned error can't find the container with id 50386ab34fb572e0845f8596a244597f26badc0a1994e237cab205f72104e0a1 Jun 03 22:56:03.008366 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:03.008348 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 22:56:03.023711 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:03.023682 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86857f8789-76r22"] Jun 03 22:56:03.294756 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:03.294660 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86857f8789-76r22" event={"ID":"12c16640-5436-4c40-9030-a0cf50908c94","Type":"ContainerStarted","Data":"50386ab34fb572e0845f8596a244597f26badc0a1994e237cab205f72104e0a1"} Jun 03 22:56:05.305659 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:05.305627 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86857f8789-76r22" event={"ID":"12c16640-5436-4c40-9030-a0cf50908c94","Type":"ContainerStarted","Data":"2c103091266d4c20b54998030d56acf13007445d88b3b11529b4da8b8101b0ff"} Jun 03 22:56:05.306031 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:05.305684 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86857f8789-76r22" event={"ID":"12c16640-5436-4c40-9030-a0cf50908c94","Type":"ContainerStarted","Data":"6e7d498373d16778e021f5261d03f5198423667545477a3333a385bffca10b79"} Jun 03 22:56:05.306031 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:05.305703 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86857f8789-76r22" event={"ID":"12c16640-5436-4c40-9030-a0cf50908c94","Type":"ContainerStarted","Data":"c49260997339ad9b947a1ce3f9e1100cc1a30e2cd1196ae0aa3fd743f2ea7e11"} Jun 03 22:56:05.345468 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:05.345409 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-86857f8789-76r22" podStartSLOduration=1.250912748 podStartE2EDuration="3.345390742s" totalImagesPullingTime="2.094477994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:56:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:56:05.342118358 +0000 UTC m=+343.680770845" watchObservedRunningTime="2026-06-03 22:56:05.345390742 +0000 UTC m=+343.684043230" Jun 03 22:56:06.108709 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.108679 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54d96d66b6-nflrz"] Jun 03 22:56:06.112198 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.112175 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:06.131129 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.131100 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54d96d66b6-nflrz"] Jun 03 22:56:06.198729 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.198694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsmz7\" (UniqueName: \"kubernetes.io/projected/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-kube-api-access-hsmz7\") pod \"console-54d96d66b6-nflrz\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:06.198729 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.198736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-trusted-ca-bundle\") pod \"console-54d96d66b6-nflrz\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:06.198938 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.198756 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-console-oauth-config\") pod \"console-54d96d66b6-nflrz\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:06.198938 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.198825 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-service-ca\") pod \"console-54d96d66b6-nflrz\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:06.198938 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.198868 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-console-serving-cert\") pod \"console-54d96d66b6-nflrz\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:06.198938 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.198902 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-oauth-serving-cert\") pod \"console-54d96d66b6-nflrz\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:06.198938 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.198925 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-console-config\") pod \"console-54d96d66b6-nflrz\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:06.300228 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.300193 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-oauth-serving-cert\") pod \"console-54d96d66b6-nflrz\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:06.300376 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.300239 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-console-config\") pod \"console-54d96d66b6-nflrz\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:06.300376 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.300279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsmz7\" (UniqueName: \"kubernetes.io/projected/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-kube-api-access-hsmz7\") pod \"console-54d96d66b6-nflrz\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:06.300376 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.300303 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-trusted-ca-bundle\") pod \"console-54d96d66b6-nflrz\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:06.300376 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.300322 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-console-oauth-config\") pod \"console-54d96d66b6-nflrz\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:06.300376 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.300349 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-service-ca\") pod \"console-54d96d66b6-nflrz\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:06.300677 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.300381 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-console-serving-cert\") pod \"console-54d96d66b6-nflrz\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:06.301077 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.301050 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-oauth-serving-cert\") pod \"console-54d96d66b6-nflrz\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:06.301191 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.301050 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-console-config\") pod \"console-54d96d66b6-nflrz\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:06.301191 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.301182 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-trusted-ca-bundle\") pod \"console-54d96d66b6-nflrz\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:06.301310 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.301208 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-service-ca\") pod \"console-54d96d66b6-nflrz\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:06.302649 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.302628 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-console-oauth-config\") pod \"console-54d96d66b6-nflrz\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:06.303069 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.303046 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-console-serving-cert\") pod \"console-54d96d66b6-nflrz\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:06.312615 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.312594 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsmz7\" (UniqueName: \"kubernetes.io/projected/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-kube-api-access-hsmz7\") pod \"console-54d96d66b6-nflrz\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:06.421820 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.421729 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:06.595787 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:06.595755 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54d96d66b6-nflrz"] Jun 03 22:56:06.597062 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:56:06.597038 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a124e81_3582_4ca6_ac94_1e23fbd6ce35.slice/crio-5a6726a873a6033c17979946fc404ea22afa540555a0b131fc62d6c93dba490e WatchSource:0}: Error finding container 5a6726a873a6033c17979946fc404ea22afa540555a0b131fc62d6c93dba490e: Status 404 returned error can't find the container with id 5a6726a873a6033c17979946fc404ea22afa540555a0b131fc62d6c93dba490e Jun 03 22:56:07.315817 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:07.315785 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54d96d66b6-nflrz" event={"ID":"9a124e81-3582-4ca6-ac94-1e23fbd6ce35","Type":"ContainerStarted","Data":"deb605bd8ba5b8950ea21af891910f1f5d18c6aea6b3f4a43142ba71b3a37025"} Jun 03 22:56:07.316205 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:07.315838 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54d96d66b6-nflrz" event={"ID":"9a124e81-3582-4ca6-ac94-1e23fbd6ce35","Type":"ContainerStarted","Data":"5a6726a873a6033c17979946fc404ea22afa540555a0b131fc62d6c93dba490e"} Jun 03 22:56:07.357670 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:07.357617 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54d96d66b6-nflrz" podStartSLOduration=1.357601458 podStartE2EDuration="1.357601458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:56:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:56:07.357023487 +0000 UTC m=+345.695675974" watchObservedRunningTime="2026-06-03 22:56:07.357601458 +0000 UTC m=+345.696253945" Jun 03 22:56:16.422161 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:16.422117 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:16.422576 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:16.422186 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:16.427046 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:16.427022 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:17.359996 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:17.359967 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:56:17.446090 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:17.446050 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86c58b9cfb-vj6nj"] Jun 03 22:56:42.471188 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:42.471127 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-86c58b9cfb-vj6nj" podUID="e61850be-42f7-4879-a692-6a5ade8c5a05" containerName="console" containerID="cri-o://fb98a2f9123339c050850efdeac2ea0f6fcc9594996d707159e6b572e9193ad9" gracePeriod=15 Jun 03 22:56:42.724878 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:42.724807 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:56:42.732043 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:42.732022 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e61850be-42f7-4879-a692-6a5ade8c5a05-console-serving-cert\") pod \"e61850be-42f7-4879-a692-6a5ade8c5a05\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " Jun 03 22:56:42.732164 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:42.732104 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e61850be-42f7-4879-a692-6a5ade8c5a05-oauth-serving-cert\") pod \"e61850be-42f7-4879-a692-6a5ade8c5a05\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " Jun 03 22:56:42.732164 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:42.732124 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e61850be-42f7-4879-a692-6a5ade8c5a05-service-ca\") pod \"e61850be-42f7-4879-a692-6a5ade8c5a05\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " Jun 03 22:56:42.732164 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:42.732143 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48cj8\" (UniqueName: \"kubernetes.io/projected/e61850be-42f7-4879-a692-6a5ade8c5a05-kube-api-access-48cj8\") pod \"e61850be-42f7-4879-a692-6a5ade8c5a05\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " Jun 03 22:56:42.732319 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:42.732165 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e61850be-42f7-4879-a692-6a5ade8c5a05-trusted-ca-bundle\") pod \"e61850be-42f7-4879-a692-6a5ade8c5a05\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " Jun 03 22:56:42.732319 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:42.732187 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e61850be-42f7-4879-a692-6a5ade8c5a05-console-oauth-config\") pod \"e61850be-42f7-4879-a692-6a5ade8c5a05\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " Jun 03 22:56:42.732319 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:42.732209 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e61850be-42f7-4879-a692-6a5ade8c5a05-console-config\") pod \"e61850be-42f7-4879-a692-6a5ade8c5a05\" (UID: \"e61850be-42f7-4879-a692-6a5ade8c5a05\") " Jun 03 22:56:42.732680 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:42.732652 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e61850be-42f7-4879-a692-6a5ade8c5a05-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e61850be-42f7-4879-a692-6a5ade8c5a05" (UID: "e61850be-42f7-4879-a692-6a5ade8c5a05"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:56:42.732680 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:42.732660 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e61850be-42f7-4879-a692-6a5ade8c5a05-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e61850be-42f7-4879-a692-6a5ade8c5a05" (UID: "e61850be-42f7-4879-a692-6a5ade8c5a05"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:56:42.732896 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:42.732652 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e61850be-42f7-4879-a692-6a5ade8c5a05-service-ca" (OuterVolumeSpecName: "service-ca") pod "e61850be-42f7-4879-a692-6a5ade8c5a05" (UID: "e61850be-42f7-4879-a692-6a5ade8c5a05"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:56:42.732896 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:42.732731 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e61850be-42f7-4879-a692-6a5ade8c5a05-console-config" (OuterVolumeSpecName: "console-config") pod "e61850be-42f7-4879-a692-6a5ade8c5a05" (UID: "e61850be-42f7-4879-a692-6a5ade8c5a05"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:56:42.734092 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:42.734071 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e61850be-42f7-4879-a692-6a5ade8c5a05-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e61850be-42f7-4879-a692-6a5ade8c5a05" (UID: "e61850be-42f7-4879-a692-6a5ade8c5a05"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:56:42.734269 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:42.734250 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e61850be-42f7-4879-a692-6a5ade8c5a05-kube-api-access-48cj8" (OuterVolumeSpecName: "kube-api-access-48cj8") pod "e61850be-42f7-4879-a692-6a5ade8c5a05" (UID: "e61850be-42f7-4879-a692-6a5ade8c5a05"). InnerVolumeSpecName "kube-api-access-48cj8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:56:42.734269 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:42.734251 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e61850be-42f7-4879-a692-6a5ade8c5a05-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e61850be-42f7-4879-a692-6a5ade8c5a05" (UID: "e61850be-42f7-4879-a692-6a5ade8c5a05"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:56:42.832772 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:42.832737 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e61850be-42f7-4879-a692-6a5ade8c5a05-oauth-serving-cert\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:56:42.832772 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:42.832764 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e61850be-42f7-4879-a692-6a5ade8c5a05-service-ca\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:56:42.832772 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:42.832774 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48cj8\" (UniqueName: \"kubernetes.io/projected/e61850be-42f7-4879-a692-6a5ade8c5a05-kube-api-access-48cj8\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:56:42.832772 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:42.832784 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e61850be-42f7-4879-a692-6a5ade8c5a05-trusted-ca-bundle\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:56:42.833052 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:42.832792 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e61850be-42f7-4879-a692-6a5ade8c5a05-console-oauth-config\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:56:42.833052 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:42.832801 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e61850be-42f7-4879-a692-6a5ade8c5a05-console-config\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:56:42.833052 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:42.832809 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e61850be-42f7-4879-a692-6a5ade8c5a05-console-serving-cert\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:56:43.462312 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:43.462277 2576 generic.go:356] "Generic (PLEG): container finished" podID="e61850be-42f7-4879-a692-6a5ade8c5a05" containerID="fb98a2f9123339c050850efdeac2ea0f6fcc9594996d707159e6b572e9193ad9" exitCode=0 Jun 03 22:56:43.462535 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:43.462322 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86c58b9cfb-vj6nj" Jun 03 22:56:43.462535 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:43.462352 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86c58b9cfb-vj6nj" event={"ID":"e61850be-42f7-4879-a692-6a5ade8c5a05","Type":"ContainerDied","Data":"fb98a2f9123339c050850efdeac2ea0f6fcc9594996d707159e6b572e9193ad9"} Jun 03 22:56:43.462535 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:43.462392 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86c58b9cfb-vj6nj" event={"ID":"e61850be-42f7-4879-a692-6a5ade8c5a05","Type":"ContainerDied","Data":"2773d7b72c8550a85c717295397d31d8dccc99eae3a6482c695e6fdae4436ae2"} Jun 03 22:56:43.462535 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:43.462412 2576 scope.go:117] "RemoveContainer" containerID="fb98a2f9123339c050850efdeac2ea0f6fcc9594996d707159e6b572e9193ad9" Jun 03 22:56:43.470847 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:43.470828 2576 scope.go:117] "RemoveContainer" containerID="fb98a2f9123339c050850efdeac2ea0f6fcc9594996d707159e6b572e9193ad9" Jun 03 22:56:43.471111 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:56:43.471092 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb98a2f9123339c050850efdeac2ea0f6fcc9594996d707159e6b572e9193ad9\": container with ID starting with fb98a2f9123339c050850efdeac2ea0f6fcc9594996d707159e6b572e9193ad9 not found: ID does not exist" containerID="fb98a2f9123339c050850efdeac2ea0f6fcc9594996d707159e6b572e9193ad9" Jun 03 22:56:43.471170 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:43.471126 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb98a2f9123339c050850efdeac2ea0f6fcc9594996d707159e6b572e9193ad9"} err="failed to get container status \"fb98a2f9123339c050850efdeac2ea0f6fcc9594996d707159e6b572e9193ad9\": rpc error: code = NotFound desc = could not find container \"fb98a2f9123339c050850efdeac2ea0f6fcc9594996d707159e6b572e9193ad9\": container with ID starting with fb98a2f9123339c050850efdeac2ea0f6fcc9594996d707159e6b572e9193ad9 not found: ID does not exist" Jun 03 22:56:43.484409 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:43.484382 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86c58b9cfb-vj6nj"] Jun 03 22:56:43.488525 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:43.488486 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86c58b9cfb-vj6nj"] Jun 03 22:56:44.115904 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:56:44.115869 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e61850be-42f7-4879-a692-6a5ade8c5a05" path="/var/lib/kubelet/pods/e61850be-42f7-4879-a692-6a5ade8c5a05/volumes" Jun 03 22:57:30.969352 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:30.969269 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d8df56f5-z487m"] Jun 03 22:57:30.969901 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:30.969694 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e61850be-42f7-4879-a692-6a5ade8c5a05" containerName="console" Jun 03 22:57:30.969901 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:30.969708 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e61850be-42f7-4879-a692-6a5ade8c5a05" containerName="console" Jun 03 22:57:30.969901 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:30.969768 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e61850be-42f7-4879-a692-6a5ade8c5a05" containerName="console" Jun 03 22:57:30.972871 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:30.972846 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:30.986639 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:30.986610 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d8df56f5-z487m"] Jun 03 22:57:31.064154 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.064116 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/264c8e8c-3175-4634-8faf-a8cb30c0a97b-console-oauth-config\") pod \"console-5d8df56f5-z487m\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:31.064154 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.064158 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/264c8e8c-3175-4634-8faf-a8cb30c0a97b-console-serving-cert\") pod \"console-5d8df56f5-z487m\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:31.064363 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.064176 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/264c8e8c-3175-4634-8faf-a8cb30c0a97b-console-config\") pod \"console-5d8df56f5-z487m\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:31.064363 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.064284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kxlm\" (UniqueName: \"kubernetes.io/projected/264c8e8c-3175-4634-8faf-a8cb30c0a97b-kube-api-access-2kxlm\") pod \"console-5d8df56f5-z487m\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:31.064363 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.064322 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/264c8e8c-3175-4634-8faf-a8cb30c0a97b-service-ca\") pod \"console-5d8df56f5-z487m\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:31.064363 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.064348 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/264c8e8c-3175-4634-8faf-a8cb30c0a97b-oauth-serving-cert\") pod \"console-5d8df56f5-z487m\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:31.064491 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.064389 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/264c8e8c-3175-4634-8faf-a8cb30c0a97b-trusted-ca-bundle\") pod \"console-5d8df56f5-z487m\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:31.165032 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.164981 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kxlm\" (UniqueName: \"kubernetes.io/projected/264c8e8c-3175-4634-8faf-a8cb30c0a97b-kube-api-access-2kxlm\") pod \"console-5d8df56f5-z487m\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:31.165032 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.165038 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/264c8e8c-3175-4634-8faf-a8cb30c0a97b-service-ca\") pod \"console-5d8df56f5-z487m\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:31.165252 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.165070 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/264c8e8c-3175-4634-8faf-a8cb30c0a97b-oauth-serving-cert\") pod \"console-5d8df56f5-z487m\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:31.165252 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.165115 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/264c8e8c-3175-4634-8faf-a8cb30c0a97b-trusted-ca-bundle\") pod \"console-5d8df56f5-z487m\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:31.165329 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.165282 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/264c8e8c-3175-4634-8faf-a8cb30c0a97b-console-oauth-config\") pod \"console-5d8df56f5-z487m\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:31.165380 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.165352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/264c8e8c-3175-4634-8faf-a8cb30c0a97b-console-serving-cert\") pod \"console-5d8df56f5-z487m\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:31.165429 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.165390 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/264c8e8c-3175-4634-8faf-a8cb30c0a97b-console-config\") pod \"console-5d8df56f5-z487m\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:31.165945 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.165921 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/264c8e8c-3175-4634-8faf-a8cb30c0a97b-oauth-serving-cert\") pod \"console-5d8df56f5-z487m\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:31.166174 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.166152 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/264c8e8c-3175-4634-8faf-a8cb30c0a97b-trusted-ca-bundle\") pod \"console-5d8df56f5-z487m\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:31.166228 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.166157 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/264c8e8c-3175-4634-8faf-a8cb30c0a97b-console-config\") pod \"console-5d8df56f5-z487m\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:31.166271 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.166247 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/264c8e8c-3175-4634-8faf-a8cb30c0a97b-service-ca\") pod \"console-5d8df56f5-z487m\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:31.167936 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.167911 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/264c8e8c-3175-4634-8faf-a8cb30c0a97b-console-oauth-config\") pod \"console-5d8df56f5-z487m\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:31.168019 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.167918 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/264c8e8c-3175-4634-8faf-a8cb30c0a97b-console-serving-cert\") pod \"console-5d8df56f5-z487m\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:31.173192 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.173175 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kxlm\" (UniqueName: \"kubernetes.io/projected/264c8e8c-3175-4634-8faf-a8cb30c0a97b-kube-api-access-2kxlm\") pod \"console-5d8df56f5-z487m\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:31.282540 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.282424 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:31.422018 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.421979 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d8df56f5-z487m"] Jun 03 22:57:31.425143 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:57:31.425107 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod264c8e8c_3175_4634_8faf_a8cb30c0a97b.slice/crio-0fac365ae259d230bd8e1c7473a892b9e91fe1f99c8a4815c24ffa91d7a64bef WatchSource:0}: Error finding container 0fac365ae259d230bd8e1c7473a892b9e91fe1f99c8a4815c24ffa91d7a64bef: Status 404 returned error can't find the container with id 0fac365ae259d230bd8e1c7473a892b9e91fe1f99c8a4815c24ffa91d7a64bef Jun 03 22:57:31.657423 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.657383 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8df56f5-z487m" event={"ID":"264c8e8c-3175-4634-8faf-a8cb30c0a97b","Type":"ContainerStarted","Data":"a419ce13364592487bbbf0442d9d86e8bc67f73e63e61cd1df3b4fa6adb870ba"} Jun 03 22:57:31.657616 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.657445 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8df56f5-z487m" event={"ID":"264c8e8c-3175-4634-8faf-a8cb30c0a97b","Type":"ContainerStarted","Data":"0fac365ae259d230bd8e1c7473a892b9e91fe1f99c8a4815c24ffa91d7a64bef"} Jun 03 22:57:31.678641 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:31.678592 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d8df56f5-z487m" podStartSLOduration=1.6785759919999999 podStartE2EDuration="1.678575992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:57:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:57:31.678201726 +0000 UTC m=+430.016854213" watchObservedRunningTime="2026-06-03 22:57:31.678575992 +0000 UTC m=+430.017228552" Jun 03 22:57:41.283361 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:41.283320 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:41.283811 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:41.283380 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:41.288097 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:41.288066 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:41.700800 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:41.700772 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d8df56f5-z487m" Jun 03 22:57:41.746885 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:41.746851 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54d96d66b6-nflrz"] Jun 03 22:57:56.982824 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:56.982787 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd"] Jun 03 22:57:56.986390 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:56.986373 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd" Jun 03 22:57:56.988556 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:56.988528 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 22:57:56.988675 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:56.988504 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 22:57:56.988675 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:56.988568 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-grzxb\"" Jun 03 22:57:56.997774 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:56.997747 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd"] Jun 03 22:57:57.091717 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:57.091679 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af438b67-7760-4239-99f6-039c0dc1559e-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd\" (UID: \"af438b67-7760-4239-99f6-039c0dc1559e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd" Jun 03 22:57:57.091916 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:57.091759 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpl57\" (UniqueName: \"kubernetes.io/projected/af438b67-7760-4239-99f6-039c0dc1559e-kube-api-access-jpl57\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd\" (UID: \"af438b67-7760-4239-99f6-039c0dc1559e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd" Jun 03 22:57:57.091916 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:57.091782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af438b67-7760-4239-99f6-039c0dc1559e-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd\" (UID: \"af438b67-7760-4239-99f6-039c0dc1559e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd" Jun 03 22:57:57.192771 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:57.192739 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpl57\" (UniqueName: \"kubernetes.io/projected/af438b67-7760-4239-99f6-039c0dc1559e-kube-api-access-jpl57\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd\" (UID: \"af438b67-7760-4239-99f6-039c0dc1559e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd" Jun 03 22:57:57.192771 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:57.192773 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af438b67-7760-4239-99f6-039c0dc1559e-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd\" (UID: \"af438b67-7760-4239-99f6-039c0dc1559e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd" Jun 03 22:57:57.192981 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:57.192826 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af438b67-7760-4239-99f6-039c0dc1559e-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd\" (UID: \"af438b67-7760-4239-99f6-039c0dc1559e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd" Jun 03 22:57:57.193252 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:57.193232 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af438b67-7760-4239-99f6-039c0dc1559e-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd\" (UID: \"af438b67-7760-4239-99f6-039c0dc1559e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd" Jun 03 22:57:57.193288 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:57.193248 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af438b67-7760-4239-99f6-039c0dc1559e-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd\" (UID: \"af438b67-7760-4239-99f6-039c0dc1559e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd" Jun 03 22:57:57.202480 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:57.202447 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpl57\" (UniqueName: \"kubernetes.io/projected/af438b67-7760-4239-99f6-039c0dc1559e-kube-api-access-jpl57\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd\" (UID: \"af438b67-7760-4239-99f6-039c0dc1559e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd" Jun 03 22:57:57.296352 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:57.296324 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd" Jun 03 22:57:57.445902 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:57.445867 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd"] Jun 03 22:57:57.448920 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:57:57.448887 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf438b67_7760_4239_99f6_039c0dc1559e.slice/crio-546f33a80f35e51ca0f248439263949a6054a54a3c3ba73250cd75a5dd078854 WatchSource:0}: Error finding container 546f33a80f35e51ca0f248439263949a6054a54a3c3ba73250cd75a5dd078854: Status 404 returned error can't find the container with id 546f33a80f35e51ca0f248439263949a6054a54a3c3ba73250cd75a5dd078854 Jun 03 22:57:57.766716 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:57:57.766633 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd" event={"ID":"af438b67-7760-4239-99f6-039c0dc1559e","Type":"ContainerStarted","Data":"546f33a80f35e51ca0f248439263949a6054a54a3c3ba73250cd75a5dd078854"} Jun 03 22:58:04.800308 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:04.800270 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd" event={"ID":"af438b67-7760-4239-99f6-039c0dc1559e","Type":"ContainerStarted","Data":"845299b57f7eec237494c4693a5dd7618d7a126b852005c756124ce265e6f90b"} Jun 03 22:58:05.805586 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:05.805547 2576 generic.go:356] "Generic (PLEG): container finished" podID="af438b67-7760-4239-99f6-039c0dc1559e" containerID="845299b57f7eec237494c4693a5dd7618d7a126b852005c756124ce265e6f90b" exitCode=0 Jun 03 22:58:05.806021 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:05.805632 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd" event={"ID":"af438b67-7760-4239-99f6-039c0dc1559e","Type":"ContainerDied","Data":"845299b57f7eec237494c4693a5dd7618d7a126b852005c756124ce265e6f90b"} Jun 03 22:58:06.768825 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:06.768785 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54d96d66b6-nflrz" podUID="9a124e81-3582-4ca6-ac94-1e23fbd6ce35" containerName="console" containerID="cri-o://deb605bd8ba5b8950ea21af891910f1f5d18c6aea6b3f4a43142ba71b3a37025" gracePeriod=15 Jun 03 22:58:07.045927 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.045881 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:58:07.189619 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.189587 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-console-serving-cert\") pod \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " Jun 03 22:58:07.189619 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.189619 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-oauth-serving-cert\") pod \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " Jun 03 22:58:07.189848 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.189638 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsmz7\" (UniqueName: \"kubernetes.io/projected/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-kube-api-access-hsmz7\") pod \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " Jun 03 22:58:07.189848 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.189663 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-console-oauth-config\") pod \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " Jun 03 22:58:07.189848 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.189694 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-trusted-ca-bundle\") pod \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " Jun 03 22:58:07.189997 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.189913 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-console-config\") pod \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " Jun 03 22:58:07.189997 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.189965 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-service-ca\") pod \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\" (UID: \"9a124e81-3582-4ca6-ac94-1e23fbd6ce35\") " Jun 03 22:58:07.190107 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.190089 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9a124e81-3582-4ca6-ac94-1e23fbd6ce35" (UID: "9a124e81-3582-4ca6-ac94-1e23fbd6ce35"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:58:07.190169 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.190133 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9a124e81-3582-4ca6-ac94-1e23fbd6ce35" (UID: "9a124e81-3582-4ca6-ac94-1e23fbd6ce35"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:58:07.190374 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.190326 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-console-config" (OuterVolumeSpecName: "console-config") pod "9a124e81-3582-4ca6-ac94-1e23fbd6ce35" (UID: "9a124e81-3582-4ca6-ac94-1e23fbd6ce35"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:58:07.190456 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.190415 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-console-config\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:58:07.190456 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.190432 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-oauth-serving-cert\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:58:07.190456 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.190445 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-trusted-ca-bundle\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:58:07.190656 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.190588 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-service-ca" (OuterVolumeSpecName: "service-ca") pod "9a124e81-3582-4ca6-ac94-1e23fbd6ce35" (UID: "9a124e81-3582-4ca6-ac94-1e23fbd6ce35"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:58:07.192144 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.192119 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-kube-api-access-hsmz7" (OuterVolumeSpecName: "kube-api-access-hsmz7") pod "9a124e81-3582-4ca6-ac94-1e23fbd6ce35" (UID: "9a124e81-3582-4ca6-ac94-1e23fbd6ce35"). InnerVolumeSpecName "kube-api-access-hsmz7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:58:07.192288 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.192264 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9a124e81-3582-4ca6-ac94-1e23fbd6ce35" (UID: "9a124e81-3582-4ca6-ac94-1e23fbd6ce35"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:58:07.192409 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.192383 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9a124e81-3582-4ca6-ac94-1e23fbd6ce35" (UID: "9a124e81-3582-4ca6-ac94-1e23fbd6ce35"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:58:07.291957 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.291873 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-console-serving-cert\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:58:07.291957 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.291910 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsmz7\" (UniqueName: \"kubernetes.io/projected/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-kube-api-access-hsmz7\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:58:07.291957 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.291928 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-console-oauth-config\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:58:07.291957 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.291941 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a124e81-3582-4ca6-ac94-1e23fbd6ce35-service-ca\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:58:07.815935 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.815901 2576 generic.go:356] "Generic (PLEG): container finished" podID="9a124e81-3582-4ca6-ac94-1e23fbd6ce35" containerID="deb605bd8ba5b8950ea21af891910f1f5d18c6aea6b3f4a43142ba71b3a37025" exitCode=0 Jun 03 22:58:07.816108 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.815961 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54d96d66b6-nflrz" event={"ID":"9a124e81-3582-4ca6-ac94-1e23fbd6ce35","Type":"ContainerDied","Data":"deb605bd8ba5b8950ea21af891910f1f5d18c6aea6b3f4a43142ba71b3a37025"} Jun 03 22:58:07.816108 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.816016 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54d96d66b6-nflrz" event={"ID":"9a124e81-3582-4ca6-ac94-1e23fbd6ce35","Type":"ContainerDied","Data":"5a6726a873a6033c17979946fc404ea22afa540555a0b131fc62d6c93dba490e"} Jun 03 22:58:07.816108 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.816045 2576 scope.go:117] "RemoveContainer" containerID="deb605bd8ba5b8950ea21af891910f1f5d18c6aea6b3f4a43142ba71b3a37025" Jun 03 22:58:07.816108 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.815964 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54d96d66b6-nflrz" Jun 03 22:58:07.839994 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.839968 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54d96d66b6-nflrz"] Jun 03 22:58:07.846708 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:07.846683 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54d96d66b6-nflrz"] Jun 03 22:58:08.116762 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:08.116690 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a124e81-3582-4ca6-ac94-1e23fbd6ce35" path="/var/lib/kubelet/pods/9a124e81-3582-4ca6-ac94-1e23fbd6ce35/volumes" Jun 03 22:58:08.416019 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:08.415828 2576 scope.go:117] "RemoveContainer" containerID="deb605bd8ba5b8950ea21af891910f1f5d18c6aea6b3f4a43142ba71b3a37025" Jun 03 22:58:08.416152 ip-10-0-140-99 kubenswrapper[2576]: E0603 22:58:08.416133 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"deb605bd8ba5b8950ea21af891910f1f5d18c6aea6b3f4a43142ba71b3a37025\": container with ID starting with deb605bd8ba5b8950ea21af891910f1f5d18c6aea6b3f4a43142ba71b3a37025 not found: ID does not exist" containerID="deb605bd8ba5b8950ea21af891910f1f5d18c6aea6b3f4a43142ba71b3a37025" Jun 03 22:58:08.416200 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:08.416166 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"deb605bd8ba5b8950ea21af891910f1f5d18c6aea6b3f4a43142ba71b3a37025"} err="failed to get container status \"deb605bd8ba5b8950ea21af891910f1f5d18c6aea6b3f4a43142ba71b3a37025\": rpc error: code = NotFound desc = could not find container \"deb605bd8ba5b8950ea21af891910f1f5d18c6aea6b3f4a43142ba71b3a37025\": container with ID starting with deb605bd8ba5b8950ea21af891910f1f5d18c6aea6b3f4a43142ba71b3a37025 not found: ID does not exist" Jun 03 22:58:08.822083 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:08.822048 2576 generic.go:356] "Generic (PLEG): container finished" podID="af438b67-7760-4239-99f6-039c0dc1559e" containerID="db889e6d4408e879db633aec298435dc0fa0a66345a5827b4c449a2a86911d0f" exitCode=0 Jun 03 22:58:08.822277 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:08.822130 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd" event={"ID":"af438b67-7760-4239-99f6-039c0dc1559e","Type":"ContainerDied","Data":"db889e6d4408e879db633aec298435dc0fa0a66345a5827b4c449a2a86911d0f"} Jun 03 22:58:15.859161 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:15.859126 2576 generic.go:356] "Generic (PLEG): container finished" podID="af438b67-7760-4239-99f6-039c0dc1559e" containerID="e3b2b1806d1da2b9a348dd433f7f6821eedc7b358128b274c04fca25e174b8bc" exitCode=0 Jun 03 22:58:15.859552 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:15.859212 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd" event={"ID":"af438b67-7760-4239-99f6-039c0dc1559e","Type":"ContainerDied","Data":"e3b2b1806d1da2b9a348dd433f7f6821eedc7b358128b274c04fca25e174b8bc"} Jun 03 22:58:16.989012 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:16.988983 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd" Jun 03 22:58:17.076069 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:17.076024 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af438b67-7760-4239-99f6-039c0dc1559e-util\") pod \"af438b67-7760-4239-99f6-039c0dc1559e\" (UID: \"af438b67-7760-4239-99f6-039c0dc1559e\") " Jun 03 22:58:17.076069 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:17.076074 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af438b67-7760-4239-99f6-039c0dc1559e-bundle\") pod \"af438b67-7760-4239-99f6-039c0dc1559e\" (UID: \"af438b67-7760-4239-99f6-039c0dc1559e\") " Jun 03 22:58:17.076325 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:17.076130 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpl57\" (UniqueName: \"kubernetes.io/projected/af438b67-7760-4239-99f6-039c0dc1559e-kube-api-access-jpl57\") pod \"af438b67-7760-4239-99f6-039c0dc1559e\" (UID: \"af438b67-7760-4239-99f6-039c0dc1559e\") " Jun 03 22:58:17.076854 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:17.076820 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af438b67-7760-4239-99f6-039c0dc1559e-bundle" (OuterVolumeSpecName: "bundle") pod "af438b67-7760-4239-99f6-039c0dc1559e" (UID: "af438b67-7760-4239-99f6-039c0dc1559e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:58:17.078353 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:17.078330 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af438b67-7760-4239-99f6-039c0dc1559e-kube-api-access-jpl57" (OuterVolumeSpecName: "kube-api-access-jpl57") pod "af438b67-7760-4239-99f6-039c0dc1559e" (UID: "af438b67-7760-4239-99f6-039c0dc1559e"). InnerVolumeSpecName "kube-api-access-jpl57". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:58:17.081183 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:17.081158 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af438b67-7760-4239-99f6-039c0dc1559e-util" (OuterVolumeSpecName: "util") pod "af438b67-7760-4239-99f6-039c0dc1559e" (UID: "af438b67-7760-4239-99f6-039c0dc1559e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:58:17.176825 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:17.176729 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpl57\" (UniqueName: \"kubernetes.io/projected/af438b67-7760-4239-99f6-039c0dc1559e-kube-api-access-jpl57\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:58:17.176825 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:17.176763 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af438b67-7760-4239-99f6-039c0dc1559e-util\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:58:17.176825 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:17.176773 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af438b67-7760-4239-99f6-039c0dc1559e-bundle\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:58:17.869225 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:17.869198 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd" Jun 03 22:58:17.869392 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:17.869220 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddkrvd" event={"ID":"af438b67-7760-4239-99f6-039c0dc1559e","Type":"ContainerDied","Data":"546f33a80f35e51ca0f248439263949a6054a54a3c3ba73250cd75a5dd078854"} Jun 03 22:58:17.869392 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:17.869270 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="546f33a80f35e51ca0f248439263949a6054a54a3c3ba73250cd75a5dd078854" Jun 03 22:58:24.985302 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:24.985267 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k9chl"] Jun 03 22:58:24.985774 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:24.985584 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a124e81-3582-4ca6-ac94-1e23fbd6ce35" containerName="console" Jun 03 22:58:24.985774 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:24.985595 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a124e81-3582-4ca6-ac94-1e23fbd6ce35" containerName="console" Jun 03 22:58:24.985774 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:24.985611 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af438b67-7760-4239-99f6-039c0dc1559e" containerName="pull" Jun 03 22:58:24.985774 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:24.985616 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="af438b67-7760-4239-99f6-039c0dc1559e" containerName="pull" Jun 03 22:58:24.985774 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:24.985629 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af438b67-7760-4239-99f6-039c0dc1559e" containerName="util" Jun 03 22:58:24.985774 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:24.985635 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="af438b67-7760-4239-99f6-039c0dc1559e" containerName="util" Jun 03 22:58:24.985774 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:24.985641 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af438b67-7760-4239-99f6-039c0dc1559e" containerName="extract" Jun 03 22:58:24.985774 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:24.985646 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="af438b67-7760-4239-99f6-039c0dc1559e" containerName="extract" Jun 03 22:58:24.985774 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:24.985692 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a124e81-3582-4ca6-ac94-1e23fbd6ce35" containerName="console" Jun 03 22:58:24.985774 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:24.985700 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="af438b67-7760-4239-99f6-039c0dc1559e" containerName="extract" Jun 03 22:58:24.989562 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:24.989544 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k9chl" Jun 03 22:58:24.991541 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:24.991492 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-v4drx\"" Jun 03 22:58:24.991674 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:24.991576 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 03 22:58:24.991674 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:24.991605 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 03 22:58:25.001024 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:25.001000 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k9chl"] Jun 03 22:58:25.045729 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:25.045688 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsmvn\" (UniqueName: \"kubernetes.io/projected/ab6c545d-12ce-469e-b3ae-0b76822eebdb-kube-api-access-dsmvn\") pod \"cert-manager-operator-controller-manager-57757f7cfc-k9chl\" (UID: \"ab6c545d-12ce-469e-b3ae-0b76822eebdb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k9chl" Jun 03 22:58:25.045897 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:25.045785 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab6c545d-12ce-469e-b3ae-0b76822eebdb-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-k9chl\" (UID: \"ab6c545d-12ce-469e-b3ae-0b76822eebdb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k9chl" Jun 03 22:58:25.146499 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:25.146469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsmvn\" (UniqueName: \"kubernetes.io/projected/ab6c545d-12ce-469e-b3ae-0b76822eebdb-kube-api-access-dsmvn\") pod \"cert-manager-operator-controller-manager-57757f7cfc-k9chl\" (UID: \"ab6c545d-12ce-469e-b3ae-0b76822eebdb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k9chl" Jun 03 22:58:25.146638 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:25.146589 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab6c545d-12ce-469e-b3ae-0b76822eebdb-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-k9chl\" (UID: \"ab6c545d-12ce-469e-b3ae-0b76822eebdb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k9chl" Jun 03 22:58:25.147021 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:25.147003 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab6c545d-12ce-469e-b3ae-0b76822eebdb-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-k9chl\" (UID: \"ab6c545d-12ce-469e-b3ae-0b76822eebdb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k9chl" Jun 03 22:58:25.154181 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:25.154159 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsmvn\" (UniqueName: \"kubernetes.io/projected/ab6c545d-12ce-469e-b3ae-0b76822eebdb-kube-api-access-dsmvn\") pod \"cert-manager-operator-controller-manager-57757f7cfc-k9chl\" (UID: \"ab6c545d-12ce-469e-b3ae-0b76822eebdb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k9chl" Jun 03 22:58:25.298440 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:25.298412 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k9chl" Jun 03 22:58:25.433385 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:25.433353 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k9chl"] Jun 03 22:58:25.437249 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:58:25.437221 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab6c545d_12ce_469e_b3ae_0b76822eebdb.slice/crio-defe542a7fc24d5eda6fe1b242447c3acd5cdb4b8ddf55eff4b99c0c8b2427af WatchSource:0}: Error finding container defe542a7fc24d5eda6fe1b242447c3acd5cdb4b8ddf55eff4b99c0c8b2427af: Status 404 returned error can't find the container with id defe542a7fc24d5eda6fe1b242447c3acd5cdb4b8ddf55eff4b99c0c8b2427af Jun 03 22:58:25.902949 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:25.902916 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k9chl" event={"ID":"ab6c545d-12ce-469e-b3ae-0b76822eebdb","Type":"ContainerStarted","Data":"defe542a7fc24d5eda6fe1b242447c3acd5cdb4b8ddf55eff4b99c0c8b2427af"} Jun 03 22:58:28.918604 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:28.918563 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k9chl" event={"ID":"ab6c545d-12ce-469e-b3ae-0b76822eebdb","Type":"ContainerStarted","Data":"bfccb9288838c9b0cfd06a34f4cc8596cc30781a6c992dc7423b00d3bd0ea1d1"} Jun 03 22:58:28.942221 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:28.942166 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-k9chl" podStartSLOduration=2.293820456 podStartE2EDuration="4.94214902s" totalImagesPullingTime="2.648328564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:58:28.940248705 +0000 UTC m=+487.278901193" watchObservedRunningTime="2026-06-03 22:58:28.94214902 +0000 UTC m=+487.280801507" Jun 03 22:58:29.460197 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:29.460160 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg"] Jun 03 22:58:29.462498 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:29.462481 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg" Jun 03 22:58:29.464934 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:29.464903 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-grzxb\"" Jun 03 22:58:29.465504 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:29.465489 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 22:58:29.465656 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:29.465633 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 22:58:29.478821 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:29.478784 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg"] Jun 03 22:58:29.582125 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:29.582093 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/790643f4-b867-4422-838a-5e0f3c5ce07d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg\" (UID: \"790643f4-b867-4422-838a-5e0f3c5ce07d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg" Jun 03 22:58:29.582308 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:29.582190 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/790643f4-b867-4422-838a-5e0f3c5ce07d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg\" (UID: \"790643f4-b867-4422-838a-5e0f3c5ce07d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg" Jun 03 22:58:29.582308 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:29.582219 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6fmh\" (UniqueName: \"kubernetes.io/projected/790643f4-b867-4422-838a-5e0f3c5ce07d-kube-api-access-c6fmh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg\" (UID: \"790643f4-b867-4422-838a-5e0f3c5ce07d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg" Jun 03 22:58:29.683408 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:29.683369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/790643f4-b867-4422-838a-5e0f3c5ce07d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg\" (UID: \"790643f4-b867-4422-838a-5e0f3c5ce07d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg" Jun 03 22:58:29.683612 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:29.683424 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6fmh\" (UniqueName: \"kubernetes.io/projected/790643f4-b867-4422-838a-5e0f3c5ce07d-kube-api-access-c6fmh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg\" (UID: \"790643f4-b867-4422-838a-5e0f3c5ce07d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg" Jun 03 22:58:29.683612 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:29.683454 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/790643f4-b867-4422-838a-5e0f3c5ce07d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg\" (UID: \"790643f4-b867-4422-838a-5e0f3c5ce07d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg" Jun 03 22:58:29.683812 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:29.683791 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/790643f4-b867-4422-838a-5e0f3c5ce07d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg\" (UID: \"790643f4-b867-4422-838a-5e0f3c5ce07d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg" Jun 03 22:58:29.683899 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:29.683814 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/790643f4-b867-4422-838a-5e0f3c5ce07d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg\" (UID: \"790643f4-b867-4422-838a-5e0f3c5ce07d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg" Jun 03 22:58:29.695645 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:29.695607 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6fmh\" (UniqueName: \"kubernetes.io/projected/790643f4-b867-4422-838a-5e0f3c5ce07d-kube-api-access-c6fmh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg\" (UID: \"790643f4-b867-4422-838a-5e0f3c5ce07d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg" Jun 03 22:58:29.771550 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:29.771449 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg" Jun 03 22:58:29.901152 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:29.901110 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg"] Jun 03 22:58:29.904500 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:58:29.904477 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod790643f4_b867_4422_838a_5e0f3c5ce07d.slice/crio-b323c46c0410777bdf3af8a19d245d3c2d33f46879ec386ef8af82ffb642fce2 WatchSource:0}: Error finding container b323c46c0410777bdf3af8a19d245d3c2d33f46879ec386ef8af82ffb642fce2: Status 404 returned error can't find the container with id b323c46c0410777bdf3af8a19d245d3c2d33f46879ec386ef8af82ffb642fce2 Jun 03 22:58:29.925424 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:29.925392 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg" event={"ID":"790643f4-b867-4422-838a-5e0f3c5ce07d","Type":"ContainerStarted","Data":"b323c46c0410777bdf3af8a19d245d3c2d33f46879ec386ef8af82ffb642fce2"} Jun 03 22:58:30.932457 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:30.932427 2576 generic.go:356] "Generic (PLEG): container finished" podID="790643f4-b867-4422-838a-5e0f3c5ce07d" containerID="35235853a60b44df4446fb33a8cb99c3fa54021574dfaec7e775f033e0cb1417" exitCode=0 Jun 03 22:58:30.932948 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:30.932529 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg" event={"ID":"790643f4-b867-4422-838a-5e0f3c5ce07d","Type":"ContainerDied","Data":"35235853a60b44df4446fb33a8cb99c3fa54021574dfaec7e775f033e0cb1417"} Jun 03 22:58:33.950437 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:33.950401 2576 generic.go:356] "Generic (PLEG): container finished" podID="790643f4-b867-4422-838a-5e0f3c5ce07d" containerID="385e0e18e901755cf4d2f8ba006ae6c297dbccb7fce00e74dec3f5d540c7f09f" exitCode=0 Jun 03 22:58:33.950949 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:33.950449 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg" event={"ID":"790643f4-b867-4422-838a-5e0f3c5ce07d","Type":"ContainerDied","Data":"385e0e18e901755cf4d2f8ba006ae6c297dbccb7fce00e74dec3f5d540c7f09f"} Jun 03 22:58:34.956607 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:34.956573 2576 generic.go:356] "Generic (PLEG): container finished" podID="790643f4-b867-4422-838a-5e0f3c5ce07d" containerID="7883f4851f6159a8de9b3cd06e79b24dd762bd9ca695406a77d33ecb50375666" exitCode=0 Jun 03 22:58:34.957004 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:34.956657 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg" event={"ID":"790643f4-b867-4422-838a-5e0f3c5ce07d","Type":"ContainerDied","Data":"7883f4851f6159a8de9b3cd06e79b24dd762bd9ca695406a77d33ecb50375666"} Jun 03 22:58:36.088756 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:36.088725 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg" Jun 03 22:58:36.140501 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:36.140471 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/790643f4-b867-4422-838a-5e0f3c5ce07d-util\") pod \"790643f4-b867-4422-838a-5e0f3c5ce07d\" (UID: \"790643f4-b867-4422-838a-5e0f3c5ce07d\") " Jun 03 22:58:36.140696 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:36.140522 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/790643f4-b867-4422-838a-5e0f3c5ce07d-bundle\") pod \"790643f4-b867-4422-838a-5e0f3c5ce07d\" (UID: \"790643f4-b867-4422-838a-5e0f3c5ce07d\") " Jun 03 22:58:36.140696 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:36.140541 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6fmh\" (UniqueName: \"kubernetes.io/projected/790643f4-b867-4422-838a-5e0f3c5ce07d-kube-api-access-c6fmh\") pod \"790643f4-b867-4422-838a-5e0f3c5ce07d\" (UID: \"790643f4-b867-4422-838a-5e0f3c5ce07d\") " Jun 03 22:58:36.140897 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:36.140873 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/790643f4-b867-4422-838a-5e0f3c5ce07d-bundle" (OuterVolumeSpecName: "bundle") pod "790643f4-b867-4422-838a-5e0f3c5ce07d" (UID: "790643f4-b867-4422-838a-5e0f3c5ce07d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:58:36.142565 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:36.142543 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/790643f4-b867-4422-838a-5e0f3c5ce07d-kube-api-access-c6fmh" (OuterVolumeSpecName: "kube-api-access-c6fmh") pod "790643f4-b867-4422-838a-5e0f3c5ce07d" (UID: "790643f4-b867-4422-838a-5e0f3c5ce07d"). InnerVolumeSpecName "kube-api-access-c6fmh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:58:36.146626 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:36.146502 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/790643f4-b867-4422-838a-5e0f3c5ce07d-util" (OuterVolumeSpecName: "util") pod "790643f4-b867-4422-838a-5e0f3c5ce07d" (UID: "790643f4-b867-4422-838a-5e0f3c5ce07d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:58:36.242126 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:36.242040 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/790643f4-b867-4422-838a-5e0f3c5ce07d-util\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:58:36.242126 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:36.242071 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/790643f4-b867-4422-838a-5e0f3c5ce07d-bundle\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:58:36.242126 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:36.242079 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6fmh\" (UniqueName: \"kubernetes.io/projected/790643f4-b867-4422-838a-5e0f3c5ce07d-kube-api-access-c6fmh\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:58:36.967147 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:36.967122 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg" Jun 03 22:58:36.967147 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:36.967142 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mmg" event={"ID":"790643f4-b867-4422-838a-5e0f3c5ce07d","Type":"ContainerDied","Data":"b323c46c0410777bdf3af8a19d245d3c2d33f46879ec386ef8af82ffb642fce2"} Jun 03 22:58:36.967323 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:36.967208 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b323c46c0410777bdf3af8a19d245d3c2d33f46879ec386ef8af82ffb642fce2" Jun 03 22:58:47.246457 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:47.246425 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-48s4c"] Jun 03 22:58:47.246859 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:47.246738 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="790643f4-b867-4422-838a-5e0f3c5ce07d" containerName="pull" Jun 03 22:58:47.246859 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:47.246749 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="790643f4-b867-4422-838a-5e0f3c5ce07d" containerName="pull" Jun 03 22:58:47.246859 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:47.246759 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="790643f4-b867-4422-838a-5e0f3c5ce07d" containerName="util" Jun 03 22:58:47.246859 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:47.246764 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="790643f4-b867-4422-838a-5e0f3c5ce07d" containerName="util" Jun 03 22:58:47.246859 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:47.246775 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="790643f4-b867-4422-838a-5e0f3c5ce07d" containerName="extract" Jun 03 22:58:47.246859 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:47.246781 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="790643f4-b867-4422-838a-5e0f3c5ce07d" containerName="extract" Jun 03 22:58:47.246859 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:47.246844 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="790643f4-b867-4422-838a-5e0f3c5ce07d" containerName="extract" Jun 03 22:58:47.248794 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:47.248776 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-48s4c" Jun 03 22:58:47.250832 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:47.250808 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 22:58:47.250959 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:47.250852 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-42hwn\"" Jun 03 22:58:47.250959 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:47.250817 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 22:58:47.258596 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:47.258563 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-48s4c"] Jun 03 22:58:47.341223 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:47.341187 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06e4caa0-3f29-4f26-8190-28b7994228dc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-48s4c\" (UID: \"06e4caa0-3f29-4f26-8190-28b7994228dc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-48s4c" Jun 03 22:58:47.341400 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:47.341236 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsn7h\" (UniqueName: \"kubernetes.io/projected/06e4caa0-3f29-4f26-8190-28b7994228dc-kube-api-access-xsn7h\") pod \"openshift-lws-operator-fd8ccff4c-48s4c\" (UID: \"06e4caa0-3f29-4f26-8190-28b7994228dc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-48s4c" Jun 03 22:58:47.441740 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:47.441709 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06e4caa0-3f29-4f26-8190-28b7994228dc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-48s4c\" (UID: \"06e4caa0-3f29-4f26-8190-28b7994228dc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-48s4c" Jun 03 22:58:47.441896 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:47.441756 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsn7h\" (UniqueName: \"kubernetes.io/projected/06e4caa0-3f29-4f26-8190-28b7994228dc-kube-api-access-xsn7h\") pod \"openshift-lws-operator-fd8ccff4c-48s4c\" (UID: \"06e4caa0-3f29-4f26-8190-28b7994228dc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-48s4c" Jun 03 22:58:47.442154 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:47.442130 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06e4caa0-3f29-4f26-8190-28b7994228dc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-48s4c\" (UID: \"06e4caa0-3f29-4f26-8190-28b7994228dc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-48s4c" Jun 03 22:58:47.450896 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:47.450871 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsn7h\" (UniqueName: \"kubernetes.io/projected/06e4caa0-3f29-4f26-8190-28b7994228dc-kube-api-access-xsn7h\") pod \"openshift-lws-operator-fd8ccff4c-48s4c\" (UID: \"06e4caa0-3f29-4f26-8190-28b7994228dc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-48s4c" Jun 03 22:58:47.575578 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:47.575542 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-48s4c" Jun 03 22:58:47.701913 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:47.701884 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-48s4c"] Jun 03 22:58:47.705728 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:58:47.705700 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06e4caa0_3f29_4f26_8190_28b7994228dc.slice/crio-ed93135aa8c60d859f6cc3eaa1679c4e6dfaafefe3c586d184a12a4479c6e3fd WatchSource:0}: Error finding container ed93135aa8c60d859f6cc3eaa1679c4e6dfaafefe3c586d184a12a4479c6e3fd: Status 404 returned error can't find the container with id ed93135aa8c60d859f6cc3eaa1679c4e6dfaafefe3c586d184a12a4479c6e3fd Jun 03 22:58:48.017455 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:48.017368 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-48s4c" event={"ID":"06e4caa0-3f29-4f26-8190-28b7994228dc","Type":"ContainerStarted","Data":"ed93135aa8c60d859f6cc3eaa1679c4e6dfaafefe3c586d184a12a4479c6e3fd"} Jun 03 22:58:49.263295 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:49.263262 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-h4qzp"] Jun 03 22:58:49.265746 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:49.265727 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-h4qzp" Jun 03 22:58:49.267962 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:49.267938 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 22:58:49.268088 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:49.268071 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 22:58:49.268336 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:49.268321 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-s45p5\"" Jun 03 22:58:49.278707 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:49.278686 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-h4qzp"] Jun 03 22:58:49.360852 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:49.360817 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8dd79965-7ed4-4d18-a7fc-1fa6cb41a911-bound-sa-token\") pod \"cert-manager-59c77684cc-h4qzp\" (UID: \"8dd79965-7ed4-4d18-a7fc-1fa6cb41a911\") " pod="cert-manager/cert-manager-59c77684cc-h4qzp" Jun 03 22:58:49.361022 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:49.360878 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5prjf\" (UniqueName: \"kubernetes.io/projected/8dd79965-7ed4-4d18-a7fc-1fa6cb41a911-kube-api-access-5prjf\") pod \"cert-manager-59c77684cc-h4qzp\" (UID: \"8dd79965-7ed4-4d18-a7fc-1fa6cb41a911\") " pod="cert-manager/cert-manager-59c77684cc-h4qzp" Jun 03 22:58:49.461690 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:49.461651 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5prjf\" (UniqueName: \"kubernetes.io/projected/8dd79965-7ed4-4d18-a7fc-1fa6cb41a911-kube-api-access-5prjf\") pod \"cert-manager-59c77684cc-h4qzp\" (UID: \"8dd79965-7ed4-4d18-a7fc-1fa6cb41a911\") " pod="cert-manager/cert-manager-59c77684cc-h4qzp" Jun 03 22:58:49.461889 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:49.461788 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8dd79965-7ed4-4d18-a7fc-1fa6cb41a911-bound-sa-token\") pod \"cert-manager-59c77684cc-h4qzp\" (UID: \"8dd79965-7ed4-4d18-a7fc-1fa6cb41a911\") " pod="cert-manager/cert-manager-59c77684cc-h4qzp" Jun 03 22:58:49.470001 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:49.469970 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8dd79965-7ed4-4d18-a7fc-1fa6cb41a911-bound-sa-token\") pod \"cert-manager-59c77684cc-h4qzp\" (UID: \"8dd79965-7ed4-4d18-a7fc-1fa6cb41a911\") " pod="cert-manager/cert-manager-59c77684cc-h4qzp" Jun 03 22:58:49.470158 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:49.470102 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5prjf\" (UniqueName: \"kubernetes.io/projected/8dd79965-7ed4-4d18-a7fc-1fa6cb41a911-kube-api-access-5prjf\") pod \"cert-manager-59c77684cc-h4qzp\" (UID: \"8dd79965-7ed4-4d18-a7fc-1fa6cb41a911\") " pod="cert-manager/cert-manager-59c77684cc-h4qzp" Jun 03 22:58:49.576392 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:49.576351 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-h4qzp" Jun 03 22:58:49.732055 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:49.732010 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-h4qzp"] Jun 03 22:58:49.734878 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:58:49.734848 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8dd79965_7ed4_4d18_a7fc_1fa6cb41a911.slice/crio-23466924401f972db2800ee843563c8f660da8d7073ee9b0f0ebb2120a036ddf WatchSource:0}: Error finding container 23466924401f972db2800ee843563c8f660da8d7073ee9b0f0ebb2120a036ddf: Status 404 returned error can't find the container with id 23466924401f972db2800ee843563c8f660da8d7073ee9b0f0ebb2120a036ddf Jun 03 22:58:50.029029 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:50.028932 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-48s4c" event={"ID":"06e4caa0-3f29-4f26-8190-28b7994228dc","Type":"ContainerStarted","Data":"99dfd206101d15cbec6fee040771ecfdc279986229a9c1a252806dee72cbc3cc"} Jun 03 22:58:50.030231 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:50.030204 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-h4qzp" event={"ID":"8dd79965-7ed4-4d18-a7fc-1fa6cb41a911","Type":"ContainerStarted","Data":"23466924401f972db2800ee843563c8f660da8d7073ee9b0f0ebb2120a036ddf"} Jun 03 22:58:50.044815 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:50.044764 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-48s4c" podStartSLOduration=1.155956546 podStartE2EDuration="3.044748736s" totalImagesPullingTime="1.88879219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:58:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:58:50.044418413 +0000 UTC m=+508.383070902" watchObservedRunningTime="2026-06-03 22:58:50.044748736 +0000 UTC m=+508.383401224" Jun 03 22:58:53.048292 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:53.048247 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-h4qzp" event={"ID":"8dd79965-7ed4-4d18-a7fc-1fa6cb41a911","Type":"ContainerStarted","Data":"1b214735944669a52cc828301ce072bca760c0eea47d5286fe49404805590d1e"} Jun 03 22:58:53.070552 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:53.070482 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-h4qzp" podStartSLOduration=1.529817833 podStartE2EDuration="4.070462704s" totalImagesPullingTime="2.540644871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:58:53.06761058 +0000 UTC m=+511.406263067" watchObservedRunningTime="2026-06-03 22:58:53.070462704 +0000 UTC m=+511.409115192" Jun 03 22:58:54.088169 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:54.088131 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps"] Jun 03 22:58:54.090799 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:54.090774 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps" Jun 03 22:58:54.092813 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:54.092784 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 22:58:54.092943 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:54.092815 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-grzxb\"" Jun 03 22:58:54.092943 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:54.092863 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 22:58:54.100568 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:54.100544 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps"] Jun 03 22:58:54.204139 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:54.204106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn67x\" (UniqueName: \"kubernetes.io/projected/b3902c26-65f3-4d88-afa4-2b3dacc4e0e2-kube-api-access-qn67x\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps\" (UID: \"b3902c26-65f3-4d88-afa4-2b3dacc4e0e2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps" Jun 03 22:58:54.204326 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:54.204176 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3902c26-65f3-4d88-afa4-2b3dacc4e0e2-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps\" (UID: \"b3902c26-65f3-4d88-afa4-2b3dacc4e0e2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps" Jun 03 22:58:54.204326 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:54.204238 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3902c26-65f3-4d88-afa4-2b3dacc4e0e2-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps\" (UID: \"b3902c26-65f3-4d88-afa4-2b3dacc4e0e2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps" Jun 03 22:58:54.305486 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:54.305446 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn67x\" (UniqueName: \"kubernetes.io/projected/b3902c26-65f3-4d88-afa4-2b3dacc4e0e2-kube-api-access-qn67x\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps\" (UID: \"b3902c26-65f3-4d88-afa4-2b3dacc4e0e2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps" Jun 03 22:58:54.305719 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:54.305551 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3902c26-65f3-4d88-afa4-2b3dacc4e0e2-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps\" (UID: \"b3902c26-65f3-4d88-afa4-2b3dacc4e0e2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps" Jun 03 22:58:54.305719 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:54.305597 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3902c26-65f3-4d88-afa4-2b3dacc4e0e2-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps\" (UID: \"b3902c26-65f3-4d88-afa4-2b3dacc4e0e2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps" Jun 03 22:58:54.305996 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:54.305974 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3902c26-65f3-4d88-afa4-2b3dacc4e0e2-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps\" (UID: \"b3902c26-65f3-4d88-afa4-2b3dacc4e0e2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps" Jun 03 22:58:54.305996 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:54.305990 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3902c26-65f3-4d88-afa4-2b3dacc4e0e2-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps\" (UID: \"b3902c26-65f3-4d88-afa4-2b3dacc4e0e2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps" Jun 03 22:58:54.313089 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:54.313066 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn67x\" (UniqueName: \"kubernetes.io/projected/b3902c26-65f3-4d88-afa4-2b3dacc4e0e2-kube-api-access-qn67x\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps\" (UID: \"b3902c26-65f3-4d88-afa4-2b3dacc4e0e2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps" Jun 03 22:58:54.400772 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:54.400684 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps" Jun 03 22:58:54.538756 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:54.538728 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps"] Jun 03 22:58:54.543164 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:58:54.543120 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3902c26_65f3_4d88_afa4_2b3dacc4e0e2.slice/crio-a85b4bda60519e12c8b8afba64bdf0431b0c043600b4c5eb43f2f911768c463b WatchSource:0}: Error finding container a85b4bda60519e12c8b8afba64bdf0431b0c043600b4c5eb43f2f911768c463b: Status 404 returned error can't find the container with id a85b4bda60519e12c8b8afba64bdf0431b0c043600b4c5eb43f2f911768c463b Jun 03 22:58:55.059272 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:55.059237 2576 generic.go:356] "Generic (PLEG): container finished" podID="b3902c26-65f3-4d88-afa4-2b3dacc4e0e2" containerID="19b332a92a89d89b45bb922c48d165f5aa59efe04b1cbfce56032a8d2be8366b" exitCode=0 Jun 03 22:58:55.059464 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:55.059330 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps" event={"ID":"b3902c26-65f3-4d88-afa4-2b3dacc4e0e2","Type":"ContainerDied","Data":"19b332a92a89d89b45bb922c48d165f5aa59efe04b1cbfce56032a8d2be8366b"} Jun 03 22:58:55.059464 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:55.059387 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps" event={"ID":"b3902c26-65f3-4d88-afa4-2b3dacc4e0e2","Type":"ContainerStarted","Data":"a85b4bda60519e12c8b8afba64bdf0431b0c043600b4c5eb43f2f911768c463b"} Jun 03 22:58:56.066070 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:56.066033 2576 generic.go:356] "Generic (PLEG): container finished" podID="b3902c26-65f3-4d88-afa4-2b3dacc4e0e2" containerID="d53ce7762cf12c6ff1c83a04ff295a4b5f4272cffa64d90fd9467834ea6f96bd" exitCode=0 Jun 03 22:58:56.066554 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:56.066082 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps" event={"ID":"b3902c26-65f3-4d88-afa4-2b3dacc4e0e2","Type":"ContainerDied","Data":"d53ce7762cf12c6ff1c83a04ff295a4b5f4272cffa64d90fd9467834ea6f96bd"} Jun 03 22:58:57.073195 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:57.073161 2576 generic.go:356] "Generic (PLEG): container finished" podID="b3902c26-65f3-4d88-afa4-2b3dacc4e0e2" containerID="cdf89336c6f92f243d24d5823d435ad09808ac7bb7299c52ca4d14bfad6f5cae" exitCode=0 Jun 03 22:58:57.073596 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:57.073236 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps" event={"ID":"b3902c26-65f3-4d88-afa4-2b3dacc4e0e2","Type":"ContainerDied","Data":"cdf89336c6f92f243d24d5823d435ad09808ac7bb7299c52ca4d14bfad6f5cae"} Jun 03 22:58:57.459676 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:57.459603 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-747dfb677c-jrqrq"] Jun 03 22:58:57.462065 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:57.462050 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-747dfb677c-jrqrq" Jun 03 22:58:57.463850 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:57.463829 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 22:58:57.464231 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:57.464213 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 22:58:57.464330 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:57.464235 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 22:58:57.464330 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:57.464251 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-x5fz4\"" Jun 03 22:58:57.471600 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:57.471576 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-747dfb677c-jrqrq"] Jun 03 22:58:57.635137 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:57.635095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b6wd\" (UniqueName: \"kubernetes.io/projected/a900500b-de11-4a9d-b96b-dc0a1cb69aba-kube-api-access-8b6wd\") pod \"lws-controller-manager-747dfb677c-jrqrq\" (UID: \"a900500b-de11-4a9d-b96b-dc0a1cb69aba\") " pod="openshift-lws-operator/lws-controller-manager-747dfb677c-jrqrq" Jun 03 22:58:57.635137 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:57.635139 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a900500b-de11-4a9d-b96b-dc0a1cb69aba-cert\") pod \"lws-controller-manager-747dfb677c-jrqrq\" (UID: \"a900500b-de11-4a9d-b96b-dc0a1cb69aba\") " pod="openshift-lws-operator/lws-controller-manager-747dfb677c-jrqrq" Jun 03 22:58:57.635370 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:57.635167 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a900500b-de11-4a9d-b96b-dc0a1cb69aba-manager-config\") pod \"lws-controller-manager-747dfb677c-jrqrq\" (UID: \"a900500b-de11-4a9d-b96b-dc0a1cb69aba\") " pod="openshift-lws-operator/lws-controller-manager-747dfb677c-jrqrq" Jun 03 22:58:57.635370 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:57.635245 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a900500b-de11-4a9d-b96b-dc0a1cb69aba-metrics-cert\") pod \"lws-controller-manager-747dfb677c-jrqrq\" (UID: \"a900500b-de11-4a9d-b96b-dc0a1cb69aba\") " pod="openshift-lws-operator/lws-controller-manager-747dfb677c-jrqrq" Jun 03 22:58:57.736663 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:57.736578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a900500b-de11-4a9d-b96b-dc0a1cb69aba-metrics-cert\") pod \"lws-controller-manager-747dfb677c-jrqrq\" (UID: \"a900500b-de11-4a9d-b96b-dc0a1cb69aba\") " pod="openshift-lws-operator/lws-controller-manager-747dfb677c-jrqrq" Jun 03 22:58:57.736663 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:57.736623 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b6wd\" (UniqueName: \"kubernetes.io/projected/a900500b-de11-4a9d-b96b-dc0a1cb69aba-kube-api-access-8b6wd\") pod \"lws-controller-manager-747dfb677c-jrqrq\" (UID: \"a900500b-de11-4a9d-b96b-dc0a1cb69aba\") " pod="openshift-lws-operator/lws-controller-manager-747dfb677c-jrqrq" Jun 03 22:58:57.736663 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:57.736657 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a900500b-de11-4a9d-b96b-dc0a1cb69aba-cert\") pod \"lws-controller-manager-747dfb677c-jrqrq\" (UID: \"a900500b-de11-4a9d-b96b-dc0a1cb69aba\") " pod="openshift-lws-operator/lws-controller-manager-747dfb677c-jrqrq" Jun 03 22:58:57.736946 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:57.736696 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a900500b-de11-4a9d-b96b-dc0a1cb69aba-manager-config\") pod \"lws-controller-manager-747dfb677c-jrqrq\" (UID: \"a900500b-de11-4a9d-b96b-dc0a1cb69aba\") " pod="openshift-lws-operator/lws-controller-manager-747dfb677c-jrqrq" Jun 03 22:58:57.737479 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:57.737460 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a900500b-de11-4a9d-b96b-dc0a1cb69aba-manager-config\") pod \"lws-controller-manager-747dfb677c-jrqrq\" (UID: \"a900500b-de11-4a9d-b96b-dc0a1cb69aba\") " pod="openshift-lws-operator/lws-controller-manager-747dfb677c-jrqrq" Jun 03 22:58:57.739124 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:57.739102 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a900500b-de11-4a9d-b96b-dc0a1cb69aba-cert\") pod \"lws-controller-manager-747dfb677c-jrqrq\" (UID: \"a900500b-de11-4a9d-b96b-dc0a1cb69aba\") " pod="openshift-lws-operator/lws-controller-manager-747dfb677c-jrqrq" Jun 03 22:58:57.739208 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:57.739180 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a900500b-de11-4a9d-b96b-dc0a1cb69aba-metrics-cert\") pod \"lws-controller-manager-747dfb677c-jrqrq\" (UID: \"a900500b-de11-4a9d-b96b-dc0a1cb69aba\") " pod="openshift-lws-operator/lws-controller-manager-747dfb677c-jrqrq" Jun 03 22:58:57.744331 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:57.744313 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b6wd\" (UniqueName: \"kubernetes.io/projected/a900500b-de11-4a9d-b96b-dc0a1cb69aba-kube-api-access-8b6wd\") pod \"lws-controller-manager-747dfb677c-jrqrq\" (UID: \"a900500b-de11-4a9d-b96b-dc0a1cb69aba\") " pod="openshift-lws-operator/lws-controller-manager-747dfb677c-jrqrq" Jun 03 22:58:57.772354 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:57.772317 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-747dfb677c-jrqrq" Jun 03 22:58:57.919002 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:57.918977 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-747dfb677c-jrqrq"] Jun 03 22:58:57.921231 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:58:57.921203 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda900500b_de11_4a9d_b96b_dc0a1cb69aba.slice/crio-45a9698daf91a8c6036831d641d6dd2c4c2dcf9bc0c690d9c88fed9eedb04966 WatchSource:0}: Error finding container 45a9698daf91a8c6036831d641d6dd2c4c2dcf9bc0c690d9c88fed9eedb04966: Status 404 returned error can't find the container with id 45a9698daf91a8c6036831d641d6dd2c4c2dcf9bc0c690d9c88fed9eedb04966 Jun 03 22:58:58.079069 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:58.079035 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-747dfb677c-jrqrq" event={"ID":"a900500b-de11-4a9d-b96b-dc0a1cb69aba","Type":"ContainerStarted","Data":"45a9698daf91a8c6036831d641d6dd2c4c2dcf9bc0c690d9c88fed9eedb04966"} Jun 03 22:58:58.200863 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:58.200825 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps" Jun 03 22:58:58.342554 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:58.342441 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3902c26-65f3-4d88-afa4-2b3dacc4e0e2-bundle\") pod \"b3902c26-65f3-4d88-afa4-2b3dacc4e0e2\" (UID: \"b3902c26-65f3-4d88-afa4-2b3dacc4e0e2\") " Jun 03 22:58:58.342554 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:58.342491 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3902c26-65f3-4d88-afa4-2b3dacc4e0e2-util\") pod \"b3902c26-65f3-4d88-afa4-2b3dacc4e0e2\" (UID: \"b3902c26-65f3-4d88-afa4-2b3dacc4e0e2\") " Jun 03 22:58:58.342554 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:58.342548 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qn67x\" (UniqueName: \"kubernetes.io/projected/b3902c26-65f3-4d88-afa4-2b3dacc4e0e2-kube-api-access-qn67x\") pod \"b3902c26-65f3-4d88-afa4-2b3dacc4e0e2\" (UID: \"b3902c26-65f3-4d88-afa4-2b3dacc4e0e2\") " Jun 03 22:58:58.343177 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:58.343153 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3902c26-65f3-4d88-afa4-2b3dacc4e0e2-bundle" (OuterVolumeSpecName: "bundle") pod "b3902c26-65f3-4d88-afa4-2b3dacc4e0e2" (UID: "b3902c26-65f3-4d88-afa4-2b3dacc4e0e2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:58:58.344664 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:58.344642 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3902c26-65f3-4d88-afa4-2b3dacc4e0e2-kube-api-access-qn67x" (OuterVolumeSpecName: "kube-api-access-qn67x") pod "b3902c26-65f3-4d88-afa4-2b3dacc4e0e2" (UID: "b3902c26-65f3-4d88-afa4-2b3dacc4e0e2"). InnerVolumeSpecName "kube-api-access-qn67x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:58:58.348217 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:58.348179 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3902c26-65f3-4d88-afa4-2b3dacc4e0e2-util" (OuterVolumeSpecName: "util") pod "b3902c26-65f3-4d88-afa4-2b3dacc4e0e2" (UID: "b3902c26-65f3-4d88-afa4-2b3dacc4e0e2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:58:58.443565 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:58.443531 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3902c26-65f3-4d88-afa4-2b3dacc4e0e2-bundle\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:58:58.443565 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:58.443560 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3902c26-65f3-4d88-afa4-2b3dacc4e0e2-util\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:58:58.443565 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:58.443572 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qn67x\" (UniqueName: \"kubernetes.io/projected/b3902c26-65f3-4d88-afa4-2b3dacc4e0e2-kube-api-access-qn67x\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:58:59.084973 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:59.084945 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps" Jun 03 22:58:59.084973 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:59.084968 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbqqps" event={"ID":"b3902c26-65f3-4d88-afa4-2b3dacc4e0e2","Type":"ContainerDied","Data":"a85b4bda60519e12c8b8afba64bdf0431b0c043600b4c5eb43f2f911768c463b"} Jun 03 22:58:59.085408 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:58:59.085014 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a85b4bda60519e12c8b8afba64bdf0431b0c043600b4c5eb43f2f911768c463b" Jun 03 22:59:01.095844 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:01.095810 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-747dfb677c-jrqrq" event={"ID":"a900500b-de11-4a9d-b96b-dc0a1cb69aba","Type":"ContainerStarted","Data":"2fadeaf95fb0b2ced63c07e385aaf5ba5a254f9afd7bd314278b665fe44484a1"} Jun 03 22:59:01.096226 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:01.095948 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-747dfb677c-jrqrq" Jun 03 22:59:01.116043 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:01.115990 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-747dfb677c-jrqrq" podStartSLOduration=1.71623453 podStartE2EDuration="4.11597241s" totalImagesPullingTime="2.39973788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:59:01.1135514 +0000 UTC m=+519.452203887" watchObservedRunningTime="2026-06-03 22:59:01.11597241 +0000 UTC m=+519.454624898" Jun 03 22:59:08.165126 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.165086 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p"] Jun 03 22:59:08.165625 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.165561 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3902c26-65f3-4d88-afa4-2b3dacc4e0e2" containerName="extract" Jun 03 22:59:08.165625 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.165579 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3902c26-65f3-4d88-afa4-2b3dacc4e0e2" containerName="extract" Jun 03 22:59:08.165625 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.165593 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3902c26-65f3-4d88-afa4-2b3dacc4e0e2" containerName="pull" Jun 03 22:59:08.165625 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.165602 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3902c26-65f3-4d88-afa4-2b3dacc4e0e2" containerName="pull" Jun 03 22:59:08.165835 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.165632 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3902c26-65f3-4d88-afa4-2b3dacc4e0e2" containerName="util" Jun 03 22:59:08.165835 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.165642 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3902c26-65f3-4d88-afa4-2b3dacc4e0e2" containerName="util" Jun 03 22:59:08.165835 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.165729 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3902c26-65f3-4d88-afa4-2b3dacc4e0e2" containerName="extract" Jun 03 22:59:08.173338 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.173312 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p" Jun 03 22:59:08.182990 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.182963 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 22:59:08.183137 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.183019 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 22:59:08.183225 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.183202 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cq2pv\"" Jun 03 22:59:08.183272 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.183247 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 22:59:08.183312 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.183283 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 22:59:08.188920 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.188887 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p"] Jun 03 22:59:08.219075 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.219040 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e24113d-b734-4ca2-a4d6-123a47aa3b25-webhook-cert\") pod \"opendatahub-operator-controller-manager-967f449d5-52g6p\" (UID: \"2e24113d-b734-4ca2-a4d6-123a47aa3b25\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p" Jun 03 22:59:08.219075 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.219080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2e24113d-b734-4ca2-a4d6-123a47aa3b25-apiservice-cert\") pod \"opendatahub-operator-controller-manager-967f449d5-52g6p\" (UID: \"2e24113d-b734-4ca2-a4d6-123a47aa3b25\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p" Jun 03 22:59:08.219327 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.219104 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e24113d-b734-4ca2-a4d6-123a47aa3b25-tmp\") pod \"opendatahub-operator-controller-manager-967f449d5-52g6p\" (UID: \"2e24113d-b734-4ca2-a4d6-123a47aa3b25\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p" Jun 03 22:59:08.219327 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.219166 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2e24113d-b734-4ca2-a4d6-123a47aa3b25-manifests\") pod \"opendatahub-operator-controller-manager-967f449d5-52g6p\" (UID: \"2e24113d-b734-4ca2-a4d6-123a47aa3b25\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p" Jun 03 22:59:08.219327 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.219201 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx8bh\" (UniqueName: \"kubernetes.io/projected/2e24113d-b734-4ca2-a4d6-123a47aa3b25-kube-api-access-cx8bh\") pod \"opendatahub-operator-controller-manager-967f449d5-52g6p\" (UID: \"2e24113d-b734-4ca2-a4d6-123a47aa3b25\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p" Jun 03 22:59:08.320393 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.320346 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e24113d-b734-4ca2-a4d6-123a47aa3b25-webhook-cert\") pod \"opendatahub-operator-controller-manager-967f449d5-52g6p\" (UID: \"2e24113d-b734-4ca2-a4d6-123a47aa3b25\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p" Jun 03 22:59:08.320393 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.320400 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2e24113d-b734-4ca2-a4d6-123a47aa3b25-apiservice-cert\") pod \"opendatahub-operator-controller-manager-967f449d5-52g6p\" (UID: \"2e24113d-b734-4ca2-a4d6-123a47aa3b25\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p" Jun 03 22:59:08.320679 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.320429 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e24113d-b734-4ca2-a4d6-123a47aa3b25-tmp\") pod \"opendatahub-operator-controller-manager-967f449d5-52g6p\" (UID: \"2e24113d-b734-4ca2-a4d6-123a47aa3b25\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p" Jun 03 22:59:08.320679 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.320472 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2e24113d-b734-4ca2-a4d6-123a47aa3b25-manifests\") pod \"opendatahub-operator-controller-manager-967f449d5-52g6p\" (UID: \"2e24113d-b734-4ca2-a4d6-123a47aa3b25\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p" Jun 03 22:59:08.320679 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.320496 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx8bh\" (UniqueName: \"kubernetes.io/projected/2e24113d-b734-4ca2-a4d6-123a47aa3b25-kube-api-access-cx8bh\") pod \"opendatahub-operator-controller-manager-967f449d5-52g6p\" (UID: \"2e24113d-b734-4ca2-a4d6-123a47aa3b25\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p" Jun 03 22:59:08.320938 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.320910 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2e24113d-b734-4ca2-a4d6-123a47aa3b25-manifests\") pod \"opendatahub-operator-controller-manager-967f449d5-52g6p\" (UID: \"2e24113d-b734-4ca2-a4d6-123a47aa3b25\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p" Jun 03 22:59:08.322863 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.322837 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e24113d-b734-4ca2-a4d6-123a47aa3b25-tmp\") pod \"opendatahub-operator-controller-manager-967f449d5-52g6p\" (UID: \"2e24113d-b734-4ca2-a4d6-123a47aa3b25\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p" Jun 03 22:59:08.323086 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.323066 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2e24113d-b734-4ca2-a4d6-123a47aa3b25-apiservice-cert\") pod \"opendatahub-operator-controller-manager-967f449d5-52g6p\" (UID: \"2e24113d-b734-4ca2-a4d6-123a47aa3b25\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p" Jun 03 22:59:08.323129 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.323112 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e24113d-b734-4ca2-a4d6-123a47aa3b25-webhook-cert\") pod \"opendatahub-operator-controller-manager-967f449d5-52g6p\" (UID: \"2e24113d-b734-4ca2-a4d6-123a47aa3b25\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p" Jun 03 22:59:08.328884 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.328852 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx8bh\" (UniqueName: \"kubernetes.io/projected/2e24113d-b734-4ca2-a4d6-123a47aa3b25-kube-api-access-cx8bh\") pod \"opendatahub-operator-controller-manager-967f449d5-52g6p\" (UID: \"2e24113d-b734-4ca2-a4d6-123a47aa3b25\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p" Jun 03 22:59:08.482909 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.482813 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p" Jun 03 22:59:08.635199 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:08.635172 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p"] Jun 03 22:59:08.637529 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:59:08.637483 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e24113d_b734_4ca2_a4d6_123a47aa3b25.slice/crio-c03a10e9c70c45afb2c577e6884a5aae9bc20d0d783708bfc5816c0593cac1ce WatchSource:0}: Error finding container c03a10e9c70c45afb2c577e6884a5aae9bc20d0d783708bfc5816c0593cac1ce: Status 404 returned error can't find the container with id c03a10e9c70c45afb2c577e6884a5aae9bc20d0d783708bfc5816c0593cac1ce Jun 03 22:59:09.133091 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:09.133059 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p" event={"ID":"2e24113d-b734-4ca2-a4d6-123a47aa3b25","Type":"ContainerStarted","Data":"c03a10e9c70c45afb2c577e6884a5aae9bc20d0d783708bfc5816c0593cac1ce"} Jun 03 22:59:12.103031 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:12.102999 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-747dfb677c-jrqrq" Jun 03 22:59:12.151381 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:12.151349 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p" event={"ID":"2e24113d-b734-4ca2-a4d6-123a47aa3b25","Type":"ContainerStarted","Data":"cc6496bbaaee39b170471267f7b9083786b9e7993eaaa2599d784b3bcf91e2bd"} Jun 03 22:59:13.157564 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:13.157505 2576 generic.go:356] "Generic (PLEG): container finished" podID="2e24113d-b734-4ca2-a4d6-123a47aa3b25" containerID="cc6496bbaaee39b170471267f7b9083786b9e7993eaaa2599d784b3bcf91e2bd" exitCode=0 Jun 03 22:59:13.157997 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:13.157618 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p" event={"ID":"2e24113d-b734-4ca2-a4d6-123a47aa3b25","Type":"ContainerDied","Data":"cc6496bbaaee39b170471267f7b9083786b9e7993eaaa2599d784b3bcf91e2bd"} Jun 03 22:59:14.166094 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:14.166043 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p" event={"ID":"2e24113d-b734-4ca2-a4d6-123a47aa3b25","Type":"ContainerStarted","Data":"6125640e4c3b4c6c4b57e750bf6e5e67854f3624a69ff47151bf58ae375e2a53"} Jun 03 22:59:14.166606 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:14.166156 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p" Jun 03 22:59:14.186310 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:14.186241 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p" podStartSLOduration=2.141802301 podStartE2EDuration="6.186220004s" totalImagesPullingTime="3.076849791s" totalInitContainerRuntime="967.567912ms" isStatefulPod=false podCreationTimestamp="2026-06-03 22:59:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:59:14.185639454 +0000 UTC m=+532.524291942" watchObservedRunningTime="2026-06-03 22:59:14.186220004 +0000 UTC m=+532.524872495" Jun 03 22:59:25.174041 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:25.174006 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-52g6p" Jun 03 22:59:29.432796 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:29.432758 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss"] Jun 03 22:59:29.441623 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:29.441597 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss" Jun 03 22:59:29.443826 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:29.443799 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-grzxb\"" Jun 03 22:59:29.444005 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:29.443843 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 22:59:29.444219 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:29.443891 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 22:59:29.444397 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:29.444273 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss"] Jun 03 22:59:29.511731 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:29.511688 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34888d89-7464-4ffb-bd59-512aa1ec0a7c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss\" (UID: \"34888d89-7464-4ffb-bd59-512aa1ec0a7c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss" Jun 03 22:59:29.511950 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:29.511878 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb2hb\" (UniqueName: \"kubernetes.io/projected/34888d89-7464-4ffb-bd59-512aa1ec0a7c-kube-api-access-mb2hb\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss\" (UID: \"34888d89-7464-4ffb-bd59-512aa1ec0a7c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss" Jun 03 22:59:29.512012 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:29.511991 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34888d89-7464-4ffb-bd59-512aa1ec0a7c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss\" (UID: \"34888d89-7464-4ffb-bd59-512aa1ec0a7c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss" Jun 03 22:59:29.612469 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:29.612419 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34888d89-7464-4ffb-bd59-512aa1ec0a7c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss\" (UID: \"34888d89-7464-4ffb-bd59-512aa1ec0a7c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss" Jun 03 22:59:29.612469 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:29.612484 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34888d89-7464-4ffb-bd59-512aa1ec0a7c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss\" (UID: \"34888d89-7464-4ffb-bd59-512aa1ec0a7c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss" Jun 03 22:59:29.612691 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:29.612571 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb2hb\" (UniqueName: \"kubernetes.io/projected/34888d89-7464-4ffb-bd59-512aa1ec0a7c-kube-api-access-mb2hb\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss\" (UID: \"34888d89-7464-4ffb-bd59-512aa1ec0a7c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss" Jun 03 22:59:29.612844 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:29.612822 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34888d89-7464-4ffb-bd59-512aa1ec0a7c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss\" (UID: \"34888d89-7464-4ffb-bd59-512aa1ec0a7c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss" Jun 03 22:59:29.612898 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:29.612851 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34888d89-7464-4ffb-bd59-512aa1ec0a7c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss\" (UID: \"34888d89-7464-4ffb-bd59-512aa1ec0a7c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss" Jun 03 22:59:29.620615 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:29.620583 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb2hb\" (UniqueName: \"kubernetes.io/projected/34888d89-7464-4ffb-bd59-512aa1ec0a7c-kube-api-access-mb2hb\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss\" (UID: \"34888d89-7464-4ffb-bd59-512aa1ec0a7c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss" Jun 03 22:59:29.752639 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:29.752561 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss" Jun 03 22:59:29.893877 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:29.893851 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss"] Jun 03 22:59:29.895825 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:59:29.895787 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34888d89_7464_4ffb_bd59_512aa1ec0a7c.slice/crio-32bb4d1f8452a5d985a6cc289e7a8bd65074100f7db99ab2afa04d9cffd5220a WatchSource:0}: Error finding container 32bb4d1f8452a5d985a6cc289e7a8bd65074100f7db99ab2afa04d9cffd5220a: Status 404 returned error can't find the container with id 32bb4d1f8452a5d985a6cc289e7a8bd65074100f7db99ab2afa04d9cffd5220a Jun 03 22:59:30.248272 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:30.248238 2576 generic.go:356] "Generic (PLEG): container finished" podID="34888d89-7464-4ffb-bd59-512aa1ec0a7c" containerID="a68e45ff5b546e6dad257e93b93d8bc9b75d38baa8e45663a14db2bf990371af" exitCode=0 Jun 03 22:59:30.248471 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:30.248329 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss" event={"ID":"34888d89-7464-4ffb-bd59-512aa1ec0a7c","Type":"ContainerDied","Data":"a68e45ff5b546e6dad257e93b93d8bc9b75d38baa8e45663a14db2bf990371af"} Jun 03 22:59:30.248471 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:30.248384 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss" event={"ID":"34888d89-7464-4ffb-bd59-512aa1ec0a7c","Type":"ContainerStarted","Data":"32bb4d1f8452a5d985a6cc289e7a8bd65074100f7db99ab2afa04d9cffd5220a"} Jun 03 22:59:31.254811 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:31.254716 2576 generic.go:356] "Generic (PLEG): container finished" podID="34888d89-7464-4ffb-bd59-512aa1ec0a7c" containerID="0e59957edad80c9b3a31ffe9380d54a5b66b55da8685ab70a6f7f02049a2d33c" exitCode=0 Jun 03 22:59:31.255168 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:31.254803 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss" event={"ID":"34888d89-7464-4ffb-bd59-512aa1ec0a7c","Type":"ContainerDied","Data":"0e59957edad80c9b3a31ffe9380d54a5b66b55da8685ab70a6f7f02049a2d33c"} Jun 03 22:59:32.262018 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:32.261985 2576 generic.go:356] "Generic (PLEG): container finished" podID="34888d89-7464-4ffb-bd59-512aa1ec0a7c" containerID="f97e3a7d40f37b6b1f28da478c679f7565ae107232a31d6ffda37905f8849a10" exitCode=0 Jun 03 22:59:32.262419 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:32.262074 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss" event={"ID":"34888d89-7464-4ffb-bd59-512aa1ec0a7c","Type":"ContainerDied","Data":"f97e3a7d40f37b6b1f28da478c679f7565ae107232a31d6ffda37905f8849a10"} Jun 03 22:59:33.398775 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:33.398745 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss" Jun 03 22:59:33.550049 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:33.550012 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34888d89-7464-4ffb-bd59-512aa1ec0a7c-bundle\") pod \"34888d89-7464-4ffb-bd59-512aa1ec0a7c\" (UID: \"34888d89-7464-4ffb-bd59-512aa1ec0a7c\") " Jun 03 22:59:33.550212 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:33.550128 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34888d89-7464-4ffb-bd59-512aa1ec0a7c-util\") pod \"34888d89-7464-4ffb-bd59-512aa1ec0a7c\" (UID: \"34888d89-7464-4ffb-bd59-512aa1ec0a7c\") " Jun 03 22:59:33.550212 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:33.550200 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb2hb\" (UniqueName: \"kubernetes.io/projected/34888d89-7464-4ffb-bd59-512aa1ec0a7c-kube-api-access-mb2hb\") pod \"34888d89-7464-4ffb-bd59-512aa1ec0a7c\" (UID: \"34888d89-7464-4ffb-bd59-512aa1ec0a7c\") " Jun 03 22:59:33.550987 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:33.550960 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34888d89-7464-4ffb-bd59-512aa1ec0a7c-bundle" (OuterVolumeSpecName: "bundle") pod "34888d89-7464-4ffb-bd59-512aa1ec0a7c" (UID: "34888d89-7464-4ffb-bd59-512aa1ec0a7c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:59:33.552229 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:33.552203 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34888d89-7464-4ffb-bd59-512aa1ec0a7c-kube-api-access-mb2hb" (OuterVolumeSpecName: "kube-api-access-mb2hb") pod "34888d89-7464-4ffb-bd59-512aa1ec0a7c" (UID: "34888d89-7464-4ffb-bd59-512aa1ec0a7c"). InnerVolumeSpecName "kube-api-access-mb2hb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:59:33.555676 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:33.555640 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34888d89-7464-4ffb-bd59-512aa1ec0a7c-util" (OuterVolumeSpecName: "util") pod "34888d89-7464-4ffb-bd59-512aa1ec0a7c" (UID: "34888d89-7464-4ffb-bd59-512aa1ec0a7c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:59:33.651884 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:33.651848 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34888d89-7464-4ffb-bd59-512aa1ec0a7c-bundle\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:59:33.651884 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:33.651878 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34888d89-7464-4ffb-bd59-512aa1ec0a7c-util\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:59:33.651884 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:33.651891 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb2hb\" (UniqueName: \"kubernetes.io/projected/34888d89-7464-4ffb-bd59-512aa1ec0a7c-kube-api-access-mb2hb\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:59:34.275888 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:34.275854 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss" Jun 03 22:59:34.276056 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:34.275863 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06twrss" event={"ID":"34888d89-7464-4ffb-bd59-512aa1ec0a7c","Type":"ContainerDied","Data":"32bb4d1f8452a5d985a6cc289e7a8bd65074100f7db99ab2afa04d9cffd5220a"} Jun 03 22:59:34.276056 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:34.275977 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32bb4d1f8452a5d985a6cc289e7a8bd65074100f7db99ab2afa04d9cffd5220a" Jun 03 22:59:43.690615 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:43.690576 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf"] Jun 03 22:59:43.691002 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:43.690910 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34888d89-7464-4ffb-bd59-512aa1ec0a7c" containerName="pull" Jun 03 22:59:43.691002 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:43.690920 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="34888d89-7464-4ffb-bd59-512aa1ec0a7c" containerName="pull" Jun 03 22:59:43.691002 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:43.690935 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34888d89-7464-4ffb-bd59-512aa1ec0a7c" containerName="extract" Jun 03 22:59:43.691002 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:43.690941 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="34888d89-7464-4ffb-bd59-512aa1ec0a7c" containerName="extract" Jun 03 22:59:43.691002 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:43.690950 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34888d89-7464-4ffb-bd59-512aa1ec0a7c" containerName="util" Jun 03 22:59:43.691002 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:43.690956 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="34888d89-7464-4ffb-bd59-512aa1ec0a7c" containerName="util" Jun 03 22:59:43.691180 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:43.691009 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="34888d89-7464-4ffb-bd59-512aa1ec0a7c" containerName="extract" Jun 03 22:59:43.697655 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:43.697629 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf" Jun 03 22:59:43.723005 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:43.722976 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 22:59:43.724734 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:43.724719 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-grzxb\"" Jun 03 22:59:43.725040 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:43.725024 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 22:59:43.738966 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:43.738940 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf"] Jun 03 22:59:43.848319 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:43.848278 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf\" (UID: \"d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf" Jun 03 22:59:43.848489 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:43.848330 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf\" (UID: \"d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf" Jun 03 22:59:43.848489 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:43.848354 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpgp9\" (UniqueName: \"kubernetes.io/projected/d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd-kube-api-access-rpgp9\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf\" (UID: \"d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf" Jun 03 22:59:43.949566 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:43.949451 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf\" (UID: \"d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf" Jun 03 22:59:43.949566 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:43.949535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf\" (UID: \"d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf" Jun 03 22:59:43.949755 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:43.949566 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpgp9\" (UniqueName: \"kubernetes.io/projected/d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd-kube-api-access-rpgp9\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf\" (UID: \"d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf" Jun 03 22:59:43.949906 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:43.949885 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf\" (UID: \"d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf" Jun 03 22:59:43.949942 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:43.949891 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf\" (UID: \"d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf" Jun 03 22:59:43.980647 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:43.980610 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpgp9\" (UniqueName: \"kubernetes.io/projected/d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd-kube-api-access-rpgp9\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf\" (UID: \"d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf" Jun 03 22:59:44.006631 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:44.006594 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf" Jun 03 22:59:44.169262 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:44.169238 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf"] Jun 03 22:59:44.171685 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:59:44.171656 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd37e9dc0_b5c8_4fe4_a536_4e19c12b24cd.slice/crio-497d90f2052e5f8f95db83f1c515152b657ffff458a9d29bb75ded9e795246f3 WatchSource:0}: Error finding container 497d90f2052e5f8f95db83f1c515152b657ffff458a9d29bb75ded9e795246f3: Status 404 returned error can't find the container with id 497d90f2052e5f8f95db83f1c515152b657ffff458a9d29bb75ded9e795246f3 Jun 03 22:59:44.325858 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:44.325828 2576 generic.go:356] "Generic (PLEG): container finished" podID="d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd" containerID="b13f9a832da77cfd81c716d3b575b40fadcac377e558c1b0ce818599137d1b61" exitCode=0 Jun 03 22:59:44.326033 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:44.325911 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf" event={"ID":"d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd","Type":"ContainerDied","Data":"b13f9a832da77cfd81c716d3b575b40fadcac377e558c1b0ce818599137d1b61"} Jun 03 22:59:44.326033 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:44.325965 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf" event={"ID":"d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd","Type":"ContainerStarted","Data":"497d90f2052e5f8f95db83f1c515152b657ffff458a9d29bb75ded9e795246f3"} Jun 03 22:59:45.332442 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:45.332404 2576 generic.go:356] "Generic (PLEG): container finished" podID="d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd" containerID="0b1ab9f28868831e5d76823e7714a252dcba6ef4fcec0a1d7dd386b792b17069" exitCode=0 Jun 03 22:59:45.332867 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:45.332486 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf" event={"ID":"d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd","Type":"ContainerDied","Data":"0b1ab9f28868831e5d76823e7714a252dcba6ef4fcec0a1d7dd386b792b17069"} Jun 03 22:59:46.339205 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:46.339166 2576 generic.go:356] "Generic (PLEG): container finished" podID="d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd" containerID="07a53b935e6b33f290aec383736410e1fd33cd627d9b8eff256191e23f745ae0" exitCode=0 Jun 03 22:59:46.339586 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:46.339258 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf" event={"ID":"d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd","Type":"ContainerDied","Data":"07a53b935e6b33f290aec383736410e1fd33cd627d9b8eff256191e23f745ae0"} Jun 03 22:59:47.483964 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:47.483938 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf" Jun 03 22:59:47.578916 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:47.578877 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpgp9\" (UniqueName: \"kubernetes.io/projected/d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd-kube-api-access-rpgp9\") pod \"d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd\" (UID: \"d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd\") " Jun 03 22:59:47.579091 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:47.578939 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd-util\") pod \"d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd\" (UID: \"d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd\") " Jun 03 22:59:47.579091 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:47.579068 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd-bundle\") pod \"d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd\" (UID: \"d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd\") " Jun 03 22:59:47.579962 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:47.579937 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd-bundle" (OuterVolumeSpecName: "bundle") pod "d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd" (UID: "d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:59:47.581025 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:47.581002 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd-kube-api-access-rpgp9" (OuterVolumeSpecName: "kube-api-access-rpgp9") pod "d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd" (UID: "d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd"). InnerVolumeSpecName "kube-api-access-rpgp9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:59:47.584735 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:47.584712 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd-util" (OuterVolumeSpecName: "util") pod "d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd" (UID: "d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:59:47.680789 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:47.680702 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd-bundle\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:59:47.680789 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:47.680734 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpgp9\" (UniqueName: \"kubernetes.io/projected/d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd-kube-api-access-rpgp9\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:59:47.680789 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:47.680744 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd-util\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 22:59:48.350883 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:48.350854 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf" Jun 03 22:59:48.350883 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:48.350869 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alw2qf" event={"ID":"d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd","Type":"ContainerDied","Data":"497d90f2052e5f8f95db83f1c515152b657ffff458a9d29bb75ded9e795246f3"} Jun 03 22:59:48.351131 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:48.350909 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="497d90f2052e5f8f95db83f1c515152b657ffff458a9d29bb75ded9e795246f3" Jun 03 22:59:57.812525 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:57.812472 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-685f64df48-tj2g8"] Jun 03 22:59:57.813023 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:57.813001 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd" containerName="extract" Jun 03 22:59:57.813068 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:57.813027 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd" containerName="extract" Jun 03 22:59:57.813068 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:57.813049 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd" containerName="util" Jun 03 22:59:57.813068 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:57.813057 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd" containerName="util" Jun 03 22:59:57.813164 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:57.813084 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd" containerName="pull" Jun 03 22:59:57.813164 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:57.813093 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd" containerName="pull" Jun 03 22:59:57.813224 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:57.813190 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d37e9dc0-b5c8-4fe4-a536-4e19c12b24cd" containerName="extract" Jun 03 22:59:57.817681 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:57.817662 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-685f64df48-tj2g8" Jun 03 22:59:57.822036 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:57.822012 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vxt97\"" Jun 03 22:59:57.822164 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:57.822033 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 22:59:57.824696 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:57.824670 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-685f64df48-tj2g8"] Jun 03 22:59:57.874150 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:57.874121 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ac8c03e9-1cea-4b74-b838-13427719fe1a-redirect-config\") pod \"dashboard-redirect-685f64df48-tj2g8\" (UID: \"ac8c03e9-1cea-4b74-b838-13427719fe1a\") " pod="opendatahub/dashboard-redirect-685f64df48-tj2g8" Jun 03 22:59:57.874320 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:57.874185 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsddm\" (UniqueName: \"kubernetes.io/projected/ac8c03e9-1cea-4b74-b838-13427719fe1a-kube-api-access-tsddm\") pod \"dashboard-redirect-685f64df48-tj2g8\" (UID: \"ac8c03e9-1cea-4b74-b838-13427719fe1a\") " pod="opendatahub/dashboard-redirect-685f64df48-tj2g8" Jun 03 22:59:57.975207 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:57.975170 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsddm\" (UniqueName: \"kubernetes.io/projected/ac8c03e9-1cea-4b74-b838-13427719fe1a-kube-api-access-tsddm\") pod \"dashboard-redirect-685f64df48-tj2g8\" (UID: \"ac8c03e9-1cea-4b74-b838-13427719fe1a\") " pod="opendatahub/dashboard-redirect-685f64df48-tj2g8" Jun 03 22:59:57.975380 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:57.975242 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ac8c03e9-1cea-4b74-b838-13427719fe1a-redirect-config\") pod \"dashboard-redirect-685f64df48-tj2g8\" (UID: \"ac8c03e9-1cea-4b74-b838-13427719fe1a\") " pod="opendatahub/dashboard-redirect-685f64df48-tj2g8" Jun 03 22:59:57.976003 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:57.975981 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ac8c03e9-1cea-4b74-b838-13427719fe1a-redirect-config\") pod \"dashboard-redirect-685f64df48-tj2g8\" (UID: \"ac8c03e9-1cea-4b74-b838-13427719fe1a\") " pod="opendatahub/dashboard-redirect-685f64df48-tj2g8" Jun 03 22:59:57.982479 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:57.982451 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsddm\" (UniqueName: \"kubernetes.io/projected/ac8c03e9-1cea-4b74-b838-13427719fe1a-kube-api-access-tsddm\") pod \"dashboard-redirect-685f64df48-tj2g8\" (UID: \"ac8c03e9-1cea-4b74-b838-13427719fe1a\") " pod="opendatahub/dashboard-redirect-685f64df48-tj2g8" Jun 03 22:59:58.129024 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:58.128931 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-685f64df48-tj2g8" Jun 03 22:59:58.266420 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:58.266394 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-685f64df48-tj2g8"] Jun 03 22:59:58.268562 ip-10-0-140-99 kubenswrapper[2576]: W0603 22:59:58.268532 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac8c03e9_1cea_4b74_b838_13427719fe1a.slice/crio-4d6b8179f29683895fd7731d558c6668dc22a5990ffb7fe283252c0189a0ebb1 WatchSource:0}: Error finding container 4d6b8179f29683895fd7731d558c6668dc22a5990ffb7fe283252c0189a0ebb1: Status 404 returned error can't find the container with id 4d6b8179f29683895fd7731d558c6668dc22a5990ffb7fe283252c0189a0ebb1 Jun 03 22:59:58.401328 ip-10-0-140-99 kubenswrapper[2576]: I0603 22:59:58.401236 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-685f64df48-tj2g8" event={"ID":"ac8c03e9-1cea-4b74-b838-13427719fe1a","Type":"ContainerStarted","Data":"4d6b8179f29683895fd7731d558c6668dc22a5990ffb7fe283252c0189a0ebb1"} Jun 03 23:00:03.432474 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:03.432438 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-685f64df48-tj2g8" event={"ID":"ac8c03e9-1cea-4b74-b838-13427719fe1a","Type":"ContainerStarted","Data":"78af2c46280be4441cc3f010c71b02ab9da2d8cf6452be417cde2a1819dccf6c"} Jun 03 23:00:03.449009 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:03.448948 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-685f64df48-tj2g8" podStartSLOduration=1.707232427 podStartE2EDuration="6.448931331s" totalImagesPullingTime="4.741698904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:00:03.447868076 +0000 UTC m=+581.786520566" watchObservedRunningTime="2026-06-03 23:00:03.448931331 +0000 UTC m=+581.787583819" Jun 03 23:00:14.947628 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:14.947596 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q"] Jun 03 23:00:14.952470 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:14.952447 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:14.954574 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:14.954550 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-kpxds\"" Jun 03 23:00:14.954704 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:14.954582 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 23:00:14.964020 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:14.963995 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q"] Jun 03 23:00:15.032646 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.032605 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1dd9ac2-8f51-42d8-be38-6894028ae94a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.032814 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.032678 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1dd9ac2-8f51-42d8-be38-6894028ae94a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.032814 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.032709 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1dd9ac2-8f51-42d8-be38-6894028ae94a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.032814 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.032726 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1dd9ac2-8f51-42d8-be38-6894028ae94a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.032814 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.032760 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1dd9ac2-8f51-42d8-be38-6894028ae94a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.032962 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.032822 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1dd9ac2-8f51-42d8-be38-6894028ae94a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.032962 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.032875 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1dd9ac2-8f51-42d8-be38-6894028ae94a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.032962 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.032909 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1dd9ac2-8f51-42d8-be38-6894028ae94a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.032962 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.032928 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlbh7\" (UniqueName: \"kubernetes.io/projected/e1dd9ac2-8f51-42d8-be38-6894028ae94a-kube-api-access-dlbh7\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.133898 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.133864 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1dd9ac2-8f51-42d8-be38-6894028ae94a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.133898 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.133904 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1dd9ac2-8f51-42d8-be38-6894028ae94a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.134172 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.133927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1dd9ac2-8f51-42d8-be38-6894028ae94a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.134172 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.133947 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlbh7\" (UniqueName: \"kubernetes.io/projected/e1dd9ac2-8f51-42d8-be38-6894028ae94a-kube-api-access-dlbh7\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.134172 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.133970 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1dd9ac2-8f51-42d8-be38-6894028ae94a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.134172 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.134010 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1dd9ac2-8f51-42d8-be38-6894028ae94a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.134172 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.134044 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1dd9ac2-8f51-42d8-be38-6894028ae94a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.134488 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.134237 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1dd9ac2-8f51-42d8-be38-6894028ae94a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.134488 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.134299 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1dd9ac2-8f51-42d8-be38-6894028ae94a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.134488 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.134368 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1dd9ac2-8f51-42d8-be38-6894028ae94a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.134488 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.134429 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1dd9ac2-8f51-42d8-be38-6894028ae94a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.134753 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.134557 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1dd9ac2-8f51-42d8-be38-6894028ae94a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.134753 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.134732 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1dd9ac2-8f51-42d8-be38-6894028ae94a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.134831 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.134816 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1dd9ac2-8f51-42d8-be38-6894028ae94a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.136448 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.136427 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1dd9ac2-8f51-42d8-be38-6894028ae94a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.136632 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.136616 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1dd9ac2-8f51-42d8-be38-6894028ae94a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.141287 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.141260 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1dd9ac2-8f51-42d8-be38-6894028ae94a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.142097 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.142080 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlbh7\" (UniqueName: \"kubernetes.io/projected/e1dd9ac2-8f51-42d8-be38-6894028ae94a-kube-api-access-dlbh7\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcvv54q\" (UID: \"e1dd9ac2-8f51-42d8-be38-6894028ae94a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.263759 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.263652 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:15.402419 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.402393 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q"] Jun 03 23:00:15.404284 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:00:15.404259 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1dd9ac2_8f51_42d8_be38_6894028ae94a.slice/crio-49d29da633f27447ec706e8d244c3e77c331cbcaf7b0bea806d2e7393066871b WatchSource:0}: Error finding container 49d29da633f27447ec706e8d244c3e77c331cbcaf7b0bea806d2e7393066871b: Status 404 returned error can't find the container with id 49d29da633f27447ec706e8d244c3e77c331cbcaf7b0bea806d2e7393066871b Jun 03 23:00:15.494429 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:15.494389 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" event={"ID":"e1dd9ac2-8f51-42d8-be38-6894028ae94a","Type":"ContainerStarted","Data":"49d29da633f27447ec706e8d244c3e77c331cbcaf7b0bea806d2e7393066871b"} Jun 03 23:00:18.140777 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:18.140723 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 23:00:18.141036 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:18.140814 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 23:00:18.141036 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:18.140852 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 23:00:18.514362 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:18.514263 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" event={"ID":"e1dd9ac2-8f51-42d8-be38-6894028ae94a","Type":"ContainerStarted","Data":"0f3c89b615880710f5721c8cabad48157a5582bd665eb8b486ecbe057899f3e4"} Jun 03 23:00:18.533003 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:18.532951 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" podStartSLOduration=1.79883279 podStartE2EDuration="4.532931837s" totalImagesPullingTime="2.734099047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:00:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:00:18.531316966 +0000 UTC m=+596.869969468" watchObservedRunningTime="2026-06-03 23:00:18.532931837 +0000 UTC m=+596.871584325" Jun 03 23:00:19.264009 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:19.263979 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:19.269101 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:19.269076 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:19.519624 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:19.519535 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:19.520485 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:19.520466 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcvv54q" Jun 03 23:00:22.109810 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:22.109776 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvqlh_c1356fb0-4884-41e6-8d59-fed020dd7a80/ovn-acl-logging/0.log" Jun 03 23:00:22.110559 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:22.110536 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvqlh_c1356fb0-4884-41e6-8d59-fed020dd7a80/ovn-acl-logging/0.log" Jun 03 23:00:28.697989 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:28.697953 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zbqfg"] Jun 03 23:00:28.701190 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:28.701175 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zbqfg" Jun 03 23:00:28.704042 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:28.704018 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 23:00:28.704179 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:28.704018 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 23:00:28.704360 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:28.704340 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-rrlpx\"" Jun 03 23:00:28.714543 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:28.714484 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zbqfg"] Jun 03 23:00:28.870160 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:28.870126 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5vs8\" (UniqueName: \"kubernetes.io/projected/c46b7d02-70f1-41d0-902d-b4f53f160c9f-kube-api-access-x5vs8\") pod \"kuadrant-operator-catalog-zbqfg\" (UID: \"c46b7d02-70f1-41d0-902d-b4f53f160c9f\") " pod="kuadrant-system/kuadrant-operator-catalog-zbqfg" Jun 03 23:00:28.971505 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:28.971420 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5vs8\" (UniqueName: \"kubernetes.io/projected/c46b7d02-70f1-41d0-902d-b4f53f160c9f-kube-api-access-x5vs8\") pod \"kuadrant-operator-catalog-zbqfg\" (UID: \"c46b7d02-70f1-41d0-902d-b4f53f160c9f\") " pod="kuadrant-system/kuadrant-operator-catalog-zbqfg" Jun 03 23:00:28.978820 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:28.978794 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5vs8\" (UniqueName: \"kubernetes.io/projected/c46b7d02-70f1-41d0-902d-b4f53f160c9f-kube-api-access-x5vs8\") pod \"kuadrant-operator-catalog-zbqfg\" (UID: \"c46b7d02-70f1-41d0-902d-b4f53f160c9f\") " pod="kuadrant-system/kuadrant-operator-catalog-zbqfg" Jun 03 23:00:29.011867 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:29.011831 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zbqfg" Jun 03 23:00:29.042692 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:29.042663 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zbqfg"] Jun 03 23:00:29.144101 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:29.144070 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zbqfg"] Jun 03 23:00:29.145866 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:00:29.145839 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc46b7d02_70f1_41d0_902d_b4f53f160c9f.slice/crio-bc6040dbc37b628c443c0bda05a2fe3d00574ce15169a80932fcf2c582a5dbaa WatchSource:0}: Error finding container bc6040dbc37b628c443c0bda05a2fe3d00574ce15169a80932fcf2c582a5dbaa: Status 404 returned error can't find the container with id bc6040dbc37b628c443c0bda05a2fe3d00574ce15169a80932fcf2c582a5dbaa Jun 03 23:00:29.252836 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:29.252752 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-26bfs"] Jun 03 23:00:29.257462 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:29.257439 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-26bfs" Jun 03 23:00:29.263312 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:29.263286 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-26bfs"] Jun 03 23:00:29.374883 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:29.374843 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q78mv\" (UniqueName: \"kubernetes.io/projected/1f28ab11-c152-4b7a-9df9-bb746cd7f4c1-kube-api-access-q78mv\") pod \"kuadrant-operator-catalog-26bfs\" (UID: \"1f28ab11-c152-4b7a-9df9-bb746cd7f4c1\") " pod="kuadrant-system/kuadrant-operator-catalog-26bfs" Jun 03 23:00:29.475919 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:29.475876 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q78mv\" (UniqueName: \"kubernetes.io/projected/1f28ab11-c152-4b7a-9df9-bb746cd7f4c1-kube-api-access-q78mv\") pod \"kuadrant-operator-catalog-26bfs\" (UID: \"1f28ab11-c152-4b7a-9df9-bb746cd7f4c1\") " pod="kuadrant-system/kuadrant-operator-catalog-26bfs" Jun 03 23:00:29.483627 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:29.483606 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q78mv\" (UniqueName: \"kubernetes.io/projected/1f28ab11-c152-4b7a-9df9-bb746cd7f4c1-kube-api-access-q78mv\") pod \"kuadrant-operator-catalog-26bfs\" (UID: \"1f28ab11-c152-4b7a-9df9-bb746cd7f4c1\") " pod="kuadrant-system/kuadrant-operator-catalog-26bfs" Jun 03 23:00:29.568757 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:29.568730 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-26bfs" Jun 03 23:00:29.571149 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:29.571121 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zbqfg" event={"ID":"c46b7d02-70f1-41d0-902d-b4f53f160c9f","Type":"ContainerStarted","Data":"bc6040dbc37b628c443c0bda05a2fe3d00574ce15169a80932fcf2c582a5dbaa"} Jun 03 23:00:29.705917 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:29.705779 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-26bfs"] Jun 03 23:00:29.708421 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:00:29.708391 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f28ab11_c152_4b7a_9df9_bb746cd7f4c1.slice/crio-ffc2be03bd9e68a9d59feb3a349260dc96fc9208e5a905167fb90c09fbd89165 WatchSource:0}: Error finding container ffc2be03bd9e68a9d59feb3a349260dc96fc9208e5a905167fb90c09fbd89165: Status 404 returned error can't find the container with id ffc2be03bd9e68a9d59feb3a349260dc96fc9208e5a905167fb90c09fbd89165 Jun 03 23:00:30.580367 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:30.580231 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-26bfs" event={"ID":"1f28ab11-c152-4b7a-9df9-bb746cd7f4c1","Type":"ContainerStarted","Data":"ffc2be03bd9e68a9d59feb3a349260dc96fc9208e5a905167fb90c09fbd89165"} Jun 03 23:00:31.587943 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:31.587899 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zbqfg" event={"ID":"c46b7d02-70f1-41d0-902d-b4f53f160c9f","Type":"ContainerStarted","Data":"70a09068a63d481b6e4c1ee907a0e945eed8b8900f7cfd2b777da9f460d5fab8"} Jun 03 23:00:31.588443 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:31.588001 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-zbqfg" podUID="c46b7d02-70f1-41d0-902d-b4f53f160c9f" containerName="registry-server" containerID="cri-o://70a09068a63d481b6e4c1ee907a0e945eed8b8900f7cfd2b777da9f460d5fab8" gracePeriod=2 Jun 03 23:00:31.589997 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:31.589970 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-26bfs" event={"ID":"1f28ab11-c152-4b7a-9df9-bb746cd7f4c1","Type":"ContainerStarted","Data":"b7a35157807a6884e04c0cff6f7760e82b1214065635c5a983e1dd42490e5dbe"} Jun 03 23:00:31.605174 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:31.605124 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zbqfg" podStartSLOduration=1.31959465 podStartE2EDuration="3.605108435s" totalImagesPullingTime="2.285513785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:00:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:00:31.603486746 +0000 UTC m=+609.942139235" watchObservedRunningTime="2026-06-03 23:00:31.605108435 +0000 UTC m=+609.943760923" Jun 03 23:00:31.621038 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:31.620984 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-26bfs" podStartSLOduration=0.893275082 podStartE2EDuration="2.620969437s" totalImagesPullingTime="1.727694355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:00:31.619052566 +0000 UTC m=+609.957705082" watchObservedRunningTime="2026-06-03 23:00:31.620969437 +0000 UTC m=+609.959621924" Jun 03 23:00:31.939210 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:31.939184 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zbqfg" Jun 03 23:00:32.103611 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:32.103583 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5vs8\" (UniqueName: \"kubernetes.io/projected/c46b7d02-70f1-41d0-902d-b4f53f160c9f-kube-api-access-x5vs8\") pod \"c46b7d02-70f1-41d0-902d-b4f53f160c9f\" (UID: \"c46b7d02-70f1-41d0-902d-b4f53f160c9f\") " Jun 03 23:00:32.105716 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:32.105683 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c46b7d02-70f1-41d0-902d-b4f53f160c9f-kube-api-access-x5vs8" (OuterVolumeSpecName: "kube-api-access-x5vs8") pod "c46b7d02-70f1-41d0-902d-b4f53f160c9f" (UID: "c46b7d02-70f1-41d0-902d-b4f53f160c9f"). InnerVolumeSpecName "kube-api-access-x5vs8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:00:32.204851 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:32.204816 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5vs8\" (UniqueName: \"kubernetes.io/projected/c46b7d02-70f1-41d0-902d-b4f53f160c9f-kube-api-access-x5vs8\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:00:32.596685 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:32.596649 2576 generic.go:356] "Generic (PLEG): container finished" podID="c46b7d02-70f1-41d0-902d-b4f53f160c9f" containerID="70a09068a63d481b6e4c1ee907a0e945eed8b8900f7cfd2b777da9f460d5fab8" exitCode=0 Jun 03 23:00:32.597168 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:32.596691 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zbqfg" Jun 03 23:00:32.597168 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:32.596724 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zbqfg" event={"ID":"c46b7d02-70f1-41d0-902d-b4f53f160c9f","Type":"ContainerDied","Data":"70a09068a63d481b6e4c1ee907a0e945eed8b8900f7cfd2b777da9f460d5fab8"} Jun 03 23:00:32.597168 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:32.596772 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zbqfg" event={"ID":"c46b7d02-70f1-41d0-902d-b4f53f160c9f","Type":"ContainerDied","Data":"bc6040dbc37b628c443c0bda05a2fe3d00574ce15169a80932fcf2c582a5dbaa"} Jun 03 23:00:32.597168 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:32.596801 2576 scope.go:117] "RemoveContainer" containerID="70a09068a63d481b6e4c1ee907a0e945eed8b8900f7cfd2b777da9f460d5fab8" Jun 03 23:00:32.605849 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:32.605826 2576 scope.go:117] "RemoveContainer" containerID="70a09068a63d481b6e4c1ee907a0e945eed8b8900f7cfd2b777da9f460d5fab8" Jun 03 23:00:32.606106 ip-10-0-140-99 kubenswrapper[2576]: E0603 23:00:32.606087 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70a09068a63d481b6e4c1ee907a0e945eed8b8900f7cfd2b777da9f460d5fab8\": container with ID starting with 70a09068a63d481b6e4c1ee907a0e945eed8b8900f7cfd2b777da9f460d5fab8 not found: ID does not exist" containerID="70a09068a63d481b6e4c1ee907a0e945eed8b8900f7cfd2b777da9f460d5fab8" Jun 03 23:00:32.606168 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:32.606113 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70a09068a63d481b6e4c1ee907a0e945eed8b8900f7cfd2b777da9f460d5fab8"} err="failed to get container status \"70a09068a63d481b6e4c1ee907a0e945eed8b8900f7cfd2b777da9f460d5fab8\": rpc error: code = NotFound desc = could not find container \"70a09068a63d481b6e4c1ee907a0e945eed8b8900f7cfd2b777da9f460d5fab8\": container with ID starting with 70a09068a63d481b6e4c1ee907a0e945eed8b8900f7cfd2b777da9f460d5fab8 not found: ID does not exist" Jun 03 23:00:32.613567 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:32.613542 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zbqfg"] Jun 03 23:00:32.616760 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:32.616736 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zbqfg"] Jun 03 23:00:34.117373 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:34.117344 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c46b7d02-70f1-41d0-902d-b4f53f160c9f" path="/var/lib/kubelet/pods/c46b7d02-70f1-41d0-902d-b4f53f160c9f/volumes" Jun 03 23:00:39.569076 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:39.569033 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-26bfs" Jun 03 23:00:39.569501 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:39.569102 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-26bfs" Jun 03 23:00:39.592882 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:39.592855 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-26bfs" Jun 03 23:00:39.653521 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:39.653478 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-26bfs" Jun 03 23:00:44.028259 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.028218 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg"] Jun 03 23:00:44.028770 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.028750 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c46b7d02-70f1-41d0-902d-b4f53f160c9f" containerName="registry-server" Jun 03 23:00:44.028846 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.028774 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c46b7d02-70f1-41d0-902d-b4f53f160c9f" containerName="registry-server" Jun 03 23:00:44.028908 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.028888 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c46b7d02-70f1-41d0-902d-b4f53f160c9f" containerName="registry-server" Jun 03 23:00:44.046050 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.046023 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg"] Jun 03 23:00:44.046200 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.046146 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg" Jun 03 23:00:44.048222 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.048197 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-r9xr4\"" Jun 03 23:00:44.113769 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.113735 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vprnp\" (UniqueName: \"kubernetes.io/projected/53e9b424-db33-4e1f-b60f-73a8cc5e53d2-kube-api-access-vprnp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg\" (UID: \"53e9b424-db33-4e1f-b60f-73a8cc5e53d2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg" Jun 03 23:00:44.113996 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.113834 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53e9b424-db33-4e1f-b60f-73a8cc5e53d2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg\" (UID: \"53e9b424-db33-4e1f-b60f-73a8cc5e53d2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg" Jun 03 23:00:44.113996 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.113879 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53e9b424-db33-4e1f-b60f-73a8cc5e53d2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg\" (UID: \"53e9b424-db33-4e1f-b60f-73a8cc5e53d2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg" Jun 03 23:00:44.214883 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.214845 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vprnp\" (UniqueName: \"kubernetes.io/projected/53e9b424-db33-4e1f-b60f-73a8cc5e53d2-kube-api-access-vprnp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg\" (UID: \"53e9b424-db33-4e1f-b60f-73a8cc5e53d2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg" Jun 03 23:00:44.215076 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.214933 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53e9b424-db33-4e1f-b60f-73a8cc5e53d2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg\" (UID: \"53e9b424-db33-4e1f-b60f-73a8cc5e53d2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg" Jun 03 23:00:44.215076 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.214961 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53e9b424-db33-4e1f-b60f-73a8cc5e53d2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg\" (UID: \"53e9b424-db33-4e1f-b60f-73a8cc5e53d2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg" Jun 03 23:00:44.215330 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.215313 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53e9b424-db33-4e1f-b60f-73a8cc5e53d2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg\" (UID: \"53e9b424-db33-4e1f-b60f-73a8cc5e53d2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg" Jun 03 23:00:44.215370 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.215357 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53e9b424-db33-4e1f-b60f-73a8cc5e53d2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg\" (UID: \"53e9b424-db33-4e1f-b60f-73a8cc5e53d2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg" Jun 03 23:00:44.223386 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.223359 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vprnp\" (UniqueName: \"kubernetes.io/projected/53e9b424-db33-4e1f-b60f-73a8cc5e53d2-kube-api-access-vprnp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg\" (UID: \"53e9b424-db33-4e1f-b60f-73a8cc5e53d2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg" Jun 03 23:00:44.355479 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.355437 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg" Jun 03 23:00:44.494200 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.494169 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg"] Jun 03 23:00:44.496528 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:00:44.496488 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53e9b424_db33_4e1f_b60f_73a8cc5e53d2.slice/crio-af9365483d5f4208d0a536a6391a834fa04c771b1d8eefd6dbe98447079a1db5 WatchSource:0}: Error finding container af9365483d5f4208d0a536a6391a834fa04c771b1d8eefd6dbe98447079a1db5: Status 404 returned error can't find the container with id af9365483d5f4208d0a536a6391a834fa04c771b1d8eefd6dbe98447079a1db5 Jun 03 23:00:44.628580 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.628494 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t"] Jun 03 23:00:44.631213 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.631198 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t" Jun 03 23:00:44.639421 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.639388 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t"] Jun 03 23:00:44.657458 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.657423 2576 generic.go:356] "Generic (PLEG): container finished" podID="53e9b424-db33-4e1f-b60f-73a8cc5e53d2" containerID="cb90fd9f55486e7248a75313aadf647ee391ea419667e912b61e8ad0b30b4b6e" exitCode=0 Jun 03 23:00:44.657644 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.657503 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg" event={"ID":"53e9b424-db33-4e1f-b60f-73a8cc5e53d2","Type":"ContainerDied","Data":"cb90fd9f55486e7248a75313aadf647ee391ea419667e912b61e8ad0b30b4b6e"} Jun 03 23:00:44.657644 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.657574 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg" event={"ID":"53e9b424-db33-4e1f-b60f-73a8cc5e53d2","Type":"ContainerStarted","Data":"af9365483d5f4208d0a536a6391a834fa04c771b1d8eefd6dbe98447079a1db5"} Jun 03 23:00:44.720384 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.720352 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2831ff51-1122-4231-bd19-68fd965b4f29-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t\" (UID: \"2831ff51-1122-4231-bd19-68fd965b4f29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t" Jun 03 23:00:44.720553 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.720395 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2831ff51-1122-4231-bd19-68fd965b4f29-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t\" (UID: \"2831ff51-1122-4231-bd19-68fd965b4f29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t" Jun 03 23:00:44.720553 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.720488 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shtnp\" (UniqueName: \"kubernetes.io/projected/2831ff51-1122-4231-bd19-68fd965b4f29-kube-api-access-shtnp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t\" (UID: \"2831ff51-1122-4231-bd19-68fd965b4f29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t" Jun 03 23:00:44.821095 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.821062 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2831ff51-1122-4231-bd19-68fd965b4f29-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t\" (UID: \"2831ff51-1122-4231-bd19-68fd965b4f29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t" Jun 03 23:00:44.821277 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.821107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2831ff51-1122-4231-bd19-68fd965b4f29-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t\" (UID: \"2831ff51-1122-4231-bd19-68fd965b4f29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t" Jun 03 23:00:44.821277 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.821151 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shtnp\" (UniqueName: \"kubernetes.io/projected/2831ff51-1122-4231-bd19-68fd965b4f29-kube-api-access-shtnp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t\" (UID: \"2831ff51-1122-4231-bd19-68fd965b4f29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t" Jun 03 23:00:44.821464 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.821441 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2831ff51-1122-4231-bd19-68fd965b4f29-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t\" (UID: \"2831ff51-1122-4231-bd19-68fd965b4f29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t" Jun 03 23:00:44.821561 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.821491 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2831ff51-1122-4231-bd19-68fd965b4f29-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t\" (UID: \"2831ff51-1122-4231-bd19-68fd965b4f29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t" Jun 03 23:00:44.830664 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.830641 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shtnp\" (UniqueName: \"kubernetes.io/projected/2831ff51-1122-4231-bd19-68fd965b4f29-kube-api-access-shtnp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t\" (UID: \"2831ff51-1122-4231-bd19-68fd965b4f29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t" Jun 03 23:00:44.977186 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:44.977088 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t" Jun 03 23:00:45.115477 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.115447 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t"] Jun 03 23:00:45.117359 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:00:45.117324 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2831ff51_1122_4231_bd19_68fd965b4f29.slice/crio-26162f46a364d182be8752a6ae13d3b50f6edc176b1be73fd767226e3582276e WatchSource:0}: Error finding container 26162f46a364d182be8752a6ae13d3b50f6edc176b1be73fd767226e3582276e: Status 404 returned error can't find the container with id 26162f46a364d182be8752a6ae13d3b50f6edc176b1be73fd767226e3582276e Jun 03 23:00:45.234310 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.234232 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c"] Jun 03 23:00:45.237021 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.237005 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c" Jun 03 23:00:45.245590 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.245561 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c"] Jun 03 23:00:45.326432 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.326396 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd1391ea-9919-4781-9560-23a62a54c899-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c\" (UID: \"bd1391ea-9919-4781-9560-23a62a54c899\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c" Jun 03 23:00:45.326633 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.326563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd1391ea-9919-4781-9560-23a62a54c899-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c\" (UID: \"bd1391ea-9919-4781-9560-23a62a54c899\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c" Jun 03 23:00:45.326696 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.326657 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78dnl\" (UniqueName: \"kubernetes.io/projected/bd1391ea-9919-4781-9560-23a62a54c899-kube-api-access-78dnl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c\" (UID: \"bd1391ea-9919-4781-9560-23a62a54c899\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c" Jun 03 23:00:45.427544 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.427504 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd1391ea-9919-4781-9560-23a62a54c899-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c\" (UID: \"bd1391ea-9919-4781-9560-23a62a54c899\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c" Jun 03 23:00:45.427668 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.427576 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78dnl\" (UniqueName: \"kubernetes.io/projected/bd1391ea-9919-4781-9560-23a62a54c899-kube-api-access-78dnl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c\" (UID: \"bd1391ea-9919-4781-9560-23a62a54c899\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c" Jun 03 23:00:45.427668 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.427613 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd1391ea-9919-4781-9560-23a62a54c899-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c\" (UID: \"bd1391ea-9919-4781-9560-23a62a54c899\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c" Jun 03 23:00:45.427928 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.427903 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd1391ea-9919-4781-9560-23a62a54c899-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c\" (UID: \"bd1391ea-9919-4781-9560-23a62a54c899\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c" Jun 03 23:00:45.428026 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.427942 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd1391ea-9919-4781-9560-23a62a54c899-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c\" (UID: \"bd1391ea-9919-4781-9560-23a62a54c899\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c" Jun 03 23:00:45.435110 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.435081 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78dnl\" (UniqueName: \"kubernetes.io/projected/bd1391ea-9919-4781-9560-23a62a54c899-kube-api-access-78dnl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c\" (UID: \"bd1391ea-9919-4781-9560-23a62a54c899\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c" Jun 03 23:00:45.591827 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.591790 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c" Jun 03 23:00:45.669899 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.667778 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69"] Jun 03 23:00:45.673449 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.673406 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69"] Jun 03 23:00:45.673627 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.673536 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69" Jun 03 23:00:45.677803 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.677771 2576 generic.go:356] "Generic (PLEG): container finished" podID="2831ff51-1122-4231-bd19-68fd965b4f29" containerID="986e396c54a774672424e39b489ffcf238e752ae0d6c176a1ab14d290673441b" exitCode=0 Jun 03 23:00:45.677924 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.677852 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t" event={"ID":"2831ff51-1122-4231-bd19-68fd965b4f29","Type":"ContainerDied","Data":"986e396c54a774672424e39b489ffcf238e752ae0d6c176a1ab14d290673441b"} Jun 03 23:00:45.677924 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.677898 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t" event={"ID":"2831ff51-1122-4231-bd19-68fd965b4f29","Type":"ContainerStarted","Data":"26162f46a364d182be8752a6ae13d3b50f6edc176b1be73fd767226e3582276e"} Jun 03 23:00:45.680553 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.680525 2576 generic.go:356] "Generic (PLEG): container finished" podID="53e9b424-db33-4e1f-b60f-73a8cc5e53d2" containerID="e8c611cb0049d8655c69769ee3b3f4fc7ae33f95ed936b00b12415c738242893" exitCode=0 Jun 03 23:00:45.680682 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.680622 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg" event={"ID":"53e9b424-db33-4e1f-b60f-73a8cc5e53d2","Type":"ContainerDied","Data":"e8c611cb0049d8655c69769ee3b3f4fc7ae33f95ed936b00b12415c738242893"} Jun 03 23:00:45.730493 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.730458 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lczq4\" (UniqueName: \"kubernetes.io/projected/1238ece7-710e-471e-950c-40589caa6ce5-kube-api-access-lczq4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69\" (UID: \"1238ece7-710e-471e-950c-40589caa6ce5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69" Jun 03 23:00:45.730678 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.730588 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1238ece7-710e-471e-950c-40589caa6ce5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69\" (UID: \"1238ece7-710e-471e-950c-40589caa6ce5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69" Jun 03 23:00:45.730736 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.730699 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1238ece7-710e-471e-950c-40589caa6ce5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69\" (UID: \"1238ece7-710e-471e-950c-40589caa6ce5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69" Jun 03 23:00:45.757750 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.757725 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c"] Jun 03 23:00:45.759691 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:00:45.759667 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd1391ea_9919_4781_9560_23a62a54c899.slice/crio-5e060658257e2c6fd6ec769918ded8054c0fd87cf6fcf4c49f65a3f43b698777 WatchSource:0}: Error finding container 5e060658257e2c6fd6ec769918ded8054c0fd87cf6fcf4c49f65a3f43b698777: Status 404 returned error can't find the container with id 5e060658257e2c6fd6ec769918ded8054c0fd87cf6fcf4c49f65a3f43b698777 Jun 03 23:00:45.831523 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.831482 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lczq4\" (UniqueName: \"kubernetes.io/projected/1238ece7-710e-471e-950c-40589caa6ce5-kube-api-access-lczq4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69\" (UID: \"1238ece7-710e-471e-950c-40589caa6ce5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69" Jun 03 23:00:45.831654 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.831569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1238ece7-710e-471e-950c-40589caa6ce5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69\" (UID: \"1238ece7-710e-471e-950c-40589caa6ce5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69" Jun 03 23:00:45.831714 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.831676 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1238ece7-710e-471e-950c-40589caa6ce5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69\" (UID: \"1238ece7-710e-471e-950c-40589caa6ce5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69" Jun 03 23:00:45.832138 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.832110 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1238ece7-710e-471e-950c-40589caa6ce5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69\" (UID: \"1238ece7-710e-471e-950c-40589caa6ce5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69" Jun 03 23:00:45.832236 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.832154 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1238ece7-710e-471e-950c-40589caa6ce5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69\" (UID: \"1238ece7-710e-471e-950c-40589caa6ce5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69" Jun 03 23:00:45.846002 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.845977 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lczq4\" (UniqueName: \"kubernetes.io/projected/1238ece7-710e-471e-950c-40589caa6ce5-kube-api-access-lczq4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69\" (UID: \"1238ece7-710e-471e-950c-40589caa6ce5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69" Jun 03 23:00:45.986657 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:45.986617 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69" Jun 03 23:00:46.121025 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:46.120997 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69"] Jun 03 23:00:46.122453 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:00:46.122427 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1238ece7_710e_471e_950c_40589caa6ce5.slice/crio-8915d11f9c47514b3a3cba4c43d94ddcb0de426e965280b249b4f2fa1f65aa56 WatchSource:0}: Error finding container 8915d11f9c47514b3a3cba4c43d94ddcb0de426e965280b249b4f2fa1f65aa56: Status 404 returned error can't find the container with id 8915d11f9c47514b3a3cba4c43d94ddcb0de426e965280b249b4f2fa1f65aa56 Jun 03 23:00:46.688112 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:46.688018 2576 generic.go:356] "Generic (PLEG): container finished" podID="bd1391ea-9919-4781-9560-23a62a54c899" containerID="528188bf3017c578e88163fa8da73c8515f4b0398b73f13a73096cd4caa29de2" exitCode=0 Jun 03 23:00:46.688112 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:46.688072 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c" event={"ID":"bd1391ea-9919-4781-9560-23a62a54c899","Type":"ContainerDied","Data":"528188bf3017c578e88163fa8da73c8515f4b0398b73f13a73096cd4caa29de2"} Jun 03 23:00:46.688336 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:46.688123 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c" event={"ID":"bd1391ea-9919-4781-9560-23a62a54c899","Type":"ContainerStarted","Data":"5e060658257e2c6fd6ec769918ded8054c0fd87cf6fcf4c49f65a3f43b698777"} Jun 03 23:00:46.689833 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:46.689810 2576 generic.go:356] "Generic (PLEG): container finished" podID="1238ece7-710e-471e-950c-40589caa6ce5" containerID="f3c8a57790187970e45f79e978d6fbf67274faf4a647bbda410ad984a28c8209" exitCode=0 Jun 03 23:00:46.689965 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:46.689886 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69" event={"ID":"1238ece7-710e-471e-950c-40589caa6ce5","Type":"ContainerDied","Data":"f3c8a57790187970e45f79e978d6fbf67274faf4a647bbda410ad984a28c8209"} Jun 03 23:00:46.689965 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:46.689937 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69" event={"ID":"1238ece7-710e-471e-950c-40589caa6ce5","Type":"ContainerStarted","Data":"8915d11f9c47514b3a3cba4c43d94ddcb0de426e965280b249b4f2fa1f65aa56"} Jun 03 23:00:46.691983 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:46.691959 2576 generic.go:356] "Generic (PLEG): container finished" podID="2831ff51-1122-4231-bd19-68fd965b4f29" containerID="f3280d2527ab0c393ec6c258deac942475e6ae67c2f58788b7c0b5be5f81a2f4" exitCode=0 Jun 03 23:00:46.692096 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:46.692044 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t" event={"ID":"2831ff51-1122-4231-bd19-68fd965b4f29","Type":"ContainerDied","Data":"f3280d2527ab0c393ec6c258deac942475e6ae67c2f58788b7c0b5be5f81a2f4"} Jun 03 23:00:46.694359 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:46.694338 2576 generic.go:356] "Generic (PLEG): container finished" podID="53e9b424-db33-4e1f-b60f-73a8cc5e53d2" containerID="b864d93adc7625089d6cbe91a1e58e7d111712224322d34cf74f24407d4475a0" exitCode=0 Jun 03 23:00:46.694445 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:46.694377 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg" event={"ID":"53e9b424-db33-4e1f-b60f-73a8cc5e53d2","Type":"ContainerDied","Data":"b864d93adc7625089d6cbe91a1e58e7d111712224322d34cf74f24407d4475a0"} Jun 03 23:00:47.701495 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:47.701454 2576 generic.go:356] "Generic (PLEG): container finished" podID="1238ece7-710e-471e-950c-40589caa6ce5" containerID="54e53ffbf2b6ea99079699b1444ac8fa4dba6596ea385b464b43c2abcd4adc77" exitCode=0 Jun 03 23:00:47.701975 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:47.701551 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69" event={"ID":"1238ece7-710e-471e-950c-40589caa6ce5","Type":"ContainerDied","Data":"54e53ffbf2b6ea99079699b1444ac8fa4dba6596ea385b464b43c2abcd4adc77"} Jun 03 23:00:47.703935 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:47.703912 2576 generic.go:356] "Generic (PLEG): container finished" podID="2831ff51-1122-4231-bd19-68fd965b4f29" containerID="d695081d92ab61c91738b85a47c57244846b5ef7014d2b099309e1d4bc9e971c" exitCode=0 Jun 03 23:00:47.704049 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:47.703995 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t" event={"ID":"2831ff51-1122-4231-bd19-68fd965b4f29","Type":"ContainerDied","Data":"d695081d92ab61c91738b85a47c57244846b5ef7014d2b099309e1d4bc9e971c"} Jun 03 23:00:47.706049 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:47.706029 2576 generic.go:356] "Generic (PLEG): container finished" podID="bd1391ea-9919-4781-9560-23a62a54c899" containerID="98cd475ff9406945c02aa852b6710d7b676e3ba03ff40d05b6d654a2ae288b6f" exitCode=0 Jun 03 23:00:47.706122 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:47.706100 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c" event={"ID":"bd1391ea-9919-4781-9560-23a62a54c899","Type":"ContainerDied","Data":"98cd475ff9406945c02aa852b6710d7b676e3ba03ff40d05b6d654a2ae288b6f"} Jun 03 23:00:47.839989 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:47.839934 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg" Jun 03 23:00:47.948311 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:47.948280 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vprnp\" (UniqueName: \"kubernetes.io/projected/53e9b424-db33-4e1f-b60f-73a8cc5e53d2-kube-api-access-vprnp\") pod \"53e9b424-db33-4e1f-b60f-73a8cc5e53d2\" (UID: \"53e9b424-db33-4e1f-b60f-73a8cc5e53d2\") " Jun 03 23:00:47.948478 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:47.948339 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53e9b424-db33-4e1f-b60f-73a8cc5e53d2-bundle\") pod \"53e9b424-db33-4e1f-b60f-73a8cc5e53d2\" (UID: \"53e9b424-db33-4e1f-b60f-73a8cc5e53d2\") " Jun 03 23:00:47.948478 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:47.948374 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53e9b424-db33-4e1f-b60f-73a8cc5e53d2-util\") pod \"53e9b424-db33-4e1f-b60f-73a8cc5e53d2\" (UID: \"53e9b424-db33-4e1f-b60f-73a8cc5e53d2\") " Jun 03 23:00:47.948960 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:47.948928 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53e9b424-db33-4e1f-b60f-73a8cc5e53d2-bundle" (OuterVolumeSpecName: "bundle") pod "53e9b424-db33-4e1f-b60f-73a8cc5e53d2" (UID: "53e9b424-db33-4e1f-b60f-73a8cc5e53d2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:00:47.950432 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:47.950406 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53e9b424-db33-4e1f-b60f-73a8cc5e53d2-kube-api-access-vprnp" (OuterVolumeSpecName: "kube-api-access-vprnp") pod "53e9b424-db33-4e1f-b60f-73a8cc5e53d2" (UID: "53e9b424-db33-4e1f-b60f-73a8cc5e53d2"). InnerVolumeSpecName "kube-api-access-vprnp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:00:47.954024 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:47.953991 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53e9b424-db33-4e1f-b60f-73a8cc5e53d2-util" (OuterVolumeSpecName: "util") pod "53e9b424-db33-4e1f-b60f-73a8cc5e53d2" (UID: "53e9b424-db33-4e1f-b60f-73a8cc5e53d2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:00:48.049860 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:48.049811 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53e9b424-db33-4e1f-b60f-73a8cc5e53d2-bundle\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:00:48.049860 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:48.049853 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53e9b424-db33-4e1f-b60f-73a8cc5e53d2-util\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:00:48.049860 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:48.049863 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vprnp\" (UniqueName: \"kubernetes.io/projected/53e9b424-db33-4e1f-b60f-73a8cc5e53d2-kube-api-access-vprnp\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:00:48.713120 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:48.713081 2576 generic.go:356] "Generic (PLEG): container finished" podID="bd1391ea-9919-4781-9560-23a62a54c899" containerID="e2c2734befe63951f0a0fb160811c31930c03f9650e7b02e87a2119a25434a86" exitCode=0 Jun 03 23:00:48.713606 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:48.713153 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c" event={"ID":"bd1391ea-9919-4781-9560-23a62a54c899","Type":"ContainerDied","Data":"e2c2734befe63951f0a0fb160811c31930c03f9650e7b02e87a2119a25434a86"} Jun 03 23:00:48.715182 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:48.715159 2576 generic.go:356] "Generic (PLEG): container finished" podID="1238ece7-710e-471e-950c-40589caa6ce5" containerID="955ee6e5aad8877a00345529db83b063177bc95e9abe8de75ea0fdc437a0a060" exitCode=0 Jun 03 23:00:48.715280 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:48.715237 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69" event={"ID":"1238ece7-710e-471e-950c-40589caa6ce5","Type":"ContainerDied","Data":"955ee6e5aad8877a00345529db83b063177bc95e9abe8de75ea0fdc437a0a060"} Jun 03 23:00:48.717111 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:48.717093 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg" Jun 03 23:00:48.717233 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:48.717120 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg" event={"ID":"53e9b424-db33-4e1f-b60f-73a8cc5e53d2","Type":"ContainerDied","Data":"af9365483d5f4208d0a536a6391a834fa04c771b1d8eefd6dbe98447079a1db5"} Jun 03 23:00:48.717233 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:48.717149 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af9365483d5f4208d0a536a6391a834fa04c771b1d8eefd6dbe98447079a1db5" Jun 03 23:00:48.850950 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:48.850923 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t" Jun 03 23:00:48.959606 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:48.959559 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2831ff51-1122-4231-bd19-68fd965b4f29-util\") pod \"2831ff51-1122-4231-bd19-68fd965b4f29\" (UID: \"2831ff51-1122-4231-bd19-68fd965b4f29\") " Jun 03 23:00:48.959606 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:48.959617 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2831ff51-1122-4231-bd19-68fd965b4f29-bundle\") pod \"2831ff51-1122-4231-bd19-68fd965b4f29\" (UID: \"2831ff51-1122-4231-bd19-68fd965b4f29\") " Jun 03 23:00:48.959845 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:48.959697 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shtnp\" (UniqueName: \"kubernetes.io/projected/2831ff51-1122-4231-bd19-68fd965b4f29-kube-api-access-shtnp\") pod \"2831ff51-1122-4231-bd19-68fd965b4f29\" (UID: \"2831ff51-1122-4231-bd19-68fd965b4f29\") " Jun 03 23:00:48.960195 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:48.960170 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2831ff51-1122-4231-bd19-68fd965b4f29-bundle" (OuterVolumeSpecName: "bundle") pod "2831ff51-1122-4231-bd19-68fd965b4f29" (UID: "2831ff51-1122-4231-bd19-68fd965b4f29"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:00:48.961849 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:48.961819 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2831ff51-1122-4231-bd19-68fd965b4f29-kube-api-access-shtnp" (OuterVolumeSpecName: "kube-api-access-shtnp") pod "2831ff51-1122-4231-bd19-68fd965b4f29" (UID: "2831ff51-1122-4231-bd19-68fd965b4f29"). InnerVolumeSpecName "kube-api-access-shtnp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:00:48.964814 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:48.964751 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2831ff51-1122-4231-bd19-68fd965b4f29-util" (OuterVolumeSpecName: "util") pod "2831ff51-1122-4231-bd19-68fd965b4f29" (UID: "2831ff51-1122-4231-bd19-68fd965b4f29"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:00:49.061135 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:49.061098 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2831ff51-1122-4231-bd19-68fd965b4f29-util\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:00:49.061135 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:49.061130 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2831ff51-1122-4231-bd19-68fd965b4f29-bundle\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:00:49.061135 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:49.061139 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shtnp\" (UniqueName: \"kubernetes.io/projected/2831ff51-1122-4231-bd19-68fd965b4f29-kube-api-access-shtnp\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:00:49.725225 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:49.725192 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t" Jun 03 23:00:49.725225 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:49.725208 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t" event={"ID":"2831ff51-1122-4231-bd19-68fd965b4f29","Type":"ContainerDied","Data":"26162f46a364d182be8752a6ae13d3b50f6edc176b1be73fd767226e3582276e"} Jun 03 23:00:49.725726 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:49.725262 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26162f46a364d182be8752a6ae13d3b50f6edc176b1be73fd767226e3582276e" Jun 03 23:00:49.887661 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:49.887636 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69" Jun 03 23:00:49.890804 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:49.890778 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c" Jun 03 23:00:49.969897 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:49.969865 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lczq4\" (UniqueName: \"kubernetes.io/projected/1238ece7-710e-471e-950c-40589caa6ce5-kube-api-access-lczq4\") pod \"1238ece7-710e-471e-950c-40589caa6ce5\" (UID: \"1238ece7-710e-471e-950c-40589caa6ce5\") " Jun 03 23:00:49.970100 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:49.969910 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1238ece7-710e-471e-950c-40589caa6ce5-bundle\") pod \"1238ece7-710e-471e-950c-40589caa6ce5\" (UID: \"1238ece7-710e-471e-950c-40589caa6ce5\") " Jun 03 23:00:49.970100 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:49.969984 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd1391ea-9919-4781-9560-23a62a54c899-bundle\") pod \"bd1391ea-9919-4781-9560-23a62a54c899\" (UID: \"bd1391ea-9919-4781-9560-23a62a54c899\") " Jun 03 23:00:49.970100 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:49.970002 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1238ece7-710e-471e-950c-40589caa6ce5-util\") pod \"1238ece7-710e-471e-950c-40589caa6ce5\" (UID: \"1238ece7-710e-471e-950c-40589caa6ce5\") " Jun 03 23:00:49.970100 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:49.970033 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd1391ea-9919-4781-9560-23a62a54c899-util\") pod \"bd1391ea-9919-4781-9560-23a62a54c899\" (UID: \"bd1391ea-9919-4781-9560-23a62a54c899\") " Jun 03 23:00:49.970100 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:49.970068 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78dnl\" (UniqueName: \"kubernetes.io/projected/bd1391ea-9919-4781-9560-23a62a54c899-kube-api-access-78dnl\") pod \"bd1391ea-9919-4781-9560-23a62a54c899\" (UID: \"bd1391ea-9919-4781-9560-23a62a54c899\") " Jun 03 23:00:49.970545 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:49.970493 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd1391ea-9919-4781-9560-23a62a54c899-bundle" (OuterVolumeSpecName: "bundle") pod "bd1391ea-9919-4781-9560-23a62a54c899" (UID: "bd1391ea-9919-4781-9560-23a62a54c899"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:00:49.970628 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:49.970550 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1238ece7-710e-471e-950c-40589caa6ce5-bundle" (OuterVolumeSpecName: "bundle") pod "1238ece7-710e-471e-950c-40589caa6ce5" (UID: "1238ece7-710e-471e-950c-40589caa6ce5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:00:49.972227 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:49.972197 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1238ece7-710e-471e-950c-40589caa6ce5-kube-api-access-lczq4" (OuterVolumeSpecName: "kube-api-access-lczq4") pod "1238ece7-710e-471e-950c-40589caa6ce5" (UID: "1238ece7-710e-471e-950c-40589caa6ce5"). InnerVolumeSpecName "kube-api-access-lczq4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:00:49.972344 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:49.972316 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd1391ea-9919-4781-9560-23a62a54c899-kube-api-access-78dnl" (OuterVolumeSpecName: "kube-api-access-78dnl") pod "bd1391ea-9919-4781-9560-23a62a54c899" (UID: "bd1391ea-9919-4781-9560-23a62a54c899"). InnerVolumeSpecName "kube-api-access-78dnl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:00:49.975784 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:49.975719 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1238ece7-710e-471e-950c-40589caa6ce5-util" (OuterVolumeSpecName: "util") pod "1238ece7-710e-471e-950c-40589caa6ce5" (UID: "1238ece7-710e-471e-950c-40589caa6ce5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:00:49.975958 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:49.975939 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd1391ea-9919-4781-9560-23a62a54c899-util" (OuterVolumeSpecName: "util") pod "bd1391ea-9919-4781-9560-23a62a54c899" (UID: "bd1391ea-9919-4781-9560-23a62a54c899"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:00:50.071306 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:50.071270 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd1391ea-9919-4781-9560-23a62a54c899-bundle\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:00:50.071306 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:50.071299 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1238ece7-710e-471e-950c-40589caa6ce5-util\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:00:50.071306 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:50.071308 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd1391ea-9919-4781-9560-23a62a54c899-util\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:00:50.071306 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:50.071315 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78dnl\" (UniqueName: \"kubernetes.io/projected/bd1391ea-9919-4781-9560-23a62a54c899-kube-api-access-78dnl\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:00:50.071611 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:50.071326 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lczq4\" (UniqueName: \"kubernetes.io/projected/1238ece7-710e-471e-950c-40589caa6ce5-kube-api-access-lczq4\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:00:50.071611 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:50.071334 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1238ece7-710e-471e-950c-40589caa6ce5-bundle\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:00:50.732860 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:50.732830 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69" Jun 03 23:00:50.732860 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:50.732852 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69" event={"ID":"1238ece7-710e-471e-950c-40589caa6ce5","Type":"ContainerDied","Data":"8915d11f9c47514b3a3cba4c43d94ddcb0de426e965280b249b4f2fa1f65aa56"} Jun 03 23:00:50.733322 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:50.732945 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8915d11f9c47514b3a3cba4c43d94ddcb0de426e965280b249b4f2fa1f65aa56" Jun 03 23:00:50.734930 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:50.734898 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c" event={"ID":"bd1391ea-9919-4781-9560-23a62a54c899","Type":"ContainerDied","Data":"5e060658257e2c6fd6ec769918ded8054c0fd87cf6fcf4c49f65a3f43b698777"} Jun 03 23:00:50.735070 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:50.734939 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c" Jun 03 23:00:50.735070 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:50.734949 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e060658257e2c6fd6ec769918ded8054c0fd87cf6fcf4c49f65a3f43b698777" Jun 03 23:00:53.246937 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.246907 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-r464s"] Jun 03 23:00:53.247329 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247239 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53e9b424-db33-4e1f-b60f-73a8cc5e53d2" containerName="pull" Jun 03 23:00:53.247329 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247249 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="53e9b424-db33-4e1f-b60f-73a8cc5e53d2" containerName="pull" Jun 03 23:00:53.247329 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247257 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1238ece7-710e-471e-950c-40589caa6ce5" containerName="extract" Jun 03 23:00:53.247329 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247262 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1238ece7-710e-471e-950c-40589caa6ce5" containerName="extract" Jun 03 23:00:53.247329 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247271 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2831ff51-1122-4231-bd19-68fd965b4f29" containerName="pull" Jun 03 23:00:53.247329 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247277 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2831ff51-1122-4231-bd19-68fd965b4f29" containerName="pull" Jun 03 23:00:53.247329 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247288 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53e9b424-db33-4e1f-b60f-73a8cc5e53d2" containerName="util" Jun 03 23:00:53.247329 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247294 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="53e9b424-db33-4e1f-b60f-73a8cc5e53d2" containerName="util" Jun 03 23:00:53.247329 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247300 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2831ff51-1122-4231-bd19-68fd965b4f29" containerName="util" Jun 03 23:00:53.247329 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247305 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2831ff51-1122-4231-bd19-68fd965b4f29" containerName="util" Jun 03 23:00:53.247329 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247311 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53e9b424-db33-4e1f-b60f-73a8cc5e53d2" containerName="extract" Jun 03 23:00:53.247329 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247315 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="53e9b424-db33-4e1f-b60f-73a8cc5e53d2" containerName="extract" Jun 03 23:00:53.247329 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247320 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd1391ea-9919-4781-9560-23a62a54c899" containerName="util" Jun 03 23:00:53.247329 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247325 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd1391ea-9919-4781-9560-23a62a54c899" containerName="util" Jun 03 23:00:53.247329 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247331 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd1391ea-9919-4781-9560-23a62a54c899" containerName="pull" Jun 03 23:00:53.247329 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247336 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd1391ea-9919-4781-9560-23a62a54c899" containerName="pull" Jun 03 23:00:53.247823 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247343 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd1391ea-9919-4781-9560-23a62a54c899" containerName="extract" Jun 03 23:00:53.247823 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247349 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd1391ea-9919-4781-9560-23a62a54c899" containerName="extract" Jun 03 23:00:53.247823 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247361 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1238ece7-710e-471e-950c-40589caa6ce5" containerName="pull" Jun 03 23:00:53.247823 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247366 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1238ece7-710e-471e-950c-40589caa6ce5" containerName="pull" Jun 03 23:00:53.247823 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247371 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1238ece7-710e-471e-950c-40589caa6ce5" containerName="util" Jun 03 23:00:53.247823 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247375 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1238ece7-710e-471e-950c-40589caa6ce5" containerName="util" Jun 03 23:00:53.247823 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247383 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2831ff51-1122-4231-bd19-68fd965b4f29" containerName="extract" Jun 03 23:00:53.247823 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247388 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2831ff51-1122-4231-bd19-68fd965b4f29" containerName="extract" Jun 03 23:00:53.247823 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247442 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd1391ea-9919-4781-9560-23a62a54c899" containerName="extract" Jun 03 23:00:53.247823 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247450 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="53e9b424-db33-4e1f-b60f-73a8cc5e53d2" containerName="extract" Jun 03 23:00:53.247823 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247458 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1238ece7-710e-471e-950c-40589caa6ce5" containerName="extract" Jun 03 23:00:53.247823 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.247464 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2831ff51-1122-4231-bd19-68fd965b4f29" containerName="extract" Jun 03 23:00:53.254857 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.254837 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r464s" Jun 03 23:00:53.257018 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.256993 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 03 23:00:53.257215 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.257200 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-x47d4\"" Jun 03 23:00:53.266943 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.266920 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-r464s"] Jun 03 23:00:53.299881 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.299850 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m5xv\" (UniqueName: \"kubernetes.io/projected/5b1633dd-d4fc-4d1f-a1b6-a515d7b50b12-kube-api-access-8m5xv\") pod \"dns-operator-controller-manager-864dd78c4c-r464s\" (UID: \"5b1633dd-d4fc-4d1f-a1b6-a515d7b50b12\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r464s" Jun 03 23:00:53.400657 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.400621 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m5xv\" (UniqueName: \"kubernetes.io/projected/5b1633dd-d4fc-4d1f-a1b6-a515d7b50b12-kube-api-access-8m5xv\") pod \"dns-operator-controller-manager-864dd78c4c-r464s\" (UID: \"5b1633dd-d4fc-4d1f-a1b6-a515d7b50b12\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r464s" Jun 03 23:00:53.416688 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.416660 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m5xv\" (UniqueName: \"kubernetes.io/projected/5b1633dd-d4fc-4d1f-a1b6-a515d7b50b12-kube-api-access-8m5xv\") pod \"dns-operator-controller-manager-864dd78c4c-r464s\" (UID: \"5b1633dd-d4fc-4d1f-a1b6-a515d7b50b12\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r464s" Jun 03 23:00:53.565333 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.565296 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r464s" Jun 03 23:00:53.709305 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.709147 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-r464s"] Jun 03 23:00:53.712239 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:00:53.712211 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b1633dd_d4fc_4d1f_a1b6_a515d7b50b12.slice/crio-cdc65024f2ef046be64b2dd21a5dfd6ba6eb4b7bf90d0381ba908350cb1159b2 WatchSource:0}: Error finding container cdc65024f2ef046be64b2dd21a5dfd6ba6eb4b7bf90d0381ba908350cb1159b2: Status 404 returned error can't find the container with id cdc65024f2ef046be64b2dd21a5dfd6ba6eb4b7bf90d0381ba908350cb1159b2 Jun 03 23:00:53.755631 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:53.755599 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r464s" event={"ID":"5b1633dd-d4fc-4d1f-a1b6-a515d7b50b12","Type":"ContainerStarted","Data":"cdc65024f2ef046be64b2dd21a5dfd6ba6eb4b7bf90d0381ba908350cb1159b2"} Jun 03 23:00:56.775701 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:56.775661 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r464s" event={"ID":"5b1633dd-d4fc-4d1f-a1b6-a515d7b50b12","Type":"ContainerStarted","Data":"ae906c0c0983a787ec2c5cd5f815ec568a7fb4ced70d21d7290de0a6271bed39"} Jun 03 23:00:56.776099 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:56.775790 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r464s" Jun 03 23:00:56.812044 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:56.811990 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r464s" podStartSLOduration=1.675617774 podStartE2EDuration="3.811974148s" totalImagesPullingTime="2.136356374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:00:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:00:56.810503484 +0000 UTC m=+635.149155972" watchObservedRunningTime="2026-06-03 23:00:56.811974148 +0000 UTC m=+635.150626705" Jun 03 23:00:59.716277 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:59.716243 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c"] Jun 03 23:00:59.719834 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:59.719816 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c" Jun 03 23:00:59.721758 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:59.721735 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nckxq\"" Jun 03 23:00:59.732975 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:59.732946 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c"] Jun 03 23:00:59.855180 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:59.855143 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93841083-5e50-4649-9ae4-70d7c9c0141d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z8c2c\" (UID: \"93841083-5e50-4649-9ae4-70d7c9c0141d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c" Jun 03 23:00:59.855180 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:59.855191 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbdsb\" (UniqueName: \"kubernetes.io/projected/93841083-5e50-4649-9ae4-70d7c9c0141d-kube-api-access-mbdsb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z8c2c\" (UID: \"93841083-5e50-4649-9ae4-70d7c9c0141d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c" Jun 03 23:00:59.956538 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:59.956479 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93841083-5e50-4649-9ae4-70d7c9c0141d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z8c2c\" (UID: \"93841083-5e50-4649-9ae4-70d7c9c0141d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c" Jun 03 23:00:59.956725 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:59.956554 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbdsb\" (UniqueName: \"kubernetes.io/projected/93841083-5e50-4649-9ae4-70d7c9c0141d-kube-api-access-mbdsb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z8c2c\" (UID: \"93841083-5e50-4649-9ae4-70d7c9c0141d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c" Jun 03 23:00:59.956918 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:59.956886 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93841083-5e50-4649-9ae4-70d7c9c0141d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z8c2c\" (UID: \"93841083-5e50-4649-9ae4-70d7c9c0141d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c" Jun 03 23:00:59.966104 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:00:59.966073 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbdsb\" (UniqueName: \"kubernetes.io/projected/93841083-5e50-4649-9ae4-70d7c9c0141d-kube-api-access-mbdsb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z8c2c\" (UID: \"93841083-5e50-4649-9ae4-70d7c9c0141d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c" Jun 03 23:01:00.030655 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:00.030557 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c" Jun 03 23:01:00.169541 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:00.169487 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c"] Jun 03 23:01:00.171572 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:01:00.171546 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93841083_5e50_4649_9ae4_70d7c9c0141d.slice/crio-3b3097012b07ea241e26e7f725a0569f9f38af225d3e031775426d0d7e87bbb8 WatchSource:0}: Error finding container 3b3097012b07ea241e26e7f725a0569f9f38af225d3e031775426d0d7e87bbb8: Status 404 returned error can't find the container with id 3b3097012b07ea241e26e7f725a0569f9f38af225d3e031775426d0d7e87bbb8 Jun 03 23:01:00.800487 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:00.800448 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c" event={"ID":"93841083-5e50-4649-9ae4-70d7c9c0141d","Type":"ContainerStarted","Data":"3b3097012b07ea241e26e7f725a0569f9f38af225d3e031775426d0d7e87bbb8"} Jun 03 23:01:04.825455 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:04.825419 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c" event={"ID":"93841083-5e50-4649-9ae4-70d7c9c0141d","Type":"ContainerStarted","Data":"6de7283d17e31bb77ee376a88aa46358b4fd068e9ee28f1e843d63565d6453e7"} Jun 03 23:01:04.825840 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:04.825557 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c" Jun 03 23:01:04.846038 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:04.845986 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c" podStartSLOduration=1.632748507 podStartE2EDuration="5.845970543s" totalImagesPullingTime="4.213222036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:01:04.843308713 +0000 UTC m=+643.181961200" watchObservedRunningTime="2026-06-03 23:01:04.845970543 +0000 UTC m=+643.184623031" Jun 03 23:01:07.510152 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:07.510115 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bszrz"] Jun 03 23:01:07.512945 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:07.512926 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bszrz" Jun 03 23:01:07.514920 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:07.514897 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 03 23:01:07.514920 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:07.514911 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 03 23:01:07.515099 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:07.514912 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-r9xr4\"" Jun 03 23:01:07.526923 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:07.526897 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bszrz"] Jun 03 23:01:07.631694 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:07.631655 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csfb5\" (UniqueName: \"kubernetes.io/projected/81158ffe-395f-4b2c-ab89-3642f2dff532-kube-api-access-csfb5\") pod \"kuadrant-console-plugin-66b5774985-bszrz\" (UID: \"81158ffe-395f-4b2c-ab89-3642f2dff532\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bszrz" Jun 03 23:01:07.631872 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:07.631705 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/81158ffe-395f-4b2c-ab89-3642f2dff532-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bszrz\" (UID: \"81158ffe-395f-4b2c-ab89-3642f2dff532\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bszrz" Jun 03 23:01:07.631872 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:07.631820 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/81158ffe-395f-4b2c-ab89-3642f2dff532-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bszrz\" (UID: \"81158ffe-395f-4b2c-ab89-3642f2dff532\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bszrz" Jun 03 23:01:07.733193 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:07.733152 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/81158ffe-395f-4b2c-ab89-3642f2dff532-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bszrz\" (UID: \"81158ffe-395f-4b2c-ab89-3642f2dff532\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bszrz" Jun 03 23:01:07.733193 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:07.733200 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csfb5\" (UniqueName: \"kubernetes.io/projected/81158ffe-395f-4b2c-ab89-3642f2dff532-kube-api-access-csfb5\") pod \"kuadrant-console-plugin-66b5774985-bszrz\" (UID: \"81158ffe-395f-4b2c-ab89-3642f2dff532\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bszrz" Jun 03 23:01:07.733453 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:07.733230 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/81158ffe-395f-4b2c-ab89-3642f2dff532-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bszrz\" (UID: \"81158ffe-395f-4b2c-ab89-3642f2dff532\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bszrz" Jun 03 23:01:07.733927 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:07.733906 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/81158ffe-395f-4b2c-ab89-3642f2dff532-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bszrz\" (UID: \"81158ffe-395f-4b2c-ab89-3642f2dff532\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bszrz" Jun 03 23:01:07.735739 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:07.735717 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/81158ffe-395f-4b2c-ab89-3642f2dff532-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bszrz\" (UID: \"81158ffe-395f-4b2c-ab89-3642f2dff532\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bszrz" Jun 03 23:01:07.743095 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:07.743068 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csfb5\" (UniqueName: \"kubernetes.io/projected/81158ffe-395f-4b2c-ab89-3642f2dff532-kube-api-access-csfb5\") pod \"kuadrant-console-plugin-66b5774985-bszrz\" (UID: \"81158ffe-395f-4b2c-ab89-3642f2dff532\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bszrz" Jun 03 23:01:07.782758 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:07.782666 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r464s" Jun 03 23:01:07.822213 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:07.822177 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bszrz" Jun 03 23:01:07.967200 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:07.967171 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bszrz"] Jun 03 23:01:07.969231 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:01:07.969203 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81158ffe_395f_4b2c_ab89_3642f2dff532.slice/crio-b2671b8a6fa9e95a1530a90243262e9f4aee7f6352dd377b4a407fd9d94aca2f WatchSource:0}: Error finding container b2671b8a6fa9e95a1530a90243262e9f4aee7f6352dd377b4a407fd9d94aca2f: Status 404 returned error can't find the container with id b2671b8a6fa9e95a1530a90243262e9f4aee7f6352dd377b4a407fd9d94aca2f Jun 03 23:01:07.970576 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:07.970560 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 23:01:08.077806 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.077772 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6855658c4-bgcpz"] Jun 03 23:01:08.081240 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.081217 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:08.095025 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.094983 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6855658c4-bgcpz"] Jun 03 23:01:08.238690 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.238655 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46f32a08-efc5-4d7d-80f8-91fc3d0d88a0-console-oauth-config\") pod \"console-6855658c4-bgcpz\" (UID: \"46f32a08-efc5-4d7d-80f8-91fc3d0d88a0\") " pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:08.238690 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.238693 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46f32a08-efc5-4d7d-80f8-91fc3d0d88a0-service-ca\") pod \"console-6855658c4-bgcpz\" (UID: \"46f32a08-efc5-4d7d-80f8-91fc3d0d88a0\") " pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:08.238915 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.238711 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46f32a08-efc5-4d7d-80f8-91fc3d0d88a0-oauth-serving-cert\") pod \"console-6855658c4-bgcpz\" (UID: \"46f32a08-efc5-4d7d-80f8-91fc3d0d88a0\") " pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:08.238915 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.238731 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46f32a08-efc5-4d7d-80f8-91fc3d0d88a0-console-serving-cert\") pod \"console-6855658c4-bgcpz\" (UID: \"46f32a08-efc5-4d7d-80f8-91fc3d0d88a0\") " pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:08.238915 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.238794 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wftqf\" (UniqueName: \"kubernetes.io/projected/46f32a08-efc5-4d7d-80f8-91fc3d0d88a0-kube-api-access-wftqf\") pod \"console-6855658c4-bgcpz\" (UID: \"46f32a08-efc5-4d7d-80f8-91fc3d0d88a0\") " pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:08.238915 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.238858 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f32a08-efc5-4d7d-80f8-91fc3d0d88a0-trusted-ca-bundle\") pod \"console-6855658c4-bgcpz\" (UID: \"46f32a08-efc5-4d7d-80f8-91fc3d0d88a0\") " pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:08.238915 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.238903 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46f32a08-efc5-4d7d-80f8-91fc3d0d88a0-console-config\") pod \"console-6855658c4-bgcpz\" (UID: \"46f32a08-efc5-4d7d-80f8-91fc3d0d88a0\") " pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:08.339883 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.339794 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46f32a08-efc5-4d7d-80f8-91fc3d0d88a0-console-config\") pod \"console-6855658c4-bgcpz\" (UID: \"46f32a08-efc5-4d7d-80f8-91fc3d0d88a0\") " pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:08.340062 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.339891 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46f32a08-efc5-4d7d-80f8-91fc3d0d88a0-console-oauth-config\") pod \"console-6855658c4-bgcpz\" (UID: \"46f32a08-efc5-4d7d-80f8-91fc3d0d88a0\") " pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:08.340062 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.339906 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46f32a08-efc5-4d7d-80f8-91fc3d0d88a0-service-ca\") pod \"console-6855658c4-bgcpz\" (UID: \"46f32a08-efc5-4d7d-80f8-91fc3d0d88a0\") " pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:08.340062 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.339921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46f32a08-efc5-4d7d-80f8-91fc3d0d88a0-oauth-serving-cert\") pod \"console-6855658c4-bgcpz\" (UID: \"46f32a08-efc5-4d7d-80f8-91fc3d0d88a0\") " pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:08.340062 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.339939 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46f32a08-efc5-4d7d-80f8-91fc3d0d88a0-console-serving-cert\") pod \"console-6855658c4-bgcpz\" (UID: \"46f32a08-efc5-4d7d-80f8-91fc3d0d88a0\") " pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:08.340062 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.339968 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wftqf\" (UniqueName: \"kubernetes.io/projected/46f32a08-efc5-4d7d-80f8-91fc3d0d88a0-kube-api-access-wftqf\") pod \"console-6855658c4-bgcpz\" (UID: \"46f32a08-efc5-4d7d-80f8-91fc3d0d88a0\") " pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:08.340062 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.339994 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f32a08-efc5-4d7d-80f8-91fc3d0d88a0-trusted-ca-bundle\") pod \"console-6855658c4-bgcpz\" (UID: \"46f32a08-efc5-4d7d-80f8-91fc3d0d88a0\") " pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:08.340725 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.340695 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46f32a08-efc5-4d7d-80f8-91fc3d0d88a0-console-config\") pod \"console-6855658c4-bgcpz\" (UID: \"46f32a08-efc5-4d7d-80f8-91fc3d0d88a0\") " pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:08.340853 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.340708 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46f32a08-efc5-4d7d-80f8-91fc3d0d88a0-oauth-serving-cert\") pod \"console-6855658c4-bgcpz\" (UID: \"46f32a08-efc5-4d7d-80f8-91fc3d0d88a0\") " pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:08.340853 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.340832 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f32a08-efc5-4d7d-80f8-91fc3d0d88a0-trusted-ca-bundle\") pod \"console-6855658c4-bgcpz\" (UID: \"46f32a08-efc5-4d7d-80f8-91fc3d0d88a0\") " pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:08.340991 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.340874 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46f32a08-efc5-4d7d-80f8-91fc3d0d88a0-service-ca\") pod \"console-6855658c4-bgcpz\" (UID: \"46f32a08-efc5-4d7d-80f8-91fc3d0d88a0\") " pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:08.342492 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.342462 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46f32a08-efc5-4d7d-80f8-91fc3d0d88a0-console-oauth-config\") pod \"console-6855658c4-bgcpz\" (UID: \"46f32a08-efc5-4d7d-80f8-91fc3d0d88a0\") " pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:08.342647 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.342624 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46f32a08-efc5-4d7d-80f8-91fc3d0d88a0-console-serving-cert\") pod \"console-6855658c4-bgcpz\" (UID: \"46f32a08-efc5-4d7d-80f8-91fc3d0d88a0\") " pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:08.356328 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.356304 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wftqf\" (UniqueName: \"kubernetes.io/projected/46f32a08-efc5-4d7d-80f8-91fc3d0d88a0-kube-api-access-wftqf\") pod \"console-6855658c4-bgcpz\" (UID: \"46f32a08-efc5-4d7d-80f8-91fc3d0d88a0\") " pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:08.391358 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.391325 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:08.537925 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.537899 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6855658c4-bgcpz"] Jun 03 23:01:08.539977 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:01:08.539953 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46f32a08_efc5_4d7d_80f8_91fc3d0d88a0.slice/crio-be6cbb027708ab2f2941c7925b92366e7415f7bd4310c858b8806656512beda9 WatchSource:0}: Error finding container be6cbb027708ab2f2941c7925b92366e7415f7bd4310c858b8806656512beda9: Status 404 returned error can't find the container with id be6cbb027708ab2f2941c7925b92366e7415f7bd4310c858b8806656512beda9 Jun 03 23:01:08.855162 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.855003 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6855658c4-bgcpz" event={"ID":"46f32a08-efc5-4d7d-80f8-91fc3d0d88a0","Type":"ContainerStarted","Data":"1bf116239e2d22bea253a591fe26f97cc643beaaa66fb17fa1548e97388caa8b"} Jun 03 23:01:08.855162 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.855076 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6855658c4-bgcpz" event={"ID":"46f32a08-efc5-4d7d-80f8-91fc3d0d88a0","Type":"ContainerStarted","Data":"be6cbb027708ab2f2941c7925b92366e7415f7bd4310c858b8806656512beda9"} Jun 03 23:01:08.856488 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.856457 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bszrz" event={"ID":"81158ffe-395f-4b2c-ab89-3642f2dff532","Type":"ContainerStarted","Data":"b2671b8a6fa9e95a1530a90243262e9f4aee7f6352dd377b4a407fd9d94aca2f"} Jun 03 23:01:08.875833 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:08.875759 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6855658c4-bgcpz" podStartSLOduration=0.875737869 podStartE2EDuration="875.737869ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:01:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:01:08.87341189 +0000 UTC m=+647.212064374" watchObservedRunningTime="2026-06-03 23:01:08.875737869 +0000 UTC m=+647.214390358" Jun 03 23:01:15.834649 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:15.834616 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c" Jun 03 23:01:17.948182 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:17.948150 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c"] Jun 03 23:01:17.948665 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:17.948375 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c" podUID="93841083-5e50-4649-9ae4-70d7c9c0141d" containerName="manager" containerID="cri-o://6de7283d17e31bb77ee376a88aa46358b4fd068e9ee28f1e843d63565d6453e7" gracePeriod=2 Jun 03 23:01:17.958146 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:17.957947 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c"] Jun 03 23:01:18.026089 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:18.026050 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6td7"] Jun 03 23:01:18.026597 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:18.026579 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93841083-5e50-4649-9ae4-70d7c9c0141d" containerName="manager" Jun 03 23:01:18.026597 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:18.026597 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="93841083-5e50-4649-9ae4-70d7c9c0141d" containerName="manager" Jun 03 23:01:18.026760 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:18.026733 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="93841083-5e50-4649-9ae4-70d7c9c0141d" containerName="manager" Jun 03 23:01:18.030007 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:18.029979 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6td7" Jun 03 23:01:18.033674 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:18.033600 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-7cn94\"" Jun 03 23:01:18.047999 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:18.047965 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6td7"] Jun 03 23:01:18.093376 ip-10-0-140-99 kubenswrapper[2576]: E0603 23:01:18.093327 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z8c2c\" is forbidden: User \"system:node:ip-10-0-140-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-99.ec2.internal' and this object" podUID="93841083-5e50-4649-9ae4-70d7c9c0141d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c" Jun 03 23:01:18.144080 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:18.144044 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxmx9\" (UniqueName: \"kubernetes.io/projected/d7b9b472-1262-4409-aada-d6914d1d72ba-kube-api-access-hxmx9\") pod \"limitador-operator-controller-manager-859d7b78bd-n6td7\" (UID: \"d7b9b472-1262-4409-aada-d6914d1d72ba\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6td7" Jun 03 23:01:18.245362 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:18.245259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxmx9\" (UniqueName: \"kubernetes.io/projected/d7b9b472-1262-4409-aada-d6914d1d72ba-kube-api-access-hxmx9\") pod \"limitador-operator-controller-manager-859d7b78bd-n6td7\" (UID: \"d7b9b472-1262-4409-aada-d6914d1d72ba\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6td7" Jun 03 23:01:18.256791 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:18.256759 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxmx9\" (UniqueName: \"kubernetes.io/projected/d7b9b472-1262-4409-aada-d6914d1d72ba-kube-api-access-hxmx9\") pod \"limitador-operator-controller-manager-859d7b78bd-n6td7\" (UID: \"d7b9b472-1262-4409-aada-d6914d1d72ba\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6td7" Jun 03 23:01:18.344642 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:18.344591 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6td7" Jun 03 23:01:18.392474 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:18.392439 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:18.392667 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:18.392518 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:18.398375 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:18.398346 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:18.929997 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:18.929966 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6855658c4-bgcpz" Jun 03 23:01:18.998278 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:18.998249 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d8df56f5-z487m"] Jun 03 23:01:19.157667 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:19.157638 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxxxv"] Jun 03 23:01:19.166892 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:19.166861 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxxxv" Jun 03 23:01:19.181242 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:19.181173 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxxxv"] Jun 03 23:01:19.256000 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:19.255966 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73489b68-7e4c-4d0b-95dd-984ce04bbe8d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mxxxv\" (UID: \"73489b68-7e4c-4d0b-95dd-984ce04bbe8d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxxxv" Jun 03 23:01:19.256180 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:19.256018 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2hkm\" (UniqueName: \"kubernetes.io/projected/73489b68-7e4c-4d0b-95dd-984ce04bbe8d-kube-api-access-g2hkm\") pod \"kuadrant-operator-controller-manager-86878c769f-mxxxv\" (UID: \"73489b68-7e4c-4d0b-95dd-984ce04bbe8d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxxxv" Jun 03 23:01:19.356902 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:19.356849 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73489b68-7e4c-4d0b-95dd-984ce04bbe8d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mxxxv\" (UID: \"73489b68-7e4c-4d0b-95dd-984ce04bbe8d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxxxv" Jun 03 23:01:19.357091 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:19.356940 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2hkm\" (UniqueName: \"kubernetes.io/projected/73489b68-7e4c-4d0b-95dd-984ce04bbe8d-kube-api-access-g2hkm\") pod \"kuadrant-operator-controller-manager-86878c769f-mxxxv\" (UID: \"73489b68-7e4c-4d0b-95dd-984ce04bbe8d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxxxv" Jun 03 23:01:19.357318 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:19.357280 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73489b68-7e4c-4d0b-95dd-984ce04bbe8d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mxxxv\" (UID: \"73489b68-7e4c-4d0b-95dd-984ce04bbe8d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxxxv" Jun 03 23:01:19.377639 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:19.377606 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2hkm\" (UniqueName: \"kubernetes.io/projected/73489b68-7e4c-4d0b-95dd-984ce04bbe8d-kube-api-access-g2hkm\") pod \"kuadrant-operator-controller-manager-86878c769f-mxxxv\" (UID: \"73489b68-7e4c-4d0b-95dd-984ce04bbe8d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxxxv" Jun 03 23:01:19.481308 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:19.481216 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxxxv" Jun 03 23:01:31.179117 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:31.179088 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c" Jun 03 23:01:31.180851 ip-10-0-140-99 kubenswrapper[2576]: E0603 23:01:31.180814 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z8c2c\" is forbidden: User \"system:node:ip-10-0-140-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-99.ec2.internal' and this object" podUID="93841083-5e50-4649-9ae4-70d7c9c0141d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c" Jun 03 23:01:31.217733 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:31.217705 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxxxv"] Jun 03 23:01:31.219425 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:01:31.219403 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73489b68_7e4c_4d0b_95dd_984ce04bbe8d.slice/crio-4b427c44050e0a53eee8f21819a915d0ff55b24f47019671b901e3f3ed1b0972 WatchSource:0}: Error finding container 4b427c44050e0a53eee8f21819a915d0ff55b24f47019671b901e3f3ed1b0972: Status 404 returned error can't find the container with id 4b427c44050e0a53eee8f21819a915d0ff55b24f47019671b901e3f3ed1b0972 Jun 03 23:01:31.233699 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:31.233619 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6td7"] Jun 03 23:01:31.236703 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:01:31.236675 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7b9b472_1262_4409_aada_d6914d1d72ba.slice/crio-117862bf31db075436192ebf5efc895c863db9271a2d09ad75436a04cd134e92 WatchSource:0}: Error finding container 117862bf31db075436192ebf5efc895c863db9271a2d09ad75436a04cd134e92: Status 404 returned error can't find the container with id 117862bf31db075436192ebf5efc895c863db9271a2d09ad75436a04cd134e92 Jun 03 23:01:31.284135 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:31.284084 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbdsb\" (UniqueName: \"kubernetes.io/projected/93841083-5e50-4649-9ae4-70d7c9c0141d-kube-api-access-mbdsb\") pod \"93841083-5e50-4649-9ae4-70d7c9c0141d\" (UID: \"93841083-5e50-4649-9ae4-70d7c9c0141d\") " Jun 03 23:01:31.284288 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:31.284213 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93841083-5e50-4649-9ae4-70d7c9c0141d-extensions-socket-volume\") pod \"93841083-5e50-4649-9ae4-70d7c9c0141d\" (UID: \"93841083-5e50-4649-9ae4-70d7c9c0141d\") " Jun 03 23:01:31.284712 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:31.284686 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93841083-5e50-4649-9ae4-70d7c9c0141d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "93841083-5e50-4649-9ae4-70d7c9c0141d" (UID: "93841083-5e50-4649-9ae4-70d7c9c0141d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:01:31.286055 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:31.286035 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93841083-5e50-4649-9ae4-70d7c9c0141d-kube-api-access-mbdsb" (OuterVolumeSpecName: "kube-api-access-mbdsb") pod "93841083-5e50-4649-9ae4-70d7c9c0141d" (UID: "93841083-5e50-4649-9ae4-70d7c9c0141d"). InnerVolumeSpecName "kube-api-access-mbdsb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:01:31.385784 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:31.385744 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93841083-5e50-4649-9ae4-70d7c9c0141d-extensions-socket-volume\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:01:31.385784 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:31.385777 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbdsb\" (UniqueName: \"kubernetes.io/projected/93841083-5e50-4649-9ae4-70d7c9c0141d-kube-api-access-mbdsb\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:01:32.028339 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:32.028304 2576 generic.go:356] "Generic (PLEG): container finished" podID="93841083-5e50-4649-9ae4-70d7c9c0141d" containerID="6de7283d17e31bb77ee376a88aa46358b4fd068e9ee28f1e843d63565d6453e7" exitCode=0 Jun 03 23:01:32.028531 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:32.028350 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c" Jun 03 23:01:32.028531 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:32.028409 2576 scope.go:117] "RemoveContainer" containerID="6de7283d17e31bb77ee376a88aa46358b4fd068e9ee28f1e843d63565d6453e7" Jun 03 23:01:32.030371 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:32.030341 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bszrz" event={"ID":"81158ffe-395f-4b2c-ab89-3642f2dff532","Type":"ContainerStarted","Data":"5820ff9b8ab242398e0fa2096421cae1bc1cc4c7c90e8a71fc1e0298f06187ad"} Jun 03 23:01:32.036092 ip-10-0-140-99 kubenswrapper[2576]: E0603 23:01:32.031233 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z8c2c\" is forbidden: User \"system:node:ip-10-0-140-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-99.ec2.internal' and this object" podUID="93841083-5e50-4649-9ae4-70d7c9c0141d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c" Jun 03 23:01:32.036977 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:32.036866 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxxxv" event={"ID":"73489b68-7e4c-4d0b-95dd-984ce04bbe8d","Type":"ContainerStarted","Data":"84a96faf2505dd3dde83e7f8746db4a82e919073b9dd39e4ed9e5150d9dd75e4"} Jun 03 23:01:32.036977 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:32.036939 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxxxv" event={"ID":"73489b68-7e4c-4d0b-95dd-984ce04bbe8d","Type":"ContainerStarted","Data":"4b427c44050e0a53eee8f21819a915d0ff55b24f47019671b901e3f3ed1b0972"} Jun 03 23:01:32.037382 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:32.037325 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxxxv" Jun 03 23:01:32.039650 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:32.039623 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6td7" event={"ID":"d7b9b472-1262-4409-aada-d6914d1d72ba","Type":"ContainerStarted","Data":"117862bf31db075436192ebf5efc895c863db9271a2d09ad75436a04cd134e92"} Jun 03 23:01:32.044113 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:32.044095 2576 scope.go:117] "RemoveContainer" containerID="6de7283d17e31bb77ee376a88aa46358b4fd068e9ee28f1e843d63565d6453e7" Jun 03 23:01:32.044432 ip-10-0-140-99 kubenswrapper[2576]: E0603 23:01:32.044404 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6de7283d17e31bb77ee376a88aa46358b4fd068e9ee28f1e843d63565d6453e7\": container with ID starting with 6de7283d17e31bb77ee376a88aa46358b4fd068e9ee28f1e843d63565d6453e7 not found: ID does not exist" containerID="6de7283d17e31bb77ee376a88aa46358b4fd068e9ee28f1e843d63565d6453e7" Jun 03 23:01:32.044543 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:32.044442 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6de7283d17e31bb77ee376a88aa46358b4fd068e9ee28f1e843d63565d6453e7"} err="failed to get container status \"6de7283d17e31bb77ee376a88aa46358b4fd068e9ee28f1e843d63565d6453e7\": rpc error: code = NotFound desc = could not find container \"6de7283d17e31bb77ee376a88aa46358b4fd068e9ee28f1e843d63565d6453e7\": container with ID starting with 6de7283d17e31bb77ee376a88aa46358b4fd068e9ee28f1e843d63565d6453e7 not found: ID does not exist" Jun 03 23:01:32.052309 ip-10-0-140-99 kubenswrapper[2576]: E0603 23:01:32.052277 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z8c2c\" is forbidden: User \"system:node:ip-10-0-140-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-99.ec2.internal' and this object" podUID="93841083-5e50-4649-9ae4-70d7c9c0141d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c" Jun 03 23:01:32.053494 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:32.053453 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bszrz" podStartSLOduration=1.940765529 podStartE2EDuration="25.053439885s" totalImagesPullingTime="23.112674356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:01:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:01:32.050312575 +0000 UTC m=+670.388965066" watchObservedRunningTime="2026-06-03 23:01:32.053439885 +0000 UTC m=+670.392092372" Jun 03 23:01:32.053775 ip-10-0-140-99 kubenswrapper[2576]: E0603 23:01:32.053749 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z8c2c\" is forbidden: User \"system:node:ip-10-0-140-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-99.ec2.internal' and this object" podUID="93841083-5e50-4649-9ae4-70d7c9c0141d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c" Jun 03 23:01:32.074789 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:32.074727 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxxxv" podStartSLOduration=13.074705795 podStartE2EDuration="13.074705795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:01:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:01:32.072389299 +0000 UTC m=+670.411041804" watchObservedRunningTime="2026-06-03 23:01:32.074705795 +0000 UTC m=+670.413358285" Jun 03 23:01:32.116610 ip-10-0-140-99 kubenswrapper[2576]: E0603 23:01:32.116566 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z8c2c\" is forbidden: User \"system:node:ip-10-0-140-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-99.ec2.internal' and this object" podUID="93841083-5e50-4649-9ae4-70d7c9c0141d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8c2c" Jun 03 23:01:32.118121 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:32.118098 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93841083-5e50-4649-9ae4-70d7c9c0141d" path="/var/lib/kubelet/pods/93841083-5e50-4649-9ae4-70d7c9c0141d/volumes" Jun 03 23:01:33.048542 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:33.048492 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6td7" event={"ID":"d7b9b472-1262-4409-aada-d6914d1d72ba","Type":"ContainerStarted","Data":"8f37cc0710d213879969fa04ca8389e7c7d0b7b19d2d984c2e72482f66760146"} Jun 03 23:01:33.049027 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:33.048866 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6td7" Jun 03 23:01:33.073149 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:33.073098 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6td7" podStartSLOduration=14.742864727 podStartE2EDuration="16.073079459s" totalImagesPullingTime="1.330214732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:01:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:01:33.072465151 +0000 UTC m=+671.411117651" watchObservedRunningTime="2026-06-03 23:01:33.073079459 +0000 UTC m=+671.411731946" Jun 03 23:01:43.051687 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:43.051652 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxxxv" Jun 03 23:01:44.024028 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:44.023994 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5d8df56f5-z487m" podUID="264c8e8c-3175-4634-8faf-a8cb30c0a97b" containerName="console" containerID="cri-o://a419ce13364592487bbbf0442d9d86e8bc67f73e63e61cd1df3b4fa6adb870ba" gracePeriod=15 Jun 03 23:01:44.056425 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:44.056397 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6td7" Jun 03 23:01:44.291857 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:44.291794 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8df56f5-z487m" Jun 03 23:01:44.414794 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:44.414759 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/264c8e8c-3175-4634-8faf-a8cb30c0a97b-service-ca\") pod \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " Jun 03 23:01:44.414794 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:44.414794 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/264c8e8c-3175-4634-8faf-a8cb30c0a97b-oauth-serving-cert\") pod \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " Jun 03 23:01:44.415047 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:44.414829 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/264c8e8c-3175-4634-8faf-a8cb30c0a97b-console-oauth-config\") pod \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " Jun 03 23:01:44.415047 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:44.414856 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/264c8e8c-3175-4634-8faf-a8cb30c0a97b-console-config\") pod \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " Jun 03 23:01:44.415153 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:44.415047 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/264c8e8c-3175-4634-8faf-a8cb30c0a97b-console-serving-cert\") pod \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " Jun 03 23:01:44.415153 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:44.415086 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/264c8e8c-3175-4634-8faf-a8cb30c0a97b-trusted-ca-bundle\") pod \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " Jun 03 23:01:44.415153 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:44.415143 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kxlm\" (UniqueName: \"kubernetes.io/projected/264c8e8c-3175-4634-8faf-a8cb30c0a97b-kube-api-access-2kxlm\") pod \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\" (UID: \"264c8e8c-3175-4634-8faf-a8cb30c0a97b\") " Jun 03 23:01:44.415315 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:44.415198 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/264c8e8c-3175-4634-8faf-a8cb30c0a97b-service-ca" (OuterVolumeSpecName: "service-ca") pod "264c8e8c-3175-4634-8faf-a8cb30c0a97b" (UID: "264c8e8c-3175-4634-8faf-a8cb30c0a97b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:01:44.415315 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:44.415245 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/264c8e8c-3175-4634-8faf-a8cb30c0a97b-console-config" (OuterVolumeSpecName: "console-config") pod "264c8e8c-3175-4634-8faf-a8cb30c0a97b" (UID: "264c8e8c-3175-4634-8faf-a8cb30c0a97b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:01:44.415315 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:44.415264 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/264c8e8c-3175-4634-8faf-a8cb30c0a97b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "264c8e8c-3175-4634-8faf-a8cb30c0a97b" (UID: "264c8e8c-3175-4634-8faf-a8cb30c0a97b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:01:44.415586 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:44.415559 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/264c8e8c-3175-4634-8faf-a8cb30c0a97b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "264c8e8c-3175-4634-8faf-a8cb30c0a97b" (UID: "264c8e8c-3175-4634-8faf-a8cb30c0a97b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:01:44.415646 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:44.415572 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/264c8e8c-3175-4634-8faf-a8cb30c0a97b-service-ca\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:01:44.415646 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:44.415618 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/264c8e8c-3175-4634-8faf-a8cb30c0a97b-oauth-serving-cert\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:01:44.415646 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:44.415637 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/264c8e8c-3175-4634-8faf-a8cb30c0a97b-console-config\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:01:44.417302 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:44.417277 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/264c8e8c-3175-4634-8faf-a8cb30c0a97b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "264c8e8c-3175-4634-8faf-a8cb30c0a97b" (UID: "264c8e8c-3175-4634-8faf-a8cb30c0a97b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:01:44.417302 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:44.417291 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/264c8e8c-3175-4634-8faf-a8cb30c0a97b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "264c8e8c-3175-4634-8faf-a8cb30c0a97b" (UID: "264c8e8c-3175-4634-8faf-a8cb30c0a97b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:01:44.417447 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:44.417327 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/264c8e8c-3175-4634-8faf-a8cb30c0a97b-kube-api-access-2kxlm" (OuterVolumeSpecName: "kube-api-access-2kxlm") pod "264c8e8c-3175-4634-8faf-a8cb30c0a97b" (UID: "264c8e8c-3175-4634-8faf-a8cb30c0a97b"). InnerVolumeSpecName "kube-api-access-2kxlm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:01:44.516570 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:44.516531 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/264c8e8c-3175-4634-8faf-a8cb30c0a97b-console-oauth-config\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:01:44.516570 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:44.516563 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/264c8e8c-3175-4634-8faf-a8cb30c0a97b-console-serving-cert\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:01:44.516570 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:44.516572 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/264c8e8c-3175-4634-8faf-a8cb30c0a97b-trusted-ca-bundle\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:01:44.516809 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:44.516581 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kxlm\" (UniqueName: \"kubernetes.io/projected/264c8e8c-3175-4634-8faf-a8cb30c0a97b-kube-api-access-2kxlm\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:01:45.125601 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:45.125559 2576 generic.go:356] "Generic (PLEG): container finished" podID="264c8e8c-3175-4634-8faf-a8cb30c0a97b" containerID="a419ce13364592487bbbf0442d9d86e8bc67f73e63e61cd1df3b4fa6adb870ba" exitCode=0 Jun 03 23:01:45.125601 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:45.125598 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8df56f5-z487m" Jun 03 23:01:45.126122 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:45.125621 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8df56f5-z487m" event={"ID":"264c8e8c-3175-4634-8faf-a8cb30c0a97b","Type":"ContainerDied","Data":"a419ce13364592487bbbf0442d9d86e8bc67f73e63e61cd1df3b4fa6adb870ba"} Jun 03 23:01:45.126122 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:45.125670 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8df56f5-z487m" event={"ID":"264c8e8c-3175-4634-8faf-a8cb30c0a97b","Type":"ContainerDied","Data":"0fac365ae259d230bd8e1c7473a892b9e91fe1f99c8a4815c24ffa91d7a64bef"} Jun 03 23:01:45.126122 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:45.125696 2576 scope.go:117] "RemoveContainer" containerID="a419ce13364592487bbbf0442d9d86e8bc67f73e63e61cd1df3b4fa6adb870ba" Jun 03 23:01:45.135920 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:45.135901 2576 scope.go:117] "RemoveContainer" containerID="a419ce13364592487bbbf0442d9d86e8bc67f73e63e61cd1df3b4fa6adb870ba" Jun 03 23:01:45.136201 ip-10-0-140-99 kubenswrapper[2576]: E0603 23:01:45.136181 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a419ce13364592487bbbf0442d9d86e8bc67f73e63e61cd1df3b4fa6adb870ba\": container with ID starting with a419ce13364592487bbbf0442d9d86e8bc67f73e63e61cd1df3b4fa6adb870ba not found: ID does not exist" containerID="a419ce13364592487bbbf0442d9d86e8bc67f73e63e61cd1df3b4fa6adb870ba" Jun 03 23:01:45.136267 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:45.136213 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a419ce13364592487bbbf0442d9d86e8bc67f73e63e61cd1df3b4fa6adb870ba"} err="failed to get container status \"a419ce13364592487bbbf0442d9d86e8bc67f73e63e61cd1df3b4fa6adb870ba\": rpc error: code = NotFound desc = could not find container \"a419ce13364592487bbbf0442d9d86e8bc67f73e63e61cd1df3b4fa6adb870ba\": container with ID starting with a419ce13364592487bbbf0442d9d86e8bc67f73e63e61cd1df3b4fa6adb870ba not found: ID does not exist" Jun 03 23:01:45.153153 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:45.153119 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d8df56f5-z487m"] Jun 03 23:01:45.161648 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:45.161616 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d8df56f5-z487m"] Jun 03 23:01:46.122141 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:01:46.122108 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="264c8e8c-3175-4634-8faf-a8cb30c0a97b" path="/var/lib/kubelet/pods/264c8e8c-3175-4634-8faf-a8cb30c0a97b/volumes" Jun 03 23:02:06.315147 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:06.315105 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-zz8mn"] Jun 03 23:02:06.315589 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:06.315487 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="264c8e8c-3175-4634-8faf-a8cb30c0a97b" containerName="console" Jun 03 23:02:06.315589 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:06.315500 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="264c8e8c-3175-4634-8faf-a8cb30c0a97b" containerName="console" Jun 03 23:02:06.315589 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:06.315583 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="264c8e8c-3175-4634-8faf-a8cb30c0a97b" containerName="console" Jun 03 23:02:06.317731 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:06.317714 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zz8mn" Jun 03 23:02:06.319677 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:06.319657 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bn7pk\"" Jun 03 23:02:06.327123 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:06.327099 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zz8mn"] Jun 03 23:02:06.397612 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:06.397576 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwcfz\" (UniqueName: \"kubernetes.io/projected/a6503f1a-b65c-4dff-af5f-c8d51a7fa048-kube-api-access-lwcfz\") pod \"authorino-58cd955675-zz8mn\" (UID: \"a6503f1a-b65c-4dff-af5f-c8d51a7fa048\") " pod="kuadrant-system/authorino-58cd955675-zz8mn" Jun 03 23:02:06.498887 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:06.498850 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwcfz\" (UniqueName: \"kubernetes.io/projected/a6503f1a-b65c-4dff-af5f-c8d51a7fa048-kube-api-access-lwcfz\") pod \"authorino-58cd955675-zz8mn\" (UID: \"a6503f1a-b65c-4dff-af5f-c8d51a7fa048\") " pod="kuadrant-system/authorino-58cd955675-zz8mn" Jun 03 23:02:06.510524 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:06.510484 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwcfz\" (UniqueName: \"kubernetes.io/projected/a6503f1a-b65c-4dff-af5f-c8d51a7fa048-kube-api-access-lwcfz\") pod \"authorino-58cd955675-zz8mn\" (UID: \"a6503f1a-b65c-4dff-af5f-c8d51a7fa048\") " pod="kuadrant-system/authorino-58cd955675-zz8mn" Jun 03 23:02:06.628044 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:06.627959 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zz8mn" Jun 03 23:02:06.762501 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:06.762472 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zz8mn"] Jun 03 23:02:06.764573 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:02:06.764547 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6503f1a_b65c_4dff_af5f_c8d51a7fa048.slice/crio-d37ebf42f6e58b16485f4b1ece1d09ca0848e5d0e6734f16c00e55731b3f3d5c WatchSource:0}: Error finding container d37ebf42f6e58b16485f4b1ece1d09ca0848e5d0e6734f16c00e55731b3f3d5c: Status 404 returned error can't find the container with id d37ebf42f6e58b16485f4b1ece1d09ca0848e5d0e6734f16c00e55731b3f3d5c Jun 03 23:02:07.252306 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:07.252272 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zz8mn" event={"ID":"a6503f1a-b65c-4dff-af5f-c8d51a7fa048","Type":"ContainerStarted","Data":"d37ebf42f6e58b16485f4b1ece1d09ca0848e5d0e6734f16c00e55731b3f3d5c"} Jun 03 23:02:10.275235 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:10.275128 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zz8mn" event={"ID":"a6503f1a-b65c-4dff-af5f-c8d51a7fa048","Type":"ContainerStarted","Data":"b7adef6addf02689f67592a007a0eebe84d498cb87becdaf926a82c5a2f0d9fa"} Jun 03 23:02:10.288335 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:10.288285 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-zz8mn" podStartSLOduration=1.256383571 podStartE2EDuration="4.288268845s" totalImagesPullingTime="3.031885274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:02:10.28767427 +0000 UTC m=+708.626326757" watchObservedRunningTime="2026-06-03 23:02:10.288268845 +0000 UTC m=+708.626921371" Jun 03 23:02:11.054904 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:11.054866 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zz8mn"] Jun 03 23:02:12.286785 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:12.286729 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-zz8mn" podUID="a6503f1a-b65c-4dff-af5f-c8d51a7fa048" containerName="authorino" containerID="cri-o://b7adef6addf02689f67592a007a0eebe84d498cb87becdaf926a82c5a2f0d9fa" gracePeriod=30 Jun 03 23:02:12.536594 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:12.536564 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zz8mn" Jun 03 23:02:12.552495 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:12.552458 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwcfz\" (UniqueName: \"kubernetes.io/projected/a6503f1a-b65c-4dff-af5f-c8d51a7fa048-kube-api-access-lwcfz\") pod \"a6503f1a-b65c-4dff-af5f-c8d51a7fa048\" (UID: \"a6503f1a-b65c-4dff-af5f-c8d51a7fa048\") " Jun 03 23:02:12.554697 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:12.554667 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6503f1a-b65c-4dff-af5f-c8d51a7fa048-kube-api-access-lwcfz" (OuterVolumeSpecName: "kube-api-access-lwcfz") pod "a6503f1a-b65c-4dff-af5f-c8d51a7fa048" (UID: "a6503f1a-b65c-4dff-af5f-c8d51a7fa048"). InnerVolumeSpecName "kube-api-access-lwcfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:02:12.653332 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:12.653295 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwcfz\" (UniqueName: \"kubernetes.io/projected/a6503f1a-b65c-4dff-af5f-c8d51a7fa048-kube-api-access-lwcfz\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:02:13.293533 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:13.293475 2576 generic.go:356] "Generic (PLEG): container finished" podID="a6503f1a-b65c-4dff-af5f-c8d51a7fa048" containerID="b7adef6addf02689f67592a007a0eebe84d498cb87becdaf926a82c5a2f0d9fa" exitCode=0 Jun 03 23:02:13.293938 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:13.293542 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zz8mn" Jun 03 23:02:13.293938 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:13.293559 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zz8mn" event={"ID":"a6503f1a-b65c-4dff-af5f-c8d51a7fa048","Type":"ContainerDied","Data":"b7adef6addf02689f67592a007a0eebe84d498cb87becdaf926a82c5a2f0d9fa"} Jun 03 23:02:13.293938 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:13.293611 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zz8mn" event={"ID":"a6503f1a-b65c-4dff-af5f-c8d51a7fa048","Type":"ContainerDied","Data":"d37ebf42f6e58b16485f4b1ece1d09ca0848e5d0e6734f16c00e55731b3f3d5c"} Jun 03 23:02:13.293938 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:13.293628 2576 scope.go:117] "RemoveContainer" containerID="b7adef6addf02689f67592a007a0eebe84d498cb87becdaf926a82c5a2f0d9fa" Jun 03 23:02:13.303655 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:13.303632 2576 scope.go:117] "RemoveContainer" containerID="b7adef6addf02689f67592a007a0eebe84d498cb87becdaf926a82c5a2f0d9fa" Jun 03 23:02:13.303961 ip-10-0-140-99 kubenswrapper[2576]: E0603 23:02:13.303943 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7adef6addf02689f67592a007a0eebe84d498cb87becdaf926a82c5a2f0d9fa\": container with ID starting with b7adef6addf02689f67592a007a0eebe84d498cb87becdaf926a82c5a2f0d9fa not found: ID does not exist" containerID="b7adef6addf02689f67592a007a0eebe84d498cb87becdaf926a82c5a2f0d9fa" Jun 03 23:02:13.304012 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:13.303970 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7adef6addf02689f67592a007a0eebe84d498cb87becdaf926a82c5a2f0d9fa"} err="failed to get container status \"b7adef6addf02689f67592a007a0eebe84d498cb87becdaf926a82c5a2f0d9fa\": rpc error: code = NotFound desc = could not find container \"b7adef6addf02689f67592a007a0eebe84d498cb87becdaf926a82c5a2f0d9fa\": container with ID starting with b7adef6addf02689f67592a007a0eebe84d498cb87becdaf926a82c5a2f0d9fa not found: ID does not exist" Jun 03 23:02:13.314884 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:13.314853 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zz8mn"] Jun 03 23:02:13.317924 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:13.317901 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-zz8mn"] Jun 03 23:02:14.118010 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:14.117979 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6503f1a-b65c-4dff-af5f-c8d51a7fa048" path="/var/lib/kubelet/pods/a6503f1a-b65c-4dff-af5f-c8d51a7fa048/volumes" Jun 03 23:02:34.704752 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:34.704712 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb"] Jun 03 23:02:34.705216 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:34.705200 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6503f1a-b65c-4dff-af5f-c8d51a7fa048" containerName="authorino" Jun 03 23:02:34.705272 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:34.705218 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6503f1a-b65c-4dff-af5f-c8d51a7fa048" containerName="authorino" Jun 03 23:02:34.705310 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:34.705301 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6503f1a-b65c-4dff-af5f-c8d51a7fa048" containerName="authorino" Jun 03 23:02:34.708278 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:34.708255 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb" Jun 03 23:02:34.710307 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:34.710290 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 23:02:34.710567 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:34.710554 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-grzxb\"" Jun 03 23:02:34.710618 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:34.710565 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 23:02:34.717970 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:34.717942 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb"] Jun 03 23:02:34.866534 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:34.866477 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/025448ae-b3c2-45f1-804a-fe43e5edd8ae-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb\" (UID: \"025448ae-b3c2-45f1-804a-fe43e5edd8ae\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb" Jun 03 23:02:34.866724 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:34.866561 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/025448ae-b3c2-45f1-804a-fe43e5edd8ae-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb\" (UID: \"025448ae-b3c2-45f1-804a-fe43e5edd8ae\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb" Jun 03 23:02:34.866724 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:34.866662 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qd6w\" (UniqueName: \"kubernetes.io/projected/025448ae-b3c2-45f1-804a-fe43e5edd8ae-kube-api-access-4qd6w\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb\" (UID: \"025448ae-b3c2-45f1-804a-fe43e5edd8ae\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb" Jun 03 23:02:34.967417 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:34.967323 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/025448ae-b3c2-45f1-804a-fe43e5edd8ae-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb\" (UID: \"025448ae-b3c2-45f1-804a-fe43e5edd8ae\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb" Jun 03 23:02:34.967417 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:34.967370 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/025448ae-b3c2-45f1-804a-fe43e5edd8ae-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb\" (UID: \"025448ae-b3c2-45f1-804a-fe43e5edd8ae\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb" Jun 03 23:02:34.967706 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:34.967429 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qd6w\" (UniqueName: \"kubernetes.io/projected/025448ae-b3c2-45f1-804a-fe43e5edd8ae-kube-api-access-4qd6w\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb\" (UID: \"025448ae-b3c2-45f1-804a-fe43e5edd8ae\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb" Jun 03 23:02:34.967793 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:34.967769 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/025448ae-b3c2-45f1-804a-fe43e5edd8ae-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb\" (UID: \"025448ae-b3c2-45f1-804a-fe43e5edd8ae\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb" Jun 03 23:02:34.967851 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:34.967813 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/025448ae-b3c2-45f1-804a-fe43e5edd8ae-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb\" (UID: \"025448ae-b3c2-45f1-804a-fe43e5edd8ae\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb" Jun 03 23:02:34.975782 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:34.975754 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qd6w\" (UniqueName: \"kubernetes.io/projected/025448ae-b3c2-45f1-804a-fe43e5edd8ae-kube-api-access-4qd6w\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb\" (UID: \"025448ae-b3c2-45f1-804a-fe43e5edd8ae\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb" Jun 03 23:02:35.020763 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:35.020725 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb" Jun 03 23:02:35.168007 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:35.167978 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb"] Jun 03 23:02:35.169816 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:02:35.169787 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod025448ae_b3c2_45f1_804a_fe43e5edd8ae.slice/crio-a9550807f71656b963fe0978119c1efbd56718fc1a2b09a0b7e24c5c951c5662 WatchSource:0}: Error finding container a9550807f71656b963fe0978119c1efbd56718fc1a2b09a0b7e24c5c951c5662: Status 404 returned error can't find the container with id a9550807f71656b963fe0978119c1efbd56718fc1a2b09a0b7e24c5c951c5662 Jun 03 23:02:35.425605 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:35.425562 2576 generic.go:356] "Generic (PLEG): container finished" podID="025448ae-b3c2-45f1-804a-fe43e5edd8ae" containerID="128d03a8ad1ac367fc9c62842a7ef824bb3282d2b070c9d651784d6462e1c1f7" exitCode=0 Jun 03 23:02:35.425994 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:35.425611 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb" event={"ID":"025448ae-b3c2-45f1-804a-fe43e5edd8ae","Type":"ContainerDied","Data":"128d03a8ad1ac367fc9c62842a7ef824bb3282d2b070c9d651784d6462e1c1f7"} Jun 03 23:02:35.425994 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:35.425688 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb" event={"ID":"025448ae-b3c2-45f1-804a-fe43e5edd8ae","Type":"ContainerStarted","Data":"a9550807f71656b963fe0978119c1efbd56718fc1a2b09a0b7e24c5c951c5662"} Jun 03 23:02:36.432719 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:36.432682 2576 generic.go:356] "Generic (PLEG): container finished" podID="025448ae-b3c2-45f1-804a-fe43e5edd8ae" containerID="d702a101f33b03f936706002ea788742fc958f799acc42db78e0dd184e9835dd" exitCode=0 Jun 03 23:02:36.433132 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:36.432768 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb" event={"ID":"025448ae-b3c2-45f1-804a-fe43e5edd8ae","Type":"ContainerDied","Data":"d702a101f33b03f936706002ea788742fc958f799acc42db78e0dd184e9835dd"} Jun 03 23:02:37.441381 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:37.441347 2576 generic.go:356] "Generic (PLEG): container finished" podID="025448ae-b3c2-45f1-804a-fe43e5edd8ae" containerID="96eb16d2bb2dccabb6c224fe454cc4aaac62e9c6d08329f11699659cbe0c45e1" exitCode=0 Jun 03 23:02:37.441861 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:37.441431 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb" event={"ID":"025448ae-b3c2-45f1-804a-fe43e5edd8ae","Type":"ContainerDied","Data":"96eb16d2bb2dccabb6c224fe454cc4aaac62e9c6d08329f11699659cbe0c45e1"} Jun 03 23:02:38.584842 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:38.584810 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb" Jun 03 23:02:38.700334 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:38.700236 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/025448ae-b3c2-45f1-804a-fe43e5edd8ae-bundle\") pod \"025448ae-b3c2-45f1-804a-fe43e5edd8ae\" (UID: \"025448ae-b3c2-45f1-804a-fe43e5edd8ae\") " Jun 03 23:02:38.700334 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:38.700277 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/025448ae-b3c2-45f1-804a-fe43e5edd8ae-util\") pod \"025448ae-b3c2-45f1-804a-fe43e5edd8ae\" (UID: \"025448ae-b3c2-45f1-804a-fe43e5edd8ae\") " Jun 03 23:02:38.700334 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:38.700318 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qd6w\" (UniqueName: \"kubernetes.io/projected/025448ae-b3c2-45f1-804a-fe43e5edd8ae-kube-api-access-4qd6w\") pod \"025448ae-b3c2-45f1-804a-fe43e5edd8ae\" (UID: \"025448ae-b3c2-45f1-804a-fe43e5edd8ae\") " Jun 03 23:02:38.700883 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:38.700845 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/025448ae-b3c2-45f1-804a-fe43e5edd8ae-bundle" (OuterVolumeSpecName: "bundle") pod "025448ae-b3c2-45f1-804a-fe43e5edd8ae" (UID: "025448ae-b3c2-45f1-804a-fe43e5edd8ae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:02:38.702892 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:38.702864 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/025448ae-b3c2-45f1-804a-fe43e5edd8ae-kube-api-access-4qd6w" (OuterVolumeSpecName: "kube-api-access-4qd6w") pod "025448ae-b3c2-45f1-804a-fe43e5edd8ae" (UID: "025448ae-b3c2-45f1-804a-fe43e5edd8ae"). InnerVolumeSpecName "kube-api-access-4qd6w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:02:38.707528 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:38.707489 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/025448ae-b3c2-45f1-804a-fe43e5edd8ae-util" (OuterVolumeSpecName: "util") pod "025448ae-b3c2-45f1-804a-fe43e5edd8ae" (UID: "025448ae-b3c2-45f1-804a-fe43e5edd8ae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:02:38.801178 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:38.801139 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/025448ae-b3c2-45f1-804a-fe43e5edd8ae-bundle\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:02:38.801178 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:38.801173 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/025448ae-b3c2-45f1-804a-fe43e5edd8ae-util\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:02:38.801178 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:38.801182 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qd6w\" (UniqueName: \"kubernetes.io/projected/025448ae-b3c2-45f1-804a-fe43e5edd8ae-kube-api-access-4qd6w\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:02:39.454763 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:39.454721 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb" event={"ID":"025448ae-b3c2-45f1-804a-fe43e5edd8ae","Type":"ContainerDied","Data":"a9550807f71656b963fe0978119c1efbd56718fc1a2b09a0b7e24c5c951c5662"} Jun 03 23:02:39.454763 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:39.454758 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zlgxb" Jun 03 23:02:39.455007 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:39.454776 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9550807f71656b963fe0978119c1efbd56718fc1a2b09a0b7e24c5c951c5662" Jun 03 23:02:57.914389 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:57.914351 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:02:57.914894 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:57.914743 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="025448ae-b3c2-45f1-804a-fe43e5edd8ae" containerName="util" Jun 03 23:02:57.914894 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:57.914756 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="025448ae-b3c2-45f1-804a-fe43e5edd8ae" containerName="util" Jun 03 23:02:57.914894 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:57.914764 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="025448ae-b3c2-45f1-804a-fe43e5edd8ae" containerName="pull" Jun 03 23:02:57.914894 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:57.914770 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="025448ae-b3c2-45f1-804a-fe43e5edd8ae" containerName="pull" Jun 03 23:02:57.914894 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:57.914777 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="025448ae-b3c2-45f1-804a-fe43e5edd8ae" containerName="extract" Jun 03 23:02:57.914894 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:57.914783 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="025448ae-b3c2-45f1-804a-fe43e5edd8ae" containerName="extract" Jun 03 23:02:57.914894 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:57.914854 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="025448ae-b3c2-45f1-804a-fe43e5edd8ae" containerName="extract" Jun 03 23:02:57.921449 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:57.921426 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 23:02:57.923753 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:57.923726 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-wprhc\"" Jun 03 23:02:57.923939 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:57.923700 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 23:02:57.924024 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:57.924007 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 23:02:57.924297 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:57.924275 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 23:02:57.927379 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:57.927356 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:02:57.979306 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:57.979277 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l7q4\" (UniqueName: \"kubernetes.io/projected/1432c85f-0cac-46ab-90f9-964876a49059-kube-api-access-6l7q4\") pod \"maas-keycloak-0\" (UID: \"1432c85f-0cac-46ab-90f9-964876a49059\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:02:58.079793 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:58.079753 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l7q4\" (UniqueName: \"kubernetes.io/projected/1432c85f-0cac-46ab-90f9-964876a49059-kube-api-access-6l7q4\") pod \"maas-keycloak-0\" (UID: \"1432c85f-0cac-46ab-90f9-964876a49059\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:02:58.089407 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:58.089382 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l7q4\" (UniqueName: \"kubernetes.io/projected/1432c85f-0cac-46ab-90f9-964876a49059-kube-api-access-6l7q4\") pod \"maas-keycloak-0\" (UID: \"1432c85f-0cac-46ab-90f9-964876a49059\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:02:58.234398 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:58.234289 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 23:02:58.374912 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:58.374891 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:02:58.377248 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:02:58.377217 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1432c85f_0cac_46ab_90f9_964876a49059.slice/crio-73f40a71f062fa419acba8482d2e605d75ef86b7bdadf2b2239eb6f766e7988c WatchSource:0}: Error finding container 73f40a71f062fa419acba8482d2e605d75ef86b7bdadf2b2239eb6f766e7988c: Status 404 returned error can't find the container with id 73f40a71f062fa419acba8482d2e605d75ef86b7bdadf2b2239eb6f766e7988c Jun 03 23:02:58.562988 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:02:58.562954 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1432c85f-0cac-46ab-90f9-964876a49059","Type":"ContainerStarted","Data":"73f40a71f062fa419acba8482d2e605d75ef86b7bdadf2b2239eb6f766e7988c"} Jun 03 23:03:03.606031 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:03.605990 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1432c85f-0cac-46ab-90f9-964876a49059","Type":"ContainerStarted","Data":"7fcf8ec721a0e50dfa8166a9e56389cb51955ff87ad0f488e0ef22ab457e1274"} Jun 03 23:03:03.625654 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:03.625599 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.246930036 podStartE2EDuration="6.625581946s" totalImagesPullingTime="4.37865191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:02:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:03.622064141 +0000 UTC m=+761.960716640" watchObservedRunningTime="2026-06-03 23:03:03.625581946 +0000 UTC m=+761.964234435" Jun 03 23:03:04.234792 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:04.234751 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 23:03:04.236938 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:04.236897 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1432c85f-0cac-46ab-90f9-964876a49059" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 03 23:03:05.235620 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:05.235575 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1432c85f-0cac-46ab-90f9-964876a49059" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 03 23:03:06.235783 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:06.235732 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1432c85f-0cac-46ab-90f9-964876a49059" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 03 23:03:07.235017 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:07.234960 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1432c85f-0cac-46ab-90f9-964876a49059" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 03 23:03:08.235430 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:08.235385 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 23:03:08.237496 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:08.236438 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1432c85f-0cac-46ab-90f9-964876a49059" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 03 23:03:09.235701 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:09.235649 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1432c85f-0cac-46ab-90f9-964876a49059" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 03 23:03:10.236938 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:10.236865 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1432c85f-0cac-46ab-90f9-964876a49059" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 03 23:03:11.235143 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:11.235087 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1432c85f-0cac-46ab-90f9-964876a49059" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 03 23:03:12.234811 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:12.234760 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1432c85f-0cac-46ab-90f9-964876a49059" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 03 23:03:13.235025 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:13.234966 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1432c85f-0cac-46ab-90f9-964876a49059" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 03 23:03:14.235681 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:14.235630 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1432c85f-0cac-46ab-90f9-964876a49059" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 03 23:03:15.234866 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:15.234818 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1432c85f-0cac-46ab-90f9-964876a49059" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 03 23:03:16.343773 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:16.343734 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 23:03:16.360879 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:16.360813 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="1432c85f-0cac-46ab-90f9-964876a49059" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 23:03:26.350142 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:26.350102 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 23:03:27.668815 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:27.668777 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5585db8bbc-tdw4t"] Jun 03 23:03:27.674169 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:27.674147 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5585db8bbc-tdw4t" Jun 03 23:03:27.676525 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:27.676496 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bn7pk\"" Jun 03 23:03:27.676704 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:27.676539 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 23:03:27.680472 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:27.680444 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5585db8bbc-tdw4t"] Jun 03 23:03:27.701982 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:27.701948 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9fac2825-1279-462e-8774-087b19751611-tls-cert\") pod \"authorino-5585db8bbc-tdw4t\" (UID: \"9fac2825-1279-462e-8774-087b19751611\") " pod="kuadrant-system/authorino-5585db8bbc-tdw4t" Jun 03 23:03:27.701982 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:27.701986 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4xqc\" (UniqueName: \"kubernetes.io/projected/9fac2825-1279-462e-8774-087b19751611-kube-api-access-w4xqc\") pod \"authorino-5585db8bbc-tdw4t\" (UID: \"9fac2825-1279-462e-8774-087b19751611\") " pod="kuadrant-system/authorino-5585db8bbc-tdw4t" Jun 03 23:03:27.802811 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:27.802778 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9fac2825-1279-462e-8774-087b19751611-tls-cert\") pod \"authorino-5585db8bbc-tdw4t\" (UID: \"9fac2825-1279-462e-8774-087b19751611\") " pod="kuadrant-system/authorino-5585db8bbc-tdw4t" Jun 03 23:03:27.802811 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:27.802817 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4xqc\" (UniqueName: \"kubernetes.io/projected/9fac2825-1279-462e-8774-087b19751611-kube-api-access-w4xqc\") pod \"authorino-5585db8bbc-tdw4t\" (UID: \"9fac2825-1279-462e-8774-087b19751611\") " pod="kuadrant-system/authorino-5585db8bbc-tdw4t" Jun 03 23:03:27.806481 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:27.806443 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9fac2825-1279-462e-8774-087b19751611-tls-cert\") pod \"authorino-5585db8bbc-tdw4t\" (UID: \"9fac2825-1279-462e-8774-087b19751611\") " pod="kuadrant-system/authorino-5585db8bbc-tdw4t" Jun 03 23:03:27.813475 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:27.813439 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4xqc\" (UniqueName: \"kubernetes.io/projected/9fac2825-1279-462e-8774-087b19751611-kube-api-access-w4xqc\") pod \"authorino-5585db8bbc-tdw4t\" (UID: \"9fac2825-1279-462e-8774-087b19751611\") " pod="kuadrant-system/authorino-5585db8bbc-tdw4t" Jun 03 23:03:27.984418 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:27.984312 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5585db8bbc-tdw4t" Jun 03 23:03:28.122499 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:03:28.122470 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fac2825_1279_462e_8774_087b19751611.slice/crio-bee4b090e32910e395e283002e09aa9cd97ec3dfbb291e472327dfca04f77755 WatchSource:0}: Error finding container bee4b090e32910e395e283002e09aa9cd97ec3dfbb291e472327dfca04f77755: Status 404 returned error can't find the container with id bee4b090e32910e395e283002e09aa9cd97ec3dfbb291e472327dfca04f77755 Jun 03 23:03:28.123170 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:28.123148 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5585db8bbc-tdw4t"] Jun 03 23:03:28.802266 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:28.802233 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5585db8bbc-tdw4t" event={"ID":"9fac2825-1279-462e-8774-087b19751611","Type":"ContainerStarted","Data":"f4206833d3d2991b459b511c604b0c247fe5b93ea998e0133f1c70c85ab44ac3"} Jun 03 23:03:28.802781 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:28.802276 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5585db8bbc-tdw4t" event={"ID":"9fac2825-1279-462e-8774-087b19751611","Type":"ContainerStarted","Data":"bee4b090e32910e395e283002e09aa9cd97ec3dfbb291e472327dfca04f77755"} Jun 03 23:03:28.819255 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:28.819203 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5585db8bbc-tdw4t" podStartSLOduration=1.430679985 podStartE2EDuration="1.819185088s" totalImagesPullingTime="388.505103ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:03:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:28.816828163 +0000 UTC m=+787.155480651" watchObservedRunningTime="2026-06-03 23:03:28.819185088 +0000 UTC m=+787.157837576" Jun 03 23:03:31.981127 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:31.981040 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69cfcd8fb9-snskv"] Jun 03 23:03:31.984690 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:31.984674 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69cfcd8fb9-snskv" Jun 03 23:03:31.986990 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:31.986974 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tpl4k\"" Jun 03 23:03:31.987120 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:31.987103 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 23:03:31.995057 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:31.995033 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69cfcd8fb9-snskv"] Jun 03 23:03:32.042740 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:32.042701 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn669\" (UniqueName: \"kubernetes.io/projected/11d6865e-315f-43ca-b18a-8e732922551a-kube-api-access-hn669\") pod \"maas-controller-69cfcd8fb9-snskv\" (UID: \"11d6865e-315f-43ca-b18a-8e732922551a\") " pod="opendatahub/maas-controller-69cfcd8fb9-snskv" Jun 03 23:03:32.143273 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:32.143241 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn669\" (UniqueName: \"kubernetes.io/projected/11d6865e-315f-43ca-b18a-8e732922551a-kube-api-access-hn669\") pod \"maas-controller-69cfcd8fb9-snskv\" (UID: \"11d6865e-315f-43ca-b18a-8e732922551a\") " pod="opendatahub/maas-controller-69cfcd8fb9-snskv" Jun 03 23:03:32.155181 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:32.155152 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn669\" (UniqueName: \"kubernetes.io/projected/11d6865e-315f-43ca-b18a-8e732922551a-kube-api-access-hn669\") pod \"maas-controller-69cfcd8fb9-snskv\" (UID: \"11d6865e-315f-43ca-b18a-8e732922551a\") " pod="opendatahub/maas-controller-69cfcd8fb9-snskv" Jun 03 23:03:32.166833 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:32.166804 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-676b7779c6-7ztmr"] Jun 03 23:03:32.171365 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:32.171345 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-676b7779c6-7ztmr" Jun 03 23:03:32.182814 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:32.182787 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-676b7779c6-7ztmr"] Jun 03 23:03:32.244037 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:32.243945 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsd45\" (UniqueName: \"kubernetes.io/projected/c6ca6943-d083-47f5-8631-fe06e28439c4-kube-api-access-lsd45\") pod \"maas-controller-676b7779c6-7ztmr\" (UID: \"c6ca6943-d083-47f5-8631-fe06e28439c4\") " pod="opendatahub/maas-controller-676b7779c6-7ztmr" Jun 03 23:03:32.296400 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:32.296356 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69cfcd8fb9-snskv" Jun 03 23:03:32.345342 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:32.345173 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsd45\" (UniqueName: \"kubernetes.io/projected/c6ca6943-d083-47f5-8631-fe06e28439c4-kube-api-access-lsd45\") pod \"maas-controller-676b7779c6-7ztmr\" (UID: \"c6ca6943-d083-47f5-8631-fe06e28439c4\") " pod="opendatahub/maas-controller-676b7779c6-7ztmr" Jun 03 23:03:32.353792 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:32.353732 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsd45\" (UniqueName: \"kubernetes.io/projected/c6ca6943-d083-47f5-8631-fe06e28439c4-kube-api-access-lsd45\") pod \"maas-controller-676b7779c6-7ztmr\" (UID: \"c6ca6943-d083-47f5-8631-fe06e28439c4\") " pod="opendatahub/maas-controller-676b7779c6-7ztmr" Jun 03 23:03:32.446587 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:32.446558 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69cfcd8fb9-snskv"] Jun 03 23:03:32.448034 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:03:32.448007 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11d6865e_315f_43ca_b18a_8e732922551a.slice/crio-2968e87d051ba749acbf92bf1513c0b2ad282104d2093b7b865ffb23232a33c2 WatchSource:0}: Error finding container 2968e87d051ba749acbf92bf1513c0b2ad282104d2093b7b865ffb23232a33c2: Status 404 returned error can't find the container with id 2968e87d051ba749acbf92bf1513c0b2ad282104d2093b7b865ffb23232a33c2 Jun 03 23:03:32.483714 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:32.483678 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-676b7779c6-7ztmr" Jun 03 23:03:32.623421 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:32.623368 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-676b7779c6-7ztmr"] Jun 03 23:03:32.626584 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:03:32.626554 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6ca6943_d083_47f5_8631_fe06e28439c4.slice/crio-8c67a6b410858e4fd0b031f39278ba07d41422d9581053ece33aafea0992f6fd WatchSource:0}: Error finding container 8c67a6b410858e4fd0b031f39278ba07d41422d9581053ece33aafea0992f6fd: Status 404 returned error can't find the container with id 8c67a6b410858e4fd0b031f39278ba07d41422d9581053ece33aafea0992f6fd Jun 03 23:03:32.827837 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:32.827796 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-676b7779c6-7ztmr" event={"ID":"c6ca6943-d083-47f5-8631-fe06e28439c4","Type":"ContainerStarted","Data":"8c67a6b410858e4fd0b031f39278ba07d41422d9581053ece33aafea0992f6fd"} Jun 03 23:03:32.829128 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:32.829102 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69cfcd8fb9-snskv" event={"ID":"11d6865e-315f-43ca-b18a-8e732922551a","Type":"ContainerStarted","Data":"2968e87d051ba749acbf92bf1513c0b2ad282104d2093b7b865ffb23232a33c2"} Jun 03 23:03:35.855321 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:35.855286 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69cfcd8fb9-snskv" event={"ID":"11d6865e-315f-43ca-b18a-8e732922551a","Type":"ContainerStarted","Data":"cb57fa5d4421de4623fea04bcae251d730dd22bbba578f870dc94c67850c3404"} Jun 03 23:03:35.855799 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:35.855466 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69cfcd8fb9-snskv" Jun 03 23:03:35.857013 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:35.856987 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-676b7779c6-7ztmr" event={"ID":"c6ca6943-d083-47f5-8631-fe06e28439c4","Type":"ContainerStarted","Data":"5a7bb743c43e54876a58291a929bf0cbdb1ab206ce84e7a62a67f9fae219624f"} Jun 03 23:03:35.857132 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:35.857033 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-676b7779c6-7ztmr" Jun 03 23:03:35.892917 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:35.892852 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-69cfcd8fb9-snskv" podStartSLOduration=1.8931621330000001 podStartE2EDuration="4.892836666s" totalImagesPullingTime="2.999674533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:35.889290459 +0000 UTC m=+794.227942962" watchObservedRunningTime="2026-06-03 23:03:35.892836666 +0000 UTC m=+794.231489153" Jun 03 23:03:35.921256 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:35.921179 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-676b7779c6-7ztmr" podStartSLOduration=1.094552807 podStartE2EDuration="3.921160164s" totalImagesPullingTime="2.826607357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:03:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:35.920034025 +0000 UTC m=+794.258686514" watchObservedRunningTime="2026-06-03 23:03:35.921160164 +0000 UTC m=+794.259812653" Jun 03 23:03:46.869288 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:46.869257 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69cfcd8fb9-snskv" Jun 03 23:03:46.869686 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:46.869484 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-676b7779c6-7ztmr" Jun 03 23:03:46.933932 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:46.933899 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69cfcd8fb9-snskv"] Jun 03 23:03:46.934152 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:46.934100 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-69cfcd8fb9-snskv" podUID="11d6865e-315f-43ca-b18a-8e732922551a" containerName="manager" containerID="cri-o://cb57fa5d4421de4623fea04bcae251d730dd22bbba578f870dc94c67850c3404" gracePeriod=30 Jun 03 23:03:47.181790 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:47.181765 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69cfcd8fb9-snskv" Jun 03 23:03:47.296082 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:47.296044 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hn669\" (UniqueName: \"kubernetes.io/projected/11d6865e-315f-43ca-b18a-8e732922551a-kube-api-access-hn669\") pod \"11d6865e-315f-43ca-b18a-8e732922551a\" (UID: \"11d6865e-315f-43ca-b18a-8e732922551a\") " Jun 03 23:03:47.298244 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:47.298220 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11d6865e-315f-43ca-b18a-8e732922551a-kube-api-access-hn669" (OuterVolumeSpecName: "kube-api-access-hn669") pod "11d6865e-315f-43ca-b18a-8e732922551a" (UID: "11d6865e-315f-43ca-b18a-8e732922551a"). InnerVolumeSpecName "kube-api-access-hn669". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:03:47.397420 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:47.397382 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hn669\" (UniqueName: \"kubernetes.io/projected/11d6865e-315f-43ca-b18a-8e732922551a-kube-api-access-hn669\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:03:47.929419 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:47.929383 2576 generic.go:356] "Generic (PLEG): container finished" podID="11d6865e-315f-43ca-b18a-8e732922551a" containerID="cb57fa5d4421de4623fea04bcae251d730dd22bbba578f870dc94c67850c3404" exitCode=0 Jun 03 23:03:47.929419 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:47.929424 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69cfcd8fb9-snskv" event={"ID":"11d6865e-315f-43ca-b18a-8e732922551a","Type":"ContainerDied","Data":"cb57fa5d4421de4623fea04bcae251d730dd22bbba578f870dc94c67850c3404"} Jun 03 23:03:47.929984 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:47.929439 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69cfcd8fb9-snskv" Jun 03 23:03:47.929984 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:47.929465 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69cfcd8fb9-snskv" event={"ID":"11d6865e-315f-43ca-b18a-8e732922551a","Type":"ContainerDied","Data":"2968e87d051ba749acbf92bf1513c0b2ad282104d2093b7b865ffb23232a33c2"} Jun 03 23:03:47.929984 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:47.929490 2576 scope.go:117] "RemoveContainer" containerID="cb57fa5d4421de4623fea04bcae251d730dd22bbba578f870dc94c67850c3404" Jun 03 23:03:47.939744 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:47.939602 2576 scope.go:117] "RemoveContainer" containerID="cb57fa5d4421de4623fea04bcae251d730dd22bbba578f870dc94c67850c3404" Jun 03 23:03:47.939940 ip-10-0-140-99 kubenswrapper[2576]: E0603 23:03:47.939919 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb57fa5d4421de4623fea04bcae251d730dd22bbba578f870dc94c67850c3404\": container with ID starting with cb57fa5d4421de4623fea04bcae251d730dd22bbba578f870dc94c67850c3404 not found: ID does not exist" containerID="cb57fa5d4421de4623fea04bcae251d730dd22bbba578f870dc94c67850c3404" Jun 03 23:03:47.939996 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:47.939953 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb57fa5d4421de4623fea04bcae251d730dd22bbba578f870dc94c67850c3404"} err="failed to get container status \"cb57fa5d4421de4623fea04bcae251d730dd22bbba578f870dc94c67850c3404\": rpc error: code = NotFound desc = could not find container \"cb57fa5d4421de4623fea04bcae251d730dd22bbba578f870dc94c67850c3404\": container with ID starting with cb57fa5d4421de4623fea04bcae251d730dd22bbba578f870dc94c67850c3404 not found: ID does not exist" Jun 03 23:03:47.950982 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:47.950948 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69cfcd8fb9-snskv"] Jun 03 23:03:47.956970 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:47.956942 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-69cfcd8fb9-snskv"] Jun 03 23:03:48.117707 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:03:48.117664 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11d6865e-315f-43ca-b18a-8e732922551a" path="/var/lib/kubelet/pods/11d6865e-315f-43ca-b18a-8e732922551a/volumes" Jun 03 23:04:06.785874 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:06.785841 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-64dc9dfcb8-jhrfw"] Jun 03 23:04:06.786283 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:06.786244 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11d6865e-315f-43ca-b18a-8e732922551a" containerName="manager" Jun 03 23:04:06.786283 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:06.786255 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="11d6865e-315f-43ca-b18a-8e732922551a" containerName="manager" Jun 03 23:04:06.786357 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:06.786322 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="11d6865e-315f-43ca-b18a-8e732922551a" containerName="manager" Jun 03 23:04:06.790899 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:06.790876 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-64dc9dfcb8-jhrfw" Jun 03 23:04:06.792837 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:06.792810 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-9gd9l\"" Jun 03 23:04:06.792969 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:06.792868 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 03 23:04:06.798774 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:06.798419 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-64dc9dfcb8-jhrfw"] Jun 03 23:04:06.878716 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:06.878684 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcqg6\" (UniqueName: \"kubernetes.io/projected/58deb3d3-ce9b-4023-953c-b674254b7471-kube-api-access-gcqg6\") pod \"maas-api-64dc9dfcb8-jhrfw\" (UID: \"58deb3d3-ce9b-4023-953c-b674254b7471\") " pod="opendatahub/maas-api-64dc9dfcb8-jhrfw" Jun 03 23:04:06.878900 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:06.878739 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58deb3d3-ce9b-4023-953c-b674254b7471-maas-api-tls\") pod \"maas-api-64dc9dfcb8-jhrfw\" (UID: \"58deb3d3-ce9b-4023-953c-b674254b7471\") " pod="opendatahub/maas-api-64dc9dfcb8-jhrfw" Jun 03 23:04:06.980096 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:06.980058 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcqg6\" (UniqueName: \"kubernetes.io/projected/58deb3d3-ce9b-4023-953c-b674254b7471-kube-api-access-gcqg6\") pod \"maas-api-64dc9dfcb8-jhrfw\" (UID: \"58deb3d3-ce9b-4023-953c-b674254b7471\") " pod="opendatahub/maas-api-64dc9dfcb8-jhrfw" Jun 03 23:04:06.980345 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:06.980120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58deb3d3-ce9b-4023-953c-b674254b7471-maas-api-tls\") pod \"maas-api-64dc9dfcb8-jhrfw\" (UID: \"58deb3d3-ce9b-4023-953c-b674254b7471\") " pod="opendatahub/maas-api-64dc9dfcb8-jhrfw" Jun 03 23:04:06.982839 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:06.982813 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58deb3d3-ce9b-4023-953c-b674254b7471-maas-api-tls\") pod \"maas-api-64dc9dfcb8-jhrfw\" (UID: \"58deb3d3-ce9b-4023-953c-b674254b7471\") " pod="opendatahub/maas-api-64dc9dfcb8-jhrfw" Jun 03 23:04:06.987751 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:06.987728 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcqg6\" (UniqueName: \"kubernetes.io/projected/58deb3d3-ce9b-4023-953c-b674254b7471-kube-api-access-gcqg6\") pod \"maas-api-64dc9dfcb8-jhrfw\" (UID: \"58deb3d3-ce9b-4023-953c-b674254b7471\") " pod="opendatahub/maas-api-64dc9dfcb8-jhrfw" Jun 03 23:04:07.102969 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:07.102934 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-64dc9dfcb8-jhrfw" Jun 03 23:04:07.264912 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:07.264873 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-64dc9dfcb8-jhrfw"] Jun 03 23:04:07.266321 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:04:07.266286 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58deb3d3_ce9b_4023_953c_b674254b7471.slice/crio-5593aac8a2aaa4d74e93f91be980ca3ded6a35d3e5d273e5dbde6a46891beb77 WatchSource:0}: Error finding container 5593aac8a2aaa4d74e93f91be980ca3ded6a35d3e5d273e5dbde6a46891beb77: Status 404 returned error can't find the container with id 5593aac8a2aaa4d74e93f91be980ca3ded6a35d3e5d273e5dbde6a46891beb77 Jun 03 23:04:07.297032 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:07.296997 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-gvmpb"] Jun 03 23:04:07.300522 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:07.300489 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-gvmpb" Jun 03 23:04:07.303652 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:07.303633 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-snjml\"" Jun 03 23:04:07.304217 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:07.304201 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 03 23:04:07.313471 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:07.313447 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-gvmpb"] Jun 03 23:04:07.383884 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:07.383793 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqkgn\" (UniqueName: \"kubernetes.io/projected/aa2d3bfe-d27e-40b1-8669-0819b3415989-kube-api-access-vqkgn\") pod \"payload-processing-7c6c859784-gvmpb\" (UID: \"aa2d3bfe-d27e-40b1-8669-0819b3415989\") " pod="openshift-ingress/payload-processing-7c6c859784-gvmpb" Jun 03 23:04:07.484913 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:07.484863 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqkgn\" (UniqueName: \"kubernetes.io/projected/aa2d3bfe-d27e-40b1-8669-0819b3415989-kube-api-access-vqkgn\") pod \"payload-processing-7c6c859784-gvmpb\" (UID: \"aa2d3bfe-d27e-40b1-8669-0819b3415989\") " pod="openshift-ingress/payload-processing-7c6c859784-gvmpb" Jun 03 23:04:07.501390 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:07.501360 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqkgn\" (UniqueName: \"kubernetes.io/projected/aa2d3bfe-d27e-40b1-8669-0819b3415989-kube-api-access-vqkgn\") pod \"payload-processing-7c6c859784-gvmpb\" (UID: \"aa2d3bfe-d27e-40b1-8669-0819b3415989\") " pod="openshift-ingress/payload-processing-7c6c859784-gvmpb" Jun 03 23:04:07.612394 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:07.612360 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-gvmpb" Jun 03 23:04:07.759215 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:07.759179 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-gvmpb"] Jun 03 23:04:07.760317 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:04:07.760294 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa2d3bfe_d27e_40b1_8669_0819b3415989.slice/crio-6ec621a720a7263949c5aa323ee43124dd1dc3248c2a3bc161a12916010e022e WatchSource:0}: Error finding container 6ec621a720a7263949c5aa323ee43124dd1dc3248c2a3bc161a12916010e022e: Status 404 returned error can't find the container with id 6ec621a720a7263949c5aa323ee43124dd1dc3248c2a3bc161a12916010e022e Jun 03 23:04:08.054932 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:08.054890 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-gvmpb" event={"ID":"aa2d3bfe-d27e-40b1-8669-0819b3415989","Type":"ContainerStarted","Data":"6ec621a720a7263949c5aa323ee43124dd1dc3248c2a3bc161a12916010e022e"} Jun 03 23:04:08.056404 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:08.056365 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-64dc9dfcb8-jhrfw" event={"ID":"58deb3d3-ce9b-4023-953c-b674254b7471","Type":"ContainerStarted","Data":"5593aac8a2aaa4d74e93f91be980ca3ded6a35d3e5d273e5dbde6a46891beb77"} Jun 03 23:04:09.065349 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:09.065314 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-64dc9dfcb8-jhrfw" event={"ID":"58deb3d3-ce9b-4023-953c-b674254b7471","Type":"ContainerStarted","Data":"784607db9b5dbfb33103698207d29eb16a5c5771f54e64fd95c1bf3dffac0b5c"} Jun 03 23:04:09.065845 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:09.065445 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-64dc9dfcb8-jhrfw" Jun 03 23:04:09.083640 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:09.083581 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-64dc9dfcb8-jhrfw" podStartSLOduration=1.6485266379999999 podStartE2EDuration="3.083566217s" totalImagesPullingTime="1.435039579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:04:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:04:09.079919889 +0000 UTC m=+827.418572378" watchObservedRunningTime="2026-06-03 23:04:09.083566217 +0000 UTC m=+827.422218704" Jun 03 23:04:10.073262 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:10.073227 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-gvmpb" event={"ID":"aa2d3bfe-d27e-40b1-8669-0819b3415989","Type":"ContainerStarted","Data":"3cf563f568251fff3cbfeff2df0432df7deec11553c0f9bd9fc19f84bf0517c8"} Jun 03 23:04:10.073715 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:10.073425 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-gvmpb" Jun 03 23:04:10.092414 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:10.092366 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-gvmpb" podStartSLOduration=0.909703951 podStartE2EDuration="3.092351857s" totalImagesPullingTime="2.182647906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:04:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:04:10.089666242 +0000 UTC m=+828.428318729" watchObservedRunningTime="2026-06-03 23:04:10.092351857 +0000 UTC m=+828.431004345" Jun 03 23:04:15.078860 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:15.078832 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-64dc9dfcb8-jhrfw" Jun 03 23:04:16.910808 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:16.910769 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:04:16.911181 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:16.911000 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="1432c85f-0cac-46ab-90f9-964876a49059" containerName="keycloak" containerID="cri-o://7fcf8ec721a0e50dfa8166a9e56389cb51955ff87ad0f488e0ef22ab457e1274" gracePeriod=30 Jun 03 23:04:18.569435 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:18.569409 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 23:04:18.691964 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:18.691865 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6l7q4\" (UniqueName: \"kubernetes.io/projected/1432c85f-0cac-46ab-90f9-964876a49059-kube-api-access-6l7q4\") pod \"1432c85f-0cac-46ab-90f9-964876a49059\" (UID: \"1432c85f-0cac-46ab-90f9-964876a49059\") " Jun 03 23:04:18.694132 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:18.694101 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1432c85f-0cac-46ab-90f9-964876a49059-kube-api-access-6l7q4" (OuterVolumeSpecName: "kube-api-access-6l7q4") pod "1432c85f-0cac-46ab-90f9-964876a49059" (UID: "1432c85f-0cac-46ab-90f9-964876a49059"). InnerVolumeSpecName "kube-api-access-6l7q4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:04:18.793278 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:18.793244 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6l7q4\" (UniqueName: \"kubernetes.io/projected/1432c85f-0cac-46ab-90f9-964876a49059-kube-api-access-6l7q4\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:04:19.140119 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.140077 2576 generic.go:356] "Generic (PLEG): container finished" podID="1432c85f-0cac-46ab-90f9-964876a49059" containerID="7fcf8ec721a0e50dfa8166a9e56389cb51955ff87ad0f488e0ef22ab457e1274" exitCode=143 Jun 03 23:04:19.140315 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.140126 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 23:04:19.140315 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.140132 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1432c85f-0cac-46ab-90f9-964876a49059","Type":"ContainerDied","Data":"7fcf8ec721a0e50dfa8166a9e56389cb51955ff87ad0f488e0ef22ab457e1274"} Jun 03 23:04:19.140315 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.140181 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1432c85f-0cac-46ab-90f9-964876a49059","Type":"ContainerDied","Data":"73f40a71f062fa419acba8482d2e605d75ef86b7bdadf2b2239eb6f766e7988c"} Jun 03 23:04:19.140315 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.140209 2576 scope.go:117] "RemoveContainer" containerID="7fcf8ec721a0e50dfa8166a9e56389cb51955ff87ad0f488e0ef22ab457e1274" Jun 03 23:04:19.151072 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.151051 2576 scope.go:117] "RemoveContainer" containerID="7fcf8ec721a0e50dfa8166a9e56389cb51955ff87ad0f488e0ef22ab457e1274" Jun 03 23:04:19.151418 ip-10-0-140-99 kubenswrapper[2576]: E0603 23:04:19.151396 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fcf8ec721a0e50dfa8166a9e56389cb51955ff87ad0f488e0ef22ab457e1274\": container with ID starting with 7fcf8ec721a0e50dfa8166a9e56389cb51955ff87ad0f488e0ef22ab457e1274 not found: ID does not exist" containerID="7fcf8ec721a0e50dfa8166a9e56389cb51955ff87ad0f488e0ef22ab457e1274" Jun 03 23:04:19.151475 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.151427 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fcf8ec721a0e50dfa8166a9e56389cb51955ff87ad0f488e0ef22ab457e1274"} err="failed to get container status \"7fcf8ec721a0e50dfa8166a9e56389cb51955ff87ad0f488e0ef22ab457e1274\": rpc error: code = NotFound desc = could not find container \"7fcf8ec721a0e50dfa8166a9e56389cb51955ff87ad0f488e0ef22ab457e1274\": container with ID starting with 7fcf8ec721a0e50dfa8166a9e56389cb51955ff87ad0f488e0ef22ab457e1274 not found: ID does not exist" Jun 03 23:04:19.162523 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.162489 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:04:19.166186 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.166163 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:04:19.189913 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.189881 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:04:19.190374 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.190356 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1432c85f-0cac-46ab-90f9-964876a49059" containerName="keycloak" Jun 03 23:04:19.190463 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.190376 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1432c85f-0cac-46ab-90f9-964876a49059" containerName="keycloak" Jun 03 23:04:19.190550 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.190485 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1432c85f-0cac-46ab-90f9-964876a49059" containerName="keycloak" Jun 03 23:04:19.194914 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.194895 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 23:04:19.196749 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.196731 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 23:04:19.196855 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.196755 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 23:04:19.196922 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.196878 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 23:04:19.196922 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.196909 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 03 23:04:19.197013 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.196970 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-wprhc\"" Jun 03 23:04:19.202152 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.202129 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:04:19.298753 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.298716 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fqdb\" (UniqueName: \"kubernetes.io/projected/c3bbd799-4c50-4749-ba2e-cd2b77c72662-kube-api-access-8fqdb\") pod \"maas-keycloak-0\" (UID: \"c3bbd799-4c50-4749-ba2e-cd2b77c72662\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:04:19.298935 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.298760 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/c3bbd799-4c50-4749-ba2e-cd2b77c72662-test-realms\") pod \"maas-keycloak-0\" (UID: \"c3bbd799-4c50-4749-ba2e-cd2b77c72662\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:04:19.400037 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.399941 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fqdb\" (UniqueName: \"kubernetes.io/projected/c3bbd799-4c50-4749-ba2e-cd2b77c72662-kube-api-access-8fqdb\") pod \"maas-keycloak-0\" (UID: \"c3bbd799-4c50-4749-ba2e-cd2b77c72662\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:04:19.400037 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.399987 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/c3bbd799-4c50-4749-ba2e-cd2b77c72662-test-realms\") pod \"maas-keycloak-0\" (UID: \"c3bbd799-4c50-4749-ba2e-cd2b77c72662\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:04:19.400789 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.400768 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/c3bbd799-4c50-4749-ba2e-cd2b77c72662-test-realms\") pod \"maas-keycloak-0\" (UID: \"c3bbd799-4c50-4749-ba2e-cd2b77c72662\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:04:19.408375 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.408351 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fqdb\" (UniqueName: \"kubernetes.io/projected/c3bbd799-4c50-4749-ba2e-cd2b77c72662-kube-api-access-8fqdb\") pod \"maas-keycloak-0\" (UID: \"c3bbd799-4c50-4749-ba2e-cd2b77c72662\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:04:19.506416 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.506377 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 23:04:19.649230 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:19.649203 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:04:19.651541 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:04:19.651443 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3bbd799_4c50_4749_ba2e_cd2b77c72662.slice/crio-f27f6f64f8cbc9e932562c916e7e99096925894087ed1a8a40646412685d3014 WatchSource:0}: Error finding container f27f6f64f8cbc9e932562c916e7e99096925894087ed1a8a40646412685d3014: Status 404 returned error can't find the container with id f27f6f64f8cbc9e932562c916e7e99096925894087ed1a8a40646412685d3014 Jun 03 23:04:20.119613 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:20.119577 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1432c85f-0cac-46ab-90f9-964876a49059" path="/var/lib/kubelet/pods/1432c85f-0cac-46ab-90f9-964876a49059/volumes" Jun 03 23:04:20.151660 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:20.151621 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c3bbd799-4c50-4749-ba2e-cd2b77c72662","Type":"ContainerStarted","Data":"a68d3c2cde4a47b99872981bb90164f6b770d4e852d832ba970654ea9c36a1fd"} Jun 03 23:04:20.151840 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:20.151677 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c3bbd799-4c50-4749-ba2e-cd2b77c72662","Type":"ContainerStarted","Data":"f27f6f64f8cbc9e932562c916e7e99096925894087ed1a8a40646412685d3014"} Jun 03 23:04:20.171341 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:20.171281 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.89162904 podStartE2EDuration="1.171266772s" totalImagesPullingTime="279.637732ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:04:20.16932656 +0000 UTC m=+838.507979050" watchObservedRunningTime="2026-06-03 23:04:20.171266772 +0000 UTC m=+838.509919260" Jun 03 23:04:20.506811 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:20.506767 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 23:04:20.508840 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:20.508800 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3bbd799-4c50-4749-ba2e-cd2b77c72662" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 23:04:21.081807 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:21.081775 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-gvmpb" Jun 03 23:04:21.507208 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:21.507087 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3bbd799-4c50-4749-ba2e-cd2b77c72662" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 23:04:22.507452 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:22.507400 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3bbd799-4c50-4749-ba2e-cd2b77c72662" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 23:04:23.507644 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:23.507588 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3bbd799-4c50-4749-ba2e-cd2b77c72662" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 23:04:24.507682 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:24.507629 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3bbd799-4c50-4749-ba2e-cd2b77c72662" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 23:04:25.508026 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:25.507971 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3bbd799-4c50-4749-ba2e-cd2b77c72662" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 23:04:26.507421 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:26.507366 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3bbd799-4c50-4749-ba2e-cd2b77c72662" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 23:04:27.507545 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:27.507471 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3bbd799-4c50-4749-ba2e-cd2b77c72662" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 23:04:28.507469 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:28.507418 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3bbd799-4c50-4749-ba2e-cd2b77c72662" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 23:04:29.507396 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:29.507361 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 23:04:29.507947 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:29.507647 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3bbd799-4c50-4749-ba2e-cd2b77c72662" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 23:04:30.507025 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:30.506975 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3bbd799-4c50-4749-ba2e-cd2b77c72662" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 23:04:31.507222 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:31.507106 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3bbd799-4c50-4749-ba2e-cd2b77c72662" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 23:04:32.506967 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:32.506914 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3bbd799-4c50-4749-ba2e-cd2b77c72662" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 23:04:33.507438 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:33.507376 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c3bbd799-4c50-4749-ba2e-cd2b77c72662" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 23:04:34.604131 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:34.604045 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 23:04:34.622845 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:34.622782 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="c3bbd799-4c50-4749-ba2e-cd2b77c72662" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 23:04:44.610013 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:44.609972 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 23:04:56.850551 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:56.850496 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5585db8bbc-tdw4t"] Jun 03 23:04:56.850995 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:56.850757 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5585db8bbc-tdw4t" podUID="9fac2825-1279-462e-8774-087b19751611" containerName="authorino" containerID="cri-o://f4206833d3d2991b459b511c604b0c247fe5b93ea998e0133f1c70c85ab44ac3" gracePeriod=30 Jun 03 23:04:57.129421 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:57.129396 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5585db8bbc-tdw4t" Jun 03 23:04:57.199584 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:57.199549 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9fac2825-1279-462e-8774-087b19751611-tls-cert\") pod \"9fac2825-1279-462e-8774-087b19751611\" (UID: \"9fac2825-1279-462e-8774-087b19751611\") " Jun 03 23:04:57.199768 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:57.199641 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4xqc\" (UniqueName: \"kubernetes.io/projected/9fac2825-1279-462e-8774-087b19751611-kube-api-access-w4xqc\") pod \"9fac2825-1279-462e-8774-087b19751611\" (UID: \"9fac2825-1279-462e-8774-087b19751611\") " Jun 03 23:04:57.201706 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:57.201675 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fac2825-1279-462e-8774-087b19751611-kube-api-access-w4xqc" (OuterVolumeSpecName: "kube-api-access-w4xqc") pod "9fac2825-1279-462e-8774-087b19751611" (UID: "9fac2825-1279-462e-8774-087b19751611"). InnerVolumeSpecName "kube-api-access-w4xqc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:04:57.211300 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:57.211271 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fac2825-1279-462e-8774-087b19751611-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9fac2825-1279-462e-8774-087b19751611" (UID: "9fac2825-1279-462e-8774-087b19751611"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:04:57.300674 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:57.300634 2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9fac2825-1279-462e-8774-087b19751611-tls-cert\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:04:57.300674 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:57.300669 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4xqc\" (UniqueName: \"kubernetes.io/projected/9fac2825-1279-462e-8774-087b19751611-kube-api-access-w4xqc\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:04:57.436846 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:57.436752 2576 generic.go:356] "Generic (PLEG): container finished" podID="9fac2825-1279-462e-8774-087b19751611" containerID="f4206833d3d2991b459b511c604b0c247fe5b93ea998e0133f1c70c85ab44ac3" exitCode=0 Jun 03 23:04:57.436992 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:57.436852 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5585db8bbc-tdw4t" event={"ID":"9fac2825-1279-462e-8774-087b19751611","Type":"ContainerDied","Data":"f4206833d3d2991b459b511c604b0c247fe5b93ea998e0133f1c70c85ab44ac3"} Jun 03 23:04:57.436992 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:57.436855 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5585db8bbc-tdw4t" Jun 03 23:04:57.436992 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:57.436885 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5585db8bbc-tdw4t" event={"ID":"9fac2825-1279-462e-8774-087b19751611","Type":"ContainerDied","Data":"bee4b090e32910e395e283002e09aa9cd97ec3dfbb291e472327dfca04f77755"} Jun 03 23:04:57.436992 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:57.436913 2576 scope.go:117] "RemoveContainer" containerID="f4206833d3d2991b459b511c604b0c247fe5b93ea998e0133f1c70c85ab44ac3" Jun 03 23:04:57.446904 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:57.446883 2576 scope.go:117] "RemoveContainer" containerID="f4206833d3d2991b459b511c604b0c247fe5b93ea998e0133f1c70c85ab44ac3" Jun 03 23:04:57.447183 ip-10-0-140-99 kubenswrapper[2576]: E0603 23:04:57.447163 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4206833d3d2991b459b511c604b0c247fe5b93ea998e0133f1c70c85ab44ac3\": container with ID starting with f4206833d3d2991b459b511c604b0c247fe5b93ea998e0133f1c70c85ab44ac3 not found: ID does not exist" containerID="f4206833d3d2991b459b511c604b0c247fe5b93ea998e0133f1c70c85ab44ac3" Jun 03 23:04:57.447228 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:57.447203 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4206833d3d2991b459b511c604b0c247fe5b93ea998e0133f1c70c85ab44ac3"} err="failed to get container status \"f4206833d3d2991b459b511c604b0c247fe5b93ea998e0133f1c70c85ab44ac3\": rpc error: code = NotFound desc = could not find container \"f4206833d3d2991b459b511c604b0c247fe5b93ea998e0133f1c70c85ab44ac3\": container with ID starting with f4206833d3d2991b459b511c604b0c247fe5b93ea998e0133f1c70c85ab44ac3 not found: ID does not exist" Jun 03 23:04:57.461392 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:57.461360 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5585db8bbc-tdw4t"] Jun 03 23:04:57.463966 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:57.463946 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5585db8bbc-tdw4t"] Jun 03 23:04:58.118402 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:04:58.118368 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fac2825-1279-462e-8774-087b19751611" path="/var/lib/kubelet/pods/9fac2825-1279-462e-8774-087b19751611/volumes" Jun 03 23:05:09.792631 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.792600 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88"] Jun 03 23:05:09.793262 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.793241 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fac2825-1279-462e-8774-087b19751611" containerName="authorino" Jun 03 23:05:09.793355 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.793265 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fac2825-1279-462e-8774-087b19751611" containerName="authorino" Jun 03 23:05:09.793411 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.793384 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fac2825-1279-462e-8774-087b19751611" containerName="authorino" Jun 03 23:05:09.796765 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.796740 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" Jun 03 23:05:09.798982 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.798960 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 03 23:05:09.799143 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.799120 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 23:05:09.799460 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.799441 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 23:05:09.799607 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.799591 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8mn54\"" Jun 03 23:05:09.808890 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.808866 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88"] Jun 03 23:05:09.823624 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.823593 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61fd16cb-e761-4bfd-9371-d168a370200e-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88\" (UID: \"61fd16cb-e761-4bfd-9371-d168a370200e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" Jun 03 23:05:09.823807 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.823631 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61fd16cb-e761-4bfd-9371-d168a370200e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88\" (UID: \"61fd16cb-e761-4bfd-9371-d168a370200e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" Jun 03 23:05:09.823874 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.823800 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61fd16cb-e761-4bfd-9371-d168a370200e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88\" (UID: \"61fd16cb-e761-4bfd-9371-d168a370200e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" Jun 03 23:05:09.823874 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.823852 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61fd16cb-e761-4bfd-9371-d168a370200e-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88\" (UID: \"61fd16cb-e761-4bfd-9371-d168a370200e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" Jun 03 23:05:09.823969 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.823910 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/61fd16cb-e761-4bfd-9371-d168a370200e-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88\" (UID: \"61fd16cb-e761-4bfd-9371-d168a370200e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" Jun 03 23:05:09.823969 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.823951 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkv9c\" (UniqueName: \"kubernetes.io/projected/61fd16cb-e761-4bfd-9371-d168a370200e-kube-api-access-nkv9c\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88\" (UID: \"61fd16cb-e761-4bfd-9371-d168a370200e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" Jun 03 23:05:09.924702 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.924665 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61fd16cb-e761-4bfd-9371-d168a370200e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88\" (UID: \"61fd16cb-e761-4bfd-9371-d168a370200e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" Jun 03 23:05:09.924902 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.924707 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61fd16cb-e761-4bfd-9371-d168a370200e-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88\" (UID: \"61fd16cb-e761-4bfd-9371-d168a370200e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" Jun 03 23:05:09.924902 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.924741 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/61fd16cb-e761-4bfd-9371-d168a370200e-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88\" (UID: \"61fd16cb-e761-4bfd-9371-d168a370200e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" Jun 03 23:05:09.924902 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.924769 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkv9c\" (UniqueName: \"kubernetes.io/projected/61fd16cb-e761-4bfd-9371-d168a370200e-kube-api-access-nkv9c\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88\" (UID: \"61fd16cb-e761-4bfd-9371-d168a370200e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" Jun 03 23:05:09.924902 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.924789 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61fd16cb-e761-4bfd-9371-d168a370200e-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88\" (UID: \"61fd16cb-e761-4bfd-9371-d168a370200e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" Jun 03 23:05:09.924902 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.924804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61fd16cb-e761-4bfd-9371-d168a370200e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88\" (UID: \"61fd16cb-e761-4bfd-9371-d168a370200e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" Jun 03 23:05:09.925190 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.925123 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61fd16cb-e761-4bfd-9371-d168a370200e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88\" (UID: \"61fd16cb-e761-4bfd-9371-d168a370200e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" Jun 03 23:05:09.925190 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.925177 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61fd16cb-e761-4bfd-9371-d168a370200e-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88\" (UID: \"61fd16cb-e761-4bfd-9371-d168a370200e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" Jun 03 23:05:09.925275 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.925226 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/61fd16cb-e761-4bfd-9371-d168a370200e-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88\" (UID: \"61fd16cb-e761-4bfd-9371-d168a370200e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" Jun 03 23:05:09.927121 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.927100 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61fd16cb-e761-4bfd-9371-d168a370200e-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88\" (UID: \"61fd16cb-e761-4bfd-9371-d168a370200e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" Jun 03 23:05:09.927494 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.927470 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61fd16cb-e761-4bfd-9371-d168a370200e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88\" (UID: \"61fd16cb-e761-4bfd-9371-d168a370200e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" Jun 03 23:05:09.932955 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:09.932921 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkv9c\" (UniqueName: \"kubernetes.io/projected/61fd16cb-e761-4bfd-9371-d168a370200e-kube-api-access-nkv9c\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88\" (UID: \"61fd16cb-e761-4bfd-9371-d168a370200e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" Jun 03 23:05:10.110128 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:10.110087 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" Jun 03 23:05:10.254075 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:10.254030 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88"] Jun 03 23:05:10.255721 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:05:10.255685 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61fd16cb_e761_4bfd_9371_d168a370200e.slice/crio-1b57045ed234b95b42341ed046fdee7eaca118df4d9ade01eb21b415659393be WatchSource:0}: Error finding container 1b57045ed234b95b42341ed046fdee7eaca118df4d9ade01eb21b415659393be: Status 404 returned error can't find the container with id 1b57045ed234b95b42341ed046fdee7eaca118df4d9ade01eb21b415659393be Jun 03 23:05:10.515762 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:10.515672 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" event={"ID":"61fd16cb-e761-4bfd-9371-d168a370200e","Type":"ContainerStarted","Data":"1b57045ed234b95b42341ed046fdee7eaca118df4d9ade01eb21b415659393be"} Jun 03 23:05:14.552549 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:14.552482 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" event={"ID":"61fd16cb-e761-4bfd-9371-d168a370200e","Type":"ContainerStarted","Data":"0c7f9d41760c0bf27d314a705ba05652e44daff0ed6a02ed344d5291b038b295"} Jun 03 23:05:16.566588 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:16.566552 2576 generic.go:356] "Generic (PLEG): container finished" podID="61fd16cb-e761-4bfd-9371-d168a370200e" containerID="0c7f9d41760c0bf27d314a705ba05652e44daff0ed6a02ed344d5291b038b295" exitCode=0 Jun 03 23:05:16.567141 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:16.566631 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" event={"ID":"61fd16cb-e761-4bfd-9371-d168a370200e","Type":"ContainerDied","Data":"0c7f9d41760c0bf27d314a705ba05652e44daff0ed6a02ed344d5291b038b295"} Jun 03 23:05:18.581156 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:18.581117 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" event={"ID":"61fd16cb-e761-4bfd-9371-d168a370200e","Type":"ContainerStarted","Data":"1df874aa8a3667260072dd999fc254dde91613a2e68fcd08273f9de5cac41ca2"} Jun 03 23:05:18.601754 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:18.601702 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" podStartSLOduration=2.8616898060000002 podStartE2EDuration="9.601684616s" totalImagesPullingTime="5.388269705s" totalInitContainerRuntime="1.351725105s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:05:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:05:18.599437118 +0000 UTC m=+896.938089607" watchObservedRunningTime="2026-06-03 23:05:18.601684616 +0000 UTC m=+896.940337101" Jun 03 23:05:20.110919 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:20.110865 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" Jun 03 23:05:20.118240 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:20.118212 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" Jun 03 23:05:20.124182 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:20.124163 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" Jun 03 23:05:20.613295 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:20.613259 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88" Jun 03 23:05:22.155975 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:22.155946 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvqlh_c1356fb0-4884-41e6-8d59-fed020dd7a80/ovn-acl-logging/0.log" Jun 03 23:05:22.157983 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:05:22.157962 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvqlh_c1356fb0-4884-41e6-8d59-fed020dd7a80/ovn-acl-logging/0.log" Jun 03 23:09:16.274604 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:16.274561 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-676b7779c6-7ztmr"] Jun 03 23:09:16.275113 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:16.274802 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-676b7779c6-7ztmr" podUID="c6ca6943-d083-47f5-8631-fe06e28439c4" containerName="manager" containerID="cri-o://5a7bb743c43e54876a58291a929bf0cbdb1ab206ce84e7a62a67f9fae219624f" gracePeriod=30 Jun 03 23:09:16.534276 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:16.534207 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-676b7779c6-7ztmr" Jun 03 23:09:16.568589 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:16.568560 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsd45\" (UniqueName: \"kubernetes.io/projected/c6ca6943-d083-47f5-8631-fe06e28439c4-kube-api-access-lsd45\") pod \"c6ca6943-d083-47f5-8631-fe06e28439c4\" (UID: \"c6ca6943-d083-47f5-8631-fe06e28439c4\") " Jun 03 23:09:16.570891 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:16.570839 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6ca6943-d083-47f5-8631-fe06e28439c4-kube-api-access-lsd45" (OuterVolumeSpecName: "kube-api-access-lsd45") pod "c6ca6943-d083-47f5-8631-fe06e28439c4" (UID: "c6ca6943-d083-47f5-8631-fe06e28439c4"). InnerVolumeSpecName "kube-api-access-lsd45". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:09:16.669298 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:16.669256 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsd45\" (UniqueName: \"kubernetes.io/projected/c6ca6943-d083-47f5-8631-fe06e28439c4-kube-api-access-lsd45\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:09:17.060586 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:17.060545 2576 generic.go:356] "Generic (PLEG): container finished" podID="c6ca6943-d083-47f5-8631-fe06e28439c4" containerID="5a7bb743c43e54876a58291a929bf0cbdb1ab206ce84e7a62a67f9fae219624f" exitCode=0 Jun 03 23:09:17.060760 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:17.060592 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-676b7779c6-7ztmr" event={"ID":"c6ca6943-d083-47f5-8631-fe06e28439c4","Type":"ContainerDied","Data":"5a7bb743c43e54876a58291a929bf0cbdb1ab206ce84e7a62a67f9fae219624f"} Jun 03 23:09:17.060760 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:17.060601 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-676b7779c6-7ztmr" Jun 03 23:09:17.060760 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:17.060646 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-676b7779c6-7ztmr" event={"ID":"c6ca6943-d083-47f5-8631-fe06e28439c4","Type":"ContainerDied","Data":"8c67a6b410858e4fd0b031f39278ba07d41422d9581053ece33aafea0992f6fd"} Jun 03 23:09:17.060760 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:17.060676 2576 scope.go:117] "RemoveContainer" containerID="5a7bb743c43e54876a58291a929bf0cbdb1ab206ce84e7a62a67f9fae219624f" Jun 03 23:09:17.073712 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:17.073689 2576 scope.go:117] "RemoveContainer" containerID="5a7bb743c43e54876a58291a929bf0cbdb1ab206ce84e7a62a67f9fae219624f" Jun 03 23:09:17.074075 ip-10-0-140-99 kubenswrapper[2576]: E0603 23:09:17.074045 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a7bb743c43e54876a58291a929bf0cbdb1ab206ce84e7a62a67f9fae219624f\": container with ID starting with 5a7bb743c43e54876a58291a929bf0cbdb1ab206ce84e7a62a67f9fae219624f not found: ID does not exist" containerID="5a7bb743c43e54876a58291a929bf0cbdb1ab206ce84e7a62a67f9fae219624f" Jun 03 23:09:17.074194 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:17.074085 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a7bb743c43e54876a58291a929bf0cbdb1ab206ce84e7a62a67f9fae219624f"} err="failed to get container status \"5a7bb743c43e54876a58291a929bf0cbdb1ab206ce84e7a62a67f9fae219624f\": rpc error: code = NotFound desc = could not find container \"5a7bb743c43e54876a58291a929bf0cbdb1ab206ce84e7a62a67f9fae219624f\": container with ID starting with 5a7bb743c43e54876a58291a929bf0cbdb1ab206ce84e7a62a67f9fae219624f not found: ID does not exist" Jun 03 23:09:17.109046 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:17.109016 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-676b7779c6-7ztmr"] Jun 03 23:09:17.113595 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:17.113568 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-676b7779c6-7ztmr"] Jun 03 23:09:17.884824 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:17.884793 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-676b7779c6-gx68c"] Jun 03 23:09:17.885234 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:17.885221 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6ca6943-d083-47f5-8631-fe06e28439c4" containerName="manager" Jun 03 23:09:17.885276 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:17.885235 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6ca6943-d083-47f5-8631-fe06e28439c4" containerName="manager" Jun 03 23:09:17.885314 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:17.885306 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6ca6943-d083-47f5-8631-fe06e28439c4" containerName="manager" Jun 03 23:09:17.889351 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:17.889330 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-676b7779c6-gx68c" Jun 03 23:09:17.891277 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:17.891258 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 23:09:17.891397 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:17.891278 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tpl4k\"" Jun 03 23:09:17.898332 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:17.898302 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-676b7779c6-gx68c"] Jun 03 23:09:17.982002 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:17.981962 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsnhl\" (UniqueName: \"kubernetes.io/projected/f4072108-1ded-40c1-981a-ef48aca0a373-kube-api-access-nsnhl\") pod \"maas-controller-676b7779c6-gx68c\" (UID: \"f4072108-1ded-40c1-981a-ef48aca0a373\") " pod="opendatahub/maas-controller-676b7779c6-gx68c" Jun 03 23:09:18.083085 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:18.083046 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsnhl\" (UniqueName: \"kubernetes.io/projected/f4072108-1ded-40c1-981a-ef48aca0a373-kube-api-access-nsnhl\") pod \"maas-controller-676b7779c6-gx68c\" (UID: \"f4072108-1ded-40c1-981a-ef48aca0a373\") " pod="opendatahub/maas-controller-676b7779c6-gx68c" Jun 03 23:09:18.092306 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:18.092274 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsnhl\" (UniqueName: \"kubernetes.io/projected/f4072108-1ded-40c1-981a-ef48aca0a373-kube-api-access-nsnhl\") pod \"maas-controller-676b7779c6-gx68c\" (UID: \"f4072108-1ded-40c1-981a-ef48aca0a373\") " pod="opendatahub/maas-controller-676b7779c6-gx68c" Jun 03 23:09:18.117776 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:18.117741 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6ca6943-d083-47f5-8631-fe06e28439c4" path="/var/lib/kubelet/pods/c6ca6943-d083-47f5-8631-fe06e28439c4/volumes" Jun 03 23:09:18.201086 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:18.200994 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-676b7779c6-gx68c" Jun 03 23:09:18.342714 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:09:18.342683 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4072108_1ded_40c1_981a_ef48aca0a373.slice/crio-b49a6e38006bdfa5f8c691fcc7c5f9c3e7259ea524a6f894049142ce2f16b59e WatchSource:0}: Error finding container b49a6e38006bdfa5f8c691fcc7c5f9c3e7259ea524a6f894049142ce2f16b59e: Status 404 returned error can't find the container with id b49a6e38006bdfa5f8c691fcc7c5f9c3e7259ea524a6f894049142ce2f16b59e Jun 03 23:09:18.343590 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:18.343560 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-676b7779c6-gx68c"] Jun 03 23:09:18.344067 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:18.344050 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 23:09:19.075228 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:19.075191 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-676b7779c6-gx68c" event={"ID":"f4072108-1ded-40c1-981a-ef48aca0a373","Type":"ContainerStarted","Data":"9b9080121df836c11625effb4c107bf33bd5e77855c0c33c37bcc87de6966dd7"} Jun 03 23:09:19.075667 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:19.075253 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-676b7779c6-gx68c" event={"ID":"f4072108-1ded-40c1-981a-ef48aca0a373","Type":"ContainerStarted","Data":"b49a6e38006bdfa5f8c691fcc7c5f9c3e7259ea524a6f894049142ce2f16b59e"} Jun 03 23:09:19.075667 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:19.075281 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-676b7779c6-gx68c" Jun 03 23:09:19.092901 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:19.092827 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-676b7779c6-gx68c" podStartSLOduration=1.7226770070000001 podStartE2EDuration="2.092808086s" totalImagesPullingTime="370.131079ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:09:19.092138478 +0000 UTC m=+1137.430790988" watchObservedRunningTime="2026-06-03 23:09:19.092808086 +0000 UTC m=+1137.431460577" Jun 03 23:09:30.088342 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:09:30.088308 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-676b7779c6-gx68c" Jun 03 23:10:22.198942 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:10:22.198912 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvqlh_c1356fb0-4884-41e6-8d59-fed020dd7a80/ovn-acl-logging/0.log" Jun 03 23:10:22.201780 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:10:22.201758 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvqlh_c1356fb0-4884-41e6-8d59-fed020dd7a80/ovn-acl-logging/0.log" Jun 03 23:15:22.241860 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:15:22.241829 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvqlh_c1356fb0-4884-41e6-8d59-fed020dd7a80/ovn-acl-logging/0.log" Jun 03 23:15:22.256695 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:15:22.256669 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvqlh_c1356fb0-4884-41e6-8d59-fed020dd7a80/ovn-acl-logging/0.log" Jun 03 23:19:48.093067 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:19:48.093030 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxxxv"] Jun 03 23:19:48.093701 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:19:48.093229 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxxxv" podUID="73489b68-7e4c-4d0b-95dd-984ce04bbe8d" containerName="manager" containerID="cri-o://84a96faf2505dd3dde83e7f8746db4a82e919073b9dd39e4ed9e5150d9dd75e4" gracePeriod=10 Jun 03 23:19:48.968278 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:19:48.967994 2576 generic.go:356] "Generic (PLEG): container finished" podID="73489b68-7e4c-4d0b-95dd-984ce04bbe8d" containerID="84a96faf2505dd3dde83e7f8746db4a82e919073b9dd39e4ed9e5150d9dd75e4" exitCode=0 Jun 03 23:19:48.968278 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:19:48.968206 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxxxv" event={"ID":"73489b68-7e4c-4d0b-95dd-984ce04bbe8d","Type":"ContainerDied","Data":"84a96faf2505dd3dde83e7f8746db4a82e919073b9dd39e4ed9e5150d9dd75e4"} Jun 03 23:19:49.051117 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:19:49.051086 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxxxv" Jun 03 23:19:49.208133 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:19:49.208043 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2hkm\" (UniqueName: \"kubernetes.io/projected/73489b68-7e4c-4d0b-95dd-984ce04bbe8d-kube-api-access-g2hkm\") pod \"73489b68-7e4c-4d0b-95dd-984ce04bbe8d\" (UID: \"73489b68-7e4c-4d0b-95dd-984ce04bbe8d\") " Jun 03 23:19:49.208133 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:19:49.208082 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73489b68-7e4c-4d0b-95dd-984ce04bbe8d-extensions-socket-volume\") pod \"73489b68-7e4c-4d0b-95dd-984ce04bbe8d\" (UID: \"73489b68-7e4c-4d0b-95dd-984ce04bbe8d\") " Jun 03 23:19:49.208591 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:19:49.208483 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73489b68-7e4c-4d0b-95dd-984ce04bbe8d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "73489b68-7e4c-4d0b-95dd-984ce04bbe8d" (UID: "73489b68-7e4c-4d0b-95dd-984ce04bbe8d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:19:49.210264 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:19:49.210240 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73489b68-7e4c-4d0b-95dd-984ce04bbe8d-kube-api-access-g2hkm" (OuterVolumeSpecName: "kube-api-access-g2hkm") pod "73489b68-7e4c-4d0b-95dd-984ce04bbe8d" (UID: "73489b68-7e4c-4d0b-95dd-984ce04bbe8d"). InnerVolumeSpecName "kube-api-access-g2hkm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:19:49.309861 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:19:49.309824 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2hkm\" (UniqueName: \"kubernetes.io/projected/73489b68-7e4c-4d0b-95dd-984ce04bbe8d-kube-api-access-g2hkm\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:19:49.309861 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:19:49.309853 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73489b68-7e4c-4d0b-95dd-984ce04bbe8d-extensions-socket-volume\") on node \"ip-10-0-140-99.ec2.internal\" DevicePath \"\"" Jun 03 23:19:49.975421 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:19:49.975390 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxxxv" Jun 03 23:19:49.975421 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:19:49.975413 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxxxv" event={"ID":"73489b68-7e4c-4d0b-95dd-984ce04bbe8d","Type":"ContainerDied","Data":"4b427c44050e0a53eee8f21819a915d0ff55b24f47019671b901e3f3ed1b0972"} Jun 03 23:19:49.975707 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:19:49.975477 2576 scope.go:117] "RemoveContainer" containerID="84a96faf2505dd3dde83e7f8746db4a82e919073b9dd39e4ed9e5150d9dd75e4" Jun 03 23:19:49.996838 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:19:49.996807 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxxxv"] Jun 03 23:19:50.000984 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:19:50.000954 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxxxv"] Jun 03 23:19:50.117684 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:19:50.117652 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73489b68-7e4c-4d0b-95dd-984ce04bbe8d" path="/var/lib/kubelet/pods/73489b68-7e4c-4d0b-95dd-984ce04bbe8d/volumes" Jun 03 23:20:22.291490 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:20:22.291459 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvqlh_c1356fb0-4884-41e6-8d59-fed020dd7a80/ovn-acl-logging/0.log" Jun 03 23:20:22.300897 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:20:22.300873 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvqlh_c1356fb0-4884-41e6-8d59-fed020dd7a80/ovn-acl-logging/0.log" Jun 03 23:20:54.199668 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:20:54.199633 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-292jt"] Jun 03 23:20:54.200281 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:20:54.200258 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73489b68-7e4c-4d0b-95dd-984ce04bbe8d" containerName="manager" Jun 03 23:20:54.200281 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:20:54.200279 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="73489b68-7e4c-4d0b-95dd-984ce04bbe8d" containerName="manager" Jun 03 23:20:54.200410 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:20:54.200383 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="73489b68-7e4c-4d0b-95dd-984ce04bbe8d" containerName="manager" Jun 03 23:20:54.203659 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:20:54.203635 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-292jt" Jun 03 23:20:54.205593 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:20:54.205573 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nckxq\"" Jun 03 23:20:54.217234 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:20:54.217210 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-292jt"] Jun 03 23:20:54.321379 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:20:54.321339 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjn8h\" (UniqueName: \"kubernetes.io/projected/d53b34cb-de79-4dfb-b92f-bb447a58e291-kube-api-access-jjn8h\") pod \"kuadrant-operator-controller-manager-86878c769f-292jt\" (UID: \"d53b34cb-de79-4dfb-b92f-bb447a58e291\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-292jt" Jun 03 23:20:54.321379 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:20:54.321386 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d53b34cb-de79-4dfb-b92f-bb447a58e291-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-292jt\" (UID: \"d53b34cb-de79-4dfb-b92f-bb447a58e291\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-292jt" Jun 03 23:20:54.422227 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:20:54.422193 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjn8h\" (UniqueName: \"kubernetes.io/projected/d53b34cb-de79-4dfb-b92f-bb447a58e291-kube-api-access-jjn8h\") pod \"kuadrant-operator-controller-manager-86878c769f-292jt\" (UID: \"d53b34cb-de79-4dfb-b92f-bb447a58e291\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-292jt" Jun 03 23:20:54.422415 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:20:54.422238 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d53b34cb-de79-4dfb-b92f-bb447a58e291-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-292jt\" (UID: \"d53b34cb-de79-4dfb-b92f-bb447a58e291\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-292jt" Jun 03 23:20:54.422735 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:20:54.422716 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d53b34cb-de79-4dfb-b92f-bb447a58e291-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-292jt\" (UID: \"d53b34cb-de79-4dfb-b92f-bb447a58e291\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-292jt" Jun 03 23:20:54.431136 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:20:54.431106 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjn8h\" (UniqueName: \"kubernetes.io/projected/d53b34cb-de79-4dfb-b92f-bb447a58e291-kube-api-access-jjn8h\") pod \"kuadrant-operator-controller-manager-86878c769f-292jt\" (UID: \"d53b34cb-de79-4dfb-b92f-bb447a58e291\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-292jt" Jun 03 23:20:54.514668 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:20:54.514584 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-292jt" Jun 03 23:20:54.658666 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:20:54.658642 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-292jt"] Jun 03 23:20:54.660789 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:20:54.660759 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd53b34cb_de79_4dfb_b92f_bb447a58e291.slice/crio-a93e6917d1e04c6e6569c55dbdd7414db2a3b89c3d7bd73fb7e6d39768ed6ed0 WatchSource:0}: Error finding container a93e6917d1e04c6e6569c55dbdd7414db2a3b89c3d7bd73fb7e6d39768ed6ed0: Status 404 returned error can't find the container with id a93e6917d1e04c6e6569c55dbdd7414db2a3b89c3d7bd73fb7e6d39768ed6ed0 Jun 03 23:20:55.371019 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:20:55.370987 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-292jt" event={"ID":"d53b34cb-de79-4dfb-b92f-bb447a58e291","Type":"ContainerStarted","Data":"5b65e1d2e58023fa2725c020eeaa8ffeeb16f2a8ba6215a0d4ad97d296522cb2"} Jun 03 23:20:55.371422 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:20:55.371036 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-292jt" event={"ID":"d53b34cb-de79-4dfb-b92f-bb447a58e291","Type":"ContainerStarted","Data":"a93e6917d1e04c6e6569c55dbdd7414db2a3b89c3d7bd73fb7e6d39768ed6ed0"} Jun 03 23:20:55.371422 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:20:55.371141 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-292jt" Jun 03 23:20:55.390411 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:20:55.390358 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-292jt" podStartSLOduration=1.390341175 podStartE2EDuration="1.390341175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:20:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:20:55.388492017 +0000 UTC m=+1833.727144507" watchObservedRunningTime="2026-06-03 23:20:55.390341175 +0000 UTC m=+1833.728993662" Jun 03 23:21:06.380380 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:21:06.380344 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-292jt" Jun 03 23:25:22.340572 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:25:22.340543 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvqlh_c1356fb0-4884-41e6-8d59-fed020dd7a80/ovn-acl-logging/0.log" Jun 03 23:25:22.351397 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:25:22.351370 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvqlh_c1356fb0-4884-41e6-8d59-fed020dd7a80/ovn-acl-logging/0.log" Jun 03 23:30:22.381225 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:30:22.381110 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvqlh_c1356fb0-4884-41e6-8d59-fed020dd7a80/ovn-acl-logging/0.log" Jun 03 23:30:22.393503 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:30:22.393476 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvqlh_c1356fb0-4884-41e6-8d59-fed020dd7a80/ovn-acl-logging/0.log" Jun 03 23:31:02.451935 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:02.451898 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-685f64df48-tj2g8_ac8c03e9-1cea-4b74-b838-13427719fe1a/nginx/0.log" Jun 03 23:31:02.933247 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:02.933205 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-64dc9dfcb8-jhrfw_58deb3d3-ce9b-4023-953c-b674254b7471/maas-api/0.log" Jun 03 23:31:03.287238 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:03.287127 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-676b7779c6-gx68c_f4072108-1ded-40c1-981a-ef48aca0a373/manager/0.log" Jun 03 23:31:03.634010 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:03.633979 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-967f449d5-52g6p_2e24113d-b734-4ca2-a4d6-123a47aa3b25/copy-manifests/0.log" Jun 03 23:31:03.641208 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:03.641180 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-967f449d5-52g6p_2e24113d-b734-4ca2-a4d6-123a47aa3b25/manager/0.log" Jun 03 23:31:04.830464 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:04.830431 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c_bd1391ea-9919-4781-9560-23a62a54c899/util/0.log" Jun 03 23:31:04.837161 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:04.837133 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c_bd1391ea-9919-4781-9560-23a62a54c899/pull/0.log" Jun 03 23:31:04.843696 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:04.843658 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c_bd1391ea-9919-4781-9560-23a62a54c899/extract/0.log" Jun 03 23:31:04.956081 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:04.956054 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69_1238ece7-710e-471e-950c-40589caa6ce5/util/0.log" Jun 03 23:31:04.963286 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:04.963263 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69_1238ece7-710e-471e-950c-40589caa6ce5/pull/0.log" Jun 03 23:31:04.969970 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:04.969915 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69_1238ece7-710e-471e-950c-40589caa6ce5/extract/0.log" Jun 03 23:31:05.080379 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:05.080343 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg_53e9b424-db33-4e1f-b60f-73a8cc5e53d2/util/0.log" Jun 03 23:31:05.086987 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:05.086905 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg_53e9b424-db33-4e1f-b60f-73a8cc5e53d2/pull/0.log" Jun 03 23:31:05.093432 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:05.093403 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg_53e9b424-db33-4e1f-b60f-73a8cc5e53d2/extract/0.log" Jun 03 23:31:05.211416 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:05.211391 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t_2831ff51-1122-4231-bd19-68fd965b4f29/util/0.log" Jun 03 23:31:05.218480 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:05.218454 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t_2831ff51-1122-4231-bd19-68fd965b4f29/pull/0.log" Jun 03 23:31:05.225721 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:05.225699 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t_2831ff51-1122-4231-bd19-68fd965b4f29/extract/0.log" Jun 03 23:31:05.595451 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:05.595415 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-r464s_5b1633dd-d4fc-4d1f-a1b6-a515d7b50b12/manager/0.log" Jun 03 23:31:05.707738 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:05.707713 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-bszrz_81158ffe-395f-4b2c-ab89-3642f2dff532/kuadrant-console-plugin/0.log" Jun 03 23:31:05.835871 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:05.835834 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-26bfs_1f28ab11-c152-4b7a-9df9-bb746cd7f4c1/registry-server/0.log" Jun 03 23:31:05.970181 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:05.970095 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-292jt_d53b34cb-de79-4dfb-b92f-bb447a58e291/manager/0.log" Jun 03 23:31:06.208391 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:06.208357 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-n6td7_d7b9b472-1262-4409-aada-d6914d1d72ba/manager/0.log" Jun 03 23:31:06.564736 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:06.564692 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcvv54q_e1dd9ac2-8f51-42d8-be38-6894028ae94a/istio-proxy/0.log" Jun 03 23:31:07.306520 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:07.306488 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gvmpb_aa2d3bfe-d27e-40b1-8669-0819b3415989/payload-processing/0.log" Jun 03 23:31:07.427991 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:07.427956 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75df67dd47-pr8cf_222cdbeb-74e5-4b5d-af08-013b734867d0/router/0.log" Jun 03 23:31:07.778076 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:07.777987 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88_61fd16cb-e761-4bfd-9371-d168a370200e/main/0.log" Jun 03 23:31:07.784809 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:07.784775 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-jqm88_61fd16cb-e761-4bfd-9371-d168a370200e/storage-initializer/0.log" Jun 03 23:31:15.873276 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:15.873245 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qd98z_5151c00d-51e2-445a-9ef4-0ee9bf2ac678/global-pull-secret-syncer/0.log" Jun 03 23:31:16.009777 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:16.009740 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qm7pj_fe1864d1-7354-440f-b41d-10a0b679eae7/konnectivity-agent/0.log" Jun 03 23:31:16.038404 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:16.038370 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-99.ec2.internal_4aed52c4997e28f083b4c99b8beb1110/haproxy/0.log" Jun 03 23:31:21.046951 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:21.046915 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c_bd1391ea-9919-4781-9560-23a62a54c899/extract/0.log" Jun 03 23:31:21.073699 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:21.073663 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c_bd1391ea-9919-4781-9560-23a62a54c899/util/0.log" Jun 03 23:31:21.100490 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:21.100456 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv58c_bd1391ea-9919-4781-9560-23a62a54c899/pull/0.log" Jun 03 23:31:21.134412 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:21.134381 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69_1238ece7-710e-471e-950c-40589caa6ce5/extract/0.log" Jun 03 23:31:21.161642 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:21.161615 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69_1238ece7-710e-471e-950c-40589caa6ce5/util/0.log" Jun 03 23:31:21.187442 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:21.187409 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e097b69_1238ece7-710e-471e-950c-40589caa6ce5/pull/0.log" Jun 03 23:31:21.231425 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:21.231399 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg_53e9b424-db33-4e1f-b60f-73a8cc5e53d2/extract/0.log" Jun 03 23:31:21.253285 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:21.253252 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg_53e9b424-db33-4e1f-b60f-73a8cc5e53d2/util/0.log" Jun 03 23:31:21.279895 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:21.279855 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bzhwg_53e9b424-db33-4e1f-b60f-73a8cc5e53d2/pull/0.log" Jun 03 23:31:21.308204 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:21.308112 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t_2831ff51-1122-4231-bd19-68fd965b4f29/extract/0.log" Jun 03 23:31:21.329951 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:21.329920 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t_2831ff51-1122-4231-bd19-68fd965b4f29/util/0.log" Jun 03 23:31:21.351153 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:21.351126 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d5w5t_2831ff51-1122-4231-bd19-68fd965b4f29/pull/0.log" Jun 03 23:31:21.692317 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:21.692232 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-r464s_5b1633dd-d4fc-4d1f-a1b6-a515d7b50b12/manager/0.log" Jun 03 23:31:21.719204 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:21.719179 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-bszrz_81158ffe-395f-4b2c-ab89-3642f2dff532/kuadrant-console-plugin/0.log" Jun 03 23:31:21.772312 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:21.772262 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-26bfs_1f28ab11-c152-4b7a-9df9-bb746cd7f4c1/registry-server/0.log" Jun 03 23:31:21.865131 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:21.865096 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-292jt_d53b34cb-de79-4dfb-b92f-bb447a58e291/manager/0.log" Jun 03 23:31:21.987801 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:21.987714 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-n6td7_d7b9b472-1262-4409-aada-d6914d1d72ba/manager/0.log" Jun 03 23:31:23.448643 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:23.448615 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_727f9d99-1975-4cca-a59a-0f7adc65620d/alertmanager/0.log" Jun 03 23:31:23.471965 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:23.471940 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_727f9d99-1975-4cca-a59a-0f7adc65620d/config-reloader/0.log" Jun 03 23:31:23.496916 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:23.496888 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_727f9d99-1975-4cca-a59a-0f7adc65620d/kube-rbac-proxy-web/0.log" Jun 03 23:31:23.518490 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:23.518457 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_727f9d99-1975-4cca-a59a-0f7adc65620d/kube-rbac-proxy/0.log" Jun 03 23:31:23.544003 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:23.543975 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_727f9d99-1975-4cca-a59a-0f7adc65620d/kube-rbac-proxy-metric/0.log" Jun 03 23:31:23.565702 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:23.565670 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_727f9d99-1975-4cca-a59a-0f7adc65620d/prom-label-proxy/0.log" Jun 03 23:31:23.587331 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:23.587307 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_727f9d99-1975-4cca-a59a-0f7adc65620d/init-config-reloader/0.log" Jun 03 23:31:23.635090 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:23.635045 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-57769895dd-xggwn_423754b4-98a4-4a39-aee0-ea4457a1d03f/cluster-monitoring-operator/0.log" Jun 03 23:31:23.923227 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:23.923199 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n65xl_e23877fa-3edc-4434-9d29-1bd8a7d79adb/node-exporter/0.log" Jun 03 23:31:23.948501 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:23.948476 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n65xl_e23877fa-3edc-4434-9d29-1bd8a7d79adb/kube-rbac-proxy/0.log" Jun 03 23:31:23.970090 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:23.970061 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n65xl_e23877fa-3edc-4434-9d29-1bd8a7d79adb/init-textfile/0.log" Jun 03 23:31:24.437363 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:24.437267 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-mw4mz_fc0f7c7b-1081-4004-9981-248d1e266565/prometheus-operator/0.log" Jun 03 23:31:24.456161 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:24.456128 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-mw4mz_fc0f7c7b-1081-4004-9981-248d1e266565/kube-rbac-proxy/0.log" Jun 03 23:31:24.486411 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:24.486367 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-4js5r_4ee03be1-6ed9-4108-98ce-5cd60fac3371/prometheus-operator-admission-webhook/0.log" Jun 03 23:31:24.531943 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:24.531900 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86857f8789-76r22_12c16640-5436-4c40-9030-a0cf50908c94/telemeter-client/0.log" Jun 03 23:31:24.557835 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:24.557809 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86857f8789-76r22_12c16640-5436-4c40-9030-a0cf50908c94/reload/0.log" Jun 03 23:31:24.583075 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:24.583037 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86857f8789-76r22_12c16640-5436-4c40-9030-a0cf50908c94/kube-rbac-proxy/0.log" Jun 03 23:31:27.263793 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:27.263740 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6855658c4-bgcpz_46f32a08-efc5-4d7d-80f8-91fc3d0d88a0/console/0.log" Jun 03 23:31:28.036529 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:28.036483 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-dlxgt_2a41c46f-e965-4cdc-b3da-940c477e04e3/volume-data-source-validator/0.log" Jun 03 23:31:28.268487 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:28.268451 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xc65t/perf-node-gather-daemonset-s9smt"] Jun 03 23:31:28.272175 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:28.272153 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-s9smt" Jun 03 23:31:28.274153 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:28.274129 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xc65t\"/\"openshift-service-ca.crt\"" Jun 03 23:31:28.274268 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:28.274174 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xc65t\"/\"default-dockercfg-ng5fq\"" Jun 03 23:31:28.274324 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:28.274266 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xc65t\"/\"kube-root-ca.crt\"" Jun 03 23:31:28.285778 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:28.285742 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xc65t/perf-node-gather-daemonset-s9smt"] Jun 03 23:31:28.328908 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:28.328871 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2bc75e77-12bc-4ec8-9d3b-73ffad27b42b-proc\") pod \"perf-node-gather-daemonset-s9smt\" (UID: \"2bc75e77-12bc-4ec8-9d3b-73ffad27b42b\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-s9smt" Jun 03 23:31:28.329106 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:28.328928 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bc75e77-12bc-4ec8-9d3b-73ffad27b42b-sys\") pod \"perf-node-gather-daemonset-s9smt\" (UID: \"2bc75e77-12bc-4ec8-9d3b-73ffad27b42b\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-s9smt" Jun 03 23:31:28.329106 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:28.328999 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bc75e77-12bc-4ec8-9d3b-73ffad27b42b-lib-modules\") pod \"perf-node-gather-daemonset-s9smt\" (UID: \"2bc75e77-12bc-4ec8-9d3b-73ffad27b42b\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-s9smt" Jun 03 23:31:28.329106 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:28.329054 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9lc8\" (UniqueName: \"kubernetes.io/projected/2bc75e77-12bc-4ec8-9d3b-73ffad27b42b-kube-api-access-z9lc8\") pod \"perf-node-gather-daemonset-s9smt\" (UID: \"2bc75e77-12bc-4ec8-9d3b-73ffad27b42b\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-s9smt" Jun 03 23:31:28.329106 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:28.329102 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2bc75e77-12bc-4ec8-9d3b-73ffad27b42b-podres\") pod \"perf-node-gather-daemonset-s9smt\" (UID: \"2bc75e77-12bc-4ec8-9d3b-73ffad27b42b\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-s9smt" Jun 03 23:31:28.430297 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:28.430253 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2bc75e77-12bc-4ec8-9d3b-73ffad27b42b-proc\") pod \"perf-node-gather-daemonset-s9smt\" (UID: \"2bc75e77-12bc-4ec8-9d3b-73ffad27b42b\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-s9smt" Jun 03 23:31:28.430487 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:28.430315 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bc75e77-12bc-4ec8-9d3b-73ffad27b42b-sys\") pod \"perf-node-gather-daemonset-s9smt\" (UID: \"2bc75e77-12bc-4ec8-9d3b-73ffad27b42b\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-s9smt" Jun 03 23:31:28.430487 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:28.430351 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bc75e77-12bc-4ec8-9d3b-73ffad27b42b-lib-modules\") pod \"perf-node-gather-daemonset-s9smt\" (UID: \"2bc75e77-12bc-4ec8-9d3b-73ffad27b42b\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-s9smt" Jun 03 23:31:28.430487 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:28.430370 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9lc8\" (UniqueName: \"kubernetes.io/projected/2bc75e77-12bc-4ec8-9d3b-73ffad27b42b-kube-api-access-z9lc8\") pod \"perf-node-gather-daemonset-s9smt\" (UID: \"2bc75e77-12bc-4ec8-9d3b-73ffad27b42b\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-s9smt" Jun 03 23:31:28.430487 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:28.430388 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2bc75e77-12bc-4ec8-9d3b-73ffad27b42b-proc\") pod \"perf-node-gather-daemonset-s9smt\" (UID: \"2bc75e77-12bc-4ec8-9d3b-73ffad27b42b\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-s9smt" Jun 03 23:31:28.430487 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:28.430446 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bc75e77-12bc-4ec8-9d3b-73ffad27b42b-sys\") pod \"perf-node-gather-daemonset-s9smt\" (UID: \"2bc75e77-12bc-4ec8-9d3b-73ffad27b42b\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-s9smt" Jun 03 23:31:28.430487 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:28.430484 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2bc75e77-12bc-4ec8-9d3b-73ffad27b42b-podres\") pod \"perf-node-gather-daemonset-s9smt\" (UID: \"2bc75e77-12bc-4ec8-9d3b-73ffad27b42b\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-s9smt" Jun 03 23:31:28.430755 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:28.430545 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bc75e77-12bc-4ec8-9d3b-73ffad27b42b-lib-modules\") pod \"perf-node-gather-daemonset-s9smt\" (UID: \"2bc75e77-12bc-4ec8-9d3b-73ffad27b42b\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-s9smt" Jun 03 23:31:28.430755 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:28.430631 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2bc75e77-12bc-4ec8-9d3b-73ffad27b42b-podres\") pod \"perf-node-gather-daemonset-s9smt\" (UID: \"2bc75e77-12bc-4ec8-9d3b-73ffad27b42b\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-s9smt" Jun 03 23:31:28.438137 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:28.438110 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9lc8\" (UniqueName: \"kubernetes.io/projected/2bc75e77-12bc-4ec8-9d3b-73ffad27b42b-kube-api-access-z9lc8\") pod \"perf-node-gather-daemonset-s9smt\" (UID: \"2bc75e77-12bc-4ec8-9d3b-73ffad27b42b\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-s9smt" Jun 03 23:31:28.583903 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:28.583809 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-s9smt" Jun 03 23:31:28.728864 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:28.728803 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xc65t/perf-node-gather-daemonset-s9smt"] Jun 03 23:31:28.731292 ip-10-0-140-99 kubenswrapper[2576]: W0603 23:31:28.731249 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2bc75e77_12bc_4ec8_9d3b_73ffad27b42b.slice/crio-7324fbe18dc6d5eb06a3908a3c70769e90cf3614573cb99ac08aff78ecbdbf92 WatchSource:0}: Error finding container 7324fbe18dc6d5eb06a3908a3c70769e90cf3614573cb99ac08aff78ecbdbf92: Status 404 returned error can't find the container with id 7324fbe18dc6d5eb06a3908a3c70769e90cf3614573cb99ac08aff78ecbdbf92 Jun 03 23:31:29.228889 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:29.228782 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-s9smt" event={"ID":"2bc75e77-12bc-4ec8-9d3b-73ffad27b42b","Type":"ContainerStarted","Data":"9b95ac877a09f8ce538b30f31d0f2ce661f0caeb1d2e1505c2a593259814a0cb"} Jun 03 23:31:29.228889 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:29.228854 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-s9smt" event={"ID":"2bc75e77-12bc-4ec8-9d3b-73ffad27b42b","Type":"ContainerStarted","Data":"7324fbe18dc6d5eb06a3908a3c70769e90cf3614573cb99ac08aff78ecbdbf92"} Jun 03 23:31:29.229111 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:29.228999 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-s9smt" Jun 03 23:31:29.243741 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:29.243683 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-s9smt" podStartSLOduration=1.243660588 podStartE2EDuration="1.243660588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:31:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:31:29.243311299 +0000 UTC m=+2467.581963789" watchObservedRunningTime="2026-06-03 23:31:29.243660588 +0000 UTC m=+2467.582313077" Jun 03 23:31:29.374282 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:29.374253 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rx252_45947991-d774-45e0-9345-7a0eef712d69/dns/0.log" Jun 03 23:31:29.399103 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:29.399074 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rx252_45947991-d774-45e0-9345-7a0eef712d69/kube-rbac-proxy/0.log" Jun 03 23:31:29.431040 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:29.431004 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6bxfb_b5a63252-f62d-4fa6-9514-cac24485d072/dns-node-resolver/0.log" Jun 03 23:31:30.053734 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:30.053692 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59499b698b-s4qwc_6d376ca9-7879-4a2b-bb03-96741cc3c90b/registry/0.log" Jun 03 23:31:30.070361 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:30.070319 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59499b698b-s4qwc_6d376ca9-7879-4a2b-bb03-96741cc3c90b/registry/1.log" Jun 03 23:31:30.092918 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:30.092889 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8s2cb_d5941858-6ad4-439b-acf6-adf174570012/node-ca/0.log" Jun 03 23:31:31.086769 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:31.086734 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcvv54q_e1dd9ac2-8f51-42d8-be38-6894028ae94a/istio-proxy/0.log" Jun 03 23:31:31.522193 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:31.522098 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gvmpb_aa2d3bfe-d27e-40b1-8669-0819b3415989/payload-processing/0.log" Jun 03 23:31:31.544181 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:31.544151 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75df67dd47-pr8cf_222cdbeb-74e5-4b5d-af08-013b734867d0/router/0.log" Jun 03 23:31:32.183057 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:32.183024 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v97ll_95bd52c6-e259-4780-b114-f7de0eb8745c/serve-healthcheck-canary/0.log" Jun 03 23:31:32.696309 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:32.696274 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-69684796bc-lglv6_90e6c068-c987-41bc-a0a3-596ce3834b50/insights-operator/0.log" Jun 03 23:31:32.697636 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:32.697604 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-69684796bc-lglv6_90e6c068-c987-41bc-a0a3-596ce3834b50/insights-operator/1.log" Jun 03 23:31:32.720563 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:32.720532 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6xqpt_002cfe94-9ba8-4670-8560-57d74669b4ab/kube-rbac-proxy/0.log" Jun 03 23:31:32.743213 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:32.743179 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6xqpt_002cfe94-9ba8-4670-8560-57d74669b4ab/exporter/0.log" Jun 03 23:31:32.765466 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:32.765437 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6xqpt_002cfe94-9ba8-4670-8560-57d74669b4ab/extractor/0.log" Jun 03 23:31:35.107470 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:35.107441 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-685f64df48-tj2g8_ac8c03e9-1cea-4b74-b838-13427719fe1a/nginx/0.log" Jun 03 23:31:35.247231 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:35.247202 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-s9smt" Jun 03 23:31:35.406268 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:35.406177 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-64dc9dfcb8-jhrfw_58deb3d3-ce9b-4023-953c-b674254b7471/maas-api/0.log" Jun 03 23:31:35.570020 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:35.569987 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-676b7779c6-gx68c_f4072108-1ded-40c1-981a-ef48aca0a373/manager/0.log" Jun 03 23:31:35.704450 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:35.704359 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-967f449d5-52g6p_2e24113d-b734-4ca2-a4d6-123a47aa3b25/manager/0.log" Jun 03 23:31:35.729828 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:35.729796 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-967f449d5-52g6p_2e24113d-b734-4ca2-a4d6-123a47aa3b25/copy-manifests/0.log" Jun 03 23:31:38.013010 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:38.012976 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-747dfb677c-jrqrq_a900500b-de11-4a9d-b96b-dc0a1cb69aba/manager/0.log" Jun 03 23:31:38.041232 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:38.041189 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-48s4c_06e4caa0-3f29-4f26-8190-28b7994228dc/openshift-lws-operator/0.log" Jun 03 23:31:40.651982 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:40.651952 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcvv54q_e1dd9ac2-8f51-42d8-be38-6894028ae94a/istio-proxy/0.log" Jun 03 23:31:41.041063 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:41.040959 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gvmpb_aa2d3bfe-d27e-40b1-8669-0819b3415989/payload-processing/0.log" Jun 03 23:31:41.060753 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:41.060723 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75df67dd47-pr8cf_222cdbeb-74e5-4b5d-af08-013b734867d0/router/0.log" Jun 03 23:31:42.166361 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:42.166328 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcvv54q_e1dd9ac2-8f51-42d8-be38-6894028ae94a/istio-proxy/0.log" Jun 03 23:31:42.564585 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:42.564549 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gvmpb_aa2d3bfe-d27e-40b1-8669-0819b3415989/payload-processing/0.log" Jun 03 23:31:42.583477 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:42.583446 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75df67dd47-pr8cf_222cdbeb-74e5-4b5d-af08-013b734867d0/router/0.log" Jun 03 23:31:43.951619 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:43.951581 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-449jt_bbac7faa-a131-4ec6-b3cb-09a3c00e69f7/kube-storage-version-migrator-operator/1.log" Jun 03 23:31:43.953280 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:43.953254 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-449jt_bbac7faa-a131-4ec6-b3cb-09a3c00e69f7/kube-storage-version-migrator-operator/0.log" Jun 03 23:31:44.261218 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:44.261126 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcvv54q_e1dd9ac2-8f51-42d8-be38-6894028ae94a/istio-proxy/0.log" Jun 03 23:31:44.625695 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:44.625660 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gvmpb_aa2d3bfe-d27e-40b1-8669-0819b3415989/payload-processing/0.log" Jun 03 23:31:44.642095 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:44.642065 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75df67dd47-pr8cf_222cdbeb-74e5-4b5d-af08-013b734867d0/router/0.log" Jun 03 23:31:45.343841 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:45.343813 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bspfc_1797d0cf-3a7e-47d4-a235-3bc54df20f2b/kube-multus-additional-cni-plugins/0.log" Jun 03 23:31:45.365218 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:45.365183 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bspfc_1797d0cf-3a7e-47d4-a235-3bc54df20f2b/egress-router-binary-copy/0.log" Jun 03 23:31:45.393480 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:45.393448 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bspfc_1797d0cf-3a7e-47d4-a235-3bc54df20f2b/cni-plugins/0.log" Jun 03 23:31:45.421622 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:45.421598 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bspfc_1797d0cf-3a7e-47d4-a235-3bc54df20f2b/bond-cni-plugin/0.log" Jun 03 23:31:45.446423 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:45.446395 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bspfc_1797d0cf-3a7e-47d4-a235-3bc54df20f2b/routeoverride-cni/0.log" Jun 03 23:31:45.470381 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:45.470354 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bspfc_1797d0cf-3a7e-47d4-a235-3bc54df20f2b/whereabouts-cni-bincopy/0.log" Jun 03 23:31:45.495599 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:45.495564 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bspfc_1797d0cf-3a7e-47d4-a235-3bc54df20f2b/whereabouts-cni/0.log" Jun 03 23:31:45.732567 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:45.732469 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-z5qwm_21456fc8-e4fa-4ff0-8940-b460142a32ae/kube-multus/0.log" Jun 03 23:31:45.758545 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:45.758495 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dzl52_5ba98357-42a7-4e6d-a783-7f58dd6c5ced/network-metrics-daemon/0.log" Jun 03 23:31:45.780119 ip-10-0-140-99 kubenswrapper[2576]: I0603 23:31:45.780093 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dzl52_5ba98357-42a7-4e6d-a783-7f58dd6c5ced/kube-rbac-proxy/0.log"