Jun 12 22:20:00.016696 ip-10-0-135-250 systemd[1]: Starting Kubernetes Kubelet... Jun 12 22:20:00.413630 ip-10-0-135-250 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 22:20:00.413630 ip-10-0-135-250 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 12 22:20:00.413630 ip-10-0-135-250 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 22:20:00.413630 ip-10-0-135-250 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 12 22:20:00.413630 ip-10-0-135-250 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 22:20:00.414845 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.414451 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 12 22:20:00.418879 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418857 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 22:20:00.418879 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418876 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 22:20:00.418879 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418882 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 22:20:00.418879 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418886 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 22:20:00.419119 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418891 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 22:20:00.419119 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418896 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 22:20:00.419119 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418900 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 22:20:00.419119 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418903 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 22:20:00.419119 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418907 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 22:20:00.419119 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418911 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 22:20:00.419119 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418915 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 12 22:20:00.419119 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418918 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 22:20:00.419119 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418921 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 22:20:00.419119 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418925 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 22:20:00.419119 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418937 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 22:20:00.419119 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418941 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 22:20:00.419119 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418945 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 22:20:00.419119 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418949 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 22:20:00.419119 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418953 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 22:20:00.419119 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418957 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 22:20:00.419119 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418961 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 22:20:00.419119 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418965 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 22:20:00.419119 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418969 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 22:20:00.419119 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418973 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 22:20:00.419893 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418976 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 22:20:00.419893 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418980 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 22:20:00.419893 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418984 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 22:20:00.419893 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418988 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 22:20:00.419893 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418992 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 22:20:00.419893 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.418996 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 22:20:00.419893 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.419000 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 22:20:00.419893 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.419004 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 22:20:00.419893 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.419008 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 22:20:00.419893 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.419012 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 22:20:00.419893 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.419017 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 22:20:00.419893 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.419021 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 22:20:00.419893 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.419027 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 22:20:00.419893 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.419032 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 22:20:00.419893 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.419036 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 22:20:00.419893 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.419041 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 22:20:00.419893 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.419045 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 22:20:00.419893 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.419049 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 22:20:00.419893 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.419054 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 22:20:00.419893 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.419059 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 22:20:00.420517 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.419063 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 22:20:00.420517 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.419067 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 22:20:00.420517 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.419072 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 22:20:00.420517 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.419135 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 22:20:00.420655 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420528 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 22:20:00.420687 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420657 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 22:20:00.420687 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420663 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 22:20:00.420687 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420666 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 22:20:00.420687 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420673 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 22:20:00.420687 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420679 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 22:20:00.420687 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420683 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 22:20:00.420687 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420687 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 22:20:00.420687 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420690 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 22:20:00.420884 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420694 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 22:20:00.420884 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420697 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 22:20:00.420884 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420701 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 22:20:00.420884 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420705 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 22:20:00.420884 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420708 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 22:20:00.420884 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420711 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 22:20:00.420884 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420714 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 22:20:00.420884 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420717 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 22:20:00.420884 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420720 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 22:20:00.420884 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420723 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 22:20:00.420884 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420726 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 22:20:00.420884 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420729 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 22:20:00.420884 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420731 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 22:20:00.420884 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420734 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 22:20:00.420884 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420737 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 22:20:00.420884 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420739 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 22:20:00.420884 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420747 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 22:20:00.420884 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420750 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 22:20:00.420884 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420753 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 22:20:00.421350 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420758 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 22:20:00.421350 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420760 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 22:20:00.421350 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420763 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 22:20:00.421350 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420767 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 22:20:00.421350 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420770 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 22:20:00.421350 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420773 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 22:20:00.421350 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420776 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 22:20:00.421350 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420780 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 22:20:00.421350 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420784 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 22:20:00.421350 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420787 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 22:20:00.421350 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420790 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 22:20:00.421350 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420793 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 22:20:00.421350 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420795 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 22:20:00.421350 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420799 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 22:20:00.421350 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420802 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 22:20:00.421350 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420805 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 22:20:00.421350 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420808 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 22:20:00.421350 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420811 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 22:20:00.421350 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420814 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 22:20:00.421818 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420817 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 22:20:00.421818 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420820 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 22:20:00.421818 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420822 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 22:20:00.421818 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.420825 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 22:20:00.421818 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421597 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 22:20:00.421818 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421605 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 22:20:00.421818 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421609 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 22:20:00.421818 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421613 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 22:20:00.421818 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421616 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 22:20:00.421818 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421619 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 22:20:00.421818 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421623 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 22:20:00.421818 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421626 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 22:20:00.421818 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421629 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 22:20:00.421818 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421631 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 22:20:00.421818 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421634 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 22:20:00.421818 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421636 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 22:20:00.421818 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421639 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 22:20:00.421818 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421642 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 22:20:00.421818 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421644 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 22:20:00.421818 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421647 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 22:20:00.422303 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421650 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 22:20:00.422303 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421652 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 22:20:00.422303 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421655 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 22:20:00.422303 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421658 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 22:20:00.422303 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421661 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 22:20:00.422303 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421664 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 22:20:00.422303 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421667 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 22:20:00.422303 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421669 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 22:20:00.422303 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421672 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 22:20:00.422303 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421674 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 22:20:00.422303 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421677 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 22:20:00.422303 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421681 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 22:20:00.422303 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421685 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 22:20:00.422303 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421689 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 22:20:00.422303 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421692 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 22:20:00.422303 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421695 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 22:20:00.422303 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421699 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 22:20:00.422303 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421702 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 22:20:00.422303 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421705 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 22:20:00.422303 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421708 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 22:20:00.422853 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421711 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 22:20:00.422853 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421714 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 22:20:00.422853 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421717 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 22:20:00.422853 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421720 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 22:20:00.422853 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421722 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 22:20:00.422853 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421725 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 22:20:00.422853 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421727 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 22:20:00.422853 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421730 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 22:20:00.422853 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421733 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 22:20:00.422853 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421735 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 22:20:00.422853 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421738 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 22:20:00.422853 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421740 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 22:20:00.422853 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421743 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 22:20:00.422853 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421746 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 22:20:00.422853 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421748 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 22:20:00.422853 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421751 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 22:20:00.422853 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421753 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 22:20:00.422853 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421757 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 22:20:00.422853 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421760 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 22:20:00.422853 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421762 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 22:20:00.423338 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421766 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 22:20:00.423338 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421768 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 22:20:00.423338 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421771 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 22:20:00.423338 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421773 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 22:20:00.423338 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421776 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 22:20:00.423338 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421780 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 22:20:00.423338 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421783 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 22:20:00.423338 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421786 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 22:20:00.423338 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421789 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 22:20:00.423338 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421792 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 22:20:00.423338 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421794 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 22:20:00.423338 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421797 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 22:20:00.423338 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421799 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 22:20:00.423338 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421803 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 22:20:00.423338 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421807 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 22:20:00.423338 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421810 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 22:20:00.423338 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421813 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 22:20:00.423338 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421815 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 22:20:00.423338 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421818 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 22:20:00.423819 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421821 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 22:20:00.423819 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421823 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 22:20:00.423819 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421826 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 22:20:00.423819 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421829 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 12 22:20:00.423819 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421832 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 22:20:00.423819 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421834 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 22:20:00.423819 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421837 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 22:20:00.423819 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421839 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 22:20:00.423819 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421842 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 22:20:00.423819 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421845 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 22:20:00.423819 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421848 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 22:20:00.423819 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421850 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 22:20:00.423819 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421853 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 22:20:00.423819 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421855 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 22:20:00.423819 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421858 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 22:20:00.423819 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421861 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 22:20:00.423819 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421863 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 22:20:00.423819 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421866 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 22:20:00.423819 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421869 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 22:20:00.423819 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421871 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 22:20:00.424299 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421874 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 22:20:00.424299 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421877 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 22:20:00.424299 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421881 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 22:20:00.424299 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.421883 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 22:20:00.424299 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422297 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 22:20:00.424299 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422303 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 22:20:00.424299 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422306 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 22:20:00.424299 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422309 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 22:20:00.424299 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422312 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 22:20:00.424299 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422315 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 22:20:00.424299 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422318 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 22:20:00.424299 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422320 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 22:20:00.424299 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422323 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 22:20:00.424299 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422326 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 22:20:00.424299 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422328 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 22:20:00.424299 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422331 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 22:20:00.424299 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422333 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 12 22:20:00.424299 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422336 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 22:20:00.424299 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422338 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 22:20:00.424299 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422341 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 22:20:00.424798 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422343 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 22:20:00.424798 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422346 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 22:20:00.424798 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422349 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 22:20:00.424798 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422352 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 22:20:00.424798 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422355 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 22:20:00.424798 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422358 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 22:20:00.424798 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422361 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 22:20:00.424798 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422364 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 22:20:00.424798 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422368 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 22:20:00.424798 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422372 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 22:20:00.424798 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422375 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 22:20:00.424798 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422379 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 22:20:00.424798 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422381 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 22:20:00.424798 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422384 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 22:20:00.424798 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422387 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 22:20:00.424798 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422390 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 22:20:00.424798 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422393 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 22:20:00.424798 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422396 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 22:20:00.424798 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422399 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 22:20:00.425267 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422402 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 22:20:00.425267 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422404 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 22:20:00.425267 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422407 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 22:20:00.425267 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422409 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 22:20:00.425267 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422412 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 22:20:00.425267 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422414 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 22:20:00.425267 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422417 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 22:20:00.425267 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422419 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 22:20:00.425267 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422422 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 22:20:00.425267 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422425 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 22:20:00.425267 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422427 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 22:20:00.425267 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422448 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 22:20:00.425267 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422451 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 22:20:00.425267 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422454 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 22:20:00.425267 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422456 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 22:20:00.425267 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422459 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 22:20:00.425267 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422462 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 22:20:00.425267 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422465 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 22:20:00.425267 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422467 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 22:20:00.425267 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422470 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 22:20:00.425765 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422474 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 22:20:00.425765 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422476 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 22:20:00.425765 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422479 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 22:20:00.425765 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422482 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 22:20:00.425765 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422484 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 22:20:00.425765 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422487 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 22:20:00.425765 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422490 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 22:20:00.425765 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422492 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 22:20:00.425765 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422495 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 22:20:00.425765 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422498 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 22:20:00.425765 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422501 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 22:20:00.425765 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422503 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 22:20:00.425765 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422505 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 22:20:00.425765 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422508 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 22:20:00.425765 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422510 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 22:20:00.425765 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422513 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 22:20:00.425765 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422515 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 22:20:00.425765 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422517 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 22:20:00.425765 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422520 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 22:20:00.425765 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422522 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 22:20:00.426233 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422525 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 22:20:00.426233 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422527 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 22:20:00.426233 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422530 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 22:20:00.426233 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422532 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 22:20:00.426233 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422535 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 22:20:00.426233 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422537 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 22:20:00.426233 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422542 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 22:20:00.426233 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422546 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 22:20:00.426233 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422549 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 22:20:00.426233 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422551 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 22:20:00.426233 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422554 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 22:20:00.426233 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422557 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 22:20:00.426233 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422559 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 22:20:00.426233 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422562 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 22:20:00.426233 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422564 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 22:20:00.426233 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422567 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 22:20:00.426233 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422569 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 22:20:00.426233 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422572 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 22:20:00.426233 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422574 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 22:20:00.426747 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422577 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 22:20:00.426747 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422579 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 22:20:00.426747 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422583 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 22:20:00.426747 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422585 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 22:20:00.426747 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.422587 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 22:20:00.426747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422660 2558 flags.go:64] FLAG: --address="0.0.0.0" Jun 12 22:20:00.426747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422667 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 12 22:20:00.426747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422674 2558 flags.go:64] FLAG: --anonymous-auth="true" Jun 12 22:20:00.426747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422679 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 12 22:20:00.426747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422683 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 12 22:20:00.426747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422686 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 12 22:20:00.426747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422691 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 12 22:20:00.426747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422700 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 12 22:20:00.426747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422703 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 12 22:20:00.426747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422706 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 12 22:20:00.426747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422710 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 12 22:20:00.426747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422713 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 12 22:20:00.426747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422716 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 12 22:20:00.426747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422720 2558 flags.go:64] FLAG: --cgroup-root="" Jun 12 22:20:00.426747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422723 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 12 22:20:00.426747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422726 2558 flags.go:64] FLAG: --client-ca-file="" Jun 12 22:20:00.426747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422729 2558 flags.go:64] FLAG: --cloud-provider="external" Jun 12 22:20:00.426747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422732 2558 flags.go:64] FLAG: --cluster-dns="[]" Jun 12 22:20:00.427307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422736 2558 flags.go:64] FLAG: --cluster-domain="" Jun 12 22:20:00.427307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422739 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 12 22:20:00.427307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422742 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 12 22:20:00.427307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422745 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 12 22:20:00.427307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422754 2558 flags.go:64] FLAG: --container-log-max-files="5" Jun 12 22:20:00.427307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422758 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 12 22:20:00.427307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422761 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 12 22:20:00.427307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422764 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 12 22:20:00.427307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422767 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 12 22:20:00.427307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422770 2558 flags.go:64] FLAG: --contention-profiling="false" Jun 12 22:20:00.427307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422773 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 12 22:20:00.427307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422777 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 12 22:20:00.427307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422780 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 12 22:20:00.427307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422783 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 12 22:20:00.427307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422788 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 12 22:20:00.427307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422791 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 12 22:20:00.427307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422794 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 12 22:20:00.427307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422797 2558 flags.go:64] FLAG: --enable-load-reader="false" Jun 12 22:20:00.427307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422800 2558 flags.go:64] FLAG: --enable-server="true" Jun 12 22:20:00.427307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422803 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 12 22:20:00.427307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422807 2558 flags.go:64] FLAG: --event-burst="100" Jun 12 22:20:00.427307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422811 2558 flags.go:64] FLAG: --event-qps="50" Jun 12 22:20:00.427307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422813 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 12 22:20:00.427307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422817 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 12 22:20:00.427894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422820 2558 flags.go:64] FLAG: --eviction-hard="" Jun 12 22:20:00.427894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422823 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 12 22:20:00.427894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422826 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 12 22:20:00.427894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422829 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 12 22:20:00.427894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422832 2558 flags.go:64] FLAG: --eviction-soft="" Jun 12 22:20:00.427894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422835 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 12 22:20:00.427894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422838 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 12 22:20:00.427894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422841 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 12 22:20:00.427894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422843 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jun 12 22:20:00.427894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422846 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 12 22:20:00.427894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422850 2558 flags.go:64] FLAG: --fail-swap-on="true" Jun 12 22:20:00.427894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422852 2558 flags.go:64] FLAG: --feature-gates="" Jun 12 22:20:00.427894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422858 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jun 12 22:20:00.427894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422861 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 12 22:20:00.427894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422865 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 12 22:20:00.427894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422868 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 12 22:20:00.427894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422871 2558 flags.go:64] FLAG: --healthz-port="10248" Jun 12 22:20:00.427894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422874 2558 flags.go:64] FLAG: --help="false" Jun 12 22:20:00.427894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422877 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-135-250.ec2.internal" Jun 12 22:20:00.427894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422880 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 12 22:20:00.427894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422883 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jun 12 22:20:00.427894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422887 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 12 22:20:00.427894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422890 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 12 22:20:00.427894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422894 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 12 22:20:00.428563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422896 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 12 22:20:00.428563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422899 2558 flags.go:64] FLAG: --image-service-endpoint="" Jun 12 22:20:00.428563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422902 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 12 22:20:00.428563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422905 2558 flags.go:64] FLAG: --kube-api-burst="100" Jun 12 22:20:00.428563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422908 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 12 22:20:00.428563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422911 2558 flags.go:64] FLAG: --kube-api-qps="50" Jun 12 22:20:00.428563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422914 2558 flags.go:64] FLAG: --kube-reserved="" Jun 12 22:20:00.428563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422917 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 12 22:20:00.428563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422920 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 12 22:20:00.428563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422923 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jun 12 22:20:00.428563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422925 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 12 22:20:00.428563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422928 2558 flags.go:64] FLAG: --lock-file="" Jun 12 22:20:00.428563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422931 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 12 22:20:00.428563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422934 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 12 22:20:00.428563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422937 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 12 22:20:00.428563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422942 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jun 12 22:20:00.428563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422945 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 12 22:20:00.428563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422948 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jun 12 22:20:00.428563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422951 2558 flags.go:64] FLAG: --logging-format="text" Jun 12 22:20:00.428563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422953 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 12 22:20:00.428563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422958 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 12 22:20:00.428563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422961 2558 flags.go:64] FLAG: --manifest-url="" Jun 12 22:20:00.428563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422964 2558 flags.go:64] FLAG: --manifest-url-header="" Jun 12 22:20:00.428563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422968 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 12 22:20:00.428563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422971 2558 flags.go:64] FLAG: --max-open-files="1000000" Jun 12 22:20:00.429291 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422975 2558 flags.go:64] FLAG: --max-pods="110" Jun 12 22:20:00.429291 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422978 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 12 22:20:00.429291 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422981 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 12 22:20:00.429291 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422984 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jun 12 22:20:00.429291 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422987 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 12 22:20:00.429291 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422990 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 12 22:20:00.429291 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422993 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 12 22:20:00.429291 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.422997 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 12 22:20:00.429291 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423002 2558 flags.go:64] FLAG: --node-status-max-images="50" Jun 12 22:20:00.429291 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423005 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 12 22:20:00.429291 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423008 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jun 12 22:20:00.429291 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423011 2558 flags.go:64] FLAG: --pod-cidr="" Jun 12 22:20:00.429291 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423014 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 12 22:20:00.429291 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423020 2558 flags.go:64] FLAG: --pod-manifest-path="" Jun 12 22:20:00.429291 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423024 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jun 12 22:20:00.429291 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423028 2558 flags.go:64] FLAG: --pods-per-core="0" Jun 12 22:20:00.429291 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423031 2558 flags.go:64] FLAG: --port="10250" Jun 12 22:20:00.429291 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423034 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 12 22:20:00.429291 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423037 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0aea90e2e2d3f7e38" Jun 12 22:20:00.429291 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423040 2558 flags.go:64] FLAG: --qos-reserved="" Jun 12 22:20:00.429291 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423043 2558 flags.go:64] FLAG: --read-only-port="10255" Jun 12 22:20:00.429291 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423046 2558 flags.go:64] FLAG: --register-node="true" Jun 12 22:20:00.429291 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423049 2558 flags.go:64] FLAG: --register-with-taints="" Jun 12 22:20:00.429291 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423052 2558 flags.go:64] FLAG: --registry-burst="10" Jun 12 22:20:00.429894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423055 2558 flags.go:64] FLAG: --registry-qps="5" Jun 12 22:20:00.429894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423058 2558 flags.go:64] FLAG: --reserved-cpus="" Jun 12 22:20:00.429894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423061 2558 flags.go:64] FLAG: --reserved-memory="" Jun 12 22:20:00.429894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423066 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 12 22:20:00.429894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423070 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 12 22:20:00.429894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423073 2558 flags.go:64] FLAG: --rotate-certificates="false" Jun 12 22:20:00.429894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423076 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 12 22:20:00.429894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423078 2558 flags.go:64] FLAG: --runonce="false" Jun 12 22:20:00.429894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423081 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 12 22:20:00.429894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423084 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 12 22:20:00.429894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423087 2558 flags.go:64] FLAG: --seccomp-default="false" Jun 12 22:20:00.429894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423090 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 12 22:20:00.429894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423093 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 12 22:20:00.429894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423096 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 12 22:20:00.429894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423099 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 12 22:20:00.429894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423103 2558 flags.go:64] FLAG: --storage-driver-password="root" Jun 12 22:20:00.429894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423105 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jun 12 22:20:00.429894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423108 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jun 12 22:20:00.429894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423111 2558 flags.go:64] FLAG: --storage-driver-user="root" Jun 12 22:20:00.429894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423114 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 12 22:20:00.429894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423117 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 12 22:20:00.429894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423120 2558 flags.go:64] FLAG: --system-cgroups="" Jun 12 22:20:00.429894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423123 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 12 22:20:00.429894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423131 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 12 22:20:00.429894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423134 2558 flags.go:64] FLAG: --tls-cert-file="" Jun 12 22:20:00.430516 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423137 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 12 22:20:00.430516 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423141 2558 flags.go:64] FLAG: --tls-min-version="" Jun 12 22:20:00.430516 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423144 2558 flags.go:64] FLAG: --tls-private-key-file="" Jun 12 22:20:00.430516 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423147 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jun 12 22:20:00.430516 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423150 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 12 22:20:00.430516 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423152 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jun 12 22:20:00.430516 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423155 2558 flags.go:64] FLAG: --v="2" Jun 12 22:20:00.430516 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423159 2558 flags.go:64] FLAG: --version="false" Jun 12 22:20:00.430516 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423164 2558 flags.go:64] FLAG: --vmodule="" Jun 12 22:20:00.430516 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423167 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 12 22:20:00.430516 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.423172 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 12 22:20:00.430516 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423293 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 22:20:00.430516 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423297 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 22:20:00.430516 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423300 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 22:20:00.430516 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423303 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 22:20:00.430516 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423307 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 22:20:00.430516 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423310 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 22:20:00.430516 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423313 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 22:20:00.430516 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423316 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 22:20:00.430516 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423319 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 22:20:00.430516 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423322 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 22:20:00.430516 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423324 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 22:20:00.431057 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423328 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 22:20:00.431057 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423330 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 22:20:00.431057 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423333 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 22:20:00.431057 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423336 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 22:20:00.431057 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423339 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 22:20:00.431057 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423342 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 22:20:00.431057 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423345 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 22:20:00.431057 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423348 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 22:20:00.431057 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423352 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 22:20:00.431057 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423354 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 22:20:00.431057 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423357 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 22:20:00.431057 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423362 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 22:20:00.431057 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423365 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 22:20:00.431057 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423368 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 22:20:00.431057 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423371 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 22:20:00.431057 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423374 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 22:20:00.431057 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423377 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 22:20:00.431057 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423379 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 22:20:00.431057 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423382 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 22:20:00.431057 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423385 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 22:20:00.431605 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423389 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 22:20:00.431605 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423392 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 22:20:00.431605 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423395 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 12 22:20:00.431605 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423397 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 22:20:00.431605 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423400 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 22:20:00.431605 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423402 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 22:20:00.431605 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423405 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 22:20:00.431605 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423408 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 22:20:00.431605 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423410 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 22:20:00.431605 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423413 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 22:20:00.431605 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423416 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 22:20:00.431605 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423418 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 22:20:00.431605 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423421 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 22:20:00.431605 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423424 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 22:20:00.431605 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423427 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 22:20:00.431605 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423443 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 22:20:00.431605 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423445 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 22:20:00.431605 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423448 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 22:20:00.431605 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423451 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 22:20:00.431605 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423453 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 22:20:00.432120 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423457 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 22:20:00.432120 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423460 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 22:20:00.432120 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423463 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 22:20:00.432120 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423466 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 22:20:00.432120 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423468 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 22:20:00.432120 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423471 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 22:20:00.432120 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423473 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 22:20:00.432120 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423476 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 22:20:00.432120 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423479 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 22:20:00.432120 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423481 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 22:20:00.432120 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423484 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 22:20:00.432120 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423487 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 22:20:00.432120 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423491 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 22:20:00.432120 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423494 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 22:20:00.432120 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423498 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 22:20:00.432120 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423501 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 22:20:00.432120 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423504 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 22:20:00.432120 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423507 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 22:20:00.432120 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423510 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 22:20:00.432599 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423513 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 22:20:00.432599 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423516 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 22:20:00.432599 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423518 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 22:20:00.432599 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423521 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 22:20:00.432599 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423524 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 22:20:00.432599 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423527 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 22:20:00.432599 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423529 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 22:20:00.432599 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423533 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 22:20:00.432599 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423536 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 22:20:00.432599 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423539 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 22:20:00.432599 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423543 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 22:20:00.432599 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423546 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 22:20:00.432599 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423549 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 22:20:00.432599 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423553 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 22:20:00.432599 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423556 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 22:20:00.432599 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423558 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 22:20:00.432599 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423561 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 22:20:00.432599 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423564 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 22:20:00.432599 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423566 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 22:20:00.432599 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423569 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 22:20:00.433088 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423571 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 22:20:00.433088 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423574 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 22:20:00.433088 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423576 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 22:20:00.433088 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423579 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 22:20:00.433088 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423582 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 22:20:00.433088 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423586 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 22:20:00.433088 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423589 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 22:20:00.433088 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423591 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 22:20:00.433088 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.423594 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 22:20:00.433088 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.424299 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 22:20:00.433088 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.430805 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 12 22:20:00.433088 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.430823 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 12 22:20:00.433088 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.430835 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 12 22:20:00.433088 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.430841 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 12 22:20:00.433452 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430899 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 22:20:00.433452 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430904 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 22:20:00.433452 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430908 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 22:20:00.433452 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430911 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 22:20:00.433452 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430914 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 22:20:00.433452 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430918 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 22:20:00.433452 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430921 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 22:20:00.433452 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430924 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 22:20:00.433452 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430927 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 22:20:00.433452 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430929 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 22:20:00.433452 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430933 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 22:20:00.433452 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430936 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 22:20:00.433452 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430938 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 22:20:00.433452 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430941 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 22:20:00.433452 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430943 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 22:20:00.433452 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430946 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 22:20:00.433452 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430949 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 22:20:00.433452 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430952 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 22:20:00.433452 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430954 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 22:20:00.433452 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430957 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 22:20:00.433946 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430960 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 22:20:00.433946 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430962 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 22:20:00.433946 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430966 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 22:20:00.433946 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430970 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 22:20:00.433946 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430974 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 22:20:00.433946 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430977 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 22:20:00.433946 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430980 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 22:20:00.433946 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430982 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 22:20:00.433946 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430985 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 22:20:00.433946 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430988 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 22:20:00.433946 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430991 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 22:20:00.433946 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430994 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 22:20:00.433946 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430996 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 22:20:00.433946 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.430999 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 22:20:00.433946 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431001 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 22:20:00.433946 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431004 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 22:20:00.433946 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431007 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 22:20:00.433946 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431009 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 22:20:00.433946 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431012 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 22:20:00.433946 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431015 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 22:20:00.434421 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431018 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 22:20:00.434421 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431020 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 22:20:00.434421 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431023 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 22:20:00.434421 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431026 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 22:20:00.434421 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431029 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 22:20:00.434421 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431031 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 22:20:00.434421 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431034 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 22:20:00.434421 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431037 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 22:20:00.434421 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431039 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 22:20:00.434421 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431042 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 22:20:00.434421 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431044 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 22:20:00.434421 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431047 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 22:20:00.434421 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431049 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 22:20:00.434421 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431052 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 22:20:00.434421 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431054 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 22:20:00.434421 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431057 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 22:20:00.434421 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431060 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 22:20:00.434421 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431062 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 22:20:00.434421 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431065 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 22:20:00.434874 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431068 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 22:20:00.434874 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431070 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 22:20:00.434874 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431074 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 22:20:00.434874 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431076 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 22:20:00.434874 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431079 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 22:20:00.434874 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431082 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 22:20:00.434874 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431084 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 22:20:00.434874 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431087 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 22:20:00.434874 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431089 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 22:20:00.434874 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431092 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 22:20:00.434874 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431096 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 22:20:00.434874 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431099 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 22:20:00.434874 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431102 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 22:20:00.434874 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431105 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 22:20:00.434874 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431108 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 22:20:00.434874 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431111 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 22:20:00.434874 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431113 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 22:20:00.434874 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431116 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 22:20:00.434874 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431118 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 22:20:00.434874 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431121 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 22:20:00.435358 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431123 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 22:20:00.435358 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431126 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 22:20:00.435358 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431129 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 22:20:00.435358 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431131 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 22:20:00.435358 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431134 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 22:20:00.435358 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431136 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 22:20:00.435358 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431139 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 22:20:00.435358 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431142 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 22:20:00.435358 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431144 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 22:20:00.435358 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431148 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 22:20:00.435358 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431151 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 22:20:00.435358 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431154 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 12 22:20:00.435358 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431157 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 22:20:00.435358 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431159 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 22:20:00.435358 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431162 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 22:20:00.435358 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431165 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 22:20:00.435358 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431168 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 22:20:00.435358 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431170 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 22:20:00.435358 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431173 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 22:20:00.435358 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431176 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 22:20:00.435855 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.431182 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 22:20:00.435855 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431301 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 22:20:00.435855 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431306 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 22:20:00.435855 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431309 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 22:20:00.435855 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431312 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 22:20:00.435855 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431315 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 22:20:00.435855 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431319 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 22:20:00.435855 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431322 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 22:20:00.435855 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431325 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 22:20:00.435855 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431327 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 22:20:00.435855 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431330 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 22:20:00.435855 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431333 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 22:20:00.435855 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431336 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 22:20:00.435855 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431338 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 22:20:00.435855 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431341 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 22:20:00.436220 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431343 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 22:20:00.436220 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431346 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 22:20:00.436220 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431348 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 22:20:00.436220 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431352 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 22:20:00.436220 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431356 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 22:20:00.436220 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431359 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 22:20:00.436220 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431362 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 22:20:00.436220 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431365 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 22:20:00.436220 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431368 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 22:20:00.436220 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431371 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 22:20:00.436220 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431373 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 22:20:00.436220 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431376 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 22:20:00.436220 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431379 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 22:20:00.436220 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431382 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 22:20:00.436220 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431384 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 22:20:00.436220 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431387 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 22:20:00.436220 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431390 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 22:20:00.436220 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431392 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 22:20:00.436220 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431395 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 22:20:00.436848 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431398 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 22:20:00.436848 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431400 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 22:20:00.436848 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431403 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 22:20:00.436848 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431405 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 22:20:00.436848 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431408 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 22:20:00.436848 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431411 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 22:20:00.436848 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431413 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 22:20:00.436848 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431416 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 22:20:00.436848 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431418 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 22:20:00.436848 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431422 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 22:20:00.436848 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431426 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 22:20:00.436848 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431441 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 22:20:00.436848 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431444 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 22:20:00.436848 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431447 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 22:20:00.436848 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431450 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 22:20:00.436848 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431453 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 22:20:00.436848 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431456 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 22:20:00.436848 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431459 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 22:20:00.436848 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431462 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 22:20:00.436848 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431465 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 22:20:00.437334 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431467 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 22:20:00.437334 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431470 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 22:20:00.437334 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431473 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 22:20:00.437334 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431475 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 22:20:00.437334 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431478 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 22:20:00.437334 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431481 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 22:20:00.437334 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431483 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 22:20:00.437334 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431486 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 22:20:00.437334 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431489 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 22:20:00.437334 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431491 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 22:20:00.437334 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431494 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 22:20:00.437334 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431496 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 22:20:00.437334 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431500 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 22:20:00.437334 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431502 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 22:20:00.437334 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431505 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 22:20:00.437334 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431508 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 22:20:00.437334 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431510 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 22:20:00.437334 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431513 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 22:20:00.437334 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431517 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 22:20:00.437334 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431519 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 22:20:00.437822 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431522 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 22:20:00.437822 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431524 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 22:20:00.437822 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431527 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 22:20:00.437822 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431529 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 22:20:00.437822 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431532 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 22:20:00.437822 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431535 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 22:20:00.437822 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431538 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 22:20:00.437822 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431540 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 22:20:00.437822 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431543 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 22:20:00.437822 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431546 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 22:20:00.437822 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431549 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 22:20:00.437822 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431551 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 22:20:00.437822 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431554 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 22:20:00.437822 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431558 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 22:20:00.437822 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431562 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 22:20:00.437822 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431564 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 22:20:00.437822 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431567 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 22:20:00.437822 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431569 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 22:20:00.437822 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431572 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 22:20:00.437822 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431574 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 22:20:00.438306 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431577 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 22:20:00.438306 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431579 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 22:20:00.438306 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431582 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 12 22:20:00.438306 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431585 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 22:20:00.438306 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431587 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 22:20:00.438306 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:00.431590 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 22:20:00.438306 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.431595 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 22:20:00.438306 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.431722 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jun 12 22:20:00.438306 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.433782 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 12 22:20:00.438306 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.435024 2558 server.go:1019] "Starting client certificate rotation" Jun 12 22:20:00.438306 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.435124 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 22:20:00.438306 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.435870 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 22:20:00.438306 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.437999 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 22:20:00.441667 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.441537 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 22:20:00.455549 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.455529 2558 log.go:25] "Validated CRI v1 runtime API" Jun 12 22:20:00.458102 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.458084 2558 log.go:25] "Validated CRI v1 image API" Jun 12 22:20:00.459600 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.459588 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 12 22:20:00.461952 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.461930 2558 fs.go:135] Filesystem UUIDs: map[7994d2af-97fc-442e-84e9-1cd09b9b9980:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f9072c70-fe49-4523-a09b-0fc7c463a9ce:/dev/nvme0n1p4] Jun 12 22:20:00.462039 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.461950 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 12 22:20:00.463203 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.463185 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 22:20:00.467964 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.467856 2558 manager.go:216] Machine: {Timestamp:2026-06-12 22:20:00.466405298 +0000 UTC m=+0.337435427 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099234 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f2760a04d21791944808f85d033f0 SystemUUID:ec2f2760-a04d-2179-1944-808f85d033f0 BootID:b9e7c605-d397-4182-8798-ab8020907cba Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6e:b6:a7:d2:5f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6e:b6:a7:d2:5f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:2d:22:9c:d9:d1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 12 22:20:00.467964 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.467961 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 12 22:20:00.468073 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.468043 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 12 22:20:00.471015 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.470989 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 12 22:20:00.471153 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.471019 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-250.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 12 22:20:00.471647 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.471637 2558 topology_manager.go:138] "Creating topology manager with none policy" Jun 12 22:20:00.471685 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.471649 2558 container_manager_linux.go:309] "Creating device plugin manager" Jun 12 22:20:00.471685 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.471657 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 22:20:00.472279 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.472270 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 22:20:00.473611 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.473601 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 12 22:20:00.477300 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.477289 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 12 22:20:00.477408 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.477399 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 12 22:20:00.477452 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.477440 2558 kubelet.go:486] "Attempting to sync node with API server" Jun 12 22:20:00.477486 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.477453 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 12 22:20:00.477486 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.477470 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 12 22:20:00.477486 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.477480 2558 kubelet.go:398] "Adding apiserver pod source" Jun 12 22:20:00.477560 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.477504 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 12 22:20:00.477895 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.477883 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 22:20:00.477943 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.477903 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 22:20:00.480053 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.480036 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 12 22:20:00.481643 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.481630 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 12 22:20:00.481691 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.481660 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 12 22:20:00.481858 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.481839 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 12 22:20:00.481858 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.481854 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 12 22:20:00.481918 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.481860 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 12 22:20:00.481918 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.481866 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 12 22:20:00.481918 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.481875 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 12 22:20:00.481918 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.481880 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 12 22:20:00.482373 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.482363 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 12 22:20:00.482373 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.482372 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 12 22:20:00.482453 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.482380 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 12 22:20:00.482453 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.482386 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 12 22:20:00.482453 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.482394 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 12 22:20:00.482453 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.482402 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 12 22:20:00.483419 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.483410 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 12 22:20:00.483467 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.483420 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 12 22:20:00.486655 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.486642 2558 server.go:1268] "Started kubelet" Jun 12 22:20:00.490065 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.490027 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 12 22:20:00.490155 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.490099 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 12 22:20:00.490927 ip-10-0-135-250 systemd[1]: Started Kubernetes Kubelet. Jun 12 22:20:00.491569 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.490959 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-prgx4" Jun 12 22:20:00.491569 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:00.491159 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 12 22:20:00.491569 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:00.491286 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-250.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 12 22:20:00.491569 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.491292 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-250.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 12 22:20:00.491569 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.491453 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 12 22:20:00.493618 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.493602 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 12 22:20:00.495003 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.494987 2558 server.go:310] "Adding debug handlers to kubelet server" Jun 12 22:20:00.497080 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.497050 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-prgx4" Jun 12 22:20:00.497232 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:00.497213 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 12 22:20:00.498347 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.498329 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 12 22:20:00.498347 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.498344 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 12 22:20:00.498540 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:00.498524 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-250.ec2.internal\" not found" Jun 12 22:20:00.498660 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:00.497755 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-250.ec2.internal.18b875759469c685 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-250.ec2.internal,UID:ip-10-0-135-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-250.ec2.internal,},FirstTimestamp:2026-06-12 22:20:00.486614661 +0000 UTC m=+0.357644773,LastTimestamp:2026-06-12 22:20:00.486614661 +0000 UTC m=+0.357644773,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-250.ec2.internal,}" Jun 12 22:20:00.498995 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.498978 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 12 22:20:00.499088 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.499045 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 12 22:20:00.499088 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.499060 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 12 22:20:00.499209 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.499167 2558 reconstruct.go:97] "Volume reconstruction finished" Jun 12 22:20:00.499209 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.499175 2558 reconciler.go:29] "Reconciler: start to sync state" Jun 12 22:20:00.499296 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.499262 2558 factory.go:55] Registering systemd factory Jun 12 22:20:00.499296 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.499275 2558 factory.go:223] Registration of the systemd container factory successfully Jun 12 22:20:00.499490 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.499477 2558 factory.go:153] Registering CRI-O factory Jun 12 22:20:00.499543 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.499495 2558 factory.go:223] Registration of the crio container factory successfully Jun 12 22:20:00.499543 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.499542 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 12 22:20:00.499683 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.499563 2558 factory.go:103] Registering Raw factory Jun 12 22:20:00.499683 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.499578 2558 manager.go:1196] Started watching for new ooms in manager Jun 12 22:20:00.500030 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.500017 2558 manager.go:349] Starting recovery of all containers Jun 12 22:20:00.506877 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.506850 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 22:20:00.506877 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.506866 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 12 22:20:00.510358 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.510339 2558 manager.go:354] Recovery completed Jun 12 22:20:00.510859 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:00.510752 2558 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-250.ec2.internal\" not found" node="ip-10-0-135-250.ec2.internal" Jun 12 22:20:00.511908 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:00.511884 2558 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 12 22:20:00.515732 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.515710 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 22:20:00.517836 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.517820 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-250.ec2.internal" event="NodeHasSufficientMemory" Jun 12 22:20:00.517895 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.517849 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-250.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 22:20:00.517895 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.517859 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-250.ec2.internal" event="NodeHasSufficientPID" Jun 12 22:20:00.518405 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.518389 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 12 22:20:00.518405 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.518403 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 12 22:20:00.518534 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.518420 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 12 22:20:00.518534 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.518393 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 22:20:00.519940 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.519924 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-250.ec2.internal" event="NodeHasSufficientMemory" Jun 12 22:20:00.520024 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.519951 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-250.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 22:20:00.520024 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.519961 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-250.ec2.internal" event="NodeHasSufficientPID" Jun 12 22:20:00.520553 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.520539 2558 policy_none.go:49] "None policy: Start" Jun 12 22:20:00.520589 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.520557 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 12 22:20:00.520589 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.520568 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 12 22:20:00.522509 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.522497 2558 policy_none.go:47] "Start" Jun 12 22:20:00.557104 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.557087 2558 manager.go:337] "Starting Device Plugin manager" Jun 12 22:20:00.583178 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:00.557177 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 12 22:20:00.583178 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.557191 2558 server.go:87] "Starting device plugin registration server" Jun 12 22:20:00.583178 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.557517 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 12 22:20:00.583178 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.557530 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 12 22:20:00.583178 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.557622 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 12 22:20:00.583178 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.557714 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 12 22:20:00.583178 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.557724 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 12 22:20:00.583178 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:00.558171 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 12 22:20:00.583178 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:00.558209 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-250.ec2.internal\" not found" Jun 12 22:20:00.583178 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.567971 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 12 22:20:00.583178 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.568008 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 12 22:20:00.583178 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.568027 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jun 12 22:20:00.583178 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:00.568055 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 12 22:20:00.583178 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.571052 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 22:20:00.658404 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.658361 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 22:20:00.664546 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.664487 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-250.ec2.internal" event="NodeHasSufficientMemory" Jun 12 22:20:00.664546 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.664518 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-250.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 22:20:00.664546 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.664534 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-250.ec2.internal" event="NodeHasSufficientPID" Jun 12 22:20:00.664742 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.664563 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-250.ec2.internal" Jun 12 22:20:00.668390 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.668371 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-250.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-250.ec2.internal"] Jun 12 22:20:00.668460 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.668450 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 22:20:00.669352 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.669329 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-250.ec2.internal" event="NodeHasSufficientMemory" Jun 12 22:20:00.669461 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.669360 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-250.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 22:20:00.669461 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.669369 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-250.ec2.internal" event="NodeHasSufficientPID" Jun 12 22:20:00.671555 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.671543 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 22:20:00.671686 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.671671 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-250.ec2.internal" Jun 12 22:20:00.671726 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.671704 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 22:20:00.672376 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.672359 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-250.ec2.internal" event="NodeHasSufficientMemory" Jun 12 22:20:00.672475 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.672384 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-250.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 22:20:00.672475 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.672394 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-250.ec2.internal" event="NodeHasSufficientPID" Jun 12 22:20:00.672475 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.672361 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-250.ec2.internal" event="NodeHasSufficientMemory" Jun 12 22:20:00.672475 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.672473 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-250.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 22:20:00.672682 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.672492 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-250.ec2.internal" event="NodeHasSufficientPID" Jun 12 22:20:00.673952 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.673938 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-250.ec2.internal" Jun 12 22:20:00.674007 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:00.673959 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-250.ec2.internal\": node \"ip-10-0-135-250.ec2.internal\" not found" Jun 12 22:20:00.674517 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.674503 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-250.ec2.internal" Jun 12 22:20:00.674574 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.674528 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 22:20:00.675359 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.675343 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-250.ec2.internal" event="NodeHasSufficientMemory" Jun 12 22:20:00.675459 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.675368 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-250.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 22:20:00.675459 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.675377 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-250.ec2.internal" event="NodeHasSufficientPID" Jun 12 22:20:00.686324 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:00.686306 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-250.ec2.internal\" not found" Jun 12 22:20:00.700282 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.700262 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fea8f5fe2d93cc4fb20f636599e647b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-250.ec2.internal\" (UID: \"fea8f5fe2d93cc4fb20f636599e647b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-250.ec2.internal" Jun 12 22:20:00.700354 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.700285 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fea8f5fe2d93cc4fb20f636599e647b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-250.ec2.internal\" (UID: \"fea8f5fe2d93cc4fb20f636599e647b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-250.ec2.internal" Jun 12 22:20:00.700354 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.700302 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/31ca95e84738030244e0b10abf497390-config\") pod \"kube-apiserver-proxy-ip-10-0-135-250.ec2.internal\" (UID: \"31ca95e84738030244e0b10abf497390\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-250.ec2.internal" Jun 12 22:20:00.705235 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:00.705218 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-250.ec2.internal\" not found" node="ip-10-0-135-250.ec2.internal" Jun 12 22:20:00.709651 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:00.709635 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-250.ec2.internal\" not found" node="ip-10-0-135-250.ec2.internal" Jun 12 22:20:00.787274 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:00.787244 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-250.ec2.internal\" not found" Jun 12 22:20:00.800671 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.800646 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/31ca95e84738030244e0b10abf497390-config\") pod \"kube-apiserver-proxy-ip-10-0-135-250.ec2.internal\" (UID: \"31ca95e84738030244e0b10abf497390\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-250.ec2.internal" Jun 12 22:20:00.800762 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.800674 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fea8f5fe2d93cc4fb20f636599e647b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-250.ec2.internal\" (UID: \"fea8f5fe2d93cc4fb20f636599e647b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-250.ec2.internal" Jun 12 22:20:00.800762 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.800692 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fea8f5fe2d93cc4fb20f636599e647b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-250.ec2.internal\" (UID: \"fea8f5fe2d93cc4fb20f636599e647b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-250.ec2.internal" Jun 12 22:20:00.800762 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.800757 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fea8f5fe2d93cc4fb20f636599e647b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-250.ec2.internal\" (UID: \"fea8f5fe2d93cc4fb20f636599e647b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-250.ec2.internal" Jun 12 22:20:00.800869 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.800753 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/31ca95e84738030244e0b10abf497390-config\") pod \"kube-apiserver-proxy-ip-10-0-135-250.ec2.internal\" (UID: \"31ca95e84738030244e0b10abf497390\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-250.ec2.internal" Jun 12 22:20:00.800869 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:00.800802 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fea8f5fe2d93cc4fb20f636599e647b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-250.ec2.internal\" (UID: \"fea8f5fe2d93cc4fb20f636599e647b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-250.ec2.internal" Jun 12 22:20:00.887560 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:00.887529 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-250.ec2.internal\" not found" Jun 12 22:20:00.988246 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:00.988187 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-250.ec2.internal\" not found" Jun 12 22:20:01.007586 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:01.007561 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-250.ec2.internal" Jun 12 22:20:01.012634 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:01.012620 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-250.ec2.internal" Jun 12 22:20:01.088844 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:01.088802 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-250.ec2.internal\" not found" Jun 12 22:20:01.189385 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:01.189347 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-250.ec2.internal\" not found" Jun 12 22:20:01.289843 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:01.289812 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-250.ec2.internal\" not found" Jun 12 22:20:01.390399 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:01.390361 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-250.ec2.internal\" not found" Jun 12 22:20:01.434828 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:01.434802 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 12 22:20:01.435406 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:01.434945 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 22:20:01.435406 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:01.434979 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 22:20:01.491294 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:01.491265 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-250.ec2.internal\" not found" Jun 12 22:20:01.503059 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:01.503028 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-11 22:15:00 +0000 UTC" deadline="2028-01-24 17:19:01.927597462 +0000 UTC" Jun 12 22:20:01.503059 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:01.503053 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14178h59m0.424548034s" Jun 12 22:20:01.590798 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:01.590757 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfea8f5fe2d93cc4fb20f636599e647b1.slice/crio-f29dd40e57b05a1ca154938ce0a9775fc2e3505820194f02427ce7588388f2cd WatchSource:0}: Error finding container f29dd40e57b05a1ca154938ce0a9775fc2e3505820194f02427ce7588388f2cd: Status 404 returned error can't find the container with id f29dd40e57b05a1ca154938ce0a9775fc2e3505820194f02427ce7588388f2cd Jun 12 22:20:01.591121 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:01.591103 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31ca95e84738030244e0b10abf497390.slice/crio-c9983c2e0547b903a8efb7b16ebb49434a14ed235f0a90ae96203dc3b30d2ea1 WatchSource:0}: Error finding container c9983c2e0547b903a8efb7b16ebb49434a14ed235f0a90ae96203dc3b30d2ea1: Status 404 returned error can't find the container with id c9983c2e0547b903a8efb7b16ebb49434a14ed235f0a90ae96203dc3b30d2ea1 Jun 12 22:20:01.592215 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:01.592199 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-250.ec2.internal\" not found" Jun 12 22:20:01.595032 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:01.595019 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 22:20:01.692764 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:01.692727 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-250.ec2.internal\" not found" Jun 12 22:20:01.732131 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:01.732103 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 22:20:01.793422 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:01.793392 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-250.ec2.internal\" not found" Jun 12 22:20:01.815011 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:01.814989 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 22:20:01.899106 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:01.899033 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-250.ec2.internal" Jun 12 22:20:01.913501 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:01.913479 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 22:20:01.914536 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:01.914523 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-250.ec2.internal" Jun 12 22:20:01.920940 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:01.920922 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 22:20:02.441130 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.441101 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 22:20:02.478420 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.478388 2558 apiserver.go:52] "Watching apiserver" Jun 12 22:20:02.487522 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.487495 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 12 22:20:02.487913 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.487881 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-250.ec2.internal","openshift-multus/multus-additional-cni-plugins-c2mhw","openshift-multus/multus-pb79d","openshift-multus/network-metrics-daemon-lqpxm","openshift-ovn-kubernetes/ovnkube-node-2498q","kube-system/global-pull-secret-syncer-mpzdk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk","openshift-cluster-node-tuning-operator/tuned-88ztf","openshift-dns/node-resolver-8l9dt","openshift-network-diagnostics/network-check-target-jfkmv","openshift-network-operator/iptables-alerter-rw5r4","kube-system/konnectivity-agent-vpbbf","kube-system/kube-apiserver-proxy-ip-10-0-135-250.ec2.internal","openshift-image-registry/node-ca-zpg7d"] Jun 12 22:20:02.490426 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.490407 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" Jun 12 22:20:02.492510 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.492493 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rw5r4" Jun 12 22:20:02.493067 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.493034 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 12 22:20:02.493158 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.493101 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nk26q\"" Jun 12 22:20:02.493158 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.493109 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 12 22:20:02.493158 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.493125 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 12 22:20:02.494676 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.494625 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.494976 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.494853 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 12 22:20:02.495072 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.495058 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 12 22:20:02.495130 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.495098 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 12 22:20:02.495371 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.495328 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wcssd\"" Jun 12 22:20:02.497076 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.496874 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:02.497076 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:02.496963 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqpxm" podUID="5707213e-da61-4306-96d0-03a1790eb281" Jun 12 22:20:02.497076 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.496985 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 12 22:20:02.497278 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.497083 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 12 22:20:02.497331 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.497296 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 12 22:20:02.497535 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.497518 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-g5c69\"" Jun 12 22:20:02.497622 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.497522 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 12 22:20:02.499619 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.499598 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 12 22:20:02.501356 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.501325 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.503544 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.503521 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 12 22:20:02.503643 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.503628 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 12 22:20:02.503704 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.503647 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hdc54\"" Jun 12 22:20:02.503837 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.503781 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:02.503903 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.503846 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 12 22:20:02.503903 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:02.503887 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mpzdk" podUID="ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4" Jun 12 22:20:02.504209 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.504191 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 12 22:20:02.504209 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.504206 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 12 22:20:02.504326 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.504232 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 12 22:20:02.505964 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.505948 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8l9dt" Jun 12 22:20:02.508101 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.508078 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 12 22:20:02.508292 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.508275 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zpg7d" Jun 12 22:20:02.508292 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.508290 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jxh5p\"" Jun 12 22:20:02.508623 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.508604 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-cnibin\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.508708 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.508637 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-multus-socket-dir-parent\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.508708 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.508661 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-host-run-k8s-cni-cncf-io\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.508708 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.508692 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 12 22:20:02.508708 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.508697 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-host-var-lib-kubelet\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.508888 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.508722 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-host-kubelet\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.508888 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.508769 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-run-openvswitch\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.508888 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.508796 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zthhs\" (UniqueName: \"kubernetes.io/projected/a49dd33d-ee37-4151-afe6-99ee78b8943b-kube-api-access-zthhs\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.508888 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.508821 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/32c69df7-0921-42ca-b0dc-e970df30d151-registration-dir\") pod \"aws-ebs-csi-driver-node-6l4zk\" (UID: \"32c69df7-0921-42ca-b0dc-e970df30d151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" Jun 12 22:20:02.508888 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.508864 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-system-cni-dir\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.509102 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.508907 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-multus-cni-dir\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.509102 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.508935 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-host-run-netns\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.509102 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.508968 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-hostroot\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.509102 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.508990 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqjp8\" (UniqueName: \"kubernetes.io/projected/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-kube-api-access-vqjp8\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.509102 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509024 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/32c69df7-0921-42ca-b0dc-e970df30d151-device-dir\") pod \"aws-ebs-csi-driver-node-6l4zk\" (UID: \"32c69df7-0921-42ca-b0dc-e970df30d151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" Jun 12 22:20:02.509102 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509055 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-etc-kubernetes\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.509342 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509111 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs\") pod \"network-metrics-daemon-lqpxm\" (UID: \"5707213e-da61-4306-96d0-03a1790eb281\") " pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:02.509342 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509137 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-systemd-units\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.509342 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509164 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.509342 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509188 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/32c69df7-0921-42ca-b0dc-e970df30d151-socket-dir\") pod \"aws-ebs-csi-driver-node-6l4zk\" (UID: \"32c69df7-0921-42ca-b0dc-e970df30d151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" Jun 12 22:20:02.509342 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509211 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tzwk\" (UniqueName: \"kubernetes.io/projected/32c69df7-0921-42ca-b0dc-e970df30d151-kube-api-access-2tzwk\") pod \"aws-ebs-csi-driver-node-6l4zk\" (UID: \"32c69df7-0921-42ca-b0dc-e970df30d151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" Jun 12 22:20:02.509342 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509242 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3195c86-ad47-4899-a7d9-c96d21781a9f-iptables-alerter-script\") pod \"iptables-alerter-rw5r4\" (UID: \"d3195c86-ad47-4899-a7d9-c96d21781a9f\") " pod="openshift-network-operator/iptables-alerter-rw5r4" Jun 12 22:20:02.509342 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509259 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-os-release\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.509342 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509273 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-run-ovn\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.509342 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509291 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-host-run-ovn-kubernetes\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.509342 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509331 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a49dd33d-ee37-4151-afe6-99ee78b8943b-ovnkube-config\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.509813 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509361 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-multus-conf-dir\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.509813 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509381 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/32c69df7-0921-42ca-b0dc-e970df30d151-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6l4zk\" (UID: \"32c69df7-0921-42ca-b0dc-e970df30d151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" Jun 12 22:20:02.509813 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509415 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/32c69df7-0921-42ca-b0dc-e970df30d151-etc-selinux\") pod \"aws-ebs-csi-driver-node-6l4zk\" (UID: \"32c69df7-0921-42ca-b0dc-e970df30d151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" Jun 12 22:20:02.509813 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509452 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-host-var-lib-cni-multus\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.509813 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509483 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-etc-openvswitch\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.509813 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509505 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-log-socket\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.509813 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509528 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-host-cni-netd\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.509813 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509547 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a49dd33d-ee37-4151-afe6-99ee78b8943b-env-overrides\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.509813 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509561 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-multus-daemon-config\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.509813 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509600 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfvnc\" (UniqueName: \"kubernetes.io/projected/d3195c86-ad47-4899-a7d9-c96d21781a9f-kube-api-access-zfvnc\") pod \"iptables-alerter-rw5r4\" (UID: \"d3195c86-ad47-4899-a7d9-c96d21781a9f\") " pod="openshift-network-operator/iptables-alerter-rw5r4" Jun 12 22:20:02.509813 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509618 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-cni-binary-copy\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.509813 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509633 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-host-slash\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.509813 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509654 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-host-run-netns\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.509813 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509680 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3195c86-ad47-4899-a7d9-c96d21781a9f-host-slash\") pod \"iptables-alerter-rw5r4\" (UID: \"d3195c86-ad47-4899-a7d9-c96d21781a9f\") " pod="openshift-network-operator/iptables-alerter-rw5r4" Jun 12 22:20:02.509813 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509699 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-host-var-lib-cni-bin\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.509813 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509713 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s8vw\" (UniqueName: \"kubernetes.io/projected/5707213e-da61-4306-96d0-03a1790eb281-kube-api-access-5s8vw\") pod \"network-metrics-daemon-lqpxm\" (UID: \"5707213e-da61-4306-96d0-03a1790eb281\") " pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:02.510345 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509728 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-node-log\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.510345 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.509758 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-host-cni-bin\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.510345 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.510164 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a49dd33d-ee37-4151-afe6-99ee78b8943b-ovnkube-script-lib\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.510345 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.510208 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/32c69df7-0921-42ca-b0dc-e970df30d151-sys-fs\") pod \"aws-ebs-csi-driver-node-6l4zk\" (UID: \"32c69df7-0921-42ca-b0dc-e970df30d151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" Jun 12 22:20:02.510345 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.510239 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-host-run-multus-certs\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.510345 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.510264 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-run-systemd\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.510345 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.510295 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-var-lib-openvswitch\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.510345 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.510323 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a49dd33d-ee37-4151-afe6-99ee78b8943b-ovn-node-metrics-cert\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.510709 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.510642 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 12 22:20:02.510941 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.510921 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 12 22:20:02.511374 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.511352 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.512051 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.511797 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 12 22:20:02.512051 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.511817 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rw2mh\"" Jun 12 22:20:02.514995 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.514780 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 12 22:20:02.514995 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.514864 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kwffx\"" Jun 12 22:20:02.514995 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.514918 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 12 22:20:02.515221 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.515142 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 22:20:02.515221 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.515155 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:02.515372 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:02.515250 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfkmv" podUID="b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e" Jun 12 22:20:02.517446 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.517411 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.519864 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.519847 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vpbbf" Jun 12 22:20:02.520004 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.519968 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zkshk\"" Jun 12 22:20:02.520081 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.520020 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 12 22:20:02.520081 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.520071 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 12 22:20:02.523609 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.523588 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 12 22:20:02.523706 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.523625 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-94n5c\"" Jun 12 22:20:02.523706 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.523674 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 12 22:20:02.537580 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.537559 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xxgrf" Jun 12 22:20:02.546580 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.546562 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xxgrf" Jun 12 22:20:02.572557 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.572512 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-250.ec2.internal" event={"ID":"31ca95e84738030244e0b10abf497390","Type":"ContainerStarted","Data":"c9983c2e0547b903a8efb7b16ebb49434a14ed235f0a90ae96203dc3b30d2ea1"} Jun 12 22:20:02.573688 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.573659 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-250.ec2.internal" event={"ID":"fea8f5fe2d93cc4fb20f636599e647b1","Type":"ContainerStarted","Data":"f29dd40e57b05a1ca154938ce0a9775fc2e3505820194f02427ce7588388f2cd"} Jun 12 22:20:02.600245 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.600217 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 12 22:20:02.610815 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.610785 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a49dd33d-ee37-4151-afe6-99ee78b8943b-ovnkube-script-lib\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.610952 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.610823 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-etc-systemd\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.610952 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.610838 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrwww\" (UniqueName: \"kubernetes.io/projected/fbe71fc0-4361-4e62-bef7-4c056d981509-kube-api-access-zrwww\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.610952 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.610855 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-host-run-multus-certs\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.610952 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.610871 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-run-systemd\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.610952 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.610916 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-run-systemd\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.610952 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.610918 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-etc-sysctl-d\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.610952 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.610945 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-host-run-multus-certs\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.611321 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.610957 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-etc-sysctl-conf\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.611321 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.610984 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-lib-modules\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.611321 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611012 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-cnibin\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.611321 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611038 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-host-run-k8s-cni-cncf-io\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.611321 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611076 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-host-var-lib-kubelet\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.611321 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611082 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-host-run-k8s-cni-cncf-io\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.611321 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611103 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-run-openvswitch\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.611321 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611137 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f223bd69-0e45-4401-b183-52acac69823a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c2mhw\" (UID: \"f223bd69-0e45-4401-b183-52acac69823a\") " pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.611321 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611144 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-host-var-lib-kubelet\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.611321 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611152 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-kubelet-config\") pod \"global-pull-secret-syncer-mpzdk\" (UID: \"ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4\") " pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:02.611321 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611187 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-cnibin\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.611321 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611189 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-run-openvswitch\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.611321 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611223 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-etc-modprobe-d\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.611321 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611244 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/32c69df7-0921-42ca-b0dc-e970df30d151-registration-dir\") pod \"aws-ebs-csi-driver-node-6l4zk\" (UID: \"32c69df7-0921-42ca-b0dc-e970df30d151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" Jun 12 22:20:02.611321 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611276 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-system-cni-dir\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.611321 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611299 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-host-run-netns\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.611321 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611322 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f223bd69-0e45-4401-b183-52acac69823a-cnibin\") pod \"multus-additional-cni-plugins-c2mhw\" (UID: \"f223bd69-0e45-4401-b183-52acac69823a\") " pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.612134 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611337 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/32c69df7-0921-42ca-b0dc-e970df30d151-registration-dir\") pod \"aws-ebs-csi-driver-node-6l4zk\" (UID: \"32c69df7-0921-42ca-b0dc-e970df30d151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" Jun 12 22:20:02.612134 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611346 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-var-lib-kubelet\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.612134 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611382 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-host-run-netns\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.612134 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611383 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-system-cni-dir\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.612134 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611388 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-etc-kubernetes\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.612134 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611411 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs\") pod \"network-metrics-daemon-lqpxm\" (UID: \"5707213e-da61-4306-96d0-03a1790eb281\") " pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:02.612134 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611451 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-etc-kubernetes\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.612134 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611461 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.612134 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611499 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pr65\" (UniqueName: \"kubernetes.io/projected/b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e-kube-api-access-2pr65\") pod \"network-check-target-jfkmv\" (UID: \"b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e\") " pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:02.612134 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611514 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/32c69df7-0921-42ca-b0dc-e970df30d151-socket-dir\") pod \"aws-ebs-csi-driver-node-6l4zk\" (UID: \"32c69df7-0921-42ca-b0dc-e970df30d151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" Jun 12 22:20:02.612134 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611531 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a49dd33d-ee37-4151-afe6-99ee78b8943b-ovnkube-script-lib\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.612134 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:02.611548 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:02.612134 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611534 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.612134 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611535 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3195c86-ad47-4899-a7d9-c96d21781a9f-iptables-alerter-script\") pod \"iptables-alerter-rw5r4\" (UID: \"d3195c86-ad47-4899-a7d9-c96d21781a9f\") " pod="openshift-network-operator/iptables-alerter-rw5r4" Jun 12 22:20:02.612134 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611594 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-os-release\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.612134 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:02.611629 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs podName:5707213e-da61-4306-96d0-03a1790eb281 nodeName:}" failed. No retries permitted until 2026-06-12 22:20:03.11159639 +0000 UTC m=+2.982626493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs") pod "network-metrics-daemon-lqpxm" (UID: "5707213e-da61-4306-96d0-03a1790eb281") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:02.612134 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611655 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-run-ovn\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.612655 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611673 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-host-run-ovn-kubernetes\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.612655 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611678 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-os-release\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.612655 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611688 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a49dd33d-ee37-4151-afe6-99ee78b8943b-ovnkube-config\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.612655 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611711 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f223bd69-0e45-4401-b183-52acac69823a-system-cni-dir\") pod \"multus-additional-cni-plugins-c2mhw\" (UID: \"f223bd69-0e45-4401-b183-52acac69823a\") " pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.612655 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611714 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-run-ovn\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.612655 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611727 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-run\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.612655 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611677 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/32c69df7-0921-42ca-b0dc-e970df30d151-socket-dir\") pod \"aws-ebs-csi-driver-node-6l4zk\" (UID: \"32c69df7-0921-42ca-b0dc-e970df30d151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" Jun 12 22:20:02.612655 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611756 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-multus-conf-dir\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.612655 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611779 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-host-run-ovn-kubernetes\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.612655 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611780 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/32c69df7-0921-42ca-b0dc-e970df30d151-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6l4zk\" (UID: \"32c69df7-0921-42ca-b0dc-e970df30d151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" Jun 12 22:20:02.612655 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611822 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-multus-conf-dir\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.612655 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611829 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/32c69df7-0921-42ca-b0dc-e970df30d151-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6l4zk\" (UID: \"32c69df7-0921-42ca-b0dc-e970df30d151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" Jun 12 22:20:02.612655 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611924 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/32c69df7-0921-42ca-b0dc-e970df30d151-etc-selinux\") pod \"aws-ebs-csi-driver-node-6l4zk\" (UID: \"32c69df7-0921-42ca-b0dc-e970df30d151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" Jun 12 22:20:02.612655 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611962 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-etc-openvswitch\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.612655 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.611983 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-host-cni-netd\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.612655 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612007 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a49dd33d-ee37-4151-afe6-99ee78b8943b-env-overrides\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.612655 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612034 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/26b5ec6b-bd2c-4920-8737-a43044a3d820-serviceca\") pod \"node-ca-zpg7d\" (UID: \"26b5ec6b-bd2c-4920-8737-a43044a3d820\") " pod="openshift-image-registry/node-ca-zpg7d" Jun 12 22:20:02.613283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612048 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-etc-openvswitch\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.613283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612062 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f223bd69-0e45-4401-b183-52acac69823a-os-release\") pod \"multus-additional-cni-plugins-c2mhw\" (UID: \"f223bd69-0e45-4401-b183-52acac69823a\") " pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.613283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612087 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3195c86-ad47-4899-a7d9-c96d21781a9f-iptables-alerter-script\") pod \"iptables-alerter-rw5r4\" (UID: \"d3195c86-ad47-4899-a7d9-c96d21781a9f\") " pod="openshift-network-operator/iptables-alerter-rw5r4" Jun 12 22:20:02.613283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612097 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-host-cni-netd\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.613283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612121 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-multus-daemon-config\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.613283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612177 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfvnc\" (UniqueName: \"kubernetes.io/projected/d3195c86-ad47-4899-a7d9-c96d21781a9f-kube-api-access-zfvnc\") pod \"iptables-alerter-rw5r4\" (UID: \"d3195c86-ad47-4899-a7d9-c96d21781a9f\") " pod="openshift-network-operator/iptables-alerter-rw5r4" Jun 12 22:20:02.613283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612224 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-host-run-netns\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.613283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612249 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-original-pull-secret\") pod \"global-pull-secret-syncer-mpzdk\" (UID: \"ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4\") " pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:02.613283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612333 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-etc-kubernetes\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.613283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612408 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-sys\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.613283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612448 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-host\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.613283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612458 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a49dd33d-ee37-4151-afe6-99ee78b8943b-ovnkube-config\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.613283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612472 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3195c86-ad47-4899-a7d9-c96d21781a9f-host-slash\") pod \"iptables-alerter-rw5r4\" (UID: \"d3195c86-ad47-4899-a7d9-c96d21781a9f\") " pod="openshift-network-operator/iptables-alerter-rw5r4" Jun 12 22:20:02.613283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612497 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s8vw\" (UniqueName: \"kubernetes.io/projected/5707213e-da61-4306-96d0-03a1790eb281-kube-api-access-5s8vw\") pod \"network-metrics-daemon-lqpxm\" (UID: \"5707213e-da61-4306-96d0-03a1790eb281\") " pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:02.613283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612526 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26b5ec6b-bd2c-4920-8737-a43044a3d820-host\") pod \"node-ca-zpg7d\" (UID: \"26b5ec6b-bd2c-4920-8737-a43044a3d820\") " pod="openshift-image-registry/node-ca-zpg7d" Jun 12 22:20:02.613283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612555 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a49dd33d-ee37-4151-afe6-99ee78b8943b-env-overrides\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.613283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612591 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f223bd69-0e45-4401-b183-52acac69823a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c2mhw\" (UID: \"f223bd69-0e45-4401-b183-52acac69823a\") " pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.614017 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612618 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbe71fc0-4361-4e62-bef7-4c056d981509-etc-tuned\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.614017 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612618 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-host-run-netns\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.614017 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612645 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9af1eca2-b583-43aa-83dc-cf6e62837d2c-tmp-dir\") pod \"node-resolver-8l9dt\" (UID: \"9af1eca2-b583-43aa-83dc-cf6e62837d2c\") " pod="openshift-dns/node-resolver-8l9dt" Jun 12 22:20:02.614017 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612662 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3195c86-ad47-4899-a7d9-c96d21781a9f-host-slash\") pod \"iptables-alerter-rw5r4\" (UID: \"d3195c86-ad47-4899-a7d9-c96d21781a9f\") " pod="openshift-network-operator/iptables-alerter-rw5r4" Jun 12 22:20:02.614017 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612671 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/32c69df7-0921-42ca-b0dc-e970df30d151-etc-selinux\") pod \"aws-ebs-csi-driver-node-6l4zk\" (UID: \"32c69df7-0921-42ca-b0dc-e970df30d151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" Jun 12 22:20:02.614017 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612680 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/32c69df7-0921-42ca-b0dc-e970df30d151-sys-fs\") pod \"aws-ebs-csi-driver-node-6l4zk\" (UID: \"32c69df7-0921-42ca-b0dc-e970df30d151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" Jun 12 22:20:02.614017 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612725 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-var-lib-openvswitch\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.614017 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612735 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-multus-daemon-config\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.614017 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612756 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/32c69df7-0921-42ca-b0dc-e970df30d151-sys-fs\") pod \"aws-ebs-csi-driver-node-6l4zk\" (UID: \"32c69df7-0921-42ca-b0dc-e970df30d151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" Jun 12 22:20:02.614017 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612798 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-var-lib-openvswitch\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.614017 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612820 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a49dd33d-ee37-4151-afe6-99ee78b8943b-ovn-node-metrics-cert\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.614017 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613029 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-multus-socket-dir-parent\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.614017 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613252 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 12 22:20:02.614017 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.612852 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-multus-socket-dir-parent\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.614017 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613338 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-host-kubelet\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.614017 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613357 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zthhs\" (UniqueName: \"kubernetes.io/projected/a49dd33d-ee37-4151-afe6-99ee78b8943b-kube-api-access-zthhs\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.614017 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613380 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8001d08-ea1e-4afd-8e3b-1ee42cf96d35-agent-certs\") pod \"konnectivity-agent-vpbbf\" (UID: \"f8001d08-ea1e-4afd-8e3b-1ee42cf96d35\") " pod="kube-system/konnectivity-agent-vpbbf" Jun 12 22:20:02.614017 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613401 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-multus-cni-dir\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.614651 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613424 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-hostroot\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.614651 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613478 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-host-kubelet\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.614651 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613494 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-hostroot\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.614651 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613515 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-multus-cni-dir\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.614651 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613543 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqjp8\" (UniqueName: \"kubernetes.io/projected/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-kube-api-access-vqjp8\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.614651 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613572 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-dbus\") pod \"global-pull-secret-syncer-mpzdk\" (UID: \"ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4\") " pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:02.614651 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613594 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbe71fc0-4361-4e62-bef7-4c056d981509-tmp\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.614651 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613619 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/32c69df7-0921-42ca-b0dc-e970df30d151-device-dir\") pod \"aws-ebs-csi-driver-node-6l4zk\" (UID: \"32c69df7-0921-42ca-b0dc-e970df30d151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" Jun 12 22:20:02.614651 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613641 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-systemd-units\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.614651 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613668 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfbz8\" (UniqueName: \"kubernetes.io/projected/26b5ec6b-bd2c-4920-8737-a43044a3d820-kube-api-access-jfbz8\") pod \"node-ca-zpg7d\" (UID: \"26b5ec6b-bd2c-4920-8737-a43044a3d820\") " pod="openshift-image-registry/node-ca-zpg7d" Jun 12 22:20:02.614651 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613683 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/32c69df7-0921-42ca-b0dc-e970df30d151-device-dir\") pod \"aws-ebs-csi-driver-node-6l4zk\" (UID: \"32c69df7-0921-42ca-b0dc-e970df30d151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" Jun 12 22:20:02.614651 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613717 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-systemd-units\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.614651 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613759 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f223bd69-0e45-4401-b183-52acac69823a-cni-binary-copy\") pod \"multus-additional-cni-plugins-c2mhw\" (UID: \"f223bd69-0e45-4401-b183-52acac69823a\") " pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.614651 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613794 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tzwk\" (UniqueName: \"kubernetes.io/projected/32c69df7-0921-42ca-b0dc-e970df30d151-kube-api-access-2tzwk\") pod \"aws-ebs-csi-driver-node-6l4zk\" (UID: \"32c69df7-0921-42ca-b0dc-e970df30d151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" Jun 12 22:20:02.614651 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613838 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtcb8\" (UniqueName: \"kubernetes.io/projected/f223bd69-0e45-4401-b183-52acac69823a-kube-api-access-gtcb8\") pod \"multus-additional-cni-plugins-c2mhw\" (UID: \"f223bd69-0e45-4401-b183-52acac69823a\") " pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.614651 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613889 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-etc-sysconfig\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.614651 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613904 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-host-var-lib-cni-multus\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.615504 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613924 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-log-socket\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.615504 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613955 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-log-socket\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.615504 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.613997 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f223bd69-0e45-4401-b183-52acac69823a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c2mhw\" (UID: \"f223bd69-0e45-4401-b183-52acac69823a\") " pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.615504 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.614038 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8001d08-ea1e-4afd-8e3b-1ee42cf96d35-konnectivity-ca\") pod \"konnectivity-agent-vpbbf\" (UID: \"f8001d08-ea1e-4afd-8e3b-1ee42cf96d35\") " pod="kube-system/konnectivity-agent-vpbbf" Jun 12 22:20:02.615504 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.614075 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-host-var-lib-cni-multus\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.615504 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.614134 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8ttc\" (UniqueName: \"kubernetes.io/projected/9af1eca2-b583-43aa-83dc-cf6e62837d2c-kube-api-access-m8ttc\") pod \"node-resolver-8l9dt\" (UID: \"9af1eca2-b583-43aa-83dc-cf6e62837d2c\") " pod="openshift-dns/node-resolver-8l9dt" Jun 12 22:20:02.615504 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.614181 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-cni-binary-copy\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.615504 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.614220 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-host-slash\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.615504 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.614250 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9af1eca2-b583-43aa-83dc-cf6e62837d2c-hosts-file\") pod \"node-resolver-8l9dt\" (UID: \"9af1eca2-b583-43aa-83dc-cf6e62837d2c\") " pod="openshift-dns/node-resolver-8l9dt" Jun 12 22:20:02.615504 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.614273 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-host-var-lib-cni-bin\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.615504 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.614294 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-node-log\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.615504 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.614314 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-host-slash\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.615504 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.614321 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-host-var-lib-cni-bin\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.615504 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.614316 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-host-cni-bin\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.615504 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.614360 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-node-log\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.615504 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.614444 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a49dd33d-ee37-4151-afe6-99ee78b8943b-host-cni-bin\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.615504 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.614655 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-cni-binary-copy\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.616491 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.616321 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a49dd33d-ee37-4151-afe6-99ee78b8943b-ovn-node-metrics-cert\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.620838 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.620813 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 22:20:02.633685 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.633652 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zthhs\" (UniqueName: \"kubernetes.io/projected/a49dd33d-ee37-4151-afe6-99ee78b8943b-kube-api-access-zthhs\") pod \"ovnkube-node-2498q\" (UID: \"a49dd33d-ee37-4151-afe6-99ee78b8943b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.633821 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.633715 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tzwk\" (UniqueName: \"kubernetes.io/projected/32c69df7-0921-42ca-b0dc-e970df30d151-kube-api-access-2tzwk\") pod \"aws-ebs-csi-driver-node-6l4zk\" (UID: \"32c69df7-0921-42ca-b0dc-e970df30d151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" Jun 12 22:20:02.633956 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.633938 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s8vw\" (UniqueName: \"kubernetes.io/projected/5707213e-da61-4306-96d0-03a1790eb281-kube-api-access-5s8vw\") pod \"network-metrics-daemon-lqpxm\" (UID: \"5707213e-da61-4306-96d0-03a1790eb281\") " pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:02.634972 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.634951 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqjp8\" (UniqueName: \"kubernetes.io/projected/a63c2dd0-dc3b-4b13-a47b-6d7c045058e7-kube-api-access-vqjp8\") pod \"multus-pb79d\" (UID: \"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7\") " pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.634972 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.634966 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfvnc\" (UniqueName: \"kubernetes.io/projected/d3195c86-ad47-4899-a7d9-c96d21781a9f-kube-api-access-zfvnc\") pod \"iptables-alerter-rw5r4\" (UID: \"d3195c86-ad47-4899-a7d9-c96d21781a9f\") " pod="openshift-network-operator/iptables-alerter-rw5r4" Jun 12 22:20:02.715240 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715158 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8001d08-ea1e-4afd-8e3b-1ee42cf96d35-agent-certs\") pod \"konnectivity-agent-vpbbf\" (UID: \"f8001d08-ea1e-4afd-8e3b-1ee42cf96d35\") " pod="kube-system/konnectivity-agent-vpbbf" Jun 12 22:20:02.715240 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715215 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-dbus\") pod \"global-pull-secret-syncer-mpzdk\" (UID: \"ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4\") " pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:02.715240 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715239 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbe71fc0-4361-4e62-bef7-4c056d981509-tmp\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.715576 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715264 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfbz8\" (UniqueName: \"kubernetes.io/projected/26b5ec6b-bd2c-4920-8737-a43044a3d820-kube-api-access-jfbz8\") pod \"node-ca-zpg7d\" (UID: \"26b5ec6b-bd2c-4920-8737-a43044a3d820\") " pod="openshift-image-registry/node-ca-zpg7d" Jun 12 22:20:02.715576 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715287 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f223bd69-0e45-4401-b183-52acac69823a-cni-binary-copy\") pod \"multus-additional-cni-plugins-c2mhw\" (UID: \"f223bd69-0e45-4401-b183-52acac69823a\") " pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.715576 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715404 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-dbus\") pod \"global-pull-secret-syncer-mpzdk\" (UID: \"ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4\") " pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:02.715576 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715405 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtcb8\" (UniqueName: \"kubernetes.io/projected/f223bd69-0e45-4401-b183-52acac69823a-kube-api-access-gtcb8\") pod \"multus-additional-cni-plugins-c2mhw\" (UID: \"f223bd69-0e45-4401-b183-52acac69823a\") " pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.715576 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715480 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-etc-sysconfig\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.715576 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715511 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f223bd69-0e45-4401-b183-52acac69823a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c2mhw\" (UID: \"f223bd69-0e45-4401-b183-52acac69823a\") " pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.715576 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715536 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8001d08-ea1e-4afd-8e3b-1ee42cf96d35-konnectivity-ca\") pod \"konnectivity-agent-vpbbf\" (UID: \"f8001d08-ea1e-4afd-8e3b-1ee42cf96d35\") " pod="kube-system/konnectivity-agent-vpbbf" Jun 12 22:20:02.715576 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715560 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8ttc\" (UniqueName: \"kubernetes.io/projected/9af1eca2-b583-43aa-83dc-cf6e62837d2c-kube-api-access-m8ttc\") pod \"node-resolver-8l9dt\" (UID: \"9af1eca2-b583-43aa-83dc-cf6e62837d2c\") " pod="openshift-dns/node-resolver-8l9dt" Jun 12 22:20:02.715962 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715588 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9af1eca2-b583-43aa-83dc-cf6e62837d2c-hosts-file\") pod \"node-resolver-8l9dt\" (UID: \"9af1eca2-b583-43aa-83dc-cf6e62837d2c\") " pod="openshift-dns/node-resolver-8l9dt" Jun 12 22:20:02.715962 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715614 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-etc-systemd\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.715962 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715638 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrwww\" (UniqueName: \"kubernetes.io/projected/fbe71fc0-4361-4e62-bef7-4c056d981509-kube-api-access-zrwww\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.715962 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715661 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-etc-sysctl-d\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.715962 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715684 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-etc-sysctl-conf\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.715962 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715710 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-lib-modules\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.715962 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715726 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9af1eca2-b583-43aa-83dc-cf6e62837d2c-hosts-file\") pod \"node-resolver-8l9dt\" (UID: \"9af1eca2-b583-43aa-83dc-cf6e62837d2c\") " pod="openshift-dns/node-resolver-8l9dt" Jun 12 22:20:02.715962 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715738 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f223bd69-0e45-4401-b183-52acac69823a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c2mhw\" (UID: \"f223bd69-0e45-4401-b183-52acac69823a\") " pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.715962 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715763 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-kubelet-config\") pod \"global-pull-secret-syncer-mpzdk\" (UID: \"ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4\") " pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:02.715962 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715789 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-etc-modprobe-d\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.715962 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715818 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f223bd69-0e45-4401-b183-52acac69823a-cnibin\") pod \"multus-additional-cni-plugins-c2mhw\" (UID: \"f223bd69-0e45-4401-b183-52acac69823a\") " pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.715962 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715823 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f223bd69-0e45-4401-b183-52acac69823a-cni-binary-copy\") pod \"multus-additional-cni-plugins-c2mhw\" (UID: \"f223bd69-0e45-4401-b183-52acac69823a\") " pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.715962 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715841 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-var-lib-kubelet\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.715962 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715887 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pr65\" (UniqueName: \"kubernetes.io/projected/b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e-kube-api-access-2pr65\") pod \"network-check-target-jfkmv\" (UID: \"b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e\") " pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:02.715962 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715893 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-var-lib-kubelet\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.715962 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715920 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f223bd69-0e45-4401-b183-52acac69823a-system-cni-dir\") pod \"multus-additional-cni-plugins-c2mhw\" (UID: \"f223bd69-0e45-4401-b183-52acac69823a\") " pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.715962 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715943 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-run\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.716764 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715974 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/26b5ec6b-bd2c-4920-8737-a43044a3d820-serviceca\") pod \"node-ca-zpg7d\" (UID: \"26b5ec6b-bd2c-4920-8737-a43044a3d820\") " pod="openshift-image-registry/node-ca-zpg7d" Jun 12 22:20:02.716764 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715996 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f223bd69-0e45-4401-b183-52acac69823a-os-release\") pod \"multus-additional-cni-plugins-c2mhw\" (UID: \"f223bd69-0e45-4401-b183-52acac69823a\") " pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.716764 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716023 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-original-pull-secret\") pod \"global-pull-secret-syncer-mpzdk\" (UID: \"ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4\") " pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:02.716764 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716042 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f223bd69-0e45-4401-b183-52acac69823a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c2mhw\" (UID: \"f223bd69-0e45-4401-b183-52acac69823a\") " pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.716764 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716111 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-run\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.716764 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.715944 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-etc-systemd\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.716764 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716243 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-etc-sysctl-d\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.716764 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716287 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f223bd69-0e45-4401-b183-52acac69823a-system-cni-dir\") pod \"multus-additional-cni-plugins-c2mhw\" (UID: \"f223bd69-0e45-4401-b183-52acac69823a\") " pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.716764 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716048 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-etc-kubernetes\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.716764 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716304 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8001d08-ea1e-4afd-8e3b-1ee42cf96d35-konnectivity-ca\") pod \"konnectivity-agent-vpbbf\" (UID: \"f8001d08-ea1e-4afd-8e3b-1ee42cf96d35\") " pod="kube-system/konnectivity-agent-vpbbf" Jun 12 22:20:02.716764 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716358 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-kubelet-config\") pod \"global-pull-secret-syncer-mpzdk\" (UID: \"ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4\") " pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:02.716764 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716380 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-etc-modprobe-d\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.716764 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716396 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-sys\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.716764 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716426 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-host\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.716764 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716454 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-etc-kubernetes\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.716764 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716471 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26b5ec6b-bd2c-4920-8737-a43044a3d820-host\") pod \"node-ca-zpg7d\" (UID: \"26b5ec6b-bd2c-4920-8737-a43044a3d820\") " pod="openshift-image-registry/node-ca-zpg7d" Jun 12 22:20:02.716764 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716487 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f223bd69-0e45-4401-b183-52acac69823a-cnibin\") pod \"multus-additional-cni-plugins-c2mhw\" (UID: \"f223bd69-0e45-4401-b183-52acac69823a\") " pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.717637 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716492 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f223bd69-0e45-4401-b183-52acac69823a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c2mhw\" (UID: \"f223bd69-0e45-4401-b183-52acac69823a\") " pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.717637 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716509 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/26b5ec6b-bd2c-4920-8737-a43044a3d820-serviceca\") pod \"node-ca-zpg7d\" (UID: \"26b5ec6b-bd2c-4920-8737-a43044a3d820\") " pod="openshift-image-registry/node-ca-zpg7d" Jun 12 22:20:02.717637 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716516 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbe71fc0-4361-4e62-bef7-4c056d981509-etc-tuned\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.717637 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716527 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-host\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.717637 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716423 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-lib-modules\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.717637 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716542 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9af1eca2-b583-43aa-83dc-cf6e62837d2c-tmp-dir\") pod \"node-resolver-8l9dt\" (UID: \"9af1eca2-b583-43aa-83dc-cf6e62837d2c\") " pod="openshift-dns/node-resolver-8l9dt" Jun 12 22:20:02.717637 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716550 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f223bd69-0e45-4401-b183-52acac69823a-os-release\") pod \"multus-additional-cni-plugins-c2mhw\" (UID: \"f223bd69-0e45-4401-b183-52acac69823a\") " pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.717637 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716243 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-etc-sysconfig\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.717637 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716578 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26b5ec6b-bd2c-4920-8737-a43044a3d820-host\") pod \"node-ca-zpg7d\" (UID: \"26b5ec6b-bd2c-4920-8737-a43044a3d820\") " pod="openshift-image-registry/node-ca-zpg7d" Jun 12 22:20:02.717637 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716584 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-sys\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.717637 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716544 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbe71fc0-4361-4e62-bef7-4c056d981509-etc-sysctl-conf\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.717637 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:02.716605 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:02.717637 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716729 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f223bd69-0e45-4401-b183-52acac69823a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c2mhw\" (UID: \"f223bd69-0e45-4401-b183-52acac69823a\") " pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.717637 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:02.716780 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-original-pull-secret podName:ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4 nodeName:}" failed. No retries permitted until 2026-06-12 22:20:03.216762051 +0000 UTC m=+3.087792150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-original-pull-secret") pod "global-pull-secret-syncer-mpzdk" (UID: "ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4") : object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:02.717637 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.716869 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9af1eca2-b583-43aa-83dc-cf6e62837d2c-tmp-dir\") pod \"node-resolver-8l9dt\" (UID: \"9af1eca2-b583-43aa-83dc-cf6e62837d2c\") " pod="openshift-dns/node-resolver-8l9dt" Jun 12 22:20:02.717637 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.717103 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f223bd69-0e45-4401-b183-52acac69823a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c2mhw\" (UID: \"f223bd69-0e45-4401-b183-52acac69823a\") " pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.718202 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.718161 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8001d08-ea1e-4afd-8e3b-1ee42cf96d35-agent-certs\") pod \"konnectivity-agent-vpbbf\" (UID: \"f8001d08-ea1e-4afd-8e3b-1ee42cf96d35\") " pod="kube-system/konnectivity-agent-vpbbf" Jun 12 22:20:02.718534 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.718508 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbe71fc0-4361-4e62-bef7-4c056d981509-tmp\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.718773 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.718752 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbe71fc0-4361-4e62-bef7-4c056d981509-etc-tuned\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.723939 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:02.723913 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 22:20:02.723939 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:02.723939 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 22:20:02.724119 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:02.723955 2558 projected.go:196] Error preparing data for projected volume kube-api-access-2pr65 for pod openshift-network-diagnostics/network-check-target-jfkmv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:02.724119 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:02.724033 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e-kube-api-access-2pr65 podName:b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e nodeName:}" failed. No retries permitted until 2026-06-12 22:20:03.224016254 +0000 UTC m=+3.095046354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2pr65" (UniqueName: "kubernetes.io/projected/b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e-kube-api-access-2pr65") pod "network-check-target-jfkmv" (UID: "b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:02.724747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.724728 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtcb8\" (UniqueName: \"kubernetes.io/projected/f223bd69-0e45-4401-b183-52acac69823a-kube-api-access-gtcb8\") pod \"multus-additional-cni-plugins-c2mhw\" (UID: \"f223bd69-0e45-4401-b183-52acac69823a\") " pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.725505 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.725485 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfbz8\" (UniqueName: \"kubernetes.io/projected/26b5ec6b-bd2c-4920-8737-a43044a3d820-kube-api-access-jfbz8\") pod \"node-ca-zpg7d\" (UID: \"26b5ec6b-bd2c-4920-8737-a43044a3d820\") " pod="openshift-image-registry/node-ca-zpg7d" Jun 12 22:20:02.725933 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.725913 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrwww\" (UniqueName: \"kubernetes.io/projected/fbe71fc0-4361-4e62-bef7-4c056d981509-kube-api-access-zrwww\") pod \"tuned-88ztf\" (UID: \"fbe71fc0-4361-4e62-bef7-4c056d981509\") " pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.726001 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.725936 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8ttc\" (UniqueName: \"kubernetes.io/projected/9af1eca2-b583-43aa-83dc-cf6e62837d2c-kube-api-access-m8ttc\") pod \"node-resolver-8l9dt\" (UID: \"9af1eca2-b583-43aa-83dc-cf6e62837d2c\") " pod="openshift-dns/node-resolver-8l9dt" Jun 12 22:20:02.802953 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.802918 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" Jun 12 22:20:02.811030 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.811006 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rw5r4" Jun 12 22:20:02.819883 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.819859 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pb79d" Jun 12 22:20:02.826581 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.826559 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:02.833198 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.833180 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8l9dt" Jun 12 22:20:02.839748 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.839724 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zpg7d" Jun 12 22:20:02.847374 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.847353 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c2mhw" Jun 12 22:20:02.855077 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.855052 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-88ztf" Jun 12 22:20:02.859888 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:02.859869 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vpbbf" Jun 12 22:20:03.119956 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:03.119927 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs\") pod \"network-metrics-daemon-lqpxm\" (UID: \"5707213e-da61-4306-96d0-03a1790eb281\") " pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:03.120123 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:03.120072 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:03.120183 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:03.120143 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs podName:5707213e-da61-4306-96d0-03a1790eb281 nodeName:}" failed. No retries permitted until 2026-06-12 22:20:04.12012377 +0000 UTC m=+3.991153888 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs") pod "network-metrics-daemon-lqpxm" (UID: "5707213e-da61-4306-96d0-03a1790eb281") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:03.220877 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:03.220841 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-original-pull-secret\") pod \"global-pull-secret-syncer-mpzdk\" (UID: \"ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4\") " pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:03.221066 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:03.221003 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:03.221115 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:03.221076 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-original-pull-secret podName:ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4 nodeName:}" failed. No retries permitted until 2026-06-12 22:20:04.221046729 +0000 UTC m=+4.092076836 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-original-pull-secret") pod "global-pull-secret-syncer-mpzdk" (UID: "ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4") : object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:03.321539 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:03.321501 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pr65\" (UniqueName: \"kubernetes.io/projected/b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e-kube-api-access-2pr65\") pod \"network-check-target-jfkmv\" (UID: \"b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e\") " pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:03.321720 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:03.321674 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 22:20:03.321720 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:03.321698 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 22:20:03.321720 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:03.321708 2558 projected.go:196] Error preparing data for projected volume kube-api-access-2pr65 for pod openshift-network-diagnostics/network-check-target-jfkmv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:03.321910 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:03.321762 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e-kube-api-access-2pr65 podName:b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e nodeName:}" failed. No retries permitted until 2026-06-12 22:20:04.321748867 +0000 UTC m=+4.192778966 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2pr65" (UniqueName: "kubernetes.io/projected/b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e-kube-api-access-2pr65") pod "network-check-target-jfkmv" (UID: "b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:03.432148 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:03.432120 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3195c86_ad47_4899_a7d9_c96d21781a9f.slice/crio-f4f96e27908c88a460f575fd7d0a62b7d34b2164881b0ade0ea613cbae409a01 WatchSource:0}: Error finding container f4f96e27908c88a460f575fd7d0a62b7d34b2164881b0ade0ea613cbae409a01: Status 404 returned error can't find the container with id f4f96e27908c88a460f575fd7d0a62b7d34b2164881b0ade0ea613cbae409a01 Jun 12 22:20:03.451747 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:03.451720 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf223bd69_0e45_4401_b183_52acac69823a.slice/crio-5263325da7bdc1daf5207ba7616d629ee7ac6b230793dbac614b97dcf7ccf118 WatchSource:0}: Error finding container 5263325da7bdc1daf5207ba7616d629ee7ac6b230793dbac614b97dcf7ccf118: Status 404 returned error can't find the container with id 5263325da7bdc1daf5207ba7616d629ee7ac6b230793dbac614b97dcf7ccf118 Jun 12 22:20:03.453069 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:03.452746 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbe71fc0_4361_4e62_bef7_4c056d981509.slice/crio-6e177e93bd167f9a8dcbf9bb9358c4fd09521e62b2007c2a7f16bd5f67f8a4cc WatchSource:0}: Error finding container 6e177e93bd167f9a8dcbf9bb9358c4fd09521e62b2007c2a7f16bd5f67f8a4cc: Status 404 returned error can't find the container with id 6e177e93bd167f9a8dcbf9bb9358c4fd09521e62b2007c2a7f16bd5f67f8a4cc Jun 12 22:20:03.454129 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:03.454106 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32c69df7_0921_42ca_b0dc_e970df30d151.slice/crio-70b617110e7e6e9161c5652f019717587c0a5ceb667149da4a0ef629866a0783 WatchSource:0}: Error finding container 70b617110e7e6e9161c5652f019717587c0a5ceb667149da4a0ef629866a0783: Status 404 returned error can't find the container with id 70b617110e7e6e9161c5652f019717587c0a5ceb667149da4a0ef629866a0783 Jun 12 22:20:03.459267 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:03.459245 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda49dd33d_ee37_4151_afe6_99ee78b8943b.slice/crio-c3734893c63230357101745b119119569ffd80d6c2daa540e2b65f6b7e84cb29 WatchSource:0}: Error finding container c3734893c63230357101745b119119569ffd80d6c2daa540e2b65f6b7e84cb29: Status 404 returned error can't find the container with id c3734893c63230357101745b119119569ffd80d6c2daa540e2b65f6b7e84cb29 Jun 12 22:20:03.460360 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:03.460338 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26b5ec6b_bd2c_4920_8737_a43044a3d820.slice/crio-b0545d01cf630b22d522549a84600a4740d2d5e79a1ea6f167a30845c7a3775b WatchSource:0}: Error finding container b0545d01cf630b22d522549a84600a4740d2d5e79a1ea6f167a30845c7a3775b: Status 404 returned error can't find the container with id b0545d01cf630b22d522549a84600a4740d2d5e79a1ea6f167a30845c7a3775b Jun 12 22:20:03.461077 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:03.461063 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8001d08_ea1e_4afd_8e3b_1ee42cf96d35.slice/crio-12d6ada155124ec68f23bb0381fcc4e36b586cbcc2104652d0769c347f44daa1 WatchSource:0}: Error finding container 12d6ada155124ec68f23bb0381fcc4e36b586cbcc2104652d0769c347f44daa1: Status 404 returned error can't find the container with id 12d6ada155124ec68f23bb0381fcc4e36b586cbcc2104652d0769c347f44daa1 Jun 12 22:20:03.463149 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:03.463125 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9af1eca2_b583_43aa_83dc_cf6e62837d2c.slice/crio-eade35179d3361d1e14f77123c7edb8a9c481c1eb90499889cab13ef4110e034 WatchSource:0}: Error finding container eade35179d3361d1e14f77123c7edb8a9c481c1eb90499889cab13ef4110e034: Status 404 returned error can't find the container with id eade35179d3361d1e14f77123c7edb8a9c481c1eb90499889cab13ef4110e034 Jun 12 22:20:03.549585 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:03.549537 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 22:15:02 +0000 UTC" deadline="2027-12-05 01:50:21.854679286 +0000 UTC" Jun 12 22:20:03.549585 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:03.549580 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12963h30m18.305102243s" Jun 12 22:20:03.579818 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:03.579726 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-250.ec2.internal" event={"ID":"31ca95e84738030244e0b10abf497390","Type":"ContainerStarted","Data":"80ab072d670002347541d913a618f88deb132399031dc8fba568d27c2d255a84"} Jun 12 22:20:03.581732 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:03.581700 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zpg7d" event={"ID":"26b5ec6b-bd2c-4920-8737-a43044a3d820","Type":"ContainerStarted","Data":"b0545d01cf630b22d522549a84600a4740d2d5e79a1ea6f167a30845c7a3775b"} Jun 12 22:20:03.583701 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:03.583676 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" event={"ID":"32c69df7-0921-42ca-b0dc-e970df30d151","Type":"ContainerStarted","Data":"70b617110e7e6e9161c5652f019717587c0a5ceb667149da4a0ef629866a0783"} Jun 12 22:20:03.585445 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:03.585409 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-88ztf" event={"ID":"fbe71fc0-4361-4e62-bef7-4c056d981509","Type":"ContainerStarted","Data":"6e177e93bd167f9a8dcbf9bb9358c4fd09521e62b2007c2a7f16bd5f67f8a4cc"} Jun 12 22:20:03.586968 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:03.586944 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rw5r4" event={"ID":"d3195c86-ad47-4899-a7d9-c96d21781a9f","Type":"ContainerStarted","Data":"f4f96e27908c88a460f575fd7d0a62b7d34b2164881b0ade0ea613cbae409a01"} Jun 12 22:20:03.589481 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:03.589447 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pb79d" event={"ID":"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7","Type":"ContainerStarted","Data":"8d5ae28f6d6cf1b4cfb0bf8692c9a2f6d6b401d7a47fac8aa047f58d6a2182ea"} Jun 12 22:20:03.591811 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:03.591789 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8l9dt" event={"ID":"9af1eca2-b583-43aa-83dc-cf6e62837d2c","Type":"ContainerStarted","Data":"eade35179d3361d1e14f77123c7edb8a9c481c1eb90499889cab13ef4110e034"} Jun 12 22:20:03.592693 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:03.592675 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vpbbf" event={"ID":"f8001d08-ea1e-4afd-8e3b-1ee42cf96d35","Type":"ContainerStarted","Data":"12d6ada155124ec68f23bb0381fcc4e36b586cbcc2104652d0769c347f44daa1"} Jun 12 22:20:03.594692 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:03.594651 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-250.ec2.internal" podStartSLOduration=2.5946395239999998 podStartE2EDuration="2.594639524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:20:03.594068713 +0000 UTC m=+3.465098833" watchObservedRunningTime="2026-06-12 22:20:03.594639524 +0000 UTC m=+3.465669698" Jun 12 22:20:03.595491 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:03.595465 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2498q" event={"ID":"a49dd33d-ee37-4151-afe6-99ee78b8943b","Type":"ContainerStarted","Data":"c3734893c63230357101745b119119569ffd80d6c2daa540e2b65f6b7e84cb29"} Jun 12 22:20:03.597270 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:03.597250 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c2mhw" event={"ID":"f223bd69-0e45-4401-b183-52acac69823a","Type":"ContainerStarted","Data":"5263325da7bdc1daf5207ba7616d629ee7ac6b230793dbac614b97dcf7ccf118"} Jun 12 22:20:04.128772 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:04.128099 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs\") pod \"network-metrics-daemon-lqpxm\" (UID: \"5707213e-da61-4306-96d0-03a1790eb281\") " pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:04.128772 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:04.128300 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:04.128772 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:04.128365 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs podName:5707213e-da61-4306-96d0-03a1790eb281 nodeName:}" failed. No retries permitted until 2026-06-12 22:20:06.128346662 +0000 UTC m=+5.999376784 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs") pod "network-metrics-daemon-lqpxm" (UID: "5707213e-da61-4306-96d0-03a1790eb281") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:04.229003 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:04.228955 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-original-pull-secret\") pod \"global-pull-secret-syncer-mpzdk\" (UID: \"ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4\") " pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:04.229197 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:04.229124 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:04.229197 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:04.229188 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-original-pull-secret podName:ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4 nodeName:}" failed. No retries permitted until 2026-06-12 22:20:06.229168657 +0000 UTC m=+6.100198761 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-original-pull-secret") pod "global-pull-secret-syncer-mpzdk" (UID: "ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4") : object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:04.330102 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:04.330045 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pr65\" (UniqueName: \"kubernetes.io/projected/b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e-kube-api-access-2pr65\") pod \"network-check-target-jfkmv\" (UID: \"b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e\") " pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:04.330279 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:04.330258 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 22:20:04.330279 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:04.330279 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 22:20:04.330377 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:04.330293 2558 projected.go:196] Error preparing data for projected volume kube-api-access-2pr65 for pod openshift-network-diagnostics/network-check-target-jfkmv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:04.330377 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:04.330351 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e-kube-api-access-2pr65 podName:b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e nodeName:}" failed. No retries permitted until 2026-06-12 22:20:06.330332734 +0000 UTC m=+6.201362836 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2pr65" (UniqueName: "kubernetes.io/projected/b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e-kube-api-access-2pr65") pod "network-check-target-jfkmv" (UID: "b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:04.549978 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:04.549932 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 22:15:02 +0000 UTC" deadline="2027-11-23 07:52:49.559543324 +0000 UTC" Jun 12 22:20:04.549978 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:04.549977 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12681h32m45.009571004s" Jun 12 22:20:04.570206 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:04.569590 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:04.570206 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:04.569607 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:04.570206 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:04.569716 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfkmv" podUID="b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e" Jun 12 22:20:04.570206 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:04.570126 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mpzdk" podUID="ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4" Jun 12 22:20:04.570841 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:04.570680 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:04.570841 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:04.570803 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqpxm" podUID="5707213e-da61-4306-96d0-03a1790eb281" Jun 12 22:20:04.621199 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:04.620048 2558 generic.go:356] "Generic (PLEG): container finished" podID="fea8f5fe2d93cc4fb20f636599e647b1" containerID="724b8bdbf2f29eb2b207e2cfcad86c19dfee2d4efcec7d0088e1a7bf0e5ae890" exitCode=0 Jun 12 22:20:04.621199 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:04.620970 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-250.ec2.internal" event={"ID":"fea8f5fe2d93cc4fb20f636599e647b1","Type":"ContainerDied","Data":"724b8bdbf2f29eb2b207e2cfcad86c19dfee2d4efcec7d0088e1a7bf0e5ae890"} Jun 12 22:20:05.642778 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:05.642738 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-250.ec2.internal" event={"ID":"fea8f5fe2d93cc4fb20f636599e647b1","Type":"ContainerStarted","Data":"d8e2d708de992aa48889d7e10dd983700b4de2e0aceea714fe26e39e26cc7d8f"} Jun 12 22:20:06.145796 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:06.145170 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs\") pod \"network-metrics-daemon-lqpxm\" (UID: \"5707213e-da61-4306-96d0-03a1790eb281\") " pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:06.145796 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:06.145367 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:06.145796 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:06.145443 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs podName:5707213e-da61-4306-96d0-03a1790eb281 nodeName:}" failed. No retries permitted until 2026-06-12 22:20:10.145412374 +0000 UTC m=+10.016442494 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs") pod "network-metrics-daemon-lqpxm" (UID: "5707213e-da61-4306-96d0-03a1790eb281") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:06.246040 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:06.246004 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-original-pull-secret\") pod \"global-pull-secret-syncer-mpzdk\" (UID: \"ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4\") " pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:06.246219 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:06.246156 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:06.246219 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:06.246216 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-original-pull-secret podName:ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4 nodeName:}" failed. No retries permitted until 2026-06-12 22:20:10.246199871 +0000 UTC m=+10.117229975 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-original-pull-secret") pod "global-pull-secret-syncer-mpzdk" (UID: "ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4") : object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:06.346675 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:06.346638 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pr65\" (UniqueName: \"kubernetes.io/projected/b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e-kube-api-access-2pr65\") pod \"network-check-target-jfkmv\" (UID: \"b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e\") " pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:06.346839 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:06.346803 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 22:20:06.346839 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:06.346825 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 22:20:06.346839 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:06.346839 2558 projected.go:196] Error preparing data for projected volume kube-api-access-2pr65 for pod openshift-network-diagnostics/network-check-target-jfkmv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:06.346994 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:06.346906 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e-kube-api-access-2pr65 podName:b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e nodeName:}" failed. No retries permitted until 2026-06-12 22:20:10.346886543 +0000 UTC m=+10.217916652 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2pr65" (UniqueName: "kubernetes.io/projected/b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e-kube-api-access-2pr65") pod "network-check-target-jfkmv" (UID: "b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:06.569088 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:06.568566 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:06.569088 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:06.568598 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:06.569088 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:06.568566 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:06.569088 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:06.568714 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqpxm" podUID="5707213e-da61-4306-96d0-03a1790eb281" Jun 12 22:20:06.569088 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:06.568824 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfkmv" podUID="b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e" Jun 12 22:20:06.569088 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:06.568905 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mpzdk" podUID="ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4" Jun 12 22:20:08.569510 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:08.568990 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:08.569510 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:08.568996 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:08.569510 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:08.569144 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqpxm" podUID="5707213e-da61-4306-96d0-03a1790eb281" Jun 12 22:20:08.569510 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:08.569208 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mpzdk" podUID="ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4" Jun 12 22:20:08.569510 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:08.569274 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:08.569510 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:08.569344 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfkmv" podUID="b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e" Jun 12 22:20:10.182285 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:10.182182 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs\") pod \"network-metrics-daemon-lqpxm\" (UID: \"5707213e-da61-4306-96d0-03a1790eb281\") " pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:10.182784 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:10.182379 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:10.182784 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:10.182465 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs podName:5707213e-da61-4306-96d0-03a1790eb281 nodeName:}" failed. No retries permitted until 2026-06-12 22:20:18.18244165 +0000 UTC m=+18.053471764 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs") pod "network-metrics-daemon-lqpxm" (UID: "5707213e-da61-4306-96d0-03a1790eb281") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:10.282864 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:10.282818 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-original-pull-secret\") pod \"global-pull-secret-syncer-mpzdk\" (UID: \"ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4\") " pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:10.283052 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:10.282980 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:10.283052 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:10.283044 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-original-pull-secret podName:ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4 nodeName:}" failed. No retries permitted until 2026-06-12 22:20:18.283024904 +0000 UTC m=+18.154055007 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-original-pull-secret") pod "global-pull-secret-syncer-mpzdk" (UID: "ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4") : object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:10.383848 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:10.383796 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pr65\" (UniqueName: \"kubernetes.io/projected/b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e-kube-api-access-2pr65\") pod \"network-check-target-jfkmv\" (UID: \"b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e\") " pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:10.384045 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:10.384007 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 22:20:10.384045 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:10.384033 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 22:20:10.384045 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:10.384046 2558 projected.go:196] Error preparing data for projected volume kube-api-access-2pr65 for pod openshift-network-diagnostics/network-check-target-jfkmv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:10.384223 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:10.384102 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e-kube-api-access-2pr65 podName:b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e nodeName:}" failed. No retries permitted until 2026-06-12 22:20:18.384085217 +0000 UTC m=+18.255115316 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2pr65" (UniqueName: "kubernetes.io/projected/b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e-kube-api-access-2pr65") pod "network-check-target-jfkmv" (UID: "b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:10.569686 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:10.569247 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:10.569686 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:10.569364 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqpxm" podUID="5707213e-da61-4306-96d0-03a1790eb281" Jun 12 22:20:10.569686 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:10.569459 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:10.569686 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:10.569578 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mpzdk" podUID="ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4" Jun 12 22:20:10.569686 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:10.569625 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:10.570050 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:10.569692 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfkmv" podUID="b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e" Jun 12 22:20:12.569704 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:12.568679 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:12.569704 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:12.568679 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:12.569704 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:12.568845 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:12.569704 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:12.568862 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqpxm" podUID="5707213e-da61-4306-96d0-03a1790eb281" Jun 12 22:20:12.569704 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:12.568963 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfkmv" podUID="b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e" Jun 12 22:20:12.569704 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:12.569051 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mpzdk" podUID="ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4" Jun 12 22:20:14.568639 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:14.568601 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:14.568639 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:14.568625 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:14.568639 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:14.568645 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:14.569161 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:14.568745 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mpzdk" podUID="ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4" Jun 12 22:20:14.569161 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:14.568837 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfkmv" podUID="b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e" Jun 12 22:20:14.569161 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:14.568943 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqpxm" podUID="5707213e-da61-4306-96d0-03a1790eb281" Jun 12 22:20:16.569042 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:16.569002 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:16.569042 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:16.569038 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:16.569592 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:16.569002 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:16.569592 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:16.569133 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mpzdk" podUID="ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4" Jun 12 22:20:16.569592 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:16.569210 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqpxm" podUID="5707213e-da61-4306-96d0-03a1790eb281" Jun 12 22:20:16.569592 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:16.569282 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfkmv" podUID="b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e" Jun 12 22:20:18.237397 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:18.237366 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs\") pod \"network-metrics-daemon-lqpxm\" (UID: \"5707213e-da61-4306-96d0-03a1790eb281\") " pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:18.237797 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:18.237535 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:18.237797 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:18.237595 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs podName:5707213e-da61-4306-96d0-03a1790eb281 nodeName:}" failed. No retries permitted until 2026-06-12 22:20:34.237578563 +0000 UTC m=+34.108608662 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs") pod "network-metrics-daemon-lqpxm" (UID: "5707213e-da61-4306-96d0-03a1790eb281") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:18.338703 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:18.338670 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-original-pull-secret\") pod \"global-pull-secret-syncer-mpzdk\" (UID: \"ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4\") " pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:18.338854 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:18.338810 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:18.338913 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:18.338880 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-original-pull-secret podName:ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4 nodeName:}" failed. No retries permitted until 2026-06-12 22:20:34.338861974 +0000 UTC m=+34.209892094 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-original-pull-secret") pod "global-pull-secret-syncer-mpzdk" (UID: "ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4") : object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:18.439984 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:18.439905 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pr65\" (UniqueName: \"kubernetes.io/projected/b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e-kube-api-access-2pr65\") pod \"network-check-target-jfkmv\" (UID: \"b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e\") " pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:18.440136 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:18.440040 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 22:20:18.440136 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:18.440053 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 22:20:18.440136 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:18.440063 2558 projected.go:196] Error preparing data for projected volume kube-api-access-2pr65 for pod openshift-network-diagnostics/network-check-target-jfkmv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:18.440136 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:18.440115 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e-kube-api-access-2pr65 podName:b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e nodeName:}" failed. No retries permitted until 2026-06-12 22:20:34.440098506 +0000 UTC m=+34.311128604 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2pr65" (UniqueName: "kubernetes.io/projected/b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e-kube-api-access-2pr65") pod "network-check-target-jfkmv" (UID: "b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:18.568324 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:18.568288 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:18.568324 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:18.568310 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:18.568324 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:18.568288 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:18.568611 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:18.568420 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfkmv" podUID="b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e" Jun 12 22:20:18.568611 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:18.568484 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mpzdk" podUID="ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4" Jun 12 22:20:18.568611 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:18.568566 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqpxm" podUID="5707213e-da61-4306-96d0-03a1790eb281" Jun 12 22:20:20.569793 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:20.569764 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:20.570202 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:20.569844 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:20.570202 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:20.569861 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mpzdk" podUID="ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4" Jun 12 22:20:20.570202 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:20.569945 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfkmv" podUID="b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e" Jun 12 22:20:20.570202 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:20.570002 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:20.570202 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:20.570094 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqpxm" podUID="5707213e-da61-4306-96d0-03a1790eb281" Jun 12 22:20:22.568785 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:22.568553 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:22.569422 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:22.568561 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:22.569422 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:22.568875 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqpxm" podUID="5707213e-da61-4306-96d0-03a1790eb281" Jun 12 22:20:22.569422 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:22.568739 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:22.569422 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:22.568938 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mpzdk" podUID="ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4" Jun 12 22:20:22.569422 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:22.569013 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfkmv" podUID="b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e" Jun 12 22:20:22.675948 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:22.675661 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pb79d" event={"ID":"a63c2dd0-dc3b-4b13-a47b-6d7c045058e7","Type":"ContainerStarted","Data":"bd123b3fe8b33971de07ca846b3ac287fc8a07ef02da1e2f7e188f119de3bf93"} Jun 12 22:20:22.677183 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:22.677155 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8l9dt" event={"ID":"9af1eca2-b583-43aa-83dc-cf6e62837d2c","Type":"ContainerStarted","Data":"fc8eeda108fa35a0dc516b01510635f892d474c7d3b0d8009078ad4b5f281d85"} Jun 12 22:20:22.678680 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:22.678655 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vpbbf" event={"ID":"f8001d08-ea1e-4afd-8e3b-1ee42cf96d35","Type":"ContainerStarted","Data":"069c1105eafa63349d43dc896b5a0e6d2f42307f7661bf391965aff8d436a112"} Jun 12 22:20:22.681834 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:22.681814 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2498q" event={"ID":"a49dd33d-ee37-4151-afe6-99ee78b8943b","Type":"ContainerStarted","Data":"70639cb1f4538d5cecee5602d29a9d6c0dd25bf0fa415b9f1937de729b48083b"} Jun 12 22:20:22.682036 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:22.682005 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2498q" event={"ID":"a49dd33d-ee37-4151-afe6-99ee78b8943b","Type":"ContainerStarted","Data":"a2b7b8080a964ff2812acc6690892ff9955639123c39c27db7bcc4dc87f296ff"} Jun 12 22:20:22.682136 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:22.682067 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2498q" event={"ID":"a49dd33d-ee37-4151-afe6-99ee78b8943b","Type":"ContainerStarted","Data":"5585213ba4dd2cf504ce77f3d8bc424708edb9d1ced088ed37dc164a93d2af4b"} Jun 12 22:20:22.682136 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:22.682120 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2498q" event={"ID":"a49dd33d-ee37-4151-afe6-99ee78b8943b","Type":"ContainerStarted","Data":"22ab2684524a457d1db204fc25086cf7ae681ae314f3e774de0a8c789b0f9708"} Jun 12 22:20:22.682249 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:22.682168 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2498q" event={"ID":"a49dd33d-ee37-4151-afe6-99ee78b8943b","Type":"ContainerStarted","Data":"f744a6cc32069c4827f8cc18ce92d3d8ec30333ef0488517c78da11892bda97d"} Jun 12 22:20:22.683554 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:22.683519 2558 generic.go:356] "Generic (PLEG): container finished" podID="f223bd69-0e45-4401-b183-52acac69823a" containerID="1bf69e9fa75f742aa195b9e6797932d3a3b72f8b2aac00a1ce33b84072ac4162" exitCode=0 Jun 12 22:20:22.683653 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:22.683602 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c2mhw" event={"ID":"f223bd69-0e45-4401-b183-52acac69823a","Type":"ContainerDied","Data":"1bf69e9fa75f742aa195b9e6797932d3a3b72f8b2aac00a1ce33b84072ac4162"} Jun 12 22:20:22.685307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:22.685287 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zpg7d" event={"ID":"26b5ec6b-bd2c-4920-8737-a43044a3d820","Type":"ContainerStarted","Data":"e88fb67d1a3f2a2ef4b8a9213d01f0d3ef9bec8eb37ca4c41f30f412d11c670d"} Jun 12 22:20:22.686780 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:22.686749 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" event={"ID":"32c69df7-0921-42ca-b0dc-e970df30d151","Type":"ContainerStarted","Data":"afbd4646dc38307c58b4b53db74a6b2d5c97a90b365a43a2ede53b2f6603b85e"} Jun 12 22:20:22.688280 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:22.688261 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-88ztf" event={"ID":"fbe71fc0-4361-4e62-bef7-4c056d981509","Type":"ContainerStarted","Data":"bd66490ae9eff48e7282f7ebb3486d2ae856e5c90b22bfcb6949806ba9abb2b1"} Jun 12 22:20:22.701204 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:22.701159 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-250.ec2.internal" podStartSLOduration=21.701147206 podStartE2EDuration="21.701147206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:20:05.66613275 +0000 UTC m=+5.537162866" watchObservedRunningTime="2026-06-12 22:20:22.701147206 +0000 UTC m=+22.572177326" Jun 12 22:20:22.701378 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:22.701349 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pb79d" podStartSLOduration=3.9521580910000003 podStartE2EDuration="22.701341558s" totalImagesPullingTime="18.749183467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:20:22.700932457 +0000 UTC m=+22.571962577" watchObservedRunningTime="2026-06-12 22:20:22.701341558 +0000 UTC m=+22.572371680" Jun 12 22:20:22.741999 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:22.741915 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-88ztf" podStartSLOduration=4.176264099 podStartE2EDuration="22.741890332s" totalImagesPullingTime="18.565626233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:20:22.740848281 +0000 UTC m=+22.611878403" watchObservedRunningTime="2026-06-12 22:20:22.741890332 +0000 UTC m=+22.612920455" Jun 12 22:20:22.756702 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:22.756659 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vpbbf" podStartSLOduration=7.927039482 podStartE2EDuration="22.75664618s" totalImagesPullingTime="14.829606698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:20:22.755737143 +0000 UTC m=+22.626767257" watchObservedRunningTime="2026-06-12 22:20:22.75664618 +0000 UTC m=+22.627676300" Jun 12 22:20:22.772732 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:22.772684 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8l9dt" podStartSLOduration=4.23756302 podStartE2EDuration="22.772667s" totalImagesPullingTime="18.53510398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:20:22.772572312 +0000 UTC m=+22.643602439" watchObservedRunningTime="2026-06-12 22:20:22.772667 +0000 UTC m=+22.643697122" Jun 12 22:20:22.793147 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:22.793102 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zpg7d" podStartSLOduration=4.256743525 podStartE2EDuration="22.793089092s" totalImagesPullingTime="18.536345567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:20:22.792278485 +0000 UTC m=+22.663308611" watchObservedRunningTime="2026-06-12 22:20:22.793089092 +0000 UTC m=+22.664119211" Jun 12 22:20:23.469242 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:23.469065 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 12 22:20:23.569483 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:23.569372 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-12T22:20:23.469232648Z","UUID":"32b7c0e1-4a1f-4d37-81fe-4d457d520f78","Handler":null,"Name":"","Endpoint":""} Jun 12 22:20:23.571014 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:23.570995 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 12 22:20:23.571141 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:23.571035 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 12 22:20:23.694415 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:23.694330 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2498q" event={"ID":"a49dd33d-ee37-4151-afe6-99ee78b8943b","Type":"ContainerStarted","Data":"77e1d6a9da1c5defd898b73a173d57f51be141717309c6251a332227388bb7bc"} Jun 12 22:20:23.696367 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:23.696339 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" event={"ID":"32c69df7-0921-42ca-b0dc-e970df30d151","Type":"ContainerStarted","Data":"455a1cbf08713001848b5104af403cbcba51faa94d3dbb72c9048da60636eaf0"} Jun 12 22:20:23.697984 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:23.697955 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rw5r4" event={"ID":"d3195c86-ad47-4899-a7d9-c96d21781a9f","Type":"ContainerStarted","Data":"15bd2cadda8e98943d84f1d3d2edeb2a92afc678803133efbc81a6571c29a4e6"} Jun 12 22:20:23.713260 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:23.713212 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rw5r4" podStartSLOduration=5.1383159 podStartE2EDuration="23.713200536s" totalImagesPullingTime="18.574884636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:20:23.713005853 +0000 UTC m=+23.584035977" watchObservedRunningTime="2026-06-12 22:20:23.713200536 +0000 UTC m=+23.584230658" Jun 12 22:20:24.342133 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:24.342095 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vpbbf" Jun 12 22:20:24.342818 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:24.342790 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vpbbf" Jun 12 22:20:24.568941 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:24.568907 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:24.568941 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:24.568920 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:24.569192 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:24.569039 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqpxm" podUID="5707213e-da61-4306-96d0-03a1790eb281" Jun 12 22:20:24.569192 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:24.569069 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:24.569192 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:24.569177 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfkmv" podUID="b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e" Jun 12 22:20:24.569339 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:24.569256 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mpzdk" podUID="ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4" Jun 12 22:20:24.704956 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:24.704857 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" event={"ID":"32c69df7-0921-42ca-b0dc-e970df30d151","Type":"ContainerStarted","Data":"9556f32b51e25fd713c34980a6979ff28cfb035f5e3cb8694dad39b428cf558e"} Jun 12 22:20:25.710188 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:25.710152 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2498q" event={"ID":"a49dd33d-ee37-4151-afe6-99ee78b8943b","Type":"ContainerStarted","Data":"76d23b535791db354b6ef2cccc433cea05f0252652f23f827e284d700ddb6f89"} Jun 12 22:20:25.710702 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:25.710203 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 12 22:20:26.568774 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:26.568744 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:26.568962 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:26.568805 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:26.568962 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:26.568810 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:26.568962 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:26.568910 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqpxm" podUID="5707213e-da61-4306-96d0-03a1790eb281" Jun 12 22:20:26.569155 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:26.568984 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mpzdk" podUID="ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4" Jun 12 22:20:26.569155 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:26.569071 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfkmv" podUID="b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e" Jun 12 22:20:27.718462 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:27.718191 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2498q" event={"ID":"a49dd33d-ee37-4151-afe6-99ee78b8943b","Type":"ContainerStarted","Data":"e55eb4e3e0a0d1d5faf19657fac4ffa5853e1fd6377250a8bd93cc2ec29067c9"} Jun 12 22:20:27.719102 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:27.718506 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:27.719102 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:27.718563 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:27.719102 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:27.718609 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:27.720317 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:27.720290 2558 generic.go:356] "Generic (PLEG): container finished" podID="f223bd69-0e45-4401-b183-52acac69823a" containerID="b379bd0440ff0af65c7a213a52c4c4fe154c242510836b3c015ea63e17b3c20b" exitCode=0 Jun 12 22:20:27.720410 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:27.720327 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c2mhw" event={"ID":"f223bd69-0e45-4401-b183-52acac69823a","Type":"ContainerDied","Data":"b379bd0440ff0af65c7a213a52c4c4fe154c242510836b3c015ea63e17b3c20b"} Jun 12 22:20:27.734766 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:27.734739 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:27.736269 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:27.736250 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:20:27.744869 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:27.744834 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2498q" podStartSLOduration=9.161517759 podStartE2EDuration="27.744821523s" totalImagesPullingTime="18.583303764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:20:27.743687454 +0000 UTC m=+27.614717598" watchObservedRunningTime="2026-06-12 22:20:27.744821523 +0000 UTC m=+27.615851634" Jun 12 22:20:27.745111 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:27.745087 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6l4zk" podStartSLOduration=7.202959388 podStartE2EDuration="27.745077544s" totalImagesPullingTime="20.542118156s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:20:24.722092974 +0000 UTC m=+24.593123098" watchObservedRunningTime="2026-06-12 22:20:27.745077544 +0000 UTC m=+27.616107666" Jun 12 22:20:28.568797 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:28.568767 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:28.568985 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:28.568767 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:28.568985 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:28.568887 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqpxm" podUID="5707213e-da61-4306-96d0-03a1790eb281" Jun 12 22:20:28.568985 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:28.568767 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:28.568985 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:28.568949 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mpzdk" podUID="ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4" Jun 12 22:20:28.569184 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:28.569012 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfkmv" podUID="b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e" Jun 12 22:20:29.422011 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:29.421783 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mpzdk"] Jun 12 22:20:29.422479 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:29.422060 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:29.422479 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:29.422150 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mpzdk" podUID="ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4" Jun 12 22:20:29.425532 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:29.425506 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lqpxm"] Jun 12 22:20:29.425662 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:29.425605 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:29.425748 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:29.425725 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqpxm" podUID="5707213e-da61-4306-96d0-03a1790eb281" Jun 12 22:20:29.426289 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:29.426260 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jfkmv"] Jun 12 22:20:29.426387 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:29.426343 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:29.426459 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:29.426416 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfkmv" podUID="b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e" Jun 12 22:20:29.727233 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:29.727158 2558 generic.go:356] "Generic (PLEG): container finished" podID="f223bd69-0e45-4401-b183-52acac69823a" containerID="50f73d73ee8b61430159a3185fb07460102cbe5469ef221519a153a59c0dfe83" exitCode=0 Jun 12 22:20:29.727505 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:29.727245 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c2mhw" event={"ID":"f223bd69-0e45-4401-b183-52acac69823a","Type":"ContainerDied","Data":"50f73d73ee8b61430159a3185fb07460102cbe5469ef221519a153a59c0dfe83"} Jun 12 22:20:31.568326 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:31.568298 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:31.569001 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:31.568298 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:31.569001 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:31.568391 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfkmv" podUID="b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e" Jun 12 22:20:31.569001 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:31.568493 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqpxm" podUID="5707213e-da61-4306-96d0-03a1790eb281" Jun 12 22:20:31.569001 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:31.568299 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:31.569001 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:31.568590 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mpzdk" podUID="ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4" Jun 12 22:20:31.734682 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:31.734610 2558 generic.go:356] "Generic (PLEG): container finished" podID="f223bd69-0e45-4401-b183-52acac69823a" containerID="48d0dd563fdc1a6e29a61fb78b1b3ea9771b24e69a5c6d69580b3d9ce47d3741" exitCode=0 Jun 12 22:20:31.734682 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:31.734664 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c2mhw" event={"ID":"f223bd69-0e45-4401-b183-52acac69823a","Type":"ContainerDied","Data":"48d0dd563fdc1a6e29a61fb78b1b3ea9771b24e69a5c6d69580b3d9ce47d3741"} Jun 12 22:20:31.895942 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:31.895912 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vpbbf" Jun 12 22:20:31.896124 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:31.896050 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 12 22:20:31.896466 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:31.896452 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vpbbf" Jun 12 22:20:33.568639 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:33.568607 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:33.569129 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:33.568612 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:33.569129 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:33.568702 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mpzdk" podUID="ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4" Jun 12 22:20:33.569129 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:33.568721 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:33.569129 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:33.568793 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqpxm" podUID="5707213e-da61-4306-96d0-03a1790eb281" Jun 12 22:20:33.569129 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:33.568855 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfkmv" podUID="b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e" Jun 12 22:20:34.255318 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:34.255283 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs\") pod \"network-metrics-daemon-lqpxm\" (UID: \"5707213e-da61-4306-96d0-03a1790eb281\") " pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:34.255539 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:34.255463 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:34.255539 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:34.255538 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs podName:5707213e-da61-4306-96d0-03a1790eb281 nodeName:}" failed. No retries permitted until 2026-06-12 22:21:06.255516995 +0000 UTC m=+66.126547095 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs") pod "network-metrics-daemon-lqpxm" (UID: "5707213e-da61-4306-96d0-03a1790eb281") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:34.356327 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:34.356292 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-original-pull-secret\") pod \"global-pull-secret-syncer-mpzdk\" (UID: \"ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4\") " pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:34.356539 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:34.356450 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:34.356539 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:34.356506 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-original-pull-secret podName:ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4 nodeName:}" failed. No retries permitted until 2026-06-12 22:21:06.356492921 +0000 UTC m=+66.227523019 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-original-pull-secret") pod "global-pull-secret-syncer-mpzdk" (UID: "ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4") : object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:34.457006 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:34.456963 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pr65\" (UniqueName: \"kubernetes.io/projected/b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e-kube-api-access-2pr65\") pod \"network-check-target-jfkmv\" (UID: \"b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e\") " pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:34.457179 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:34.457126 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 22:20:34.457179 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:34.457143 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 22:20:34.457179 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:34.457153 2558 projected.go:196] Error preparing data for projected volume kube-api-access-2pr65 for pod openshift-network-diagnostics/network-check-target-jfkmv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:34.457280 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:34.457200 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e-kube-api-access-2pr65 podName:b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e nodeName:}" failed. No retries permitted until 2026-06-12 22:21:06.457187475 +0000 UTC m=+66.328217579 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2pr65" (UniqueName: "kubernetes.io/projected/b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e-kube-api-access-2pr65") pod "network-check-target-jfkmv" (UID: "b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:34.924135 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:34.924060 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-250.ec2.internal" event="NodeReady" Jun 12 22:20:34.924580 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:34.924214 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 12 22:20:34.969381 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:34.969338 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bgplx"] Jun 12 22:20:34.972227 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:34.972120 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bgplx" Jun 12 22:20:34.972567 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:34.972543 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8s5t8"] Jun 12 22:20:34.974860 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:34.974624 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cwxnw\"" Jun 12 22:20:34.974972 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:34.974899 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 12 22:20:34.975097 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:34.975075 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8s5t8" Jun 12 22:20:34.975179 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:34.975163 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 12 22:20:34.978252 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:34.978227 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 12 22:20:34.978484 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:34.978410 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 12 22:20:34.978592 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:34.978499 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k7z4s\"" Jun 12 22:20:34.978592 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:34.978555 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 12 22:20:34.985999 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:34.985976 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bgplx"] Jun 12 22:20:34.986900 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:34.986799 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8s5t8"] Jun 12 22:20:35.061415 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.061383 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfx7s\" (UniqueName: \"kubernetes.io/projected/97c3a625-9d8c-402e-9a2b-58626ea31c58-kube-api-access-wfx7s\") pod \"dns-default-bgplx\" (UID: \"97c3a625-9d8c-402e-9a2b-58626ea31c58\") " pod="openshift-dns/dns-default-bgplx" Jun 12 22:20:35.061415 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.061424 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97c3a625-9d8c-402e-9a2b-58626ea31c58-tmp-dir\") pod \"dns-default-bgplx\" (UID: \"97c3a625-9d8c-402e-9a2b-58626ea31c58\") " pod="openshift-dns/dns-default-bgplx" Jun 12 22:20:35.061657 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.061531 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls\") pod \"dns-default-bgplx\" (UID: \"97c3a625-9d8c-402e-9a2b-58626ea31c58\") " pod="openshift-dns/dns-default-bgplx" Jun 12 22:20:35.061657 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.061620 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plt76\" (UniqueName: \"kubernetes.io/projected/d54c5b13-ba6f-4fd5-8c27-d15c4900af5f-kube-api-access-plt76\") pod \"ingress-canary-8s5t8\" (UID: \"d54c5b13-ba6f-4fd5-8c27-d15c4900af5f\") " pod="openshift-ingress-canary/ingress-canary-8s5t8" Jun 12 22:20:35.061732 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.061665 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/97c3a625-9d8c-402e-9a2b-58626ea31c58-config-volume\") pod \"dns-default-bgplx\" (UID: \"97c3a625-9d8c-402e-9a2b-58626ea31c58\") " pod="openshift-dns/dns-default-bgplx" Jun 12 22:20:35.061732 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.061688 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d54c5b13-ba6f-4fd5-8c27-d15c4900af5f-cert\") pod \"ingress-canary-8s5t8\" (UID: \"d54c5b13-ba6f-4fd5-8c27-d15c4900af5f\") " pod="openshift-ingress-canary/ingress-canary-8s5t8" Jun 12 22:20:35.162697 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.162659 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plt76\" (UniqueName: \"kubernetes.io/projected/d54c5b13-ba6f-4fd5-8c27-d15c4900af5f-kube-api-access-plt76\") pod \"ingress-canary-8s5t8\" (UID: \"d54c5b13-ba6f-4fd5-8c27-d15c4900af5f\") " pod="openshift-ingress-canary/ingress-canary-8s5t8" Jun 12 22:20:35.162871 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.162706 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/97c3a625-9d8c-402e-9a2b-58626ea31c58-config-volume\") pod \"dns-default-bgplx\" (UID: \"97c3a625-9d8c-402e-9a2b-58626ea31c58\") " pod="openshift-dns/dns-default-bgplx" Jun 12 22:20:35.162871 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.162732 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d54c5b13-ba6f-4fd5-8c27-d15c4900af5f-cert\") pod \"ingress-canary-8s5t8\" (UID: \"d54c5b13-ba6f-4fd5-8c27-d15c4900af5f\") " pod="openshift-ingress-canary/ingress-canary-8s5t8" Jun 12 22:20:35.162871 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.162759 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfx7s\" (UniqueName: \"kubernetes.io/projected/97c3a625-9d8c-402e-9a2b-58626ea31c58-kube-api-access-wfx7s\") pod \"dns-default-bgplx\" (UID: \"97c3a625-9d8c-402e-9a2b-58626ea31c58\") " pod="openshift-dns/dns-default-bgplx" Jun 12 22:20:35.162871 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.162790 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97c3a625-9d8c-402e-9a2b-58626ea31c58-tmp-dir\") pod \"dns-default-bgplx\" (UID: \"97c3a625-9d8c-402e-9a2b-58626ea31c58\") " pod="openshift-dns/dns-default-bgplx" Jun 12 22:20:35.163091 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.163058 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls\") pod \"dns-default-bgplx\" (UID: \"97c3a625-9d8c-402e-9a2b-58626ea31c58\") " pod="openshift-dns/dns-default-bgplx" Jun 12 22:20:35.163204 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.163126 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97c3a625-9d8c-402e-9a2b-58626ea31c58-tmp-dir\") pod \"dns-default-bgplx\" (UID: \"97c3a625-9d8c-402e-9a2b-58626ea31c58\") " pod="openshift-dns/dns-default-bgplx" Jun 12 22:20:35.163204 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:35.163172 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 22:20:35.163304 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:35.163231 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls podName:97c3a625-9d8c-402e-9a2b-58626ea31c58 nodeName:}" failed. No retries permitted until 2026-06-12 22:20:35.663212591 +0000 UTC m=+35.534242706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls") pod "dns-default-bgplx" (UID: "97c3a625-9d8c-402e-9a2b-58626ea31c58") : secret "dns-default-metrics-tls" not found Jun 12 22:20:35.163395 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.163369 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/97c3a625-9d8c-402e-9a2b-58626ea31c58-config-volume\") pod \"dns-default-bgplx\" (UID: \"97c3a625-9d8c-402e-9a2b-58626ea31c58\") " pod="openshift-dns/dns-default-bgplx" Jun 12 22:20:35.167392 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.167247 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d54c5b13-ba6f-4fd5-8c27-d15c4900af5f-cert\") pod \"ingress-canary-8s5t8\" (UID: \"d54c5b13-ba6f-4fd5-8c27-d15c4900af5f\") " pod="openshift-ingress-canary/ingress-canary-8s5t8" Jun 12 22:20:35.171758 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.171695 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfx7s\" (UniqueName: \"kubernetes.io/projected/97c3a625-9d8c-402e-9a2b-58626ea31c58-kube-api-access-wfx7s\") pod \"dns-default-bgplx\" (UID: \"97c3a625-9d8c-402e-9a2b-58626ea31c58\") " pod="openshift-dns/dns-default-bgplx" Jun 12 22:20:35.171857 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.171754 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plt76\" (UniqueName: \"kubernetes.io/projected/d54c5b13-ba6f-4fd5-8c27-d15c4900af5f-kube-api-access-plt76\") pod \"ingress-canary-8s5t8\" (UID: \"d54c5b13-ba6f-4fd5-8c27-d15c4900af5f\") " pod="openshift-ingress-canary/ingress-canary-8s5t8" Jun 12 22:20:35.292752 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.292718 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8s5t8" Jun 12 22:20:35.568693 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.568590 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:20:35.568856 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.568712 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:20:35.568856 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.568803 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:20:35.571554 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.571531 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 22:20:35.571692 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.571673 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 22:20:35.571749 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.571738 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2gthm\"" Jun 12 22:20:35.571797 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.571754 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 22:20:35.571970 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.571946 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fhkqb\"" Jun 12 22:20:35.572084 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.571946 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 22:20:35.667149 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:35.667116 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls\") pod \"dns-default-bgplx\" (UID: \"97c3a625-9d8c-402e-9a2b-58626ea31c58\") " pod="openshift-dns/dns-default-bgplx" Jun 12 22:20:35.667327 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:35.667253 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 22:20:35.667327 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:35.667308 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls podName:97c3a625-9d8c-402e-9a2b-58626ea31c58 nodeName:}" failed. No retries permitted until 2026-06-12 22:20:36.667294944 +0000 UTC m=+36.538325043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls") pod "dns-default-bgplx" (UID: "97c3a625-9d8c-402e-9a2b-58626ea31c58") : secret "dns-default-metrics-tls" not found Jun 12 22:20:36.226651 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:36.226521 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8s5t8"] Jun 12 22:20:36.230504 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:20:36.230482 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd54c5b13_ba6f_4fd5_8c27_d15c4900af5f.slice/crio-89326a88d8dec9e30ba342faac285de2ea0a81767e077ab10c684621e100be2a WatchSource:0}: Error finding container 89326a88d8dec9e30ba342faac285de2ea0a81767e077ab10c684621e100be2a: Status 404 returned error can't find the container with id 89326a88d8dec9e30ba342faac285de2ea0a81767e077ab10c684621e100be2a Jun 12 22:20:36.672934 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:36.672904 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls\") pod \"dns-default-bgplx\" (UID: \"97c3a625-9d8c-402e-9a2b-58626ea31c58\") " pod="openshift-dns/dns-default-bgplx" Jun 12 22:20:36.673125 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:36.673007 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 22:20:36.673125 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:36.673068 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls podName:97c3a625-9d8c-402e-9a2b-58626ea31c58 nodeName:}" failed. No retries permitted until 2026-06-12 22:20:38.673055765 +0000 UTC m=+38.544085865 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls") pod "dns-default-bgplx" (UID: "97c3a625-9d8c-402e-9a2b-58626ea31c58") : secret "dns-default-metrics-tls" not found Jun 12 22:20:36.748083 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:36.748050 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8s5t8" event={"ID":"d54c5b13-ba6f-4fd5-8c27-d15c4900af5f","Type":"ContainerStarted","Data":"89326a88d8dec9e30ba342faac285de2ea0a81767e077ab10c684621e100be2a"} Jun 12 22:20:36.750650 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:36.750624 2558 generic.go:356] "Generic (PLEG): container finished" podID="f223bd69-0e45-4401-b183-52acac69823a" containerID="215d07af29209cec049698e0168133dc8e2d875865dea164cbbf080330e26e5b" exitCode=0 Jun 12 22:20:36.750765 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:36.750658 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c2mhw" event={"ID":"f223bd69-0e45-4401-b183-52acac69823a","Type":"ContainerDied","Data":"215d07af29209cec049698e0168133dc8e2d875865dea164cbbf080330e26e5b"} Jun 12 22:20:37.757801 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:37.757713 2558 generic.go:356] "Generic (PLEG): container finished" podID="f223bd69-0e45-4401-b183-52acac69823a" containerID="0e678a6eee96a4c5a9c9c193b0cb84059574af6be0d840ba19cff73b7e8d79a5" exitCode=0 Jun 12 22:20:37.758281 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:37.757835 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c2mhw" event={"ID":"f223bd69-0e45-4401-b183-52acac69823a","Type":"ContainerDied","Data":"0e678a6eee96a4c5a9c9c193b0cb84059574af6be0d840ba19cff73b7e8d79a5"} Jun 12 22:20:38.688913 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:38.688687 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls\") pod \"dns-default-bgplx\" (UID: \"97c3a625-9d8c-402e-9a2b-58626ea31c58\") " pod="openshift-dns/dns-default-bgplx" Jun 12 22:20:38.688913 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:38.688839 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 22:20:38.688913 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:38.688912 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls podName:97c3a625-9d8c-402e-9a2b-58626ea31c58 nodeName:}" failed. No retries permitted until 2026-06-12 22:20:42.688896231 +0000 UTC m=+42.559926335 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls") pod "dns-default-bgplx" (UID: "97c3a625-9d8c-402e-9a2b-58626ea31c58") : secret "dns-default-metrics-tls" not found Jun 12 22:20:38.763248 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:38.763208 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c2mhw" event={"ID":"f223bd69-0e45-4401-b183-52acac69823a","Type":"ContainerStarted","Data":"8cf9f475ac23a894a35ed51c0f81abe36d1c3b4ca4d17379e2eb25bcafb29242"} Jun 12 22:20:38.764751 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:38.764730 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8s5t8" event={"ID":"d54c5b13-ba6f-4fd5-8c27-d15c4900af5f","Type":"ContainerStarted","Data":"3f5a0f131691e7a7df44849e591519959fbb759c87bc5ad532ba140051845a89"} Jun 12 22:20:38.786522 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:38.786484 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-c2mhw" podStartSLOduration=8.747917501 podStartE2EDuration="38.786470136s" totalImagesPullingTime="30.038552635s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:20:38.784771817 +0000 UTC m=+38.655801938" watchObservedRunningTime="2026-06-12 22:20:38.786470136 +0000 UTC m=+38.657500266" Jun 12 22:20:38.799600 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:38.799561 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8s5t8" podStartSLOduration=2.705993116 podStartE2EDuration="4.799548356s" totalImagesPullingTime="2.09355524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:20:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:20:38.798873189 +0000 UTC m=+38.669903311" watchObservedRunningTime="2026-06-12 22:20:38.799548356 +0000 UTC m=+38.670578488" Jun 12 22:20:42.715761 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:42.715719 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls\") pod \"dns-default-bgplx\" (UID: \"97c3a625-9d8c-402e-9a2b-58626ea31c58\") " pod="openshift-dns/dns-default-bgplx" Jun 12 22:20:42.716161 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:42.715855 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 22:20:42.716161 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:42.715905 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls podName:97c3a625-9d8c-402e-9a2b-58626ea31c58 nodeName:}" failed. No retries permitted until 2026-06-12 22:20:50.715892173 +0000 UTC m=+50.586922277 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls") pod "dns-default-bgplx" (UID: "97c3a625-9d8c-402e-9a2b-58626ea31c58") : secret "dns-default-metrics-tls" not found Jun 12 22:20:50.772749 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:50.772705 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls\") pod \"dns-default-bgplx\" (UID: \"97c3a625-9d8c-402e-9a2b-58626ea31c58\") " pod="openshift-dns/dns-default-bgplx" Jun 12 22:20:50.773255 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:50.772820 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 22:20:50.773255 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:20:50.772872 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls podName:97c3a625-9d8c-402e-9a2b-58626ea31c58 nodeName:}" failed. No retries permitted until 2026-06-12 22:21:06.772858619 +0000 UTC m=+66.643888718 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls") pod "dns-default-bgplx" (UID: "97c3a625-9d8c-402e-9a2b-58626ea31c58") : secret "dns-default-metrics-tls" not found Jun 12 22:20:59.737551 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:20:59.737525 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2498q" Jun 12 22:21:06.282041 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:06.281980 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs\") pod \"network-metrics-daemon-lqpxm\" (UID: \"5707213e-da61-4306-96d0-03a1790eb281\") " pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:21:06.285093 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:06.285075 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 22:21:06.292761 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:21:06.292742 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 22:21:06.292864 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:21:06.292853 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs podName:5707213e-da61-4306-96d0-03a1790eb281 nodeName:}" failed. No retries permitted until 2026-06-12 22:22:10.292832659 +0000 UTC m=+130.163862758 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs") pod "network-metrics-daemon-lqpxm" (UID: "5707213e-da61-4306-96d0-03a1790eb281") : secret "metrics-daemon-secret" not found Jun 12 22:21:06.382652 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:06.382619 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-original-pull-secret\") pod \"global-pull-secret-syncer-mpzdk\" (UID: \"ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4\") " pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:21:06.385463 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:06.385447 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 22:21:06.396651 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:06.396619 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4-original-pull-secret\") pod \"global-pull-secret-syncer-mpzdk\" (UID: \"ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4\") " pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:21:06.483775 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:06.483744 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pr65\" (UniqueName: \"kubernetes.io/projected/b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e-kube-api-access-2pr65\") pod \"network-check-target-jfkmv\" (UID: \"b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e\") " pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:21:06.486731 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:06.486711 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 22:21:06.488765 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:06.488739 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mpzdk" Jun 12 22:21:06.496689 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:06.496670 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 22:21:06.507349 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:06.507323 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pr65\" (UniqueName: \"kubernetes.io/projected/b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e-kube-api-access-2pr65\") pod \"network-check-target-jfkmv\" (UID: \"b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e\") " pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:21:06.612685 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:06.612651 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mpzdk"] Jun 12 22:21:06.616032 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:21:06.616003 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad7cebde_3bc5_4ed5_9ffd_60050c90f5d4.slice/crio-6ac1516bffe81ebc0006e07445e2789199ad593680ab56a2d7cd07907c575d61 WatchSource:0}: Error finding container 6ac1516bffe81ebc0006e07445e2789199ad593680ab56a2d7cd07907c575d61: Status 404 returned error can't find the container with id 6ac1516bffe81ebc0006e07445e2789199ad593680ab56a2d7cd07907c575d61 Jun 12 22:21:06.785906 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:06.783562 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fhkqb\"" Jun 12 22:21:06.786420 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:06.786396 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls\") pod \"dns-default-bgplx\" (UID: \"97c3a625-9d8c-402e-9a2b-58626ea31c58\") " pod="openshift-dns/dns-default-bgplx" Jun 12 22:21:06.786532 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:21:06.786514 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 22:21:06.786595 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:21:06.786584 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls podName:97c3a625-9d8c-402e-9a2b-58626ea31c58 nodeName:}" failed. No retries permitted until 2026-06-12 22:21:38.786567165 +0000 UTC m=+98.657597267 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls") pod "dns-default-bgplx" (UID: "97c3a625-9d8c-402e-9a2b-58626ea31c58") : secret "dns-default-metrics-tls" not found Jun 12 22:21:06.791148 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:06.791130 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:21:06.828293 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:06.828253 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mpzdk" event={"ID":"ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4","Type":"ContainerStarted","Data":"6ac1516bffe81ebc0006e07445e2789199ad593680ab56a2d7cd07907c575d61"} Jun 12 22:21:06.913807 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:06.913759 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jfkmv"] Jun 12 22:21:06.919051 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:21:06.919016 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb78bbe64_6ce1_4fe0_b8bc_d8413d1f7d5e.slice/crio-971e7529668f20016efcf54525b21bb3b3d8c6aa36ef429f15d7483341627fd2 WatchSource:0}: Error finding container 971e7529668f20016efcf54525b21bb3b3d8c6aa36ef429f15d7483341627fd2: Status 404 returned error can't find the container with id 971e7529668f20016efcf54525b21bb3b3d8c6aa36ef429f15d7483341627fd2 Jun 12 22:21:07.832668 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:07.832618 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jfkmv" event={"ID":"b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e","Type":"ContainerStarted","Data":"971e7529668f20016efcf54525b21bb3b3d8c6aa36ef429f15d7483341627fd2"} Jun 12 22:21:11.844669 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:11.844637 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mpzdk" event={"ID":"ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4","Type":"ContainerStarted","Data":"4b9e8eb151496bb811aabe5f410df78d07bd47e3fd3e02336ab3d47eac1381c8"} Jun 12 22:21:11.846071 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:11.846049 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jfkmv" event={"ID":"b78bbe64-6ce1-4fe0-b8bc-d8413d1f7d5e","Type":"ContainerStarted","Data":"6258a053bf1a0580e68371afed2665bd2bece1d1f4f85798a567bf1f1b48425d"} Jun 12 22:21:11.846183 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:11.846167 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:21:11.868979 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:11.868924 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mpzdk" podStartSLOduration=67.249599668 podStartE2EDuration="1m11.868907527s" totalImagesPullingTime="4.619307859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:11.868739768 +0000 UTC m=+71.739769888" watchObservedRunningTime="2026-06-12 22:21:11.868907527 +0000 UTC m=+71.739937649" Jun 12 22:21:11.894217 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:11.894175 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jfkmv" podStartSLOduration=67.581725663 podStartE2EDuration="1m11.894161958s" totalImagesPullingTime="4.312436295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:11.894090285 +0000 UTC m=+71.765120408" watchObservedRunningTime="2026-06-12 22:21:11.894161958 +0000 UTC m=+71.765192079" Jun 12 22:21:23.071234 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:23.071100 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64bbfd9f5d-xcrwg"] Jun 12 22:21:23.075046 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:23.075025 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64bbfd9f5d-xcrwg" Jun 12 22:21:23.077627 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:23.077609 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-jw96d\"" Jun 12 22:21:23.078597 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:23.078569 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 12 22:21:23.078753 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:23.078737 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 12 22:21:23.078826 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:23.078744 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 12 22:21:23.078875 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:23.078863 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 12 22:21:23.086900 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:23.086879 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64bbfd9f5d-xcrwg"] Jun 12 22:21:23.096237 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:23.096216 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1726f16a-0e14-4be7-a42e-9548eb90b2d5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64bbfd9f5d-xcrwg\" (UID: \"1726f16a-0e14-4be7-a42e-9548eb90b2d5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64bbfd9f5d-xcrwg" Jun 12 22:21:23.096327 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:23.096256 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svmbl\" (UniqueName: \"kubernetes.io/projected/1726f16a-0e14-4be7-a42e-9548eb90b2d5-kube-api-access-svmbl\") pod \"managed-serviceaccount-addon-agent-64bbfd9f5d-xcrwg\" (UID: \"1726f16a-0e14-4be7-a42e-9548eb90b2d5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64bbfd9f5d-xcrwg" Jun 12 22:21:23.197453 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:23.197404 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svmbl\" (UniqueName: \"kubernetes.io/projected/1726f16a-0e14-4be7-a42e-9548eb90b2d5-kube-api-access-svmbl\") pod \"managed-serviceaccount-addon-agent-64bbfd9f5d-xcrwg\" (UID: \"1726f16a-0e14-4be7-a42e-9548eb90b2d5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64bbfd9f5d-xcrwg" Jun 12 22:21:23.197619 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:23.197492 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1726f16a-0e14-4be7-a42e-9548eb90b2d5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64bbfd9f5d-xcrwg\" (UID: \"1726f16a-0e14-4be7-a42e-9548eb90b2d5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64bbfd9f5d-xcrwg" Jun 12 22:21:23.199823 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:23.199803 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1726f16a-0e14-4be7-a42e-9548eb90b2d5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64bbfd9f5d-xcrwg\" (UID: \"1726f16a-0e14-4be7-a42e-9548eb90b2d5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64bbfd9f5d-xcrwg" Jun 12 22:21:23.206876 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:23.206853 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svmbl\" (UniqueName: \"kubernetes.io/projected/1726f16a-0e14-4be7-a42e-9548eb90b2d5-kube-api-access-svmbl\") pod \"managed-serviceaccount-addon-agent-64bbfd9f5d-xcrwg\" (UID: \"1726f16a-0e14-4be7-a42e-9548eb90b2d5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64bbfd9f5d-xcrwg" Jun 12 22:21:23.393695 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:23.393602 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64bbfd9f5d-xcrwg" Jun 12 22:21:23.512047 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:23.512018 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64bbfd9f5d-xcrwg"] Jun 12 22:21:23.514804 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:21:23.514778 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1726f16a_0e14_4be7_a42e_9548eb90b2d5.slice/crio-3ae1ec5c3ce7d79246ff87a46f70da3931b0e801bad7059c421223362e1a71dc WatchSource:0}: Error finding container 3ae1ec5c3ce7d79246ff87a46f70da3931b0e801bad7059c421223362e1a71dc: Status 404 returned error can't find the container with id 3ae1ec5c3ce7d79246ff87a46f70da3931b0e801bad7059c421223362e1a71dc Jun 12 22:21:23.876549 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:23.876504 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64bbfd9f5d-xcrwg" event={"ID":"1726f16a-0e14-4be7-a42e-9548eb90b2d5","Type":"ContainerStarted","Data":"3ae1ec5c3ce7d79246ff87a46f70da3931b0e801bad7059c421223362e1a71dc"} Jun 12 22:21:26.885237 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:26.885201 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64bbfd9f5d-xcrwg" event={"ID":"1726f16a-0e14-4be7-a42e-9548eb90b2d5","Type":"ContainerStarted","Data":"28fb93bac70cb903e9cd65397124cd586a41cbf183436daee61c8549ecac1291"} Jun 12 22:21:26.902043 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:26.901986 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64bbfd9f5d-xcrwg" podStartSLOduration=1.443298618 podStartE2EDuration="3.901969481s" totalImagesPullingTime="2.458670863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:26.901529621 +0000 UTC m=+86.772559743" watchObservedRunningTime="2026-06-12 22:21:26.901969481 +0000 UTC m=+86.772999602" Jun 12 22:21:38.803376 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:38.803342 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls\") pod \"dns-default-bgplx\" (UID: \"97c3a625-9d8c-402e-9a2b-58626ea31c58\") " pod="openshift-dns/dns-default-bgplx" Jun 12 22:21:38.803780 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:21:38.803520 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 22:21:38.803780 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:21:38.803589 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls podName:97c3a625-9d8c-402e-9a2b-58626ea31c58 nodeName:}" failed. No retries permitted until 2026-06-12 22:22:42.803573419 +0000 UTC m=+162.674603519 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls") pod "dns-default-bgplx" (UID: "97c3a625-9d8c-402e-9a2b-58626ea31c58") : secret "dns-default-metrics-tls" not found Jun 12 22:21:42.851378 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:21:42.851344 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jfkmv" Jun 12 22:22:10.313011 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:22:10.312962 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs\") pod \"network-metrics-daemon-lqpxm\" (UID: \"5707213e-da61-4306-96d0-03a1790eb281\") " pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:22:10.313550 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:22:10.313094 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 22:22:10.313550 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:22:10.313150 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs podName:5707213e-da61-4306-96d0-03a1790eb281 nodeName:}" failed. No retries permitted until 2026-06-12 22:24:12.313135436 +0000 UTC m=+252.184165535 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs") pod "network-metrics-daemon-lqpxm" (UID: "5707213e-da61-4306-96d0-03a1790eb281") : secret "metrics-daemon-secret" not found Jun 12 22:22:37.985934 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:22:37.985885 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bgplx" podUID="97c3a625-9d8c-402e-9a2b-58626ea31c58" Jun 12 22:22:38.057736 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:22:38.057707 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bgplx" Jun 12 22:22:38.596138 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:22:38.596101 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lqpxm" podUID="5707213e-da61-4306-96d0-03a1790eb281" Jun 12 22:22:42.832401 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:22:42.832356 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls\") pod \"dns-default-bgplx\" (UID: \"97c3a625-9d8c-402e-9a2b-58626ea31c58\") " pod="openshift-dns/dns-default-bgplx" Jun 12 22:22:42.832894 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:22:42.832484 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 22:22:42.832894 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:22:42.832535 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls podName:97c3a625-9d8c-402e-9a2b-58626ea31c58 nodeName:}" failed. No retries permitted until 2026-06-12 22:24:44.832521209 +0000 UTC m=+284.703551308 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls") pod "dns-default-bgplx" (UID: "97c3a625-9d8c-402e-9a2b-58626ea31c58") : secret "dns-default-metrics-tls" not found Jun 12 22:22:52.568642 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:22:52.568557 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:23:26.168122 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:23:26.168090 2558 generic.go:356] "Generic (PLEG): container finished" podID="1726f16a-0e14-4be7-a42e-9548eb90b2d5" containerID="28fb93bac70cb903e9cd65397124cd586a41cbf183436daee61c8549ecac1291" exitCode=255 Jun 12 22:23:26.168458 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:23:26.168152 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64bbfd9f5d-xcrwg" event={"ID":"1726f16a-0e14-4be7-a42e-9548eb90b2d5","Type":"ContainerDied","Data":"28fb93bac70cb903e9cd65397124cd586a41cbf183436daee61c8549ecac1291"} Jun 12 22:23:26.168458 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:23:26.168411 2558 scope.go:117] "RemoveContainer" containerID="28fb93bac70cb903e9cd65397124cd586a41cbf183436daee61c8549ecac1291" Jun 12 22:23:27.171921 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:23:27.171883 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64bbfd9f5d-xcrwg" event={"ID":"1726f16a-0e14-4be7-a42e-9548eb90b2d5","Type":"ContainerStarted","Data":"7498f53e080213e926a1284826f783c994c66681a30f975f73391bcb7f128123"} Jun 12 22:24:10.409404 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.409368 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-77d7f"] Jun 12 22:24:10.412288 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.412266 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-77d7f" Jun 12 22:24:10.412920 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.412894 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-fp4d9"] Jun 12 22:24:10.415211 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.415191 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 12 22:24:10.415313 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.415214 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-26pfg\"" Jun 12 22:24:10.415313 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.415217 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 12 22:24:10.415419 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.415406 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 12 22:24:10.415648 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.415630 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 12 22:24:10.415688 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.415675 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-rxlgh"] Jun 12 22:24:10.415788 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.415777 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-fp4d9" Jun 12 22:24:10.419012 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.418474 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-74964b6f74-tmcld"] Jun 12 22:24:10.419012 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.418532 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 12 22:24:10.419012 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.418661 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 12 22:24:10.419012 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.418701 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xq8r4\"" Jun 12 22:24:10.419012 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.419013 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-rxlgh" Jun 12 22:24:10.419299 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.419052 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 12 22:24:10.421817 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.421796 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 12 22:24:10.422040 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.422024 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dz59x\"" Jun 12 22:24:10.422161 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.422145 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 12 22:24:10.423999 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.423980 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:10.426943 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.426689 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 12 22:24:10.426943 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.426744 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 12 22:24:10.426943 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.426765 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-h8bw5\"" Jun 12 22:24:10.426943 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.426795 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 12 22:24:10.426943 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.426690 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 12 22:24:10.427249 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.427119 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 12 22:24:10.427249 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.427224 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 12 22:24:10.427938 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.427918 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-77d7f"] Jun 12 22:24:10.428730 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.428709 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-fp4d9"] Jun 12 22:24:10.434938 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.434916 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-74964b6f74-tmcld"] Jun 12 22:24:10.439975 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.439956 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-rxlgh"] Jun 12 22:24:10.505327 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.505300 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-rfqql"] Jun 12 22:24:10.508242 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.508224 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-rfqql" Jun 12 22:24:10.509784 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.509760 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkswv\" (UniqueName: \"kubernetes.io/projected/313c738d-72a0-47ef-8eb1-c3e68c725e42-kube-api-access-bkswv\") pod \"kube-storage-version-migrator-operator-7c578b78fc-77d7f\" (UID: \"313c738d-72a0-47ef-8eb1-c3e68c725e42\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-77d7f" Jun 12 22:24:10.509889 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.509792 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a25ee990-41cb-4d78-b64c-88fca92d5368-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-fp4d9\" (UID: \"a25ee990-41cb-4d78-b64c-88fca92d5368\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-fp4d9" Jun 12 22:24:10.509889 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.509812 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ba5689ea-c2bd-4358-9750-677d05eb96bb-stats-auth\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:10.509889 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.509839 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/313c738d-72a0-47ef-8eb1-c3e68c725e42-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-77d7f\" (UID: \"313c738d-72a0-47ef-8eb1-c3e68c725e42\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-77d7f" Jun 12 22:24:10.509889 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.509865 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8p9d\" (UniqueName: \"kubernetes.io/projected/ba5689ea-c2bd-4358-9750-677d05eb96bb-kube-api-access-l8p9d\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:10.510060 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.509920 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba5689ea-c2bd-4358-9750-677d05eb96bb-metrics-certs\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:10.510060 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.509948 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/07c36375-213f-4d62-8784-35df74e77d7b-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-rxlgh\" (UID: \"07c36375-213f-4d62-8784-35df74e77d7b\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-rxlgh" Jun 12 22:24:10.510060 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.509968 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/313c738d-72a0-47ef-8eb1-c3e68c725e42-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-77d7f\" (UID: \"313c738d-72a0-47ef-8eb1-c3e68c725e42\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-77d7f" Jun 12 22:24:10.510060 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.510006 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/07c36375-213f-4d62-8784-35df74e77d7b-nginx-conf\") pod \"networking-console-plugin-867b76cb74-rxlgh\" (UID: \"07c36375-213f-4d62-8784-35df74e77d7b\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-rxlgh" Jun 12 22:24:10.510060 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.510045 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qq7k\" (UniqueName: \"kubernetes.io/projected/a25ee990-41cb-4d78-b64c-88fca92d5368-kube-api-access-5qq7k\") pod \"cluster-samples-operator-9547488fd-fp4d9\" (UID: \"a25ee990-41cb-4d78-b64c-88fca92d5368\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-fp4d9" Jun 12 22:24:10.510267 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.510116 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba5689ea-c2bd-4358-9750-677d05eb96bb-service-ca-bundle\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:10.510267 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.510181 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ba5689ea-c2bd-4358-9750-677d05eb96bb-default-certificate\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:10.511124 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.511102 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 12 22:24:10.512391 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.512373 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7gx7p"] Jun 12 22:24:10.513382 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.513361 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 12 22:24:10.513382 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.513370 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b8rpn\"" Jun 12 22:24:10.513546 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.513391 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 12 22:24:10.513546 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.513445 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 12 22:24:10.515277 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.515257 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65d8696b45-rq6wt"] Jun 12 22:24:10.515389 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.515373 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7gx7p" Jun 12 22:24:10.517637 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.517612 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-tn2ds\"" Jun 12 22:24:10.517872 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.517858 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 12 22:24:10.518122 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.518109 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:10.522817 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.522801 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 12 22:24:10.523232 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.523214 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 12 22:24:10.523332 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.523233 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 12 22:24:10.523332 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.523256 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 12 22:24:10.523465 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.523390 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 12 22:24:10.523744 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.523727 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 12 22:24:10.523744 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.523737 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cn97h\"" Jun 12 22:24:10.524525 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.524500 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-rfqql"] Jun 12 22:24:10.531371 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.531325 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7gx7p"] Jun 12 22:24:10.532259 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.532243 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65d8696b45-rq6wt"] Jun 12 22:24:10.532949 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.532931 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 12 22:24:10.602549 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.602520 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-p5df5"] Jun 12 22:24:10.605305 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.605285 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-p5df5" Jun 12 22:24:10.607754 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.607737 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-grtc4\"" Jun 12 22:24:10.610451 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.610416 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a25ee990-41cb-4d78-b64c-88fca92d5368-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-fp4d9\" (UID: \"a25ee990-41cb-4d78-b64c-88fca92d5368\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-fp4d9" Jun 12 22:24:10.610551 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.610470 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/08ec4800-3d60-4d66-a897-2cb31f10284b-config\") pod \"service-ca-operator-7ccbfd59dc-7gx7p\" (UID: \"08ec4800-3d60-4d66-a897-2cb31f10284b\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7gx7p" Jun 12 22:24:10.610551 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:10.610518 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 12 22:24:10.610551 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.610529 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/313c738d-72a0-47ef-8eb1-c3e68c725e42-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-77d7f\" (UID: \"313c738d-72a0-47ef-8eb1-c3e68c725e42\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-77d7f" Jun 12 22:24:10.610700 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.610562 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1904869f-b574-4320-aab4-bfeaf06c63a8-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-rfqql\" (UID: \"1904869f-b574-4320-aab4-bfeaf06c63a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-rfqql" Jun 12 22:24:10.610700 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:10.610578 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a25ee990-41cb-4d78-b64c-88fca92d5368-samples-operator-tls podName:a25ee990-41cb-4d78-b64c-88fca92d5368 nodeName:}" failed. No retries permitted until 2026-06-12 22:24:11.110560946 +0000 UTC m=+250.981591046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a25ee990-41cb-4d78-b64c-88fca92d5368-samples-operator-tls") pod "cluster-samples-operator-9547488fd-fp4d9" (UID: "a25ee990-41cb-4d78-b64c-88fca92d5368") : secret "samples-operator-tls" not found Jun 12 22:24:10.610700 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.610608 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1904869f-b574-4320-aab4-bfeaf06c63a8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-rfqql\" (UID: \"1904869f-b574-4320-aab4-bfeaf06c63a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-rfqql" Jun 12 22:24:10.610700 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.610637 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba5689ea-c2bd-4358-9750-677d05eb96bb-metrics-certs\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:10.610700 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.610665 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b27fbe24-270b-43e1-9500-2637e49768dd-image-registry-private-configuration\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:10.610962 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.610709 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/07c36375-213f-4d62-8784-35df74e77d7b-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-rxlgh\" (UID: \"07c36375-213f-4d62-8784-35df74e77d7b\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-rxlgh" Jun 12 22:24:10.610962 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.610734 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b27fbe24-270b-43e1-9500-2637e49768dd-installation-pull-secrets\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:10.610962 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:10.610755 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 22:24:10.610962 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.610785 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b27fbe24-270b-43e1-9500-2637e49768dd-registry-certificates\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:10.610962 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:10.610815 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba5689ea-c2bd-4358-9750-677d05eb96bb-metrics-certs podName:ba5689ea-c2bd-4358-9750-677d05eb96bb nodeName:}" failed. No retries permitted until 2026-06-12 22:24:11.110797742 +0000 UTC m=+250.981827841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba5689ea-c2bd-4358-9750-677d05eb96bb-metrics-certs") pod "router-default-74964b6f74-tmcld" (UID: "ba5689ea-c2bd-4358-9750-677d05eb96bb") : secret "router-metrics-certs-default" not found Jun 12 22:24:10.610962 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.610837 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/313c738d-72a0-47ef-8eb1-c3e68c725e42-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-77d7f\" (UID: \"313c738d-72a0-47ef-8eb1-c3e68c725e42\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-77d7f" Jun 12 22:24:10.610962 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:10.610906 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 22:24:10.611568 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:10.610970 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07c36375-213f-4d62-8784-35df74e77d7b-networking-console-plugin-cert podName:07c36375-213f-4d62-8784-35df74e77d7b nodeName:}" failed. No retries permitted until 2026-06-12 22:24:11.110955207 +0000 UTC m=+250.981985305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/07c36375-213f-4d62-8784-35df74e77d7b-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-rxlgh" (UID: "07c36375-213f-4d62-8784-35df74e77d7b") : secret "networking-console-plugin-cert" not found Jun 12 22:24:10.611568 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.611016 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/07c36375-213f-4d62-8784-35df74e77d7b-nginx-conf\") pod \"networking-console-plugin-867b76cb74-rxlgh\" (UID: \"07c36375-213f-4d62-8784-35df74e77d7b\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-rxlgh" Jun 12 22:24:10.611568 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.611048 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba5689ea-c2bd-4358-9750-677d05eb96bb-service-ca-bundle\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:10.611568 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.611095 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ba5689ea-c2bd-4358-9750-677d05eb96bb-default-certificate\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:10.611568 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.611127 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkswv\" (UniqueName: \"kubernetes.io/projected/313c738d-72a0-47ef-8eb1-c3e68c725e42-kube-api-access-bkswv\") pod \"kube-storage-version-migrator-operator-7c578b78fc-77d7f\" (UID: \"313c738d-72a0-47ef-8eb1-c3e68c725e42\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-77d7f" Jun 12 22:24:10.611568 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.611154 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb6sh\" (UniqueName: \"kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-kube-api-access-cb6sh\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:10.611568 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:10.611227 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba5689ea-c2bd-4358-9750-677d05eb96bb-service-ca-bundle podName:ba5689ea-c2bd-4358-9750-677d05eb96bb nodeName:}" failed. No retries permitted until 2026-06-12 22:24:11.111212454 +0000 UTC m=+250.982242564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba5689ea-c2bd-4358-9750-677d05eb96bb-service-ca-bundle") pod "router-default-74964b6f74-tmcld" (UID: "ba5689ea-c2bd-4358-9750-677d05eb96bb") : configmap references non-existent config key: service-ca.crt Jun 12 22:24:10.611568 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.611249 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlwt8\" (UniqueName: \"kubernetes.io/projected/08ec4800-3d60-4d66-a897-2cb31f10284b-kube-api-access-mlwt8\") pod \"service-ca-operator-7ccbfd59dc-7gx7p\" (UID: \"08ec4800-3d60-4d66-a897-2cb31f10284b\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7gx7p" Jun 12 22:24:10.611568 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.611362 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/313c738d-72a0-47ef-8eb1-c3e68c725e42-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-77d7f\" (UID: \"313c738d-72a0-47ef-8eb1-c3e68c725e42\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-77d7f" Jun 12 22:24:10.611568 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.611363 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b27fbe24-270b-43e1-9500-2637e49768dd-ca-trust-extracted\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:10.611568 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.611419 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b27fbe24-270b-43e1-9500-2637e49768dd-trusted-ca\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:10.612870 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.612393 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-bound-sa-token\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:10.612870 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.612716 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8p9d\" (UniqueName: \"kubernetes.io/projected/ba5689ea-c2bd-4358-9750-677d05eb96bb-kube-api-access-l8p9d\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:10.612870 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.612753 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ba5689ea-c2bd-4358-9750-677d05eb96bb-stats-auth\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:10.613103 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.612944 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/08ec4800-3d60-4d66-a897-2cb31f10284b-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-7gx7p\" (UID: \"08ec4800-3d60-4d66-a897-2cb31f10284b\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7gx7p" Jun 12 22:24:10.613103 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.613005 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-registry-tls\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:10.613103 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.613039 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qq7k\" (UniqueName: \"kubernetes.io/projected/a25ee990-41cb-4d78-b64c-88fca92d5368-kube-api-access-5qq7k\") pod \"cluster-samples-operator-9547488fd-fp4d9\" (UID: \"a25ee990-41cb-4d78-b64c-88fca92d5368\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-fp4d9" Jun 12 22:24:10.613265 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.613245 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p569\" (UniqueName: \"kubernetes.io/projected/1904869f-b574-4320-aab4-bfeaf06c63a8-kube-api-access-6p569\") pod \"cluster-monitoring-operator-f9d7df769-rfqql\" (UID: \"1904869f-b574-4320-aab4-bfeaf06c63a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-rfqql" Jun 12 22:24:10.613323 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.612943 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/07c36375-213f-4d62-8784-35df74e77d7b-nginx-conf\") pod \"networking-console-plugin-867b76cb74-rxlgh\" (UID: \"07c36375-213f-4d62-8784-35df74e77d7b\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-rxlgh" Jun 12 22:24:10.617998 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.613690 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/313c738d-72a0-47ef-8eb1-c3e68c725e42-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-77d7f\" (UID: \"313c738d-72a0-47ef-8eb1-c3e68c725e42\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-77d7f" Jun 12 22:24:10.617998 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.614666 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ba5689ea-c2bd-4358-9750-677d05eb96bb-default-certificate\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:10.617998 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.615608 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ba5689ea-c2bd-4358-9750-677d05eb96bb-stats-auth\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:10.617998 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.616399 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-p5df5"] Jun 12 22:24:10.626933 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.626908 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkswv\" (UniqueName: \"kubernetes.io/projected/313c738d-72a0-47ef-8eb1-c3e68c725e42-kube-api-access-bkswv\") pod \"kube-storage-version-migrator-operator-7c578b78fc-77d7f\" (UID: \"313c738d-72a0-47ef-8eb1-c3e68c725e42\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-77d7f" Jun 12 22:24:10.628486 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.628466 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8p9d\" (UniqueName: \"kubernetes.io/projected/ba5689ea-c2bd-4358-9750-677d05eb96bb-kube-api-access-l8p9d\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:10.629059 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.629042 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qq7k\" (UniqueName: \"kubernetes.io/projected/a25ee990-41cb-4d78-b64c-88fca92d5368-kube-api-access-5qq7k\") pod \"cluster-samples-operator-9547488fd-fp4d9\" (UID: \"a25ee990-41cb-4d78-b64c-88fca92d5368\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-fp4d9" Jun 12 22:24:10.713965 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.713896 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1904869f-b574-4320-aab4-bfeaf06c63a8-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-rfqql\" (UID: \"1904869f-b574-4320-aab4-bfeaf06c63a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-rfqql" Jun 12 22:24:10.713965 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.713925 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1904869f-b574-4320-aab4-bfeaf06c63a8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-rfqql\" (UID: \"1904869f-b574-4320-aab4-bfeaf06c63a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-rfqql" Jun 12 22:24:10.713965 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.713948 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxvf8\" (UniqueName: \"kubernetes.io/projected/06a24a83-2d84-402b-825f-eb7ecf336ee8-kube-api-access-lxvf8\") pod \"network-check-source-6947749cfc-p5df5\" (UID: \"06a24a83-2d84-402b-825f-eb7ecf336ee8\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-p5df5" Jun 12 22:24:10.714198 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.713982 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b27fbe24-270b-43e1-9500-2637e49768dd-image-registry-private-configuration\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:10.714198 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.714033 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b27fbe24-270b-43e1-9500-2637e49768dd-installation-pull-secrets\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:10.714198 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:10.714055 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 22:24:10.714198 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.714058 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b27fbe24-270b-43e1-9500-2637e49768dd-registry-certificates\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:10.714198 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:10.714111 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1904869f-b574-4320-aab4-bfeaf06c63a8-cluster-monitoring-operator-tls podName:1904869f-b574-4320-aab4-bfeaf06c63a8 nodeName:}" failed. No retries permitted until 2026-06-12 22:24:11.214094095 +0000 UTC m=+251.085124199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1904869f-b574-4320-aab4-bfeaf06c63a8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-rfqql" (UID: "1904869f-b574-4320-aab4-bfeaf06c63a8") : secret "cluster-monitoring-operator-tls" not found Jun 12 22:24:10.714198 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.714161 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb6sh\" (UniqueName: \"kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-kube-api-access-cb6sh\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:10.714198 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.714189 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlwt8\" (UniqueName: \"kubernetes.io/projected/08ec4800-3d60-4d66-a897-2cb31f10284b-kube-api-access-mlwt8\") pod \"service-ca-operator-7ccbfd59dc-7gx7p\" (UID: \"08ec4800-3d60-4d66-a897-2cb31f10284b\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7gx7p" Jun 12 22:24:10.714590 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.714215 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b27fbe24-270b-43e1-9500-2637e49768dd-ca-trust-extracted\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:10.714590 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.714242 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b27fbe24-270b-43e1-9500-2637e49768dd-trusted-ca\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:10.714590 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.714273 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-bound-sa-token\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:10.714590 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.714305 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/08ec4800-3d60-4d66-a897-2cb31f10284b-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-7gx7p\" (UID: \"08ec4800-3d60-4d66-a897-2cb31f10284b\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7gx7p" Jun 12 22:24:10.714590 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.714349 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-registry-tls\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:10.714590 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.714379 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p569\" (UniqueName: \"kubernetes.io/projected/1904869f-b574-4320-aab4-bfeaf06c63a8-kube-api-access-6p569\") pod \"cluster-monitoring-operator-f9d7df769-rfqql\" (UID: \"1904869f-b574-4320-aab4-bfeaf06c63a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-rfqql" Jun 12 22:24:10.714590 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.714452 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/08ec4800-3d60-4d66-a897-2cb31f10284b-config\") pod \"service-ca-operator-7ccbfd59dc-7gx7p\" (UID: \"08ec4800-3d60-4d66-a897-2cb31f10284b\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7gx7p" Jun 12 22:24:10.714590 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.714584 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b27fbe24-270b-43e1-9500-2637e49768dd-ca-trust-extracted\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:10.714978 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:10.714642 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 22:24:10.714978 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.714653 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b27fbe24-270b-43e1-9500-2637e49768dd-registry-certificates\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:10.714978 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:10.714660 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65d8696b45-rq6wt: secret "image-registry-tls" not found Jun 12 22:24:10.714978 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:10.714723 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-registry-tls podName:b27fbe24-270b-43e1-9500-2637e49768dd nodeName:}" failed. No retries permitted until 2026-06-12 22:24:11.214707535 +0000 UTC m=+251.085737634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-registry-tls") pod "image-registry-65d8696b45-rq6wt" (UID: "b27fbe24-270b-43e1-9500-2637e49768dd") : secret "image-registry-tls" not found Jun 12 22:24:10.714978 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.714744 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1904869f-b574-4320-aab4-bfeaf06c63a8-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-rfqql\" (UID: \"1904869f-b574-4320-aab4-bfeaf06c63a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-rfqql" Jun 12 22:24:10.714978 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.714948 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/08ec4800-3d60-4d66-a897-2cb31f10284b-config\") pod \"service-ca-operator-7ccbfd59dc-7gx7p\" (UID: \"08ec4800-3d60-4d66-a897-2cb31f10284b\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7gx7p" Jun 12 22:24:10.715327 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.715225 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b27fbe24-270b-43e1-9500-2637e49768dd-trusted-ca\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:10.716593 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.716566 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b27fbe24-270b-43e1-9500-2637e49768dd-image-registry-private-configuration\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:10.716739 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.716718 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/08ec4800-3d60-4d66-a897-2cb31f10284b-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-7gx7p\" (UID: \"08ec4800-3d60-4d66-a897-2cb31f10284b\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7gx7p" Jun 12 22:24:10.716805 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.716789 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b27fbe24-270b-43e1-9500-2637e49768dd-installation-pull-secrets\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:10.723011 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.722968 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p569\" (UniqueName: \"kubernetes.io/projected/1904869f-b574-4320-aab4-bfeaf06c63a8-kube-api-access-6p569\") pod \"cluster-monitoring-operator-f9d7df769-rfqql\" (UID: \"1904869f-b574-4320-aab4-bfeaf06c63a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-rfqql" Jun 12 22:24:10.723283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.723265 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-bound-sa-token\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:10.723831 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.723801 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb6sh\" (UniqueName: \"kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-kube-api-access-cb6sh\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:10.723831 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.723814 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlwt8\" (UniqueName: \"kubernetes.io/projected/08ec4800-3d60-4d66-a897-2cb31f10284b-kube-api-access-mlwt8\") pod \"service-ca-operator-7ccbfd59dc-7gx7p\" (UID: \"08ec4800-3d60-4d66-a897-2cb31f10284b\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7gx7p" Jun 12 22:24:10.725955 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.725940 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-77d7f" Jun 12 22:24:10.814965 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.814938 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxvf8\" (UniqueName: \"kubernetes.io/projected/06a24a83-2d84-402b-825f-eb7ecf336ee8-kube-api-access-lxvf8\") pod \"network-check-source-6947749cfc-p5df5\" (UID: \"06a24a83-2d84-402b-825f-eb7ecf336ee8\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-p5df5" Jun 12 22:24:10.823378 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.823354 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxvf8\" (UniqueName: \"kubernetes.io/projected/06a24a83-2d84-402b-825f-eb7ecf336ee8-kube-api-access-lxvf8\") pod \"network-check-source-6947749cfc-p5df5\" (UID: \"06a24a83-2d84-402b-825f-eb7ecf336ee8\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-p5df5" Jun 12 22:24:10.826191 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.826172 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7gx7p" Jun 12 22:24:10.844470 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.844447 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-77d7f"] Jun 12 22:24:10.847568 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:24:10.847538 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod313c738d_72a0_47ef_8eb1_c3e68c725e42.slice/crio-b7f9b17c7575cf17faed85ed08914a9e332bc12833cd92ddc1566e367bb9b778 WatchSource:0}: Error finding container b7f9b17c7575cf17faed85ed08914a9e332bc12833cd92ddc1566e367bb9b778: Status 404 returned error can't find the container with id b7f9b17c7575cf17faed85ed08914a9e332bc12833cd92ddc1566e367bb9b778 Jun 12 22:24:10.919984 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.919957 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-p5df5" Jun 12 22:24:10.946988 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:10.946961 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7gx7p"] Jun 12 22:24:10.950894 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:24:10.950865 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08ec4800_3d60_4d66_a897_2cb31f10284b.slice/crio-94e5c251570b65f5b0f4210201cb1927263b0dcc2b24e644854deed4589db507 WatchSource:0}: Error finding container 94e5c251570b65f5b0f4210201cb1927263b0dcc2b24e644854deed4589db507: Status 404 returned error can't find the container with id 94e5c251570b65f5b0f4210201cb1927263b0dcc2b24e644854deed4589db507 Jun 12 22:24:11.038411 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:11.038383 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-p5df5"] Jun 12 22:24:11.041493 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:24:11.041466 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a24a83_2d84_402b_825f_eb7ecf336ee8.slice/crio-f304e2497cc6e21a112a34841d3a6ce91bd4b018282bfeb72066271c676bfadb WatchSource:0}: Error finding container f304e2497cc6e21a112a34841d3a6ce91bd4b018282bfeb72066271c676bfadb: Status 404 returned error can't find the container with id f304e2497cc6e21a112a34841d3a6ce91bd4b018282bfeb72066271c676bfadb Jun 12 22:24:11.117273 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:11.117245 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a25ee990-41cb-4d78-b64c-88fca92d5368-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-fp4d9\" (UID: \"a25ee990-41cb-4d78-b64c-88fca92d5368\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-fp4d9" Jun 12 22:24:11.117416 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:11.117293 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba5689ea-c2bd-4358-9750-677d05eb96bb-metrics-certs\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:11.117416 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:11.117408 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/07c36375-213f-4d62-8784-35df74e77d7b-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-rxlgh\" (UID: \"07c36375-213f-4d62-8784-35df74e77d7b\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-rxlgh" Jun 12 22:24:11.117548 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:11.117411 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 12 22:24:11.117548 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:11.117446 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba5689ea-c2bd-4358-9750-677d05eb96bb-service-ca-bundle\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:11.117548 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:11.117500 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a25ee990-41cb-4d78-b64c-88fca92d5368-samples-operator-tls podName:a25ee990-41cb-4d78-b64c-88fca92d5368 nodeName:}" failed. No retries permitted until 2026-06-12 22:24:12.117475888 +0000 UTC m=+251.988506003 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a25ee990-41cb-4d78-b64c-88fca92d5368-samples-operator-tls") pod "cluster-samples-operator-9547488fd-fp4d9" (UID: "a25ee990-41cb-4d78-b64c-88fca92d5368") : secret "samples-operator-tls" not found Jun 12 22:24:11.117700 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:11.117546 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 22:24:11.117700 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:11.117593 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba5689ea-c2bd-4358-9750-677d05eb96bb-metrics-certs podName:ba5689ea-c2bd-4358-9750-677d05eb96bb nodeName:}" failed. No retries permitted until 2026-06-12 22:24:12.117579933 +0000 UTC m=+251.988610036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba5689ea-c2bd-4358-9750-677d05eb96bb-metrics-certs") pod "router-default-74964b6f74-tmcld" (UID: "ba5689ea-c2bd-4358-9750-677d05eb96bb") : secret "router-metrics-certs-default" not found Jun 12 22:24:11.117700 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:11.117612 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 22:24:11.117700 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:11.117654 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07c36375-213f-4d62-8784-35df74e77d7b-networking-console-plugin-cert podName:07c36375-213f-4d62-8784-35df74e77d7b nodeName:}" failed. No retries permitted until 2026-06-12 22:24:12.117641518 +0000 UTC m=+251.988671632 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/07c36375-213f-4d62-8784-35df74e77d7b-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-rxlgh" (UID: "07c36375-213f-4d62-8784-35df74e77d7b") : secret "networking-console-plugin-cert" not found Jun 12 22:24:11.117700 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:11.117679 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba5689ea-c2bd-4358-9750-677d05eb96bb-service-ca-bundle podName:ba5689ea-c2bd-4358-9750-677d05eb96bb nodeName:}" failed. No retries permitted until 2026-06-12 22:24:12.117665247 +0000 UTC m=+251.988695346 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba5689ea-c2bd-4358-9750-677d05eb96bb-service-ca-bundle") pod "router-default-74964b6f74-tmcld" (UID: "ba5689ea-c2bd-4358-9750-677d05eb96bb") : configmap references non-existent config key: service-ca.crt Jun 12 22:24:11.218493 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:11.218404 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-registry-tls\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:11.218493 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:11.218475 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1904869f-b574-4320-aab4-bfeaf06c63a8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-rfqql\" (UID: \"1904869f-b574-4320-aab4-bfeaf06c63a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-rfqql" Jun 12 22:24:11.218688 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:11.218554 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 22:24:11.218688 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:11.218563 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 22:24:11.218688 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:11.218584 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65d8696b45-rq6wt: secret "image-registry-tls" not found Jun 12 22:24:11.218688 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:11.218599 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1904869f-b574-4320-aab4-bfeaf06c63a8-cluster-monitoring-operator-tls podName:1904869f-b574-4320-aab4-bfeaf06c63a8 nodeName:}" failed. No retries permitted until 2026-06-12 22:24:12.218586743 +0000 UTC m=+252.089616845 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1904869f-b574-4320-aab4-bfeaf06c63a8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-rfqql" (UID: "1904869f-b574-4320-aab4-bfeaf06c63a8") : secret "cluster-monitoring-operator-tls" not found Jun 12 22:24:11.218688 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:11.218629 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-registry-tls podName:b27fbe24-270b-43e1-9500-2637e49768dd nodeName:}" failed. No retries permitted until 2026-06-12 22:24:12.218612891 +0000 UTC m=+252.089643004 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-registry-tls") pod "image-registry-65d8696b45-rq6wt" (UID: "b27fbe24-270b-43e1-9500-2637e49768dd") : secret "image-registry-tls" not found Jun 12 22:24:11.279982 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:11.279949 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-p5df5" event={"ID":"06a24a83-2d84-402b-825f-eb7ecf336ee8","Type":"ContainerStarted","Data":"21581691a0213dfaba501dd21999efb3e26f544e03d79ff9d9fc9191cf159a0b"} Jun 12 22:24:11.280154 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:11.280007 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-p5df5" event={"ID":"06a24a83-2d84-402b-825f-eb7ecf336ee8","Type":"ContainerStarted","Data":"f304e2497cc6e21a112a34841d3a6ce91bd4b018282bfeb72066271c676bfadb"} Jun 12 22:24:11.281016 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:11.280993 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7gx7p" event={"ID":"08ec4800-3d60-4d66-a897-2cb31f10284b","Type":"ContainerStarted","Data":"94e5c251570b65f5b0f4210201cb1927263b0dcc2b24e644854deed4589db507"} Jun 12 22:24:11.281991 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:11.281971 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-77d7f" event={"ID":"313c738d-72a0-47ef-8eb1-c3e68c725e42","Type":"ContainerStarted","Data":"b7f9b17c7575cf17faed85ed08914a9e332bc12833cd92ddc1566e367bb9b778"} Jun 12 22:24:11.295046 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:11.295006 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-p5df5" podStartSLOduration=1.294993695 podStartE2EDuration="1.294993695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:24:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:24:11.294741638 +0000 UTC m=+251.165771770" watchObservedRunningTime="2026-06-12 22:24:11.294993695 +0000 UTC m=+251.166023815" Jun 12 22:24:12.126887 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:12.126856 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a25ee990-41cb-4d78-b64c-88fca92d5368-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-fp4d9\" (UID: \"a25ee990-41cb-4d78-b64c-88fca92d5368\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-fp4d9" Jun 12 22:24:12.127260 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:12.126908 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba5689ea-c2bd-4358-9750-677d05eb96bb-metrics-certs\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:12.127260 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:12.126966 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/07c36375-213f-4d62-8784-35df74e77d7b-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-rxlgh\" (UID: \"07c36375-213f-4d62-8784-35df74e77d7b\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-rxlgh" Jun 12 22:24:12.127260 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:12.126993 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba5689ea-c2bd-4358-9750-677d05eb96bb-service-ca-bundle\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:12.127260 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:12.127083 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 22:24:12.127260 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:12.127098 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 12 22:24:12.127260 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:12.127118 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba5689ea-c2bd-4358-9750-677d05eb96bb-service-ca-bundle podName:ba5689ea-c2bd-4358-9750-677d05eb96bb nodeName:}" failed. No retries permitted until 2026-06-12 22:24:14.127101327 +0000 UTC m=+253.998131431 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba5689ea-c2bd-4358-9750-677d05eb96bb-service-ca-bundle") pod "router-default-74964b6f74-tmcld" (UID: "ba5689ea-c2bd-4358-9750-677d05eb96bb") : configmap references non-existent config key: service-ca.crt Jun 12 22:24:12.127260 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:12.127136 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07c36375-213f-4d62-8784-35df74e77d7b-networking-console-plugin-cert podName:07c36375-213f-4d62-8784-35df74e77d7b nodeName:}" failed. No retries permitted until 2026-06-12 22:24:14.127127321 +0000 UTC m=+253.998157424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/07c36375-213f-4d62-8784-35df74e77d7b-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-rxlgh" (UID: "07c36375-213f-4d62-8784-35df74e77d7b") : secret "networking-console-plugin-cert" not found Jun 12 22:24:12.127260 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:12.127150 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 22:24:12.127260 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:12.127162 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a25ee990-41cb-4d78-b64c-88fca92d5368-samples-operator-tls podName:a25ee990-41cb-4d78-b64c-88fca92d5368 nodeName:}" failed. No retries permitted until 2026-06-12 22:24:14.12714377 +0000 UTC m=+253.998173884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a25ee990-41cb-4d78-b64c-88fca92d5368-samples-operator-tls") pod "cluster-samples-operator-9547488fd-fp4d9" (UID: "a25ee990-41cb-4d78-b64c-88fca92d5368") : secret "samples-operator-tls" not found Jun 12 22:24:12.127260 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:12.127180 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba5689ea-c2bd-4358-9750-677d05eb96bb-metrics-certs podName:ba5689ea-c2bd-4358-9750-677d05eb96bb nodeName:}" failed. No retries permitted until 2026-06-12 22:24:14.127171095 +0000 UTC m=+253.998201201 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba5689ea-c2bd-4358-9750-677d05eb96bb-metrics-certs") pod "router-default-74964b6f74-tmcld" (UID: "ba5689ea-c2bd-4358-9750-677d05eb96bb") : secret "router-metrics-certs-default" not found Jun 12 22:24:12.227937 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:12.227905 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1904869f-b574-4320-aab4-bfeaf06c63a8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-rfqql\" (UID: \"1904869f-b574-4320-aab4-bfeaf06c63a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-rfqql" Jun 12 22:24:12.228101 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:12.227998 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-registry-tls\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:12.228101 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:12.228071 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 22:24:12.228101 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:12.228088 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 22:24:12.228101 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:12.228098 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65d8696b45-rq6wt: secret "image-registry-tls" not found Jun 12 22:24:12.228240 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:12.228138 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-registry-tls podName:b27fbe24-270b-43e1-9500-2637e49768dd nodeName:}" failed. No retries permitted until 2026-06-12 22:24:14.228125788 +0000 UTC m=+254.099155886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-registry-tls") pod "image-registry-65d8696b45-rq6wt" (UID: "b27fbe24-270b-43e1-9500-2637e49768dd") : secret "image-registry-tls" not found Jun 12 22:24:12.228240 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:12.228150 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1904869f-b574-4320-aab4-bfeaf06c63a8-cluster-monitoring-operator-tls podName:1904869f-b574-4320-aab4-bfeaf06c63a8 nodeName:}" failed. No retries permitted until 2026-06-12 22:24:14.228143913 +0000 UTC m=+254.099174011 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1904869f-b574-4320-aab4-bfeaf06c63a8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-rfqql" (UID: "1904869f-b574-4320-aab4-bfeaf06c63a8") : secret "cluster-monitoring-operator-tls" not found Jun 12 22:24:12.329376 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:12.329341 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs\") pod \"network-metrics-daemon-lqpxm\" (UID: \"5707213e-da61-4306-96d0-03a1790eb281\") " pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:24:12.329557 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:12.329518 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 22:24:12.329632 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:12.329588 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs podName:5707213e-da61-4306-96d0-03a1790eb281 nodeName:}" failed. No retries permitted until 2026-06-12 22:26:14.329567867 +0000 UTC m=+374.200597967 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs") pod "network-metrics-daemon-lqpxm" (UID: "5707213e-da61-4306-96d0-03a1790eb281") : secret "metrics-daemon-secret" not found Jun 12 22:24:14.143685 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:14.143635 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a25ee990-41cb-4d78-b64c-88fca92d5368-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-fp4d9\" (UID: \"a25ee990-41cb-4d78-b64c-88fca92d5368\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-fp4d9" Jun 12 22:24:14.144085 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:14.143715 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba5689ea-c2bd-4358-9750-677d05eb96bb-metrics-certs\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:14.144085 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:14.143761 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/07c36375-213f-4d62-8784-35df74e77d7b-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-rxlgh\" (UID: \"07c36375-213f-4d62-8784-35df74e77d7b\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-rxlgh" Jun 12 22:24:14.144085 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:14.143793 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba5689ea-c2bd-4358-9750-677d05eb96bb-service-ca-bundle\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:14.144085 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:14.143802 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 12 22:24:14.144085 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:14.143850 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 22:24:14.144085 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:14.143876 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a25ee990-41cb-4d78-b64c-88fca92d5368-samples-operator-tls podName:a25ee990-41cb-4d78-b64c-88fca92d5368 nodeName:}" failed. No retries permitted until 2026-06-12 22:24:18.143856233 +0000 UTC m=+258.014886352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a25ee990-41cb-4d78-b64c-88fca92d5368-samples-operator-tls") pod "cluster-samples-operator-9547488fd-fp4d9" (UID: "a25ee990-41cb-4d78-b64c-88fca92d5368") : secret "samples-operator-tls" not found Jun 12 22:24:14.144085 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:14.143893 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba5689ea-c2bd-4358-9750-677d05eb96bb-metrics-certs podName:ba5689ea-c2bd-4358-9750-677d05eb96bb nodeName:}" failed. No retries permitted until 2026-06-12 22:24:18.143884833 +0000 UTC m=+258.014914933 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba5689ea-c2bd-4358-9750-677d05eb96bb-metrics-certs") pod "router-default-74964b6f74-tmcld" (UID: "ba5689ea-c2bd-4358-9750-677d05eb96bb") : secret "router-metrics-certs-default" not found Jun 12 22:24:14.144085 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:14.143898 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 22:24:14.144085 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:14.143904 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba5689ea-c2bd-4358-9750-677d05eb96bb-service-ca-bundle podName:ba5689ea-c2bd-4358-9750-677d05eb96bb nodeName:}" failed. No retries permitted until 2026-06-12 22:24:18.143898566 +0000 UTC m=+258.014928664 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba5689ea-c2bd-4358-9750-677d05eb96bb-service-ca-bundle") pod "router-default-74964b6f74-tmcld" (UID: "ba5689ea-c2bd-4358-9750-677d05eb96bb") : configmap references non-existent config key: service-ca.crt Jun 12 22:24:14.144085 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:14.143985 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07c36375-213f-4d62-8784-35df74e77d7b-networking-console-plugin-cert podName:07c36375-213f-4d62-8784-35df74e77d7b nodeName:}" failed. No retries permitted until 2026-06-12 22:24:18.143957782 +0000 UTC m=+258.014987888 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/07c36375-213f-4d62-8784-35df74e77d7b-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-rxlgh" (UID: "07c36375-213f-4d62-8784-35df74e77d7b") : secret "networking-console-plugin-cert" not found Jun 12 22:24:14.244962 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:14.244932 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1904869f-b574-4320-aab4-bfeaf06c63a8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-rfqql\" (UID: \"1904869f-b574-4320-aab4-bfeaf06c63a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-rfqql" Jun 12 22:24:14.245145 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:14.245023 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-registry-tls\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:14.245145 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:14.245085 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 22:24:14.245145 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:14.245114 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 22:24:14.245145 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:14.245124 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65d8696b45-rq6wt: secret "image-registry-tls" not found Jun 12 22:24:14.245341 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:14.245157 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1904869f-b574-4320-aab4-bfeaf06c63a8-cluster-monitoring-operator-tls podName:1904869f-b574-4320-aab4-bfeaf06c63a8 nodeName:}" failed. No retries permitted until 2026-06-12 22:24:18.245129036 +0000 UTC m=+258.116159148 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1904869f-b574-4320-aab4-bfeaf06c63a8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-rfqql" (UID: "1904869f-b574-4320-aab4-bfeaf06c63a8") : secret "cluster-monitoring-operator-tls" not found Jun 12 22:24:14.245341 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:14.245176 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-registry-tls podName:b27fbe24-270b-43e1-9500-2637e49768dd nodeName:}" failed. No retries permitted until 2026-06-12 22:24:18.245165868 +0000 UTC m=+258.116195975 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-registry-tls") pod "image-registry-65d8696b45-rq6wt" (UID: "b27fbe24-270b-43e1-9500-2637e49768dd") : secret "image-registry-tls" not found Jun 12 22:24:14.297822 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:14.297742 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7gx7p" event={"ID":"08ec4800-3d60-4d66-a897-2cb31f10284b","Type":"ContainerStarted","Data":"765a94d86f72d38c8788c8bd7fc0a5f0f9f6f033c27a4d63b94dec65b649b757"} Jun 12 22:24:14.299344 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:14.299317 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-77d7f" event={"ID":"313c738d-72a0-47ef-8eb1-c3e68c725e42","Type":"ContainerStarted","Data":"5f834bc6873ee73e5d582273d9f3c3d98914c018366595c0349e86bf50e6c412"} Jun 12 22:24:14.312938 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:14.312882 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7gx7p" podStartSLOduration=2.030338948 podStartE2EDuration="4.312869993s" totalImagesPullingTime="2.282531045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:24:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:24:14.311693558 +0000 UTC m=+254.182723680" watchObservedRunningTime="2026-06-12 22:24:14.312869993 +0000 UTC m=+254.183900114" Jun 12 22:24:14.329887 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:14.329845 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-77d7f" podStartSLOduration=1.946723789 podStartE2EDuration="4.329831808s" totalImagesPullingTime="2.383108019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:24:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:24:14.329208124 +0000 UTC m=+254.200238246" watchObservedRunningTime="2026-06-12 22:24:14.329831808 +0000 UTC m=+254.200861929" Jun 12 22:24:15.129776 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:15.129746 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qdfzw"] Jun 12 22:24:15.133068 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:15.133046 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:15.135733 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:15.135701 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 12 22:24:15.135733 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:15.135706 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 12 22:24:15.135936 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:15.135752 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fsx88\"" Jun 12 22:24:15.135936 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:15.135909 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 12 22:24:15.136896 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:15.136874 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 12 22:24:15.144696 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:15.144668 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qdfzw"] Jun 12 22:24:15.253929 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:15.253900 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-data-volume\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:15.254099 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:15.253941 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-crio-socket\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:15.254099 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:15.253963 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmjxw\" (UniqueName: \"kubernetes.io/projected/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-kube-api-access-lmjxw\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:15.254099 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:15.254082 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:15.254244 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:15.254134 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:15.355164 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:15.355122 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:15.355325 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:15.355187 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:15.355325 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:15.355251 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 22:24:15.355325 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:15.355298 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 22:24:15.355522 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:15.355328 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-kube-rbac-proxy-cm podName:986a3e0e-ee8a-432b-85c3-933cd9a7b3f3 nodeName:}" failed. No retries permitted until 2026-06-12 22:24:15.85530928 +0000 UTC m=+255.726339383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qdfzw" (UID: "986a3e0e-ee8a-432b-85c3-933cd9a7b3f3") : configmap "kube-rbac-proxy" not found Jun 12 22:24:15.355522 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:15.355402 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-data-volume\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:15.355522 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:15.355413 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-insights-runtime-extractor-tls podName:986a3e0e-ee8a-432b-85c3-933cd9a7b3f3 nodeName:}" failed. No retries permitted until 2026-06-12 22:24:15.855397093 +0000 UTC m=+255.726427195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qdfzw" (UID: "986a3e0e-ee8a-432b-85c3-933cd9a7b3f3") : secret "insights-runtime-extractor-tls" not found Jun 12 22:24:15.355522 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:15.355493 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-crio-socket\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:15.355741 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:15.355541 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmjxw\" (UniqueName: \"kubernetes.io/projected/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-kube-api-access-lmjxw\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:15.355741 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:15.355645 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-crio-socket\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:15.355741 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:15.355726 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-data-volume\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:15.367025 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:15.367004 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmjxw\" (UniqueName: \"kubernetes.io/projected/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-kube-api-access-lmjxw\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:15.859664 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:15.859627 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:15.859664 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:15.859671 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:15.859892 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:15.859750 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 22:24:15.859892 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:15.859808 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-kube-rbac-proxy-cm podName:986a3e0e-ee8a-432b-85c3-933cd9a7b3f3 nodeName:}" failed. No retries permitted until 2026-06-12 22:24:16.859794303 +0000 UTC m=+256.730824406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qdfzw" (UID: "986a3e0e-ee8a-432b-85c3-933cd9a7b3f3") : configmap "kube-rbac-proxy" not found Jun 12 22:24:15.859892 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:15.859850 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 22:24:15.860063 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:15.859921 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-insights-runtime-extractor-tls podName:986a3e0e-ee8a-432b-85c3-933cd9a7b3f3 nodeName:}" failed. No retries permitted until 2026-06-12 22:24:16.859899136 +0000 UTC m=+256.730929248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qdfzw" (UID: "986a3e0e-ee8a-432b-85c3-933cd9a7b3f3") : secret "insights-runtime-extractor-tls" not found Jun 12 22:24:16.868169 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:16.868135 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:16.868566 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:16.868177 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:16.868566 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:16.868289 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 22:24:16.868566 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:16.868335 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-insights-runtime-extractor-tls podName:986a3e0e-ee8a-432b-85c3-933cd9a7b3f3 nodeName:}" failed. No retries permitted until 2026-06-12 22:24:18.868321419 +0000 UTC m=+258.739351518 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qdfzw" (UID: "986a3e0e-ee8a-432b-85c3-933cd9a7b3f3") : secret "insights-runtime-extractor-tls" not found Jun 12 22:24:16.868566 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:16.868361 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 22:24:16.868566 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:16.868412 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-kube-rbac-proxy-cm podName:986a3e0e-ee8a-432b-85c3-933cd9a7b3f3 nodeName:}" failed. No retries permitted until 2026-06-12 22:24:18.868399847 +0000 UTC m=+258.739429951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qdfzw" (UID: "986a3e0e-ee8a-432b-85c3-933cd9a7b3f3") : configmap "kube-rbac-proxy" not found Jun 12 22:24:16.980968 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:16.980941 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8l9dt_9af1eca2-b583-43aa-83dc-cf6e62837d2c/dns-node-resolver/0.log" Jun 12 22:24:18.180168 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:18.180119 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a25ee990-41cb-4d78-b64c-88fca92d5368-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-fp4d9\" (UID: \"a25ee990-41cb-4d78-b64c-88fca92d5368\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-fp4d9" Jun 12 22:24:18.180577 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:18.180191 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba5689ea-c2bd-4358-9750-677d05eb96bb-metrics-certs\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:18.180577 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:18.180223 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/07c36375-213f-4d62-8784-35df74e77d7b-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-rxlgh\" (UID: \"07c36375-213f-4d62-8784-35df74e77d7b\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-rxlgh" Jun 12 22:24:18.180577 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:18.180244 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba5689ea-c2bd-4358-9750-677d05eb96bb-service-ca-bundle\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:18.180577 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:18.180295 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 12 22:24:18.180577 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:18.180320 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 22:24:18.180577 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:18.180346 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba5689ea-c2bd-4358-9750-677d05eb96bb-service-ca-bundle podName:ba5689ea-c2bd-4358-9750-677d05eb96bb nodeName:}" failed. No retries permitted until 2026-06-12 22:24:26.180332445 +0000 UTC m=+266.051362544 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba5689ea-c2bd-4358-9750-677d05eb96bb-service-ca-bundle") pod "router-default-74964b6f74-tmcld" (UID: "ba5689ea-c2bd-4358-9750-677d05eb96bb") : configmap references non-existent config key: service-ca.crt Jun 12 22:24:18.180577 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:18.180349 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 22:24:18.180577 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:18.180362 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a25ee990-41cb-4d78-b64c-88fca92d5368-samples-operator-tls podName:a25ee990-41cb-4d78-b64c-88fca92d5368 nodeName:}" failed. No retries permitted until 2026-06-12 22:24:26.180354398 +0000 UTC m=+266.051384498 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a25ee990-41cb-4d78-b64c-88fca92d5368-samples-operator-tls") pod "cluster-samples-operator-9547488fd-fp4d9" (UID: "a25ee990-41cb-4d78-b64c-88fca92d5368") : secret "samples-operator-tls" not found Jun 12 22:24:18.180577 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:18.180371 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba5689ea-c2bd-4358-9750-677d05eb96bb-metrics-certs podName:ba5689ea-c2bd-4358-9750-677d05eb96bb nodeName:}" failed. No retries permitted until 2026-06-12 22:24:26.180366601 +0000 UTC m=+266.051396699 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba5689ea-c2bd-4358-9750-677d05eb96bb-metrics-certs") pod "router-default-74964b6f74-tmcld" (UID: "ba5689ea-c2bd-4358-9750-677d05eb96bb") : secret "router-metrics-certs-default" not found Jun 12 22:24:18.180577 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:18.180393 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07c36375-213f-4d62-8784-35df74e77d7b-networking-console-plugin-cert podName:07c36375-213f-4d62-8784-35df74e77d7b nodeName:}" failed. No retries permitted until 2026-06-12 22:24:26.180378926 +0000 UTC m=+266.051409025 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/07c36375-213f-4d62-8784-35df74e77d7b-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-rxlgh" (UID: "07c36375-213f-4d62-8784-35df74e77d7b") : secret "networking-console-plugin-cert" not found Jun 12 22:24:18.281023 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:18.280991 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-registry-tls\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:18.281158 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:18.281066 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1904869f-b574-4320-aab4-bfeaf06c63a8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-rfqql\" (UID: \"1904869f-b574-4320-aab4-bfeaf06c63a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-rfqql" Jun 12 22:24:18.281158 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:18.281146 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 22:24:18.281226 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:18.281166 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65d8696b45-rq6wt: secret "image-registry-tls" not found Jun 12 22:24:18.281226 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:18.281217 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-registry-tls podName:b27fbe24-270b-43e1-9500-2637e49768dd nodeName:}" failed. No retries permitted until 2026-06-12 22:24:26.281202786 +0000 UTC m=+266.152232888 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-registry-tls") pod "image-registry-65d8696b45-rq6wt" (UID: "b27fbe24-270b-43e1-9500-2637e49768dd") : secret "image-registry-tls" not found Jun 12 22:24:18.281226 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:18.281215 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 22:24:18.281328 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:18.281244 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1904869f-b574-4320-aab4-bfeaf06c63a8-cluster-monitoring-operator-tls podName:1904869f-b574-4320-aab4-bfeaf06c63a8 nodeName:}" failed. No retries permitted until 2026-06-12 22:24:26.281238595 +0000 UTC m=+266.152268693 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1904869f-b574-4320-aab4-bfeaf06c63a8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-rfqql" (UID: "1904869f-b574-4320-aab4-bfeaf06c63a8") : secret "cluster-monitoring-operator-tls" not found Jun 12 22:24:18.380445 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:18.380416 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zpg7d_26b5ec6b-bd2c-4920-8737-a43044a3d820/node-ca/0.log" Jun 12 22:24:18.780488 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:18.780462 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8s5t8_d54c5b13-ba6f-4fd5-8c27-d15c4900af5f/serve-healthcheck-canary/0.log" Jun 12 22:24:18.885611 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:18.885573 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:18.885773 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:18.885620 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:18.885773 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:18.885691 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 22:24:18.885773 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:18.885754 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-kube-rbac-proxy-cm podName:986a3e0e-ee8a-432b-85c3-933cd9a7b3f3 nodeName:}" failed. No retries permitted until 2026-06-12 22:24:22.885738826 +0000 UTC m=+262.756768930 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qdfzw" (UID: "986a3e0e-ee8a-432b-85c3-933cd9a7b3f3") : configmap "kube-rbac-proxy" not found Jun 12 22:24:18.885903 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:18.885781 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 22:24:18.885903 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:18.885832 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-insights-runtime-extractor-tls podName:986a3e0e-ee8a-432b-85c3-933cd9a7b3f3 nodeName:}" failed. No retries permitted until 2026-06-12 22:24:22.885819562 +0000 UTC m=+262.756849661 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qdfzw" (UID: "986a3e0e-ee8a-432b-85c3-933cd9a7b3f3") : secret "insights-runtime-extractor-tls" not found Jun 12 22:24:22.918589 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:22.918553 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:22.918589 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:22.918602 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:22.919043 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:22.918684 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 22:24:22.919043 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:22.918697 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 22:24:22.919043 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:22.918750 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-kube-rbac-proxy-cm podName:986a3e0e-ee8a-432b-85c3-933cd9a7b3f3 nodeName:}" failed. No retries permitted until 2026-06-12 22:24:30.918735462 +0000 UTC m=+270.789765560 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qdfzw" (UID: "986a3e0e-ee8a-432b-85c3-933cd9a7b3f3") : configmap "kube-rbac-proxy" not found Jun 12 22:24:22.919043 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:22.918874 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-insights-runtime-extractor-tls podName:986a3e0e-ee8a-432b-85c3-933cd9a7b3f3 nodeName:}" failed. No retries permitted until 2026-06-12 22:24:30.918861677 +0000 UTC m=+270.789891780 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qdfzw" (UID: "986a3e0e-ee8a-432b-85c3-933cd9a7b3f3") : secret "insights-runtime-extractor-tls" not found Jun 12 22:24:26.248883 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:26.248842 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/07c36375-213f-4d62-8784-35df74e77d7b-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-rxlgh\" (UID: \"07c36375-213f-4d62-8784-35df74e77d7b\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-rxlgh" Jun 12 22:24:26.249415 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:26.248895 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba5689ea-c2bd-4358-9750-677d05eb96bb-service-ca-bundle\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:26.249415 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:26.248986 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 22:24:26.249415 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:26.248989 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a25ee990-41cb-4d78-b64c-88fca92d5368-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-fp4d9\" (UID: \"a25ee990-41cb-4d78-b64c-88fca92d5368\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-fp4d9" Jun 12 22:24:26.249415 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:26.249058 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba5689ea-c2bd-4358-9750-677d05eb96bb-service-ca-bundle podName:ba5689ea-c2bd-4358-9750-677d05eb96bb nodeName:}" failed. No retries permitted until 2026-06-12 22:24:42.249042175 +0000 UTC m=+282.120072277 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba5689ea-c2bd-4358-9750-677d05eb96bb-service-ca-bundle") pod "router-default-74964b6f74-tmcld" (UID: "ba5689ea-c2bd-4358-9750-677d05eb96bb") : configmap references non-existent config key: service-ca.crt Jun 12 22:24:26.249415 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:26.249137 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07c36375-213f-4d62-8784-35df74e77d7b-networking-console-plugin-cert podName:07c36375-213f-4d62-8784-35df74e77d7b nodeName:}" failed. No retries permitted until 2026-06-12 22:24:42.249113248 +0000 UTC m=+282.120143366 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/07c36375-213f-4d62-8784-35df74e77d7b-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-rxlgh" (UID: "07c36375-213f-4d62-8784-35df74e77d7b") : secret "networking-console-plugin-cert" not found Jun 12 22:24:26.249415 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:26.249210 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba5689ea-c2bd-4358-9750-677d05eb96bb-metrics-certs\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:26.251369 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:26.251348 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a25ee990-41cb-4d78-b64c-88fca92d5368-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-fp4d9\" (UID: \"a25ee990-41cb-4d78-b64c-88fca92d5368\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-fp4d9" Jun 12 22:24:26.251595 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:26.251576 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba5689ea-c2bd-4358-9750-677d05eb96bb-metrics-certs\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:26.334774 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:26.334736 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-fp4d9" Jun 12 22:24:26.350225 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:26.350188 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1904869f-b574-4320-aab4-bfeaf06c63a8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-rfqql\" (UID: \"1904869f-b574-4320-aab4-bfeaf06c63a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-rfqql" Jun 12 22:24:26.350460 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:26.350347 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-registry-tls\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:26.350460 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:26.350359 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 22:24:26.350460 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:26.350447 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1904869f-b574-4320-aab4-bfeaf06c63a8-cluster-monitoring-operator-tls podName:1904869f-b574-4320-aab4-bfeaf06c63a8 nodeName:}" failed. No retries permitted until 2026-06-12 22:24:42.350410044 +0000 UTC m=+282.221440146 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1904869f-b574-4320-aab4-bfeaf06c63a8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-rfqql" (UID: "1904869f-b574-4320-aab4-bfeaf06c63a8") : secret "cluster-monitoring-operator-tls" not found Jun 12 22:24:26.352759 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:26.352735 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-registry-tls\") pod \"image-registry-65d8696b45-rq6wt\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:26.431926 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:26.431896 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:26.463341 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:26.463305 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-fp4d9"] Jun 12 22:24:26.565663 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:26.565636 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65d8696b45-rq6wt"] Jun 12 22:24:26.567952 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:24:26.567922 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb27fbe24_270b_43e1_9500_2637e49768dd.slice/crio-38052b7e35df564145381e6f1dd4fe7906f4254f84ec3950729e12b380532feb WatchSource:0}: Error finding container 38052b7e35df564145381e6f1dd4fe7906f4254f84ec3950729e12b380532feb: Status 404 returned error can't find the container with id 38052b7e35df564145381e6f1dd4fe7906f4254f84ec3950729e12b380532feb Jun 12 22:24:27.341731 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:27.341687 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-fp4d9" event={"ID":"a25ee990-41cb-4d78-b64c-88fca92d5368","Type":"ContainerStarted","Data":"e8e8867ef8c735598fb8a32a84901c335f239c9e63d3366501d89a57de588683"} Jun 12 22:24:27.343248 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:27.343216 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" event={"ID":"b27fbe24-270b-43e1-9500-2637e49768dd","Type":"ContainerStarted","Data":"9983def5e7bfc87b0ad3838591ccefc0d9c91f814209eec8e79f3384ad85c66e"} Jun 12 22:24:27.343384 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:27.343267 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" event={"ID":"b27fbe24-270b-43e1-9500-2637e49768dd","Type":"ContainerStarted","Data":"38052b7e35df564145381e6f1dd4fe7906f4254f84ec3950729e12b380532feb"} Jun 12 22:24:27.343384 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:27.343339 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:27.363922 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:27.363870 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" podStartSLOduration=17.363850729 podStartE2EDuration="17.363850729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:24:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:24:27.363590306 +0000 UTC m=+267.234620454" watchObservedRunningTime="2026-06-12 22:24:27.363850729 +0000 UTC m=+267.234880844" Jun 12 22:24:28.349677 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:28.349633 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-fp4d9" event={"ID":"a25ee990-41cb-4d78-b64c-88fca92d5368","Type":"ContainerStarted","Data":"41f08b1ad7aa3618aa3a831aa304f3621a46816aaca0236272fc86efb2a1d52a"} Jun 12 22:24:28.350133 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:28.349705 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-fp4d9" event={"ID":"a25ee990-41cb-4d78-b64c-88fca92d5368","Type":"ContainerStarted","Data":"a416d2afe81181e3e4d63ebb1c43ac782cb0c047a187e24341b8ff8244fdc6e3"} Jun 12 22:24:28.368021 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:28.367980 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-fp4d9" podStartSLOduration=16.688423511 podStartE2EDuration="18.367965358s" totalImagesPullingTime="1.679541847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:24:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:24:28.36715902 +0000 UTC m=+268.238189141" watchObservedRunningTime="2026-06-12 22:24:28.367965358 +0000 UTC m=+268.238995480" Jun 12 22:24:30.991306 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:30.991271 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:30.991825 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:30.991323 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:30.991825 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:30.991455 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 22:24:30.991825 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:30.991536 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-insights-runtime-extractor-tls podName:986a3e0e-ee8a-432b-85c3-933cd9a7b3f3 nodeName:}" failed. No retries permitted until 2026-06-12 22:24:46.991517959 +0000 UTC m=+286.862548075 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qdfzw" (UID: "986a3e0e-ee8a-432b-85c3-933cd9a7b3f3") : secret "insights-runtime-extractor-tls" not found Jun 12 22:24:30.991989 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:30.991833 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:38.670332 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:38.670291 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65d8696b45-rq6wt"] Jun 12 22:24:41.058368 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:41.058325 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bgplx" podUID="97c3a625-9d8c-402e-9a2b-58626ea31c58" Jun 12 22:24:41.387884 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:41.387793 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bgplx" Jun 12 22:24:42.283756 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:42.283242 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/07c36375-213f-4d62-8784-35df74e77d7b-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-rxlgh\" (UID: \"07c36375-213f-4d62-8784-35df74e77d7b\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-rxlgh" Jun 12 22:24:42.283756 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:42.283315 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba5689ea-c2bd-4358-9750-677d05eb96bb-service-ca-bundle\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:42.285231 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:42.284802 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba5689ea-c2bd-4358-9750-677d05eb96bb-service-ca-bundle\") pod \"router-default-74964b6f74-tmcld\" (UID: \"ba5689ea-c2bd-4358-9750-677d05eb96bb\") " pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:42.287791 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:42.287765 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/07c36375-213f-4d62-8784-35df74e77d7b-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-rxlgh\" (UID: \"07c36375-213f-4d62-8784-35df74e77d7b\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-rxlgh" Jun 12 22:24:42.383708 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:42.383662 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1904869f-b574-4320-aab4-bfeaf06c63a8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-rfqql\" (UID: \"1904869f-b574-4320-aab4-bfeaf06c63a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-rfqql" Jun 12 22:24:42.386002 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:42.385973 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1904869f-b574-4320-aab4-bfeaf06c63a8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-rfqql\" (UID: \"1904869f-b574-4320-aab4-bfeaf06c63a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-rfqql" Jun 12 22:24:42.542122 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:42.542029 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-rxlgh" Jun 12 22:24:42.548259 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:42.548227 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:42.617293 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:42.617227 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-rfqql" Jun 12 22:24:42.733853 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:42.733772 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-rxlgh"] Jun 12 22:24:42.736845 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:24:42.736809 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07c36375_213f_4d62_8784_35df74e77d7b.slice/crio-a314ae2ea3d0c8181b8ab10f432a17a281c4d5a62c47220b37d93f03c5e820d1 WatchSource:0}: Error finding container a314ae2ea3d0c8181b8ab10f432a17a281c4d5a62c47220b37d93f03c5e820d1: Status 404 returned error can't find the container with id a314ae2ea3d0c8181b8ab10f432a17a281c4d5a62c47220b37d93f03c5e820d1 Jun 12 22:24:42.760802 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:42.760772 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-74964b6f74-tmcld"] Jun 12 22:24:42.764486 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:24:42.764459 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba5689ea_c2bd_4358_9750_677d05eb96bb.slice/crio-b75d02dc67918539cc3887a51fd8a0b93863806fb5e5d77ae98c17f34b0dde4f WatchSource:0}: Error finding container b75d02dc67918539cc3887a51fd8a0b93863806fb5e5d77ae98c17f34b0dde4f: Status 404 returned error can't find the container with id b75d02dc67918539cc3887a51fd8a0b93863806fb5e5d77ae98c17f34b0dde4f Jun 12 22:24:42.777015 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:42.776989 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-rfqql"] Jun 12 22:24:42.779601 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:24:42.779576 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1904869f_b574_4320_aab4_bfeaf06c63a8.slice/crio-0f006f09ff947f34c27af81118cea54ceaf114d10f2f63bf269bab75c71ce26e WatchSource:0}: Error finding container 0f006f09ff947f34c27af81118cea54ceaf114d10f2f63bf269bab75c71ce26e: Status 404 returned error can't find the container with id 0f006f09ff947f34c27af81118cea54ceaf114d10f2f63bf269bab75c71ce26e Jun 12 22:24:43.395718 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:43.395680 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-rfqql" event={"ID":"1904869f-b574-4320-aab4-bfeaf06c63a8","Type":"ContainerStarted","Data":"0f006f09ff947f34c27af81118cea54ceaf114d10f2f63bf269bab75c71ce26e"} Jun 12 22:24:43.397015 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:43.396960 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-rxlgh" event={"ID":"07c36375-213f-4d62-8784-35df74e77d7b","Type":"ContainerStarted","Data":"a314ae2ea3d0c8181b8ab10f432a17a281c4d5a62c47220b37d93f03c5e820d1"} Jun 12 22:24:43.398488 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:43.398463 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-74964b6f74-tmcld" event={"ID":"ba5689ea-c2bd-4358-9750-677d05eb96bb","Type":"ContainerStarted","Data":"4f23011dd6929923d37dbf9e339eddc32fc258dbd633a3f19ca4ada16bf9600e"} Jun 12 22:24:43.398606 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:43.398507 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-74964b6f74-tmcld" event={"ID":"ba5689ea-c2bd-4358-9750-677d05eb96bb","Type":"ContainerStarted","Data":"b75d02dc67918539cc3887a51fd8a0b93863806fb5e5d77ae98c17f34b0dde4f"} Jun 12 22:24:43.426732 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:43.426685 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-74964b6f74-tmcld" podStartSLOduration=33.426666704 podStartE2EDuration="33.426666704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:24:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:24:43.426171985 +0000 UTC m=+283.297202110" watchObservedRunningTime="2026-06-12 22:24:43.426666704 +0000 UTC m=+283.297696827" Jun 12 22:24:43.548744 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:43.548706 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:43.551361 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:43.551339 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:44.403381 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:44.403280 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-rxlgh" event={"ID":"07c36375-213f-4d62-8784-35df74e77d7b","Type":"ContainerStarted","Data":"5e2776f819105e4d5cd74c9ecb311af7be626d3ac9d2b3e1adad1e697ca68063"} Jun 12 22:24:44.403845 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:44.403793 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:44.404995 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:44.404974 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-74964b6f74-tmcld" Jun 12 22:24:44.421037 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:44.420990 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-rxlgh" podStartSLOduration=33.164464006 podStartE2EDuration="34.420974778s" totalImagesPullingTime="1.256510772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:24:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:24:44.419380769 +0000 UTC m=+284.290410890" watchObservedRunningTime="2026-06-12 22:24:44.420974778 +0000 UTC m=+284.292004899" Jun 12 22:24:44.905392 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:44.905361 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls\") pod \"dns-default-bgplx\" (UID: \"97c3a625-9d8c-402e-9a2b-58626ea31c58\") " pod="openshift-dns/dns-default-bgplx" Jun 12 22:24:44.907674 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:44.907652 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c3a625-9d8c-402e-9a2b-58626ea31c58-metrics-tls\") pod \"dns-default-bgplx\" (UID: \"97c3a625-9d8c-402e-9a2b-58626ea31c58\") " pod="openshift-dns/dns-default-bgplx" Jun 12 22:24:44.991734 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:44.991701 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cwxnw\"" Jun 12 22:24:44.999068 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:44.999051 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bgplx" Jun 12 22:24:45.134943 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:45.134910 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bgplx"] Jun 12 22:24:45.137853 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:24:45.137826 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c3a625_9d8c_402e_9a2b_58626ea31c58.slice/crio-27363b5cfe8dc61606835adfcf9baa927ad77ea3a8b74362b557c0d4e65e6bfb WatchSource:0}: Error finding container 27363b5cfe8dc61606835adfcf9baa927ad77ea3a8b74362b557c0d4e65e6bfb: Status 404 returned error can't find the container with id 27363b5cfe8dc61606835adfcf9baa927ad77ea3a8b74362b557c0d4e65e6bfb Jun 12 22:24:45.408112 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:45.408019 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bgplx" event={"ID":"97c3a625-9d8c-402e-9a2b-58626ea31c58","Type":"ContainerStarted","Data":"27363b5cfe8dc61606835adfcf9baa927ad77ea3a8b74362b557c0d4e65e6bfb"} Jun 12 22:24:45.409495 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:45.409463 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-rfqql" event={"ID":"1904869f-b574-4320-aab4-bfeaf06c63a8","Type":"ContainerStarted","Data":"4328b8c5ccb28365def2b3b6b90369a16f4c332c4fbc69024f6929f809dc06e7"} Jun 12 22:24:45.428215 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:45.428154 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-rfqql" podStartSLOduration=33.410495198 podStartE2EDuration="35.428136588s" totalImagesPullingTime="2.01764139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:24:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:24:45.427495425 +0000 UTC m=+285.298525566" watchObservedRunningTime="2026-06-12 22:24:45.428136588 +0000 UTC m=+285.299166712" Jun 12 22:24:47.024310 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:47.024252 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:47.029443 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:47.027506 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/986a3e0e-ee8a-432b-85c3-933cd9a7b3f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qdfzw\" (UID: \"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3\") " pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:47.242537 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:47.242452 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qdfzw" Jun 12 22:24:47.365960 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:47.365926 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qdfzw"] Jun 12 22:24:47.368953 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:24:47.368910 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod986a3e0e_ee8a_432b_85c3_933cd9a7b3f3.slice/crio-4856be1d467f292180844479e0d99c9c2f617c91eab2112d648fefd8d1ece6b4 WatchSource:0}: Error finding container 4856be1d467f292180844479e0d99c9c2f617c91eab2112d648fefd8d1ece6b4: Status 404 returned error can't find the container with id 4856be1d467f292180844479e0d99c9c2f617c91eab2112d648fefd8d1ece6b4 Jun 12 22:24:47.416985 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:47.416953 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qdfzw" event={"ID":"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3","Type":"ContainerStarted","Data":"4856be1d467f292180844479e0d99c9c2f617c91eab2112d648fefd8d1ece6b4"} Jun 12 22:24:47.418662 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:47.418636 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bgplx" event={"ID":"97c3a625-9d8c-402e-9a2b-58626ea31c58","Type":"ContainerStarted","Data":"fee5ccec572230551232f48cf11f416e05d0c380eebf6f6e9c2e0ab79aee7b3f"} Jun 12 22:24:47.418769 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:47.418676 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bgplx" event={"ID":"97c3a625-9d8c-402e-9a2b-58626ea31c58","Type":"ContainerStarted","Data":"437636fa2ca37de306f5076984d71b83f17b953f8744bd85db6ddf8215d2745d"} Jun 12 22:24:47.418885 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:47.418869 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bgplx" Jun 12 22:24:47.437873 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:47.437823 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bgplx" podStartSLOduration=251.656527339 podStartE2EDuration="4m13.437805824s" totalImagesPullingTime="1.781278485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:20:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:24:47.437580494 +0000 UTC m=+287.308610627" watchObservedRunningTime="2026-06-12 22:24:47.437805824 +0000 UTC m=+287.308835945" Jun 12 22:24:48.678346 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:48.678297 2558 patch_prober.go:28] interesting pod/image-registry-65d8696b45-rq6wt container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 22:24:48.678739 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:48.678372 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" podUID="b27fbe24-270b-43e1-9500-2637e49768dd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 22:24:51.436032 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:51.435998 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qdfzw" event={"ID":"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3","Type":"ContainerStarted","Data":"18bc63b54389f7bb240e11f4ab898f70d95c2b21f1bbfb275d87a10488b26728"} Jun 12 22:24:52.446471 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:52.446411 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qdfzw" event={"ID":"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3","Type":"ContainerStarted","Data":"f1c94054802bd146c95e6bc22ff0aba9017bcf3b5a5e5efed42c89caaeeb84e7"} Jun 12 22:24:53.451972 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.451939 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qdfzw" event={"ID":"986a3e0e-ee8a-432b-85c3-933cd9a7b3f3","Type":"ContainerStarted","Data":"b7f9ee85307d25c1300c6ec50e8401350729d3f51f9c02f035cef5fd48aef225"} Jun 12 22:24:53.473970 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.473794 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qdfzw" podStartSLOduration=32.659489918 podStartE2EDuration="38.473777658s" totalImagesPullingTime="5.81428774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:24:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:24:53.473412862 +0000 UTC m=+293.344442983" watchObservedRunningTime="2026-06-12 22:24:53.473777658 +0000 UTC m=+293.344807782" Jun 12 22:24:53.669074 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.668990 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-ll968"] Jun 12 22:24:53.672372 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.672355 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" Jun 12 22:24:53.675276 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.675251 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 12 22:24:53.675276 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.675262 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 12 22:24:53.675481 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.675293 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-x4xqs\"" Jun 12 22:24:53.675481 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.675302 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 12 22:24:53.675733 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.675716 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 12 22:24:53.687774 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.687750 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-ll968"] Jun 12 22:24:53.695311 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.695285 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7vc7d"] Jun 12 22:24:53.698396 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.698379 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.700811 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.700796 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 12 22:24:53.700985 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.700971 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 12 22:24:53.701039 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.700970 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 12 22:24:53.701124 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.701107 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kzsns\"" Jun 12 22:24:53.776661 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.776632 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9zfv\" (UniqueName: \"kubernetes.io/projected/2f1e2a26-d8dc-4585-926c-e781891246ae-kube-api-access-v9zfv\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.776661 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.776667 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f1e2a26-d8dc-4585-926c-e781891246ae-node-exporter-textfile\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.776886 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.776692 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f1e2a26-d8dc-4585-926c-e781891246ae-sys\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.776886 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.776755 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f1e2a26-d8dc-4585-926c-e781891246ae-root\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.776886 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.776782 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f1e2a26-d8dc-4585-926c-e781891246ae-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.776886 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.776801 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1da97937-b532-4753-bebb-ddac68b4de98-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-ll968\" (UID: \"1da97937-b532-4753-bebb-ddac68b4de98\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" Jun 12 22:24:53.776886 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.776820 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f1e2a26-d8dc-4585-926c-e781891246ae-node-exporter-wtmp\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.776886 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.776838 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1da97937-b532-4753-bebb-ddac68b4de98-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-ll968\" (UID: \"1da97937-b532-4753-bebb-ddac68b4de98\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" Jun 12 22:24:53.776886 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.776879 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f1e2a26-d8dc-4585-926c-e781891246ae-metrics-client-ca\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.777118 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.776928 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1da97937-b532-4753-bebb-ddac68b4de98-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-ll968\" (UID: \"1da97937-b532-4753-bebb-ddac68b4de98\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" Jun 12 22:24:53.777118 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.776947 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6h4g\" (UniqueName: \"kubernetes.io/projected/1da97937-b532-4753-bebb-ddac68b4de98-kube-api-access-c6h4g\") pod \"kube-state-metrics-678bc549d7-ll968\" (UID: \"1da97937-b532-4753-bebb-ddac68b4de98\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" Jun 12 22:24:53.777118 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.776985 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f1e2a26-d8dc-4585-926c-e781891246ae-node-exporter-tls\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.777118 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.777008 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1da97937-b532-4753-bebb-ddac68b4de98-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-ll968\" (UID: \"1da97937-b532-4753-bebb-ddac68b4de98\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" Jun 12 22:24:53.777118 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.777039 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f1e2a26-d8dc-4585-926c-e781891246ae-node-exporter-accelerators-collector-config\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.777118 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.777061 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1da97937-b532-4753-bebb-ddac68b4de98-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-ll968\" (UID: \"1da97937-b532-4753-bebb-ddac68b4de98\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" Jun 12 22:24:53.878026 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.877984 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f1e2a26-d8dc-4585-926c-e781891246ae-node-exporter-accelerators-collector-config\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.878026 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.878025 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1da97937-b532-4753-bebb-ddac68b4de98-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-ll968\" (UID: \"1da97937-b532-4753-bebb-ddac68b4de98\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" Jun 12 22:24:53.878249 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.878052 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9zfv\" (UniqueName: \"kubernetes.io/projected/2f1e2a26-d8dc-4585-926c-e781891246ae-kube-api-access-v9zfv\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.878249 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.878105 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f1e2a26-d8dc-4585-926c-e781891246ae-node-exporter-textfile\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.878249 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.878141 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f1e2a26-d8dc-4585-926c-e781891246ae-sys\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.878249 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.878163 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f1e2a26-d8dc-4585-926c-e781891246ae-root\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.878249 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.878186 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f1e2a26-d8dc-4585-926c-e781891246ae-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.878249 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.878208 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f1e2a26-d8dc-4585-926c-e781891246ae-sys\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.878249 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.878230 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1da97937-b532-4753-bebb-ddac68b4de98-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-ll968\" (UID: \"1da97937-b532-4753-bebb-ddac68b4de98\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" Jun 12 22:24:53.878609 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.878259 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f1e2a26-d8dc-4585-926c-e781891246ae-root\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.878609 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.878291 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f1e2a26-d8dc-4585-926c-e781891246ae-node-exporter-wtmp\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.878609 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.878317 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1da97937-b532-4753-bebb-ddac68b4de98-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-ll968\" (UID: \"1da97937-b532-4753-bebb-ddac68b4de98\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" Jun 12 22:24:53.878609 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.878353 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f1e2a26-d8dc-4585-926c-e781891246ae-metrics-client-ca\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.878609 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.878453 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1da97937-b532-4753-bebb-ddac68b4de98-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-ll968\" (UID: \"1da97937-b532-4753-bebb-ddac68b4de98\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" Jun 12 22:24:53.878609 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.878483 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f1e2a26-d8dc-4585-926c-e781891246ae-node-exporter-wtmp\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.878609 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.878490 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6h4g\" (UniqueName: \"kubernetes.io/projected/1da97937-b532-4753-bebb-ddac68b4de98-kube-api-access-c6h4g\") pod \"kube-state-metrics-678bc549d7-ll968\" (UID: \"1da97937-b532-4753-bebb-ddac68b4de98\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" Jun 12 22:24:53.878609 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.878535 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f1e2a26-d8dc-4585-926c-e781891246ae-node-exporter-tls\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.878609 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.878577 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1da97937-b532-4753-bebb-ddac68b4de98-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-ll968\" (UID: \"1da97937-b532-4753-bebb-ddac68b4de98\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" Jun 12 22:24:53.879033 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.878635 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1da97937-b532-4753-bebb-ddac68b4de98-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-ll968\" (UID: \"1da97937-b532-4753-bebb-ddac68b4de98\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" Jun 12 22:24:53.879033 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.878638 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f1e2a26-d8dc-4585-926c-e781891246ae-node-exporter-textfile\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.879033 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:53.878754 2558 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 12 22:24:53.879033 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:53.878807 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da97937-b532-4753-bebb-ddac68b4de98-kube-state-metrics-tls podName:1da97937-b532-4753-bebb-ddac68b4de98 nodeName:}" failed. No retries permitted until 2026-06-12 22:24:54.378788832 +0000 UTC m=+294.249818932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1da97937-b532-4753-bebb-ddac68b4de98-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-ll968" (UID: "1da97937-b532-4753-bebb-ddac68b4de98") : secret "kube-state-metrics-tls" not found Jun 12 22:24:53.879033 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.878836 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f1e2a26-d8dc-4585-926c-e781891246ae-node-exporter-accelerators-collector-config\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.879263 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.879176 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f1e2a26-d8dc-4585-926c-e781891246ae-metrics-client-ca\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.879547 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.879527 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1da97937-b532-4753-bebb-ddac68b4de98-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-ll968\" (UID: \"1da97937-b532-4753-bebb-ddac68b4de98\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" Jun 12 22:24:53.879588 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.879552 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1da97937-b532-4753-bebb-ddac68b4de98-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-ll968\" (UID: \"1da97937-b532-4753-bebb-ddac68b4de98\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" Jun 12 22:24:53.880650 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.880633 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f1e2a26-d8dc-4585-926c-e781891246ae-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.881212 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.881192 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f1e2a26-d8dc-4585-926c-e781891246ae-node-exporter-tls\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.881260 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.881208 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1da97937-b532-4753-bebb-ddac68b4de98-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-ll968\" (UID: \"1da97937-b532-4753-bebb-ddac68b4de98\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" Jun 12 22:24:53.885288 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.885266 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9zfv\" (UniqueName: \"kubernetes.io/projected/2f1e2a26-d8dc-4585-926c-e781891246ae-kube-api-access-v9zfv\") pod \"node-exporter-7vc7d\" (UID: \"2f1e2a26-d8dc-4585-926c-e781891246ae\") " pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:53.888931 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:53.888908 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6h4g\" (UniqueName: \"kubernetes.io/projected/1da97937-b532-4753-bebb-ddac68b4de98-kube-api-access-c6h4g\") pod \"kube-state-metrics-678bc549d7-ll968\" (UID: \"1da97937-b532-4753-bebb-ddac68b4de98\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" Jun 12 22:24:54.007176 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.007151 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7vc7d" Jun 12 22:24:54.018753 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:24:54.018714 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f1e2a26_d8dc_4585_926c_e781891246ae.slice/crio-53bc27307660904232e0efa7aea72154603cf28e6b611c4290c97b9b51d3c58d WatchSource:0}: Error finding container 53bc27307660904232e0efa7aea72154603cf28e6b611c4290c97b9b51d3c58d: Status 404 returned error can't find the container with id 53bc27307660904232e0efa7aea72154603cf28e6b611c4290c97b9b51d3c58d Jun 12 22:24:54.383068 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.382981 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1da97937-b532-4753-bebb-ddac68b4de98-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-ll968\" (UID: \"1da97937-b532-4753-bebb-ddac68b4de98\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" Jun 12 22:24:54.385493 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.385467 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1da97937-b532-4753-bebb-ddac68b4de98-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-ll968\" (UID: \"1da97937-b532-4753-bebb-ddac68b4de98\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" Jun 12 22:24:54.456709 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.456675 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7vc7d" event={"ID":"2f1e2a26-d8dc-4585-926c-e781891246ae","Type":"ContainerStarted","Data":"53bc27307660904232e0efa7aea72154603cf28e6b611c4290c97b9b51d3c58d"} Jun 12 22:24:54.581835 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.581807 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" Jun 12 22:24:54.741089 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.741055 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 22:24:54.745773 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.745749 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.749181 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.749151 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 12 22:24:54.749307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.749258 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 12 22:24:54.749420 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.749404 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-g7ssb\"" Jun 12 22:24:54.750106 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.750084 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 12 22:24:54.750940 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.750627 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 12 22:24:54.750940 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.750794 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 12 22:24:54.751094 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.751043 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 12 22:24:54.751262 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.751243 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 12 22:24:54.752613 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.752593 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 12 22:24:54.752752 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.752615 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-ll968"] Jun 12 22:24:54.752905 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.752857 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 12 22:24:54.755331 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:24:54.755296 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1da97937_b532_4753_bebb_ddac68b4de98.slice/crio-14c6d6b8be70088a033e1b5abd319b6b9b6c46885ad13de10b3fbd657e7aa1fa WatchSource:0}: Error finding container 14c6d6b8be70088a033e1b5abd319b6b9b6c46885ad13de10b3fbd657e7aa1fa: Status 404 returned error can't find the container with id 14c6d6b8be70088a033e1b5abd319b6b9b6c46885ad13de10b3fbd657e7aa1fa Jun 12 22:24:54.770113 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.770087 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 22:24:54.787357 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.787329 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/978305f8-aa11-445c-a27c-058443bb27fe-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.787357 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.787361 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbknh\" (UniqueName: \"kubernetes.io/projected/978305f8-aa11-445c-a27c-058443bb27fe-kube-api-access-jbknh\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.787584 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.787395 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/978305f8-aa11-445c-a27c-058443bb27fe-config-out\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.787584 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.787424 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-web-config\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.787584 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.787478 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/978305f8-aa11-445c-a27c-058443bb27fe-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.787584 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.787536 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.787584 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.787574 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/978305f8-aa11-445c-a27c-058443bb27fe-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.787768 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.787643 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.787768 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.787680 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.787768 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.787711 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.787768 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.787758 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/978305f8-aa11-445c-a27c-058443bb27fe-tls-assets\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.787905 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.787803 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.787905 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.787835 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-config-volume\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.888415 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.888377 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.888615 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.888423 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-config-volume\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.888615 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.888477 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/978305f8-aa11-445c-a27c-058443bb27fe-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.888615 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.888500 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbknh\" (UniqueName: \"kubernetes.io/projected/978305f8-aa11-445c-a27c-058443bb27fe-kube-api-access-jbknh\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.888615 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.888540 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/978305f8-aa11-445c-a27c-058443bb27fe-config-out\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.888615 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.888582 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-web-config\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.888845 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.888619 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/978305f8-aa11-445c-a27c-058443bb27fe-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.888845 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.888648 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.888845 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.888671 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/978305f8-aa11-445c-a27c-058443bb27fe-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.888845 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.888715 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.888845 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.888745 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.888845 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.888777 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.888845 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.888805 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/978305f8-aa11-445c-a27c-058443bb27fe-tls-assets\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.890945 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.889860 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/978305f8-aa11-445c-a27c-058443bb27fe-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.890945 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.890345 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/978305f8-aa11-445c-a27c-058443bb27fe-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.890945 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.890633 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/978305f8-aa11-445c-a27c-058443bb27fe-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.893883 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.893807 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.895319 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.894666 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.895319 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.895105 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.895319 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.895283 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/978305f8-aa11-445c-a27c-058443bb27fe-config-out\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.895588 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.895562 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/978305f8-aa11-445c-a27c-058443bb27fe-tls-assets\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.895652 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.895594 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.896422 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.896384 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-config-volume\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.897456 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.897400 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.897776 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.897753 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-web-config\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:54.899955 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:54.899933 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbknh\" (UniqueName: \"kubernetes.io/projected/978305f8-aa11-445c-a27c-058443bb27fe-kube-api-access-jbknh\") pod \"alertmanager-main-0\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:55.065869 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:55.065836 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:24:55.213766 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:55.213734 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 22:24:55.217606 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:24:55.217576 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod978305f8_aa11_445c_a27c_058443bb27fe.slice/crio-19845b5b5cdd3c61d46323d7fc8f2f1457270b3539cd76946c3fea9d73e0e0b2 WatchSource:0}: Error finding container 19845b5b5cdd3c61d46323d7fc8f2f1457270b3539cd76946c3fea9d73e0e0b2: Status 404 returned error can't find the container with id 19845b5b5cdd3c61d46323d7fc8f2f1457270b3539cd76946c3fea9d73e0e0b2 Jun 12 22:24:55.467583 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:55.467480 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"978305f8-aa11-445c-a27c-058443bb27fe","Type":"ContainerStarted","Data":"19845b5b5cdd3c61d46323d7fc8f2f1457270b3539cd76946c3fea9d73e0e0b2"} Jun 12 22:24:55.469274 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:55.469236 2558 generic.go:356] "Generic (PLEG): container finished" podID="2f1e2a26-d8dc-4585-926c-e781891246ae" containerID="9c228d8a7dafb111e72218b048c6053641aafb474a6705a70c59c5d4dee7beb5" exitCode=0 Jun 12 22:24:55.469396 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:55.469330 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7vc7d" event={"ID":"2f1e2a26-d8dc-4585-926c-e781891246ae","Type":"ContainerDied","Data":"9c228d8a7dafb111e72218b048c6053641aafb474a6705a70c59c5d4dee7beb5"} Jun 12 22:24:55.470595 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:55.470573 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" event={"ID":"1da97937-b532-4753-bebb-ddac68b4de98","Type":"ContainerStarted","Data":"14c6d6b8be70088a033e1b5abd319b6b9b6c46885ad13de10b3fbd657e7aa1fa"} Jun 12 22:24:55.569690 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:24:55.569645 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lqpxm" podUID="5707213e-da61-4306-96d0-03a1790eb281" Jun 12 22:24:56.477573 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.477479 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7vc7d" event={"ID":"2f1e2a26-d8dc-4585-926c-e781891246ae","Type":"ContainerStarted","Data":"df9d545e69bb87aef5e98f21bc3ad1dc3459439cc18b1861f7413bcb2bed935f"} Jun 12 22:24:56.477573 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.477546 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7vc7d" event={"ID":"2f1e2a26-d8dc-4585-926c-e781891246ae","Type":"ContainerStarted","Data":"29ab79516dd70bb6125446ed3c00bc6a81b18f6d55b3dc0aeea5a267b42d028f"} Jun 12 22:24:56.480010 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.479972 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" event={"ID":"1da97937-b532-4753-bebb-ddac68b4de98","Type":"ContainerStarted","Data":"af85ca32ccc2b81db7f50b21d69775f8aa5c63ca00415d24cadfeb3ee7c822c0"} Jun 12 22:24:56.480153 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.480026 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" event={"ID":"1da97937-b532-4753-bebb-ddac68b4de98","Type":"ContainerStarted","Data":"9c423a10b0ac25a1af4c314095e7066a1e93294da28edbf27c2d7366b83e48c5"} Jun 12 22:24:56.480153 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.480057 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" event={"ID":"1da97937-b532-4753-bebb-ddac68b4de98","Type":"ContainerStarted","Data":"5fbbf70329e52a0b6d2e052c195bd17872475f5516f3c8f5f117ba34939a7e39"} Jun 12 22:24:56.496068 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.496013 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7vc7d" podStartSLOduration=2.3721626000000002 podStartE2EDuration="3.495997254s" totalImagesPullingTime="1.055260336s" totalInitContainerRuntime="68.574318ms" isStatefulPod=true podCreationTimestamp="2026-06-12 22:24:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:24:56.494459579 +0000 UTC m=+296.365489700" watchObservedRunningTime="2026-06-12 22:24:56.495997254 +0000 UTC m=+296.367027383" Jun 12 22:24:56.513049 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.512984 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-ll968" podStartSLOduration=2.337271048 podStartE2EDuration="3.512968095s" totalImagesPullingTime="1.175697047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:24:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:24:56.512070988 +0000 UTC m=+296.383101131" watchObservedRunningTime="2026-06-12 22:24:56.512968095 +0000 UTC m=+296.383998218" Jun 12 22:24:56.643920 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.643888 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-847d8b76f8-dm6g8"] Jun 12 22:24:56.648932 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.648873 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:56.652040 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.652017 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 12 22:24:56.652255 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.652238 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 12 22:24:56.652489 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.652468 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 12 22:24:56.652606 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.652503 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ap0fafb2d67ms\"" Jun 12 22:24:56.652606 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.652558 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 12 22:24:56.652606 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.652584 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 12 22:24:56.652790 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.652558 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-99n2d\"" Jun 12 22:24:56.664680 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.664654 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-847d8b76f8-dm6g8"] Jun 12 22:24:56.705683 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.705659 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ce7d544-4c96-4b4f-85fd-06b21b1dad2d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-847d8b76f8-dm6g8\" (UID: \"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d\") " pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:56.705791 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.705700 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3ce7d544-4c96-4b4f-85fd-06b21b1dad2d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-847d8b76f8-dm6g8\" (UID: \"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d\") " pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:56.705791 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.705722 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x966\" (UniqueName: \"kubernetes.io/projected/3ce7d544-4c96-4b4f-85fd-06b21b1dad2d-kube-api-access-4x966\") pod \"thanos-querier-847d8b76f8-dm6g8\" (UID: \"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d\") " pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:56.705913 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.705788 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ce7d544-4c96-4b4f-85fd-06b21b1dad2d-metrics-client-ca\") pod \"thanos-querier-847d8b76f8-dm6g8\" (UID: \"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d\") " pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:56.705913 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.705842 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3ce7d544-4c96-4b4f-85fd-06b21b1dad2d-secret-grpc-tls\") pod \"thanos-querier-847d8b76f8-dm6g8\" (UID: \"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d\") " pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:56.705913 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.705875 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3ce7d544-4c96-4b4f-85fd-06b21b1dad2d-secret-thanos-querier-tls\") pod \"thanos-querier-847d8b76f8-dm6g8\" (UID: \"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d\") " pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:56.705913 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.705895 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ce7d544-4c96-4b4f-85fd-06b21b1dad2d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-847d8b76f8-dm6g8\" (UID: \"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d\") " pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:56.706103 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.705969 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3ce7d544-4c96-4b4f-85fd-06b21b1dad2d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-847d8b76f8-dm6g8\" (UID: \"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d\") " pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:56.806957 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.806917 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3ce7d544-4c96-4b4f-85fd-06b21b1dad2d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-847d8b76f8-dm6g8\" (UID: \"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d\") " pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:56.807175 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.807003 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x966\" (UniqueName: \"kubernetes.io/projected/3ce7d544-4c96-4b4f-85fd-06b21b1dad2d-kube-api-access-4x966\") pod \"thanos-querier-847d8b76f8-dm6g8\" (UID: \"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d\") " pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:56.807175 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.807059 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ce7d544-4c96-4b4f-85fd-06b21b1dad2d-metrics-client-ca\") pod \"thanos-querier-847d8b76f8-dm6g8\" (UID: \"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d\") " pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:56.807354 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.807331 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3ce7d544-4c96-4b4f-85fd-06b21b1dad2d-secret-grpc-tls\") pod \"thanos-querier-847d8b76f8-dm6g8\" (UID: \"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d\") " pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:56.807401 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.807378 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3ce7d544-4c96-4b4f-85fd-06b21b1dad2d-secret-thanos-querier-tls\") pod \"thanos-querier-847d8b76f8-dm6g8\" (UID: \"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d\") " pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:56.807484 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.807404 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ce7d544-4c96-4b4f-85fd-06b21b1dad2d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-847d8b76f8-dm6g8\" (UID: \"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d\") " pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:56.807542 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.807504 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3ce7d544-4c96-4b4f-85fd-06b21b1dad2d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-847d8b76f8-dm6g8\" (UID: \"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d\") " pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:56.807599 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.807571 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ce7d544-4c96-4b4f-85fd-06b21b1dad2d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-847d8b76f8-dm6g8\" (UID: \"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d\") " pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:56.807977 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.807920 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ce7d544-4c96-4b4f-85fd-06b21b1dad2d-metrics-client-ca\") pod \"thanos-querier-847d8b76f8-dm6g8\" (UID: \"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d\") " pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:56.809888 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.809855 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3ce7d544-4c96-4b4f-85fd-06b21b1dad2d-secret-thanos-querier-tls\") pod \"thanos-querier-847d8b76f8-dm6g8\" (UID: \"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d\") " pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:56.809888 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.809864 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3ce7d544-4c96-4b4f-85fd-06b21b1dad2d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-847d8b76f8-dm6g8\" (UID: \"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d\") " pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:56.810212 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.810184 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3ce7d544-4c96-4b4f-85fd-06b21b1dad2d-secret-grpc-tls\") pod \"thanos-querier-847d8b76f8-dm6g8\" (UID: \"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d\") " pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:56.810419 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.810402 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ce7d544-4c96-4b4f-85fd-06b21b1dad2d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-847d8b76f8-dm6g8\" (UID: \"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d\") " pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:56.810419 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.810410 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ce7d544-4c96-4b4f-85fd-06b21b1dad2d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-847d8b76f8-dm6g8\" (UID: \"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d\") " pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:56.810511 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.810499 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3ce7d544-4c96-4b4f-85fd-06b21b1dad2d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-847d8b76f8-dm6g8\" (UID: \"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d\") " pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:56.815270 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.815243 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x966\" (UniqueName: \"kubernetes.io/projected/3ce7d544-4c96-4b4f-85fd-06b21b1dad2d-kube-api-access-4x966\") pod \"thanos-querier-847d8b76f8-dm6g8\" (UID: \"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d\") " pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:56.969096 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:56.969061 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:24:57.104423 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:57.104352 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-847d8b76f8-dm6g8"] Jun 12 22:24:57.107261 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:24:57.107227 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ce7d544_4c96_4b4f_85fd_06b21b1dad2d.slice/crio-9b08970f5b880018f8fd34f18b21dbdd55374854e568c0af894df19d69353611 WatchSource:0}: Error finding container 9b08970f5b880018f8fd34f18b21dbdd55374854e568c0af894df19d69353611: Status 404 returned error can't find the container with id 9b08970f5b880018f8fd34f18b21dbdd55374854e568c0af894df19d69353611 Jun 12 22:24:57.426901 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:57.426818 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bgplx" Jun 12 22:24:57.490764 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:57.490725 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" event={"ID":"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d","Type":"ContainerStarted","Data":"9b08970f5b880018f8fd34f18b21dbdd55374854e568c0af894df19d69353611"} Jun 12 22:24:57.492363 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:57.492334 2558 generic.go:356] "Generic (PLEG): container finished" podID="978305f8-aa11-445c-a27c-058443bb27fe" containerID="8e72b84c544f51e7197c61840cb7740f799acb27090aa3ce5cbf0227cf596822" exitCode=0 Jun 12 22:24:57.492509 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:57.492409 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"978305f8-aa11-445c-a27c-058443bb27fe","Type":"ContainerDied","Data":"8e72b84c544f51e7197c61840cb7740f799acb27090aa3ce5cbf0227cf596822"} Jun 12 22:24:58.676410 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:58.676379 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:24:59.503976 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:59.503949 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" event={"ID":"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d","Type":"ContainerStarted","Data":"c0825a0f6a66d70314871181d937bacccb363be0f050231c2ce12ff11d6d9ccf"} Jun 12 22:24:59.504100 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:59.504033 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" event={"ID":"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d","Type":"ContainerStarted","Data":"d0261e9ad59cf504c7a47e91dffd5ddcb535fc1abb52032a941436c00c65099d"} Jun 12 22:24:59.506956 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:59.506935 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"978305f8-aa11-445c-a27c-058443bb27fe","Type":"ContainerStarted","Data":"f08f5127c71c02edfccae051354a7ee294e038161c64571a4733b399e4106ca3"} Jun 12 22:24:59.507040 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:24:59.506991 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"978305f8-aa11-445c-a27c-058443bb27fe","Type":"ContainerStarted","Data":"86b3228f4756b6f9a190f53b6fa9cf19a10da23ebb2d05a567a196f3cd73f40f"} Jun 12 22:25:00.528293 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:00.528252 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" event={"ID":"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d","Type":"ContainerStarted","Data":"c4e340c928a631125d59993da77daad44c90511d6862f56b419ce6c3c2d7a306"} Jun 12 22:25:00.528745 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:00.528375 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" event={"ID":"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d","Type":"ContainerStarted","Data":"11a649566f5584770e9ed1fe42b1e98e1b589e0e39e164bd8c92edcc7db23ba7"} Jun 12 22:25:00.528745 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:00.528423 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" event={"ID":"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d","Type":"ContainerStarted","Data":"a1cb9b3717e2041bca6d3ef5fd52de77ce9ed5ba037db6f391063e39933669b6"} Jun 12 22:25:00.532269 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:00.532228 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"978305f8-aa11-445c-a27c-058443bb27fe","Type":"ContainerStarted","Data":"63fb69f74cbe81a093c2db5960f3776d491f7e55ce5ade4c47ca13f56927d41c"} Jun 12 22:25:00.532402 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:00.532314 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"978305f8-aa11-445c-a27c-058443bb27fe","Type":"ContainerStarted","Data":"ba4a1b13531a69fee3683a2284374174a91d2866b63ed6fa67c9ee18b9508d4d"} Jun 12 22:25:00.532402 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:00.532352 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"978305f8-aa11-445c-a27c-058443bb27fe","Type":"ContainerStarted","Data":"ffd7c226476ebbe71630313f4426c1a4b0a42ef00fcef05236a8817949e4368e"} Jun 12 22:25:00.532402 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:00.532391 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"978305f8-aa11-445c-a27c-058443bb27fe","Type":"ContainerStarted","Data":"d2129fde80abc9258cc3618d33a5d8794a3128a640cb445141eea96515ed35e2"} Jun 12 22:25:00.555056 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:00.555034 2558 kubelet.go:1648] "Image garbage collection succeeded" Jun 12 22:25:00.562370 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:00.562217 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.624794974 podStartE2EDuration="6.562200195s" totalImagesPullingTime="3.917873101s" totalInitContainerRuntime="19.53212ms" isStatefulPod=false podCreationTimestamp="2026-06-12 22:24:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:25:00.559666172 +0000 UTC m=+300.430696320" watchObservedRunningTime="2026-06-12 22:25:00.562200195 +0000 UTC m=+300.433230365" Jun 12 22:25:01.544165 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:01.544119 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" event={"ID":"3ce7d544-4c96-4b4f-85fd-06b21b1dad2d","Type":"ContainerStarted","Data":"f8f692b6a39d0585ed484c1a37dd5bb8b364ab64efd7aba5a09dfffbca2523b5"} Jun 12 22:25:01.544682 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:01.544601 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:25:01.573332 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:01.573280 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" podStartSLOduration=2.541863253 podStartE2EDuration="5.573267256s" totalImagesPullingTime="3.031404003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:24:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:25:01.571767745 +0000 UTC m=+301.442797879" watchObservedRunningTime="2026-06-12 22:25:01.573267256 +0000 UTC m=+301.444297411" Jun 12 22:25:03.691361 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:03.691323 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" podUID="b27fbe24-270b-43e1-9500-2637e49768dd" containerName="registry" containerID="cri-o://9983def5e7bfc87b0ad3838591ccefc0d9c91f814209eec8e79f3384ad85c66e" gracePeriod=30 Jun 12 22:25:03.932322 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:03.932297 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:25:03.974372 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:03.974291 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cb6sh\" (UniqueName: \"kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-kube-api-access-cb6sh\") pod \"b27fbe24-270b-43e1-9500-2637e49768dd\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " Jun 12 22:25:03.974372 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:03.974332 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b27fbe24-270b-43e1-9500-2637e49768dd-trusted-ca\") pod \"b27fbe24-270b-43e1-9500-2637e49768dd\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " Jun 12 22:25:03.974372 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:03.974354 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-bound-sa-token\") pod \"b27fbe24-270b-43e1-9500-2637e49768dd\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " Jun 12 22:25:03.974671 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:03.974381 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b27fbe24-270b-43e1-9500-2637e49768dd-installation-pull-secrets\") pod \"b27fbe24-270b-43e1-9500-2637e49768dd\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " Jun 12 22:25:03.974671 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:03.974471 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b27fbe24-270b-43e1-9500-2637e49768dd-image-registry-private-configuration\") pod \"b27fbe24-270b-43e1-9500-2637e49768dd\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " Jun 12 22:25:03.974671 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:03.974529 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-registry-tls\") pod \"b27fbe24-270b-43e1-9500-2637e49768dd\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " Jun 12 22:25:03.974671 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:03.974580 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b27fbe24-270b-43e1-9500-2637e49768dd-ca-trust-extracted\") pod \"b27fbe24-270b-43e1-9500-2637e49768dd\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " Jun 12 22:25:03.974671 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:03.974618 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b27fbe24-270b-43e1-9500-2637e49768dd-registry-certificates\") pod \"b27fbe24-270b-43e1-9500-2637e49768dd\" (UID: \"b27fbe24-270b-43e1-9500-2637e49768dd\") " Jun 12 22:25:03.974919 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:03.974821 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b27fbe24-270b-43e1-9500-2637e49768dd-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b27fbe24-270b-43e1-9500-2637e49768dd" (UID: "b27fbe24-270b-43e1-9500-2637e49768dd"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:25:03.974987 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:03.974965 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b27fbe24-270b-43e1-9500-2637e49768dd-trusted-ca\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:25:03.975204 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:03.975170 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b27fbe24-270b-43e1-9500-2637e49768dd-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b27fbe24-270b-43e1-9500-2637e49768dd" (UID: "b27fbe24-270b-43e1-9500-2637e49768dd"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:25:03.976954 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:03.976925 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b27fbe24-270b-43e1-9500-2637e49768dd-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b27fbe24-270b-43e1-9500-2637e49768dd" (UID: "b27fbe24-270b-43e1-9500-2637e49768dd"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:25:03.977051 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:03.976957 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-kube-api-access-cb6sh" (OuterVolumeSpecName: "kube-api-access-cb6sh") pod "b27fbe24-270b-43e1-9500-2637e49768dd" (UID: "b27fbe24-270b-43e1-9500-2637e49768dd"). InnerVolumeSpecName "kube-api-access-cb6sh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:25:03.977051 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:03.977040 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b27fbe24-270b-43e1-9500-2637e49768dd" (UID: "b27fbe24-270b-43e1-9500-2637e49768dd"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:25:03.977150 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:03.977064 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b27fbe24-270b-43e1-9500-2637e49768dd" (UID: "b27fbe24-270b-43e1-9500-2637e49768dd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:25:03.977361 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:03.977334 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b27fbe24-270b-43e1-9500-2637e49768dd-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b27fbe24-270b-43e1-9500-2637e49768dd" (UID: "b27fbe24-270b-43e1-9500-2637e49768dd"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:25:03.983273 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:03.983252 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27fbe24-270b-43e1-9500-2637e49768dd-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b27fbe24-270b-43e1-9500-2637e49768dd" (UID: "b27fbe24-270b-43e1-9500-2637e49768dd"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:25:04.075396 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:04.075359 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cb6sh\" (UniqueName: \"kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-kube-api-access-cb6sh\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:25:04.075396 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:04.075387 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-bound-sa-token\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:25:04.075396 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:04.075397 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b27fbe24-270b-43e1-9500-2637e49768dd-installation-pull-secrets\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:25:04.075649 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:04.075409 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b27fbe24-270b-43e1-9500-2637e49768dd-image-registry-private-configuration\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:25:04.075649 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:04.075419 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b27fbe24-270b-43e1-9500-2637e49768dd-registry-tls\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:25:04.075649 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:04.075456 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b27fbe24-270b-43e1-9500-2637e49768dd-ca-trust-extracted\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:25:04.075649 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:04.075471 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b27fbe24-270b-43e1-9500-2637e49768dd-registry-certificates\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:25:04.556153 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:04.556118 2558 generic.go:356] "Generic (PLEG): container finished" podID="b27fbe24-270b-43e1-9500-2637e49768dd" containerID="9983def5e7bfc87b0ad3838591ccefc0d9c91f814209eec8e79f3384ad85c66e" exitCode=0 Jun 12 22:25:04.556153 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:04.556156 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" event={"ID":"b27fbe24-270b-43e1-9500-2637e49768dd","Type":"ContainerDied","Data":"9983def5e7bfc87b0ad3838591ccefc0d9c91f814209eec8e79f3384ad85c66e"} Jun 12 22:25:04.556354 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:04.556161 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" Jun 12 22:25:04.556354 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:04.556196 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65d8696b45-rq6wt" event={"ID":"b27fbe24-270b-43e1-9500-2637e49768dd","Type":"ContainerDied","Data":"38052b7e35df564145381e6f1dd4fe7906f4254f84ec3950729e12b380532feb"} Jun 12 22:25:04.556354 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:04.556218 2558 scope.go:117] "RemoveContainer" containerID="9983def5e7bfc87b0ad3838591ccefc0d9c91f814209eec8e79f3384ad85c66e" Jun 12 22:25:04.565346 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:04.565325 2558 scope.go:117] "RemoveContainer" containerID="9983def5e7bfc87b0ad3838591ccefc0d9c91f814209eec8e79f3384ad85c66e" Jun 12 22:25:04.565620 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:25:04.565600 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9983def5e7bfc87b0ad3838591ccefc0d9c91f814209eec8e79f3384ad85c66e\": container with ID starting with 9983def5e7bfc87b0ad3838591ccefc0d9c91f814209eec8e79f3384ad85c66e not found: ID does not exist" containerID="9983def5e7bfc87b0ad3838591ccefc0d9c91f814209eec8e79f3384ad85c66e" Jun 12 22:25:04.565667 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:04.565628 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9983def5e7bfc87b0ad3838591ccefc0d9c91f814209eec8e79f3384ad85c66e"} err="failed to get container status \"9983def5e7bfc87b0ad3838591ccefc0d9c91f814209eec8e79f3384ad85c66e\": rpc error: code = NotFound desc = could not find container \"9983def5e7bfc87b0ad3838591ccefc0d9c91f814209eec8e79f3384ad85c66e\": container with ID starting with 9983def5e7bfc87b0ad3838591ccefc0d9c91f814209eec8e79f3384ad85c66e not found: ID does not exist" Jun 12 22:25:04.582251 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:04.582230 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65d8696b45-rq6wt"] Jun 12 22:25:04.589255 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:04.589233 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65d8696b45-rq6wt"] Jun 12 22:25:06.569154 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:06.569114 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:25:06.573861 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:06.573832 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b27fbe24-270b-43e1-9500-2637e49768dd" path="/var/lib/kubelet/pods/b27fbe24-270b-43e1-9500-2637e49768dd/volumes" Jun 12 22:25:07.316089 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:07.316053 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-2vfjp"] Jun 12 22:25:07.316368 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:07.316357 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b27fbe24-270b-43e1-9500-2637e49768dd" containerName="registry" Jun 12 22:25:07.316420 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:07.316370 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b27fbe24-270b-43e1-9500-2637e49768dd" containerName="registry" Jun 12 22:25:07.316483 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:07.316425 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b27fbe24-270b-43e1-9500-2637e49768dd" containerName="registry" Jun 12 22:25:07.321478 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:07.321458 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-2vfjp" Jun 12 22:25:07.327611 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:07.327523 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 12 22:25:07.327611 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:07.327586 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 12 22:25:07.328050 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:07.327663 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-2qphg\"" Jun 12 22:25:07.350503 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:07.350472 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-2vfjp"] Jun 12 22:25:07.405238 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:07.405203 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mrgx\" (UniqueName: \"kubernetes.io/projected/8a3c5eb6-6876-4f0c-a155-52c27c7e03a6-kube-api-access-9mrgx\") pod \"downloads-694c955b9-2vfjp\" (UID: \"8a3c5eb6-6876-4f0c-a155-52c27c7e03a6\") " pod="openshift-console/downloads-694c955b9-2vfjp" Jun 12 22:25:07.505943 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:07.505888 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mrgx\" (UniqueName: \"kubernetes.io/projected/8a3c5eb6-6876-4f0c-a155-52c27c7e03a6-kube-api-access-9mrgx\") pod \"downloads-694c955b9-2vfjp\" (UID: \"8a3c5eb6-6876-4f0c-a155-52c27c7e03a6\") " pod="openshift-console/downloads-694c955b9-2vfjp" Jun 12 22:25:07.522881 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:07.522849 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mrgx\" (UniqueName: \"kubernetes.io/projected/8a3c5eb6-6876-4f0c-a155-52c27c7e03a6-kube-api-access-9mrgx\") pod \"downloads-694c955b9-2vfjp\" (UID: \"8a3c5eb6-6876-4f0c-a155-52c27c7e03a6\") " pod="openshift-console/downloads-694c955b9-2vfjp" Jun 12 22:25:07.552613 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:07.552589 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-847d8b76f8-dm6g8" Jun 12 22:25:07.630455 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:07.630365 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-2vfjp" Jun 12 22:25:07.787262 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:07.787239 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-2vfjp"] Jun 12 22:25:07.789075 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:25:07.789041 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3c5eb6_6876_4f0c_a155_52c27c7e03a6.slice/crio-47ba238cf1bd40f0d9ee1f7109482fe4c9090224f8e1e7f631486027cea11dd6 WatchSource:0}: Error finding container 47ba238cf1bd40f0d9ee1f7109482fe4c9090224f8e1e7f631486027cea11dd6: Status 404 returned error can't find the container with id 47ba238cf1bd40f0d9ee1f7109482fe4c9090224f8e1e7f631486027cea11dd6 Jun 12 22:25:07.791003 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:07.790983 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 22:25:08.575086 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:08.575049 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-2vfjp" event={"ID":"8a3c5eb6-6876-4f0c-a155-52c27c7e03a6","Type":"ContainerStarted","Data":"47ba238cf1bd40f0d9ee1f7109482fe4c9090224f8e1e7f631486027cea11dd6"} Jun 12 22:25:12.776885 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.776851 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fc64968c4-gbjfq"] Jun 12 22:25:12.780609 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.780587 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:12.783327 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.783308 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cxf6f\"" Jun 12 22:25:12.784619 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.784508 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 12 22:25:12.784619 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.784571 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 12 22:25:12.784619 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.784573 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 12 22:25:12.784826 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.784722 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 12 22:25:12.784879 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.784835 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 12 22:25:12.792323 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.792301 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc64968c4-gbjfq"] Jun 12 22:25:12.869137 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.869102 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e5eef27-86ad-47f4-8b38-b331d9661b7f-console-oauth-config\") pod \"console-fc64968c4-gbjfq\" (UID: \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\") " pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:12.869309 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.869163 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e5eef27-86ad-47f4-8b38-b331d9661b7f-console-serving-cert\") pod \"console-fc64968c4-gbjfq\" (UID: \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\") " pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:12.869309 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.869193 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txtsb\" (UniqueName: \"kubernetes.io/projected/4e5eef27-86ad-47f4-8b38-b331d9661b7f-kube-api-access-txtsb\") pod \"console-fc64968c4-gbjfq\" (UID: \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\") " pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:12.869309 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.869211 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e5eef27-86ad-47f4-8b38-b331d9661b7f-console-config\") pod \"console-fc64968c4-gbjfq\" (UID: \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\") " pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:12.869309 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.869249 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e5eef27-86ad-47f4-8b38-b331d9661b7f-oauth-serving-cert\") pod \"console-fc64968c4-gbjfq\" (UID: \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\") " pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:12.869309 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.869279 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e5eef27-86ad-47f4-8b38-b331d9661b7f-service-ca\") pod \"console-fc64968c4-gbjfq\" (UID: \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\") " pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:12.970336 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.970305 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e5eef27-86ad-47f4-8b38-b331d9661b7f-console-oauth-config\") pod \"console-fc64968c4-gbjfq\" (UID: \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\") " pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:12.970521 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.970348 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e5eef27-86ad-47f4-8b38-b331d9661b7f-console-serving-cert\") pod \"console-fc64968c4-gbjfq\" (UID: \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\") " pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:12.970521 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.970382 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txtsb\" (UniqueName: \"kubernetes.io/projected/4e5eef27-86ad-47f4-8b38-b331d9661b7f-kube-api-access-txtsb\") pod \"console-fc64968c4-gbjfq\" (UID: \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\") " pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:12.970521 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.970453 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e5eef27-86ad-47f4-8b38-b331d9661b7f-console-config\") pod \"console-fc64968c4-gbjfq\" (UID: \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\") " pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:12.970521 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.970502 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e5eef27-86ad-47f4-8b38-b331d9661b7f-oauth-serving-cert\") pod \"console-fc64968c4-gbjfq\" (UID: \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\") " pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:12.970705 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.970535 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e5eef27-86ad-47f4-8b38-b331d9661b7f-service-ca\") pod \"console-fc64968c4-gbjfq\" (UID: \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\") " pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:12.971314 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.971275 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e5eef27-86ad-47f4-8b38-b331d9661b7f-service-ca\") pod \"console-fc64968c4-gbjfq\" (UID: \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\") " pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:12.971808 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.971764 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e5eef27-86ad-47f4-8b38-b331d9661b7f-oauth-serving-cert\") pod \"console-fc64968c4-gbjfq\" (UID: \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\") " pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:12.971908 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.971866 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e5eef27-86ad-47f4-8b38-b331d9661b7f-console-config\") pod \"console-fc64968c4-gbjfq\" (UID: \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\") " pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:12.973214 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.973191 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e5eef27-86ad-47f4-8b38-b331d9661b7f-console-oauth-config\") pod \"console-fc64968c4-gbjfq\" (UID: \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\") " pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:12.973615 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.973589 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e5eef27-86ad-47f4-8b38-b331d9661b7f-console-serving-cert\") pod \"console-fc64968c4-gbjfq\" (UID: \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\") " pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:12.979501 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:12.979477 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txtsb\" (UniqueName: \"kubernetes.io/projected/4e5eef27-86ad-47f4-8b38-b331d9661b7f-kube-api-access-txtsb\") pod \"console-fc64968c4-gbjfq\" (UID: \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\") " pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:13.092366 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:13.092285 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:13.241334 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:13.241301 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc64968c4-gbjfq"] Jun 12 22:25:13.245271 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:25:13.245238 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e5eef27_86ad_47f4_8b38_b331d9661b7f.slice/crio-cdfb38cd79d4e52a5857f0385cd5d6435352cc52d3df7eddcf502e2190adb22a WatchSource:0}: Error finding container cdfb38cd79d4e52a5857f0385cd5d6435352cc52d3df7eddcf502e2190adb22a: Status 404 returned error can't find the container with id cdfb38cd79d4e52a5857f0385cd5d6435352cc52d3df7eddcf502e2190adb22a Jun 12 22:25:13.597417 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:13.597378 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc64968c4-gbjfq" event={"ID":"4e5eef27-86ad-47f4-8b38-b331d9661b7f","Type":"ContainerStarted","Data":"cdfb38cd79d4e52a5857f0385cd5d6435352cc52d3df7eddcf502e2190adb22a"} Jun 12 22:25:16.617252 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:16.617172 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc64968c4-gbjfq" event={"ID":"4e5eef27-86ad-47f4-8b38-b331d9661b7f","Type":"ContainerStarted","Data":"963ce6bfddd756ebc6441aabbbbef114a8adc784d51c9a3b5cafa4ba1e98e9cc"} Jun 12 22:25:16.639562 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:16.639464 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fc64968c4-gbjfq" podStartSLOduration=1.5846337849999999 podStartE2EDuration="4.639441004s" totalImagesPullingTime="3.054807219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:25:16.638131917 +0000 UTC m=+316.509162040" watchObservedRunningTime="2026-06-12 22:25:16.639441004 +0000 UTC m=+316.510471118" Jun 12 22:25:22.770182 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:22.770130 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56844fdccf-9jqkg"] Jun 12 22:25:22.783781 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:22.783751 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:22.784292 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:22.784266 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56844fdccf-9jqkg"] Jun 12 22:25:22.792674 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:22.792646 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 12 22:25:22.863704 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:22.863670 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcda5c31-d9f2-45a1-b531-a80d97e9e909-console-serving-cert\") pod \"console-56844fdccf-9jqkg\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:22.863907 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:22.863721 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcda5c31-d9f2-45a1-b531-a80d97e9e909-console-oauth-config\") pod \"console-56844fdccf-9jqkg\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:22.863907 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:22.863830 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcda5c31-d9f2-45a1-b531-a80d97e9e909-service-ca\") pod \"console-56844fdccf-9jqkg\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:22.863907 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:22.863869 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcda5c31-d9f2-45a1-b531-a80d97e9e909-oauth-serving-cert\") pod \"console-56844fdccf-9jqkg\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:22.863907 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:22.863901 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcda5c31-d9f2-45a1-b531-a80d97e9e909-trusted-ca-bundle\") pod \"console-56844fdccf-9jqkg\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:22.864111 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:22.864015 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcda5c31-d9f2-45a1-b531-a80d97e9e909-console-config\") pod \"console-56844fdccf-9jqkg\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:22.864111 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:22.864046 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvn2t\" (UniqueName: \"kubernetes.io/projected/dcda5c31-d9f2-45a1-b531-a80d97e9e909-kube-api-access-jvn2t\") pod \"console-56844fdccf-9jqkg\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:22.964526 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:22.964485 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcda5c31-d9f2-45a1-b531-a80d97e9e909-service-ca\") pod \"console-56844fdccf-9jqkg\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:22.964526 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:22.964533 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcda5c31-d9f2-45a1-b531-a80d97e9e909-oauth-serving-cert\") pod \"console-56844fdccf-9jqkg\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:22.964798 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:22.964564 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcda5c31-d9f2-45a1-b531-a80d97e9e909-trusted-ca-bundle\") pod \"console-56844fdccf-9jqkg\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:22.964798 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:22.964654 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcda5c31-d9f2-45a1-b531-a80d97e9e909-console-config\") pod \"console-56844fdccf-9jqkg\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:22.964798 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:22.964681 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvn2t\" (UniqueName: \"kubernetes.io/projected/dcda5c31-d9f2-45a1-b531-a80d97e9e909-kube-api-access-jvn2t\") pod \"console-56844fdccf-9jqkg\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:22.964798 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:22.964744 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcda5c31-d9f2-45a1-b531-a80d97e9e909-console-serving-cert\") pod \"console-56844fdccf-9jqkg\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:22.964798 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:22.964794 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcda5c31-d9f2-45a1-b531-a80d97e9e909-console-oauth-config\") pod \"console-56844fdccf-9jqkg\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:22.965424 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:22.965373 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcda5c31-d9f2-45a1-b531-a80d97e9e909-oauth-serving-cert\") pod \"console-56844fdccf-9jqkg\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:22.965566 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:22.965493 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcda5c31-d9f2-45a1-b531-a80d97e9e909-service-ca\") pod \"console-56844fdccf-9jqkg\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:22.965745 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:22.965697 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcda5c31-d9f2-45a1-b531-a80d97e9e909-trusted-ca-bundle\") pod \"console-56844fdccf-9jqkg\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:22.965745 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:22.965715 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcda5c31-d9f2-45a1-b531-a80d97e9e909-console-config\") pod \"console-56844fdccf-9jqkg\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:22.967900 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:22.967869 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcda5c31-d9f2-45a1-b531-a80d97e9e909-console-serving-cert\") pod \"console-56844fdccf-9jqkg\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:22.968101 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:22.967874 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcda5c31-d9f2-45a1-b531-a80d97e9e909-console-oauth-config\") pod \"console-56844fdccf-9jqkg\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:22.975239 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:22.975207 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvn2t\" (UniqueName: \"kubernetes.io/projected/dcda5c31-d9f2-45a1-b531-a80d97e9e909-kube-api-access-jvn2t\") pod \"console-56844fdccf-9jqkg\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:23.092587 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:23.092496 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:23.092587 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:23.092566 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:23.096209 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:23.096187 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:23.098014 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:23.097990 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:23.655181 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:23.655151 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:25.069227 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:25.069201 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56844fdccf-9jqkg"] Jun 12 22:25:25.071867 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:25:25.071842 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcda5c31_d9f2_45a1_b531_a80d97e9e909.slice/crio-ca6e3237d12104481ffd50106bcc2cb49f9850afc23d4d82283ffbc9995b926b WatchSource:0}: Error finding container ca6e3237d12104481ffd50106bcc2cb49f9850afc23d4d82283ffbc9995b926b: Status 404 returned error can't find the container with id ca6e3237d12104481ffd50106bcc2cb49f9850afc23d4d82283ffbc9995b926b Jun 12 22:25:25.661247 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:25.661203 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56844fdccf-9jqkg" event={"ID":"dcda5c31-d9f2-45a1-b531-a80d97e9e909","Type":"ContainerStarted","Data":"8adf2a634a60164790d3a010f1e326dc1006814c6e453d54041d1c0aeeadf19f"} Jun 12 22:25:25.661587 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:25.661561 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56844fdccf-9jqkg" event={"ID":"dcda5c31-d9f2-45a1-b531-a80d97e9e909","Type":"ContainerStarted","Data":"ca6e3237d12104481ffd50106bcc2cb49f9850afc23d4d82283ffbc9995b926b"} Jun 12 22:25:25.663003 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:25.662979 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-2vfjp" event={"ID":"8a3c5eb6-6876-4f0c-a155-52c27c7e03a6","Type":"ContainerStarted","Data":"24489a83a91c2fd578dcdc5e62bcd38eb2002cfdfa6e59456a4bcda3ecfe4339"} Jun 12 22:25:25.663109 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:25.663022 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-2vfjp" Jun 12 22:25:25.665263 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:25.665230 2558 generic.go:356] "Generic (PLEG): container finished" podID="08ec4800-3d60-4d66-a897-2cb31f10284b" containerID="765a94d86f72d38c8788c8bd7fc0a5f0f9f6f033c27a4d63b94dec65b649b757" exitCode=0 Jun 12 22:25:25.665357 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:25.665283 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7gx7p" event={"ID":"08ec4800-3d60-4d66-a897-2cb31f10284b","Type":"ContainerDied","Data":"765a94d86f72d38c8788c8bd7fc0a5f0f9f6f033c27a4d63b94dec65b649b757"} Jun 12 22:25:25.665681 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:25.665653 2558 scope.go:117] "RemoveContainer" containerID="765a94d86f72d38c8788c8bd7fc0a5f0f9f6f033c27a4d63b94dec65b649b757" Jun 12 22:25:25.674673 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:25.674651 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-2vfjp" Jun 12 22:25:25.686858 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:25.686810 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56844fdccf-9jqkg" podStartSLOduration=3.686792883 podStartE2EDuration="3.686792883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:25:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:25:25.686625447 +0000 UTC m=+325.557655569" watchObservedRunningTime="2026-06-12 22:25:25.686792883 +0000 UTC m=+325.557823004" Jun 12 22:25:25.749016 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:25.748582 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-2vfjp" podStartSLOduration=1.5067270430000002 podStartE2EDuration="18.748558668s" totalImagesPullingTime="17.241831625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:25:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:25:25.74711368 +0000 UTC m=+325.618143802" watchObservedRunningTime="2026-06-12 22:25:25.748558668 +0000 UTC m=+325.619588789" Jun 12 22:25:26.672624 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:26.672582 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7gx7p" event={"ID":"08ec4800-3d60-4d66-a897-2cb31f10284b","Type":"ContainerStarted","Data":"54bfc3b060df237d53e832d5445a69c1a0542f68acb273119cc50507246fd64f"} Jun 12 22:25:33.097381 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:33.097340 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:33.097963 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:33.097413 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:33.104279 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:33.104253 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:33.717106 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:33.717076 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:25:33.772362 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:33.772326 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fc64968c4-gbjfq"] Jun 12 22:25:39.739379 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:39.739345 2558 generic.go:356] "Generic (PLEG): container finished" podID="313c738d-72a0-47ef-8eb1-c3e68c725e42" containerID="5f834bc6873ee73e5d582273d9f3c3d98914c018366595c0349e86bf50e6c412" exitCode=0 Jun 12 22:25:39.739954 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:39.739402 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-77d7f" event={"ID":"313c738d-72a0-47ef-8eb1-c3e68c725e42","Type":"ContainerDied","Data":"5f834bc6873ee73e5d582273d9f3c3d98914c018366595c0349e86bf50e6c412"} Jun 12 22:25:39.739954 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:39.739771 2558 scope.go:117] "RemoveContainer" containerID="5f834bc6873ee73e5d582273d9f3c3d98914c018366595c0349e86bf50e6c412" Jun 12 22:25:40.745491 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:40.745450 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-77d7f" event={"ID":"313c738d-72a0-47ef-8eb1-c3e68c725e42","Type":"ContainerStarted","Data":"796781b00c03c3bace82ea787c4bc92af1a8a6e676d6cfbd3aa88e24eecdc2c3"} Jun 12 22:25:58.802543 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:58.802451 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-fc64968c4-gbjfq" podUID="4e5eef27-86ad-47f4-8b38-b331d9661b7f" containerName="console" containerID="cri-o://963ce6bfddd756ebc6441aabbbbef114a8adc784d51c9a3b5cafa4ba1e98e9cc" gracePeriod=15 Jun 12 22:25:59.076645 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.076579 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:59.193401 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.193369 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e5eef27-86ad-47f4-8b38-b331d9661b7f-oauth-serving-cert\") pod \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\" (UID: \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\") " Jun 12 22:25:59.193579 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.193453 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txtsb\" (UniqueName: \"kubernetes.io/projected/4e5eef27-86ad-47f4-8b38-b331d9661b7f-kube-api-access-txtsb\") pod \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\" (UID: \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\") " Jun 12 22:25:59.193579 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.193484 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e5eef27-86ad-47f4-8b38-b331d9661b7f-console-config\") pod \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\" (UID: \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\") " Jun 12 22:25:59.193579 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.193526 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e5eef27-86ad-47f4-8b38-b331d9661b7f-console-oauth-config\") pod \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\" (UID: \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\") " Jun 12 22:25:59.193579 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.193550 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e5eef27-86ad-47f4-8b38-b331d9661b7f-console-serving-cert\") pod \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\" (UID: \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\") " Jun 12 22:25:59.193724 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.193587 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e5eef27-86ad-47f4-8b38-b331d9661b7f-service-ca\") pod \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\" (UID: \"4e5eef27-86ad-47f4-8b38-b331d9661b7f\") " Jun 12 22:25:59.193896 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.193861 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e5eef27-86ad-47f4-8b38-b331d9661b7f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4e5eef27-86ad-47f4-8b38-b331d9661b7f" (UID: "4e5eef27-86ad-47f4-8b38-b331d9661b7f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:25:59.194002 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.193921 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e5eef27-86ad-47f4-8b38-b331d9661b7f-console-config" (OuterVolumeSpecName: "console-config") pod "4e5eef27-86ad-47f4-8b38-b331d9661b7f" (UID: "4e5eef27-86ad-47f4-8b38-b331d9661b7f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:25:59.194081 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.194058 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e5eef27-86ad-47f4-8b38-b331d9661b7f-service-ca" (OuterVolumeSpecName: "service-ca") pod "4e5eef27-86ad-47f4-8b38-b331d9661b7f" (UID: "4e5eef27-86ad-47f4-8b38-b331d9661b7f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:25:59.195779 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.195756 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e5eef27-86ad-47f4-8b38-b331d9661b7f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4e5eef27-86ad-47f4-8b38-b331d9661b7f" (UID: "4e5eef27-86ad-47f4-8b38-b331d9661b7f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:25:59.195848 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.195770 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e5eef27-86ad-47f4-8b38-b331d9661b7f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4e5eef27-86ad-47f4-8b38-b331d9661b7f" (UID: "4e5eef27-86ad-47f4-8b38-b331d9661b7f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:25:59.195902 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.195840 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e5eef27-86ad-47f4-8b38-b331d9661b7f-kube-api-access-txtsb" (OuterVolumeSpecName: "kube-api-access-txtsb") pod "4e5eef27-86ad-47f4-8b38-b331d9661b7f" (UID: "4e5eef27-86ad-47f4-8b38-b331d9661b7f"). InnerVolumeSpecName "kube-api-access-txtsb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:25:59.294313 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.294288 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e5eef27-86ad-47f4-8b38-b331d9661b7f-console-serving-cert\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:25:59.294313 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.294311 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e5eef27-86ad-47f4-8b38-b331d9661b7f-service-ca\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:25:59.294489 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.294321 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e5eef27-86ad-47f4-8b38-b331d9661b7f-oauth-serving-cert\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:25:59.294489 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.294329 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txtsb\" (UniqueName: \"kubernetes.io/projected/4e5eef27-86ad-47f4-8b38-b331d9661b7f-kube-api-access-txtsb\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:25:59.294489 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.294338 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e5eef27-86ad-47f4-8b38-b331d9661b7f-console-config\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:25:59.294489 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.294348 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e5eef27-86ad-47f4-8b38-b331d9661b7f-console-oauth-config\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:25:59.824575 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.824542 2558 generic.go:356] "Generic (PLEG): container finished" podID="4e5eef27-86ad-47f4-8b38-b331d9661b7f" containerID="963ce6bfddd756ebc6441aabbbbef114a8adc784d51c9a3b5cafa4ba1e98e9cc" exitCode=0 Jun 12 22:25:59.824981 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.824583 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc64968c4-gbjfq" Jun 12 22:25:59.824981 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.824630 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc64968c4-gbjfq" event={"ID":"4e5eef27-86ad-47f4-8b38-b331d9661b7f","Type":"ContainerDied","Data":"963ce6bfddd756ebc6441aabbbbef114a8adc784d51c9a3b5cafa4ba1e98e9cc"} Jun 12 22:25:59.824981 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.824680 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc64968c4-gbjfq" event={"ID":"4e5eef27-86ad-47f4-8b38-b331d9661b7f","Type":"ContainerDied","Data":"cdfb38cd79d4e52a5857f0385cd5d6435352cc52d3df7eddcf502e2190adb22a"} Jun 12 22:25:59.824981 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.824705 2558 scope.go:117] "RemoveContainer" containerID="963ce6bfddd756ebc6441aabbbbef114a8adc784d51c9a3b5cafa4ba1e98e9cc" Jun 12 22:25:59.833307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.833293 2558 scope.go:117] "RemoveContainer" containerID="963ce6bfddd756ebc6441aabbbbef114a8adc784d51c9a3b5cafa4ba1e98e9cc" Jun 12 22:25:59.833575 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:25:59.833556 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"963ce6bfddd756ebc6441aabbbbef114a8adc784d51c9a3b5cafa4ba1e98e9cc\": container with ID starting with 963ce6bfddd756ebc6441aabbbbef114a8adc784d51c9a3b5cafa4ba1e98e9cc not found: ID does not exist" containerID="963ce6bfddd756ebc6441aabbbbef114a8adc784d51c9a3b5cafa4ba1e98e9cc" Jun 12 22:25:59.833645 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.833582 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"963ce6bfddd756ebc6441aabbbbef114a8adc784d51c9a3b5cafa4ba1e98e9cc"} err="failed to get container status \"963ce6bfddd756ebc6441aabbbbef114a8adc784d51c9a3b5cafa4ba1e98e9cc\": rpc error: code = NotFound desc = could not find container \"963ce6bfddd756ebc6441aabbbbef114a8adc784d51c9a3b5cafa4ba1e98e9cc\": container with ID starting with 963ce6bfddd756ebc6441aabbbbef114a8adc784d51c9a3b5cafa4ba1e98e9cc not found: ID does not exist" Jun 12 22:25:59.846855 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.846833 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fc64968c4-gbjfq"] Jun 12 22:25:59.855668 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:25:59.855645 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fc64968c4-gbjfq"] Jun 12 22:26:00.573231 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:00.573196 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e5eef27-86ad-47f4-8b38-b331d9661b7f" path="/var/lib/kubelet/pods/4e5eef27-86ad-47f4-8b38-b331d9661b7f/volumes" Jun 12 22:26:14.110917 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:14.110877 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 22:26:14.111528 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:14.111293 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="alertmanager" containerID="cri-o://86b3228f4756b6f9a190f53b6fa9cf19a10da23ebb2d05a567a196f3cd73f40f" gracePeriod=120 Jun 12 22:26:14.111528 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:14.111336 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="kube-rbac-proxy-web" containerID="cri-o://d2129fde80abc9258cc3618d33a5d8794a3128a640cb445141eea96515ed35e2" gracePeriod=120 Jun 12 22:26:14.111528 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:14.111371 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="prom-label-proxy" containerID="cri-o://63fb69f74cbe81a093c2db5960f3776d491f7e55ce5ade4c47ca13f56927d41c" gracePeriod=120 Jun 12 22:26:14.111528 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:14.111394 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="kube-rbac-proxy" containerID="cri-o://ffd7c226476ebbe71630313f4426c1a4b0a42ef00fcef05236a8817949e4368e" gracePeriod=120 Jun 12 22:26:14.111528 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:14.111336 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="kube-rbac-proxy-metric" containerID="cri-o://ba4a1b13531a69fee3683a2284374174a91d2866b63ed6fa67c9ee18b9508d4d" gracePeriod=120 Jun 12 22:26:14.111528 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:14.111417 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="config-reloader" containerID="cri-o://f08f5127c71c02edfccae051354a7ee294e038161c64571a4733b399e4106ca3" gracePeriod=120 Jun 12 22:26:14.419663 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:14.419578 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs\") pod \"network-metrics-daemon-lqpxm\" (UID: \"5707213e-da61-4306-96d0-03a1790eb281\") " pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:26:14.421886 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:14.421851 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5707213e-da61-4306-96d0-03a1790eb281-metrics-certs\") pod \"network-metrics-daemon-lqpxm\" (UID: \"5707213e-da61-4306-96d0-03a1790eb281\") " pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:26:14.672580 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:14.672504 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2gthm\"" Jun 12 22:26:14.680149 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:14.680130 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqpxm" Jun 12 22:26:14.817860 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:14.817827 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lqpxm"] Jun 12 22:26:14.821442 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:26:14.821401 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5707213e_da61_4306_96d0_03a1790eb281.slice/crio-d62b75497e5e7b230d6a952f2d4dd3774ecaa4ea487a7cd2b74a325672811dcf WatchSource:0}: Error finding container d62b75497e5e7b230d6a952f2d4dd3774ecaa4ea487a7cd2b74a325672811dcf: Status 404 returned error can't find the container with id d62b75497e5e7b230d6a952f2d4dd3774ecaa4ea487a7cd2b74a325672811dcf Jun 12 22:26:14.884031 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:14.883992 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lqpxm" event={"ID":"5707213e-da61-4306-96d0-03a1790eb281","Type":"ContainerStarted","Data":"d62b75497e5e7b230d6a952f2d4dd3774ecaa4ea487a7cd2b74a325672811dcf"} Jun 12 22:26:14.887328 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:14.887303 2558 generic.go:356] "Generic (PLEG): container finished" podID="978305f8-aa11-445c-a27c-058443bb27fe" containerID="63fb69f74cbe81a093c2db5960f3776d491f7e55ce5ade4c47ca13f56927d41c" exitCode=0 Jun 12 22:26:14.887328 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:14.887324 2558 generic.go:356] "Generic (PLEG): container finished" podID="978305f8-aa11-445c-a27c-058443bb27fe" containerID="ffd7c226476ebbe71630313f4426c1a4b0a42ef00fcef05236a8817949e4368e" exitCode=0 Jun 12 22:26:14.887328 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:14.887330 2558 generic.go:356] "Generic (PLEG): container finished" podID="978305f8-aa11-445c-a27c-058443bb27fe" containerID="f08f5127c71c02edfccae051354a7ee294e038161c64571a4733b399e4106ca3" exitCode=0 Jun 12 22:26:14.887328 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:14.887336 2558 generic.go:356] "Generic (PLEG): container finished" podID="978305f8-aa11-445c-a27c-058443bb27fe" containerID="86b3228f4756b6f9a190f53b6fa9cf19a10da23ebb2d05a567a196f3cd73f40f" exitCode=0 Jun 12 22:26:14.887567 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:14.887359 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"978305f8-aa11-445c-a27c-058443bb27fe","Type":"ContainerDied","Data":"63fb69f74cbe81a093c2db5960f3776d491f7e55ce5ade4c47ca13f56927d41c"} Jun 12 22:26:14.887567 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:14.887407 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"978305f8-aa11-445c-a27c-058443bb27fe","Type":"ContainerDied","Data":"ffd7c226476ebbe71630313f4426c1a4b0a42ef00fcef05236a8817949e4368e"} Jun 12 22:26:14.887567 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:14.887460 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"978305f8-aa11-445c-a27c-058443bb27fe","Type":"ContainerDied","Data":"f08f5127c71c02edfccae051354a7ee294e038161c64571a4733b399e4106ca3"} Jun 12 22:26:14.887567 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:14.887487 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"978305f8-aa11-445c-a27c-058443bb27fe","Type":"ContainerDied","Data":"86b3228f4756b6f9a190f53b6fa9cf19a10da23ebb2d05a567a196f3cd73f40f"} Jun 12 22:26:15.358318 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.358291 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:15.426290 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.426207 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/978305f8-aa11-445c-a27c-058443bb27fe-tls-assets\") pod \"978305f8-aa11-445c-a27c-058443bb27fe\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " Jun 12 22:26:15.426290 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.426265 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-secret-alertmanager-main-tls\") pod \"978305f8-aa11-445c-a27c-058443bb27fe\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " Jun 12 22:26:15.426548 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.426297 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-secret-alertmanager-kube-rbac-proxy\") pod \"978305f8-aa11-445c-a27c-058443bb27fe\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " Jun 12 22:26:15.426548 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.426331 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/978305f8-aa11-445c-a27c-058443bb27fe-config-out\") pod \"978305f8-aa11-445c-a27c-058443bb27fe\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " Jun 12 22:26:15.426548 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.426359 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/978305f8-aa11-445c-a27c-058443bb27fe-alertmanager-trusted-ca-bundle\") pod \"978305f8-aa11-445c-a27c-058443bb27fe\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " Jun 12 22:26:15.426548 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.426385 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-secret-alertmanager-kube-rbac-proxy-metric\") pod \"978305f8-aa11-445c-a27c-058443bb27fe\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " Jun 12 22:26:15.426548 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.426450 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-web-config\") pod \"978305f8-aa11-445c-a27c-058443bb27fe\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " Jun 12 22:26:15.426548 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.426480 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/978305f8-aa11-445c-a27c-058443bb27fe-metrics-client-ca\") pod \"978305f8-aa11-445c-a27c-058443bb27fe\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " Jun 12 22:26:15.426548 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.426516 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/978305f8-aa11-445c-a27c-058443bb27fe-alertmanager-main-db\") pod \"978305f8-aa11-445c-a27c-058443bb27fe\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " Jun 12 22:26:15.426548 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.426549 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-cluster-tls-config\") pod \"978305f8-aa11-445c-a27c-058443bb27fe\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " Jun 12 22:26:15.427010 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.426594 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbknh\" (UniqueName: \"kubernetes.io/projected/978305f8-aa11-445c-a27c-058443bb27fe-kube-api-access-jbknh\") pod \"978305f8-aa11-445c-a27c-058443bb27fe\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " Jun 12 22:26:15.427010 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.426621 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-secret-alertmanager-kube-rbac-proxy-web\") pod \"978305f8-aa11-445c-a27c-058443bb27fe\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " Jun 12 22:26:15.427010 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.426662 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-config-volume\") pod \"978305f8-aa11-445c-a27c-058443bb27fe\" (UID: \"978305f8-aa11-445c-a27c-058443bb27fe\") " Jun 12 22:26:15.427010 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.426912 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/978305f8-aa11-445c-a27c-058443bb27fe-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "978305f8-aa11-445c-a27c-058443bb27fe" (UID: "978305f8-aa11-445c-a27c-058443bb27fe"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:26:15.427010 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.426999 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/978305f8-aa11-445c-a27c-058443bb27fe-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "978305f8-aa11-445c-a27c-058443bb27fe" (UID: "978305f8-aa11-445c-a27c-058443bb27fe"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:26:15.428025 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.427996 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/978305f8-aa11-445c-a27c-058443bb27fe-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "978305f8-aa11-445c-a27c-058443bb27fe" (UID: "978305f8-aa11-445c-a27c-058443bb27fe"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:26:15.429630 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.429603 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/978305f8-aa11-445c-a27c-058443bb27fe-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "978305f8-aa11-445c-a27c-058443bb27fe" (UID: "978305f8-aa11-445c-a27c-058443bb27fe"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:26:15.431367 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.431335 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "978305f8-aa11-445c-a27c-058443bb27fe" (UID: "978305f8-aa11-445c-a27c-058443bb27fe"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:26:15.431760 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.431735 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-config-volume" (OuterVolumeSpecName: "config-volume") pod "978305f8-aa11-445c-a27c-058443bb27fe" (UID: "978305f8-aa11-445c-a27c-058443bb27fe"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:26:15.432085 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.432041 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "978305f8-aa11-445c-a27c-058443bb27fe" (UID: "978305f8-aa11-445c-a27c-058443bb27fe"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:26:15.432674 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.432637 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "978305f8-aa11-445c-a27c-058443bb27fe" (UID: "978305f8-aa11-445c-a27c-058443bb27fe"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:26:15.432841 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.432803 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "978305f8-aa11-445c-a27c-058443bb27fe" (UID: "978305f8-aa11-445c-a27c-058443bb27fe"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:26:15.433055 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.433018 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/978305f8-aa11-445c-a27c-058443bb27fe-kube-api-access-jbknh" (OuterVolumeSpecName: "kube-api-access-jbknh") pod "978305f8-aa11-445c-a27c-058443bb27fe" (UID: "978305f8-aa11-445c-a27c-058443bb27fe"). InnerVolumeSpecName "kube-api-access-jbknh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:26:15.433153 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.433080 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/978305f8-aa11-445c-a27c-058443bb27fe-config-out" (OuterVolumeSpecName: "config-out") pod "978305f8-aa11-445c-a27c-058443bb27fe" (UID: "978305f8-aa11-445c-a27c-058443bb27fe"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:26:15.438276 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.438248 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "978305f8-aa11-445c-a27c-058443bb27fe" (UID: "978305f8-aa11-445c-a27c-058443bb27fe"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:26:15.444186 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.444165 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-web-config" (OuterVolumeSpecName: "web-config") pod "978305f8-aa11-445c-a27c-058443bb27fe" (UID: "978305f8-aa11-445c-a27c-058443bb27fe"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:26:15.527614 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.527576 2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/978305f8-aa11-445c-a27c-058443bb27fe-config-out\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:26:15.527614 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.527613 2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/978305f8-aa11-445c-a27c-058443bb27fe-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:26:15.527827 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.527630 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:26:15.527827 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.527649 2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-web-config\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:26:15.527827 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.527662 2558 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/978305f8-aa11-445c-a27c-058443bb27fe-metrics-client-ca\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:26:15.527827 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.527674 2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/978305f8-aa11-445c-a27c-058443bb27fe-alertmanager-main-db\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:26:15.527827 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.527686 2558 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-cluster-tls-config\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:26:15.527827 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.527699 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbknh\" (UniqueName: \"kubernetes.io/projected/978305f8-aa11-445c-a27c-058443bb27fe-kube-api-access-jbknh\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:26:15.527827 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.527713 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:26:15.527827 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.527727 2558 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-config-volume\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:26:15.527827 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.527740 2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/978305f8-aa11-445c-a27c-058443bb27fe-tls-assets\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:26:15.527827 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.527754 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-secret-alertmanager-main-tls\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:26:15.527827 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.527768 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/978305f8-aa11-445c-a27c-058443bb27fe-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:26:15.896091 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.896058 2558 generic.go:356] "Generic (PLEG): container finished" podID="978305f8-aa11-445c-a27c-058443bb27fe" containerID="ba4a1b13531a69fee3683a2284374174a91d2866b63ed6fa67c9ee18b9508d4d" exitCode=0 Jun 12 22:26:15.896091 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.896088 2558 generic.go:356] "Generic (PLEG): container finished" podID="978305f8-aa11-445c-a27c-058443bb27fe" containerID="d2129fde80abc9258cc3618d33a5d8794a3128a640cb445141eea96515ed35e2" exitCode=0 Jun 12 22:26:15.896283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.896150 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:15.896283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.896146 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"978305f8-aa11-445c-a27c-058443bb27fe","Type":"ContainerDied","Data":"ba4a1b13531a69fee3683a2284374174a91d2866b63ed6fa67c9ee18b9508d4d"} Jun 12 22:26:15.896283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.896220 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"978305f8-aa11-445c-a27c-058443bb27fe","Type":"ContainerDied","Data":"d2129fde80abc9258cc3618d33a5d8794a3128a640cb445141eea96515ed35e2"} Jun 12 22:26:15.896283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.896264 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"978305f8-aa11-445c-a27c-058443bb27fe","Type":"ContainerDied","Data":"19845b5b5cdd3c61d46323d7fc8f2f1457270b3539cd76946c3fea9d73e0e0b2"} Jun 12 22:26:15.896283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.896282 2558 scope.go:117] "RemoveContainer" containerID="63fb69f74cbe81a093c2db5960f3776d491f7e55ce5ade4c47ca13f56927d41c" Jun 12 22:26:15.897823 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.897802 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lqpxm" event={"ID":"5707213e-da61-4306-96d0-03a1790eb281","Type":"ContainerStarted","Data":"cce4df0834f4f9319efd74088b8ad3bbd6d1fda8cb5b95aa97f28038d92cd681"} Jun 12 22:26:15.906682 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.906662 2558 scope.go:117] "RemoveContainer" containerID="ba4a1b13531a69fee3683a2284374174a91d2866b63ed6fa67c9ee18b9508d4d" Jun 12 22:26:15.925248 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.925228 2558 scope.go:117] "RemoveContainer" containerID="ffd7c226476ebbe71630313f4426c1a4b0a42ef00fcef05236a8817949e4368e" Jun 12 22:26:15.928527 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.928504 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 22:26:15.934636 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.934602 2558 scope.go:117] "RemoveContainer" containerID="d2129fde80abc9258cc3618d33a5d8794a3128a640cb445141eea96515ed35e2" Jun 12 22:26:15.937984 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.937960 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 22:26:15.942103 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.942076 2558 scope.go:117] "RemoveContainer" containerID="f08f5127c71c02edfccae051354a7ee294e038161c64571a4733b399e4106ca3" Jun 12 22:26:15.950171 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.950149 2558 scope.go:117] "RemoveContainer" containerID="86b3228f4756b6f9a190f53b6fa9cf19a10da23ebb2d05a567a196f3cd73f40f" Jun 12 22:26:15.958481 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.958462 2558 scope.go:117] "RemoveContainer" containerID="8e72b84c544f51e7197c61840cb7740f799acb27090aa3ce5cbf0227cf596822" Jun 12 22:26:15.965586 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.965571 2558 scope.go:117] "RemoveContainer" containerID="63fb69f74cbe81a093c2db5960f3776d491f7e55ce5ade4c47ca13f56927d41c" Jun 12 22:26:15.965829 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:15.965810 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63fb69f74cbe81a093c2db5960f3776d491f7e55ce5ade4c47ca13f56927d41c\": container with ID starting with 63fb69f74cbe81a093c2db5960f3776d491f7e55ce5ade4c47ca13f56927d41c not found: ID does not exist" containerID="63fb69f74cbe81a093c2db5960f3776d491f7e55ce5ade4c47ca13f56927d41c" Jun 12 22:26:15.965873 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.965838 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63fb69f74cbe81a093c2db5960f3776d491f7e55ce5ade4c47ca13f56927d41c"} err="failed to get container status \"63fb69f74cbe81a093c2db5960f3776d491f7e55ce5ade4c47ca13f56927d41c\": rpc error: code = NotFound desc = could not find container \"63fb69f74cbe81a093c2db5960f3776d491f7e55ce5ade4c47ca13f56927d41c\": container with ID starting with 63fb69f74cbe81a093c2db5960f3776d491f7e55ce5ade4c47ca13f56927d41c not found: ID does not exist" Jun 12 22:26:15.965873 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.965856 2558 scope.go:117] "RemoveContainer" containerID="ba4a1b13531a69fee3683a2284374174a91d2866b63ed6fa67c9ee18b9508d4d" Jun 12 22:26:15.966093 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:15.966077 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba4a1b13531a69fee3683a2284374174a91d2866b63ed6fa67c9ee18b9508d4d\": container with ID starting with ba4a1b13531a69fee3683a2284374174a91d2866b63ed6fa67c9ee18b9508d4d not found: ID does not exist" containerID="ba4a1b13531a69fee3683a2284374174a91d2866b63ed6fa67c9ee18b9508d4d" Jun 12 22:26:15.966132 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.966097 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba4a1b13531a69fee3683a2284374174a91d2866b63ed6fa67c9ee18b9508d4d"} err="failed to get container status \"ba4a1b13531a69fee3683a2284374174a91d2866b63ed6fa67c9ee18b9508d4d\": rpc error: code = NotFound desc = could not find container \"ba4a1b13531a69fee3683a2284374174a91d2866b63ed6fa67c9ee18b9508d4d\": container with ID starting with ba4a1b13531a69fee3683a2284374174a91d2866b63ed6fa67c9ee18b9508d4d not found: ID does not exist" Jun 12 22:26:15.966132 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.966109 2558 scope.go:117] "RemoveContainer" containerID="ffd7c226476ebbe71630313f4426c1a4b0a42ef00fcef05236a8817949e4368e" Jun 12 22:26:15.966310 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:15.966292 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffd7c226476ebbe71630313f4426c1a4b0a42ef00fcef05236a8817949e4368e\": container with ID starting with ffd7c226476ebbe71630313f4426c1a4b0a42ef00fcef05236a8817949e4368e not found: ID does not exist" containerID="ffd7c226476ebbe71630313f4426c1a4b0a42ef00fcef05236a8817949e4368e" Jun 12 22:26:15.966348 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.966317 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffd7c226476ebbe71630313f4426c1a4b0a42ef00fcef05236a8817949e4368e"} err="failed to get container status \"ffd7c226476ebbe71630313f4426c1a4b0a42ef00fcef05236a8817949e4368e\": rpc error: code = NotFound desc = could not find container \"ffd7c226476ebbe71630313f4426c1a4b0a42ef00fcef05236a8817949e4368e\": container with ID starting with ffd7c226476ebbe71630313f4426c1a4b0a42ef00fcef05236a8817949e4368e not found: ID does not exist" Jun 12 22:26:15.966348 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.966334 2558 scope.go:117] "RemoveContainer" containerID="d2129fde80abc9258cc3618d33a5d8794a3128a640cb445141eea96515ed35e2" Jun 12 22:26:15.966580 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:15.966559 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2129fde80abc9258cc3618d33a5d8794a3128a640cb445141eea96515ed35e2\": container with ID starting with d2129fde80abc9258cc3618d33a5d8794a3128a640cb445141eea96515ed35e2 not found: ID does not exist" containerID="d2129fde80abc9258cc3618d33a5d8794a3128a640cb445141eea96515ed35e2" Jun 12 22:26:15.966635 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.966584 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2129fde80abc9258cc3618d33a5d8794a3128a640cb445141eea96515ed35e2"} err="failed to get container status \"d2129fde80abc9258cc3618d33a5d8794a3128a640cb445141eea96515ed35e2\": rpc error: code = NotFound desc = could not find container \"d2129fde80abc9258cc3618d33a5d8794a3128a640cb445141eea96515ed35e2\": container with ID starting with d2129fde80abc9258cc3618d33a5d8794a3128a640cb445141eea96515ed35e2 not found: ID does not exist" Jun 12 22:26:15.966635 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.966598 2558 scope.go:117] "RemoveContainer" containerID="f08f5127c71c02edfccae051354a7ee294e038161c64571a4733b399e4106ca3" Jun 12 22:26:15.966826 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:15.966811 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f08f5127c71c02edfccae051354a7ee294e038161c64571a4733b399e4106ca3\": container with ID starting with f08f5127c71c02edfccae051354a7ee294e038161c64571a4733b399e4106ca3 not found: ID does not exist" containerID="f08f5127c71c02edfccae051354a7ee294e038161c64571a4733b399e4106ca3" Jun 12 22:26:15.966869 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.966829 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f08f5127c71c02edfccae051354a7ee294e038161c64571a4733b399e4106ca3"} err="failed to get container status \"f08f5127c71c02edfccae051354a7ee294e038161c64571a4733b399e4106ca3\": rpc error: code = NotFound desc = could not find container \"f08f5127c71c02edfccae051354a7ee294e038161c64571a4733b399e4106ca3\": container with ID starting with f08f5127c71c02edfccae051354a7ee294e038161c64571a4733b399e4106ca3 not found: ID does not exist" Jun 12 22:26:15.966869 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.966844 2558 scope.go:117] "RemoveContainer" containerID="86b3228f4756b6f9a190f53b6fa9cf19a10da23ebb2d05a567a196f3cd73f40f" Jun 12 22:26:15.967058 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:15.967039 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86b3228f4756b6f9a190f53b6fa9cf19a10da23ebb2d05a567a196f3cd73f40f\": container with ID starting with 86b3228f4756b6f9a190f53b6fa9cf19a10da23ebb2d05a567a196f3cd73f40f not found: ID does not exist" containerID="86b3228f4756b6f9a190f53b6fa9cf19a10da23ebb2d05a567a196f3cd73f40f" Jun 12 22:26:15.967093 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.967061 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86b3228f4756b6f9a190f53b6fa9cf19a10da23ebb2d05a567a196f3cd73f40f"} err="failed to get container status \"86b3228f4756b6f9a190f53b6fa9cf19a10da23ebb2d05a567a196f3cd73f40f\": rpc error: code = NotFound desc = could not find container \"86b3228f4756b6f9a190f53b6fa9cf19a10da23ebb2d05a567a196f3cd73f40f\": container with ID starting with 86b3228f4756b6f9a190f53b6fa9cf19a10da23ebb2d05a567a196f3cd73f40f not found: ID does not exist" Jun 12 22:26:15.967093 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.967073 2558 scope.go:117] "RemoveContainer" containerID="8e72b84c544f51e7197c61840cb7740f799acb27090aa3ce5cbf0227cf596822" Jun 12 22:26:15.967285 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:15.967268 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e72b84c544f51e7197c61840cb7740f799acb27090aa3ce5cbf0227cf596822\": container with ID starting with 8e72b84c544f51e7197c61840cb7740f799acb27090aa3ce5cbf0227cf596822 not found: ID does not exist" containerID="8e72b84c544f51e7197c61840cb7740f799acb27090aa3ce5cbf0227cf596822" Jun 12 22:26:15.967325 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.967289 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e72b84c544f51e7197c61840cb7740f799acb27090aa3ce5cbf0227cf596822"} err="failed to get container status \"8e72b84c544f51e7197c61840cb7740f799acb27090aa3ce5cbf0227cf596822\": rpc error: code = NotFound desc = could not find container \"8e72b84c544f51e7197c61840cb7740f799acb27090aa3ce5cbf0227cf596822\": container with ID starting with 8e72b84c544f51e7197c61840cb7740f799acb27090aa3ce5cbf0227cf596822 not found: ID does not exist" Jun 12 22:26:15.967325 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.967301 2558 scope.go:117] "RemoveContainer" containerID="63fb69f74cbe81a093c2db5960f3776d491f7e55ce5ade4c47ca13f56927d41c" Jun 12 22:26:15.967543 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.967526 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63fb69f74cbe81a093c2db5960f3776d491f7e55ce5ade4c47ca13f56927d41c"} err="failed to get container status \"63fb69f74cbe81a093c2db5960f3776d491f7e55ce5ade4c47ca13f56927d41c\": rpc error: code = NotFound desc = could not find container \"63fb69f74cbe81a093c2db5960f3776d491f7e55ce5ade4c47ca13f56927d41c\": container with ID starting with 63fb69f74cbe81a093c2db5960f3776d491f7e55ce5ade4c47ca13f56927d41c not found: ID does not exist" Jun 12 22:26:15.967599 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.967543 2558 scope.go:117] "RemoveContainer" containerID="ba4a1b13531a69fee3683a2284374174a91d2866b63ed6fa67c9ee18b9508d4d" Jun 12 22:26:15.967731 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.967711 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba4a1b13531a69fee3683a2284374174a91d2866b63ed6fa67c9ee18b9508d4d"} err="failed to get container status \"ba4a1b13531a69fee3683a2284374174a91d2866b63ed6fa67c9ee18b9508d4d\": rpc error: code = NotFound desc = could not find container \"ba4a1b13531a69fee3683a2284374174a91d2866b63ed6fa67c9ee18b9508d4d\": container with ID starting with ba4a1b13531a69fee3683a2284374174a91d2866b63ed6fa67c9ee18b9508d4d not found: ID does not exist" Jun 12 22:26:15.967775 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.967732 2558 scope.go:117] "RemoveContainer" containerID="ffd7c226476ebbe71630313f4426c1a4b0a42ef00fcef05236a8817949e4368e" Jun 12 22:26:15.967934 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.967914 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffd7c226476ebbe71630313f4426c1a4b0a42ef00fcef05236a8817949e4368e"} err="failed to get container status \"ffd7c226476ebbe71630313f4426c1a4b0a42ef00fcef05236a8817949e4368e\": rpc error: code = NotFound desc = could not find container \"ffd7c226476ebbe71630313f4426c1a4b0a42ef00fcef05236a8817949e4368e\": container with ID starting with ffd7c226476ebbe71630313f4426c1a4b0a42ef00fcef05236a8817949e4368e not found: ID does not exist" Jun 12 22:26:15.967977 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.967935 2558 scope.go:117] "RemoveContainer" containerID="d2129fde80abc9258cc3618d33a5d8794a3128a640cb445141eea96515ed35e2" Jun 12 22:26:15.968152 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.968134 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2129fde80abc9258cc3618d33a5d8794a3128a640cb445141eea96515ed35e2"} err="failed to get container status \"d2129fde80abc9258cc3618d33a5d8794a3128a640cb445141eea96515ed35e2\": rpc error: code = NotFound desc = could not find container \"d2129fde80abc9258cc3618d33a5d8794a3128a640cb445141eea96515ed35e2\": container with ID starting with d2129fde80abc9258cc3618d33a5d8794a3128a640cb445141eea96515ed35e2 not found: ID does not exist" Jun 12 22:26:15.968152 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.968151 2558 scope.go:117] "RemoveContainer" containerID="f08f5127c71c02edfccae051354a7ee294e038161c64571a4733b399e4106ca3" Jun 12 22:26:15.968377 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.968360 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f08f5127c71c02edfccae051354a7ee294e038161c64571a4733b399e4106ca3"} err="failed to get container status \"f08f5127c71c02edfccae051354a7ee294e038161c64571a4733b399e4106ca3\": rpc error: code = NotFound desc = could not find container \"f08f5127c71c02edfccae051354a7ee294e038161c64571a4733b399e4106ca3\": container with ID starting with f08f5127c71c02edfccae051354a7ee294e038161c64571a4733b399e4106ca3 not found: ID does not exist" Jun 12 22:26:15.968421 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.968378 2558 scope.go:117] "RemoveContainer" containerID="86b3228f4756b6f9a190f53b6fa9cf19a10da23ebb2d05a567a196f3cd73f40f" Jun 12 22:26:15.968602 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.968583 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86b3228f4756b6f9a190f53b6fa9cf19a10da23ebb2d05a567a196f3cd73f40f"} err="failed to get container status \"86b3228f4756b6f9a190f53b6fa9cf19a10da23ebb2d05a567a196f3cd73f40f\": rpc error: code = NotFound desc = could not find container \"86b3228f4756b6f9a190f53b6fa9cf19a10da23ebb2d05a567a196f3cd73f40f\": container with ID starting with 86b3228f4756b6f9a190f53b6fa9cf19a10da23ebb2d05a567a196f3cd73f40f not found: ID does not exist" Jun 12 22:26:15.968646 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.968604 2558 scope.go:117] "RemoveContainer" containerID="8e72b84c544f51e7197c61840cb7740f799acb27090aa3ce5cbf0227cf596822" Jun 12 22:26:15.968826 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:15.968804 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e72b84c544f51e7197c61840cb7740f799acb27090aa3ce5cbf0227cf596822"} err="failed to get container status \"8e72b84c544f51e7197c61840cb7740f799acb27090aa3ce5cbf0227cf596822\": rpc error: code = NotFound desc = could not find container \"8e72b84c544f51e7197c61840cb7740f799acb27090aa3ce5cbf0227cf596822\": container with ID starting with 8e72b84c544f51e7197c61840cb7740f799acb27090aa3ce5cbf0227cf596822 not found: ID does not exist" Jun 12 22:26:16.007920 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.007889 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 22:26:16.008341 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.008322 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e5eef27-86ad-47f4-8b38-b331d9661b7f" containerName="console" Jun 12 22:26:16.008382 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.008347 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e5eef27-86ad-47f4-8b38-b331d9661b7f" containerName="console" Jun 12 22:26:16.008382 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.008364 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="kube-rbac-proxy" Jun 12 22:26:16.008382 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.008374 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="kube-rbac-proxy" Jun 12 22:26:16.008503 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.008388 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="prom-label-proxy" Jun 12 22:26:16.008503 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.008398 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="prom-label-proxy" Jun 12 22:26:16.008503 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.008413 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="config-reloader" Jun 12 22:26:16.008503 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.008422 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="config-reloader" Jun 12 22:26:16.008503 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.008449 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="alertmanager" Jun 12 22:26:16.008503 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.008460 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="alertmanager" Jun 12 22:26:16.008503 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.008475 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="kube-rbac-proxy-metric" Jun 12 22:26:16.008503 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.008483 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="kube-rbac-proxy-metric" Jun 12 22:26:16.008503 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.008498 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="kube-rbac-proxy-web" Jun 12 22:26:16.008747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.008507 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="kube-rbac-proxy-web" Jun 12 22:26:16.008747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.008516 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="init-config-reloader" Jun 12 22:26:16.008747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.008523 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="init-config-reloader" Jun 12 22:26:16.008747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.008581 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="kube-rbac-proxy" Jun 12 22:26:16.008747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.008589 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="prom-label-proxy" Jun 12 22:26:16.008747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.008597 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="config-reloader" Jun 12 22:26:16.008747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.008605 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="alertmanager" Jun 12 22:26:16.008747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.008611 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e5eef27-86ad-47f4-8b38-b331d9661b7f" containerName="console" Jun 12 22:26:16.008747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.008616 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="kube-rbac-proxy-metric" Jun 12 22:26:16.008747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.008622 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="978305f8-aa11-445c-a27c-058443bb27fe" containerName="kube-rbac-proxy-web" Jun 12 22:26:16.011719 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.011701 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.014887 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:16.014829 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-main-tls\" is forbidden: User \"system:node:ip-10-0-135-250.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-135-250.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" type="*v1.Secret" Jun 12 22:26:16.016102 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:16.016075 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-kube-rbac-proxy-web\" is forbidden: User \"system:node:ip-10-0-135-250.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-135-250.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" type="*v1.Secret" Jun 12 22:26:16.016102 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:16.016076 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-135-250.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-135-250.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" type="*v1.Secret" Jun 12 22:26:16.016254 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:16.016080 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"alertmanager-trusted-ca-bundle\" is forbidden: User \"system:node:ip-10-0-135-250.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-135-250.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" type="*v1.ConfigMap" Jun 12 22:26:16.016254 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:16.016081 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-main-generated\" is forbidden: User \"system:node:ip-10-0-135-250.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-135-250.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" type="*v1.Secret" Jun 12 22:26:16.016254 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:16.016110 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-main-dockercfg-g7ssb\" is forbidden: User \"system:node:ip-10-0-135-250.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-135-250.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-g7ssb\"" type="*v1.Secret" Jun 12 22:26:16.016851 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:16.016820 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-main-cluster-tls-config\" is forbidden: User \"system:node:ip-10-0-135-250.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-135-250.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" type="*v1.Secret" Jun 12 22:26:16.016851 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:16.016827 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"alertmanager-main-0\" is forbidden: User \"system:node:ip-10-0-135-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-135-250.ec2.internal' and this object" podUID="f1353a83-4b8f-43a6-bc37-c384342c5074" pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.017010 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:16.016832 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-main-tls-assets-0\" is forbidden: User \"system:node:ip-10-0-135-250.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-135-250.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" type="*v1.Secret" Jun 12 22:26:16.017010 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:16.016852 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-main-web-config\" is forbidden: User \"system:node:ip-10-0-135-250.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-135-250.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" type="*v1.Secret" Jun 12 22:26:16.017988 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:16.017962 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"alertmanager-kube-rbac-proxy-metric\" is forbidden: User \"system:node:ip-10-0-135-250.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-135-250.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" type="*v1.Secret" Jun 12 22:26:16.031650 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.031625 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-web-config\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.031749 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.031659 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1353a83-4b8f-43a6-bc37-c384342c5074-config-out\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.031749 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.031686 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.031833 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.031771 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.031833 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.031807 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1353a83-4b8f-43a6-bc37-c384342c5074-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.031933 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.031835 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.031933 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.031858 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-config-volume\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.031933 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.031888 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f1353a83-4b8f-43a6-bc37-c384342c5074-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.031933 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.031925 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.032098 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.031953 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.032098 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.031977 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1353a83-4b8f-43a6-bc37-c384342c5074-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.032098 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.032002 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vj29\" (UniqueName: \"kubernetes.io/projected/f1353a83-4b8f-43a6-bc37-c384342c5074-kube-api-access-8vj29\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.032098 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.032077 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1353a83-4b8f-43a6-bc37-c384342c5074-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.056442 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.056411 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 22:26:16.132976 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.132947 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-web-config\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.133101 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.132983 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1353a83-4b8f-43a6-bc37-c384342c5074-config-out\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.133101 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.133001 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.133101 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.133024 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.133101 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.133047 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1353a83-4b8f-43a6-bc37-c384342c5074-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.133101 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.133076 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.133309 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.133102 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-config-volume\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.133309 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.133211 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f1353a83-4b8f-43a6-bc37-c384342c5074-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.133309 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.133252 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.133309 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.133279 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.133309 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.133305 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1353a83-4b8f-43a6-bc37-c384342c5074-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.133558 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.133330 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vj29\" (UniqueName: \"kubernetes.io/projected/f1353a83-4b8f-43a6-bc37-c384342c5074-kube-api-access-8vj29\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.133558 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.133402 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1353a83-4b8f-43a6-bc37-c384342c5074-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.133648 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.133565 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f1353a83-4b8f-43a6-bc37-c384342c5074-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.133915 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.133898 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1353a83-4b8f-43a6-bc37-c384342c5074-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.135320 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.135301 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1353a83-4b8f-43a6-bc37-c384342c5074-config-out\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.146948 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.146921 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vj29\" (UniqueName: \"kubernetes.io/projected/f1353a83-4b8f-43a6-bc37-c384342c5074-kube-api-access-8vj29\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.573561 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.573523 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="978305f8-aa11-445c-a27c-058443bb27fe" path="/var/lib/kubelet/pods/978305f8-aa11-445c-a27c-058443bb27fe/volumes" Jun 12 22:26:16.904533 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.904448 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lqpxm" event={"ID":"5707213e-da61-4306-96d0-03a1790eb281","Type":"ContainerStarted","Data":"26b0dc77eddbf20e1480e4d01691628f8eb2792057af248f431265bac5a720f5"} Jun 12 22:26:16.908779 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.908759 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 12 22:26:16.916451 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.916393 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.953500 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.953470 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 12 22:26:16.953789 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.953479 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lqpxm" podStartSLOduration=376.010835939 podStartE2EDuration="6m16.953463787s" totalImagesPullingTime="942.627848ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:26:16.953048518 +0000 UTC m=+376.824078639" watchObservedRunningTime="2026-06-12 22:26:16.953463787 +0000 UTC m=+376.824493907" Jun 12 22:26:16.965890 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.965866 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-web-config\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:16.972734 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.972715 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 12 22:26:16.975687 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:16.975665 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:17.055933 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:17.055904 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 12 22:26:17.065825 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:17.065801 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:17.077524 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:17.077502 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 12 22:26:17.085485 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:17.085464 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-config-volume\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:17.133202 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:17.133175 2558 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-kube-rbac-proxy-metric: failed to sync secret cache: timed out waiting for the condition Jun 12 22:26:17.133202 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:17.133189 2558 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-kube-rbac-proxy-web: failed to sync secret cache: timed out waiting for the condition Jun 12 22:26:17.133345 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:17.133246 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-secret-alertmanager-kube-rbac-proxy-metric podName:f1353a83-4b8f-43a6-bc37-c384342c5074 nodeName:}" failed. No retries permitted until 2026-06-12 22:26:17.633229234 +0000 UTC m=+377.504259332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-kube-rbac-proxy-metric" (UniqueName: "kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-secret-alertmanager-kube-rbac-proxy-metric") pod "alertmanager-main-0" (UID: "f1353a83-4b8f-43a6-bc37-c384342c5074") : failed to sync secret cache: timed out waiting for the condition Jun 12 22:26:17.133345 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:17.133262 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-secret-alertmanager-kube-rbac-proxy-web podName:f1353a83-4b8f-43a6-bc37-c384342c5074 nodeName:}" failed. No retries permitted until 2026-06-12 22:26:17.633255272 +0000 UTC m=+377.504285371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-kube-rbac-proxy-web" (UniqueName: "kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-secret-alertmanager-kube-rbac-proxy-web") pod "alertmanager-main-0" (UID: "f1353a83-4b8f-43a6-bc37-c384342c5074") : failed to sync secret cache: timed out waiting for the condition Jun 12 22:26:17.133498 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:17.133488 2558 configmap.go:193] Couldn't get configMap openshift-monitoring/alertmanager-trusted-ca-bundle: failed to sync configmap cache: timed out waiting for the condition Jun 12 22:26:17.133541 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:17.133521 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f1353a83-4b8f-43a6-bc37-c384342c5074-alertmanager-trusted-ca-bundle podName:f1353a83-4b8f-43a6-bc37-c384342c5074 nodeName:}" failed. No retries permitted until 2026-06-12 22:26:17.633512364 +0000 UTC m=+377.504542464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/f1353a83-4b8f-43a6-bc37-c384342c5074-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "f1353a83-4b8f-43a6-bc37-c384342c5074") : failed to sync configmap cache: timed out waiting for the condition Jun 12 22:26:17.134276 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:17.134262 2558 projected.go:266] Couldn't get secret openshift-monitoring/alertmanager-main-tls-assets-0: failed to sync secret cache: timed out waiting for the condition Jun 12 22:26:17.134309 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:17.134279 2558 projected.go:196] Error preparing data for projected volume tls-assets for pod openshift-monitoring/alertmanager-main-0: failed to sync secret cache: timed out waiting for the condition Jun 12 22:26:17.134338 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:17.134320 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1353a83-4b8f-43a6-bc37-c384342c5074-tls-assets podName:f1353a83-4b8f-43a6-bc37-c384342c5074 nodeName:}" failed. No retries permitted until 2026-06-12 22:26:17.634307235 +0000 UTC m=+377.505337338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-assets" (UniqueName: "kubernetes.io/projected/f1353a83-4b8f-43a6-bc37-c384342c5074-tls-assets") pod "alertmanager-main-0" (UID: "f1353a83-4b8f-43a6-bc37-c384342c5074") : failed to sync secret cache: timed out waiting for the condition Jun 12 22:26:17.291278 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:17.291249 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 12 22:26:17.335485 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:17.335456 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-g7ssb\"" Jun 12 22:26:17.367648 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:17.367621 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 12 22:26:17.491553 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:17.491525 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 12 22:26:17.524886 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:17.524853 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 12 22:26:17.646312 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:17.646230 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:17.646312 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:17.646265 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:17.646743 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:17.646402 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1353a83-4b8f-43a6-bc37-c384342c5074-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:17.646743 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:17.646462 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1353a83-4b8f-43a6-bc37-c384342c5074-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:17.647314 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:17.647283 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1353a83-4b8f-43a6-bc37-c384342c5074-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:17.648788 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:17.648764 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:17.648883 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:17.648838 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1353a83-4b8f-43a6-bc37-c384342c5074-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:17.648883 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:17.648872 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f1353a83-4b8f-43a6-bc37-c384342c5074-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f1353a83-4b8f-43a6-bc37-c384342c5074\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:17.821571 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:17.821535 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:26:17.968345 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:17.968320 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 22:26:17.969447 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:26:17.969412 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1353a83_4b8f_43a6_bc37_c384342c5074.slice/crio-bb07112e06d683b6fe16b2bcbd562ff59716a557e62fc0515fec2e0bad6d15f2 WatchSource:0}: Error finding container bb07112e06d683b6fe16b2bcbd562ff59716a557e62fc0515fec2e0bad6d15f2: Status 404 returned error can't find the container with id bb07112e06d683b6fe16b2bcbd562ff59716a557e62fc0515fec2e0bad6d15f2 Jun 12 22:26:18.115842 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.115803 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-66dc9c979b-q4qgx"] Jun 12 22:26:18.118125 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.118100 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.120783 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.120762 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 12 22:26:18.121114 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.121089 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 12 22:26:18.121251 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.121146 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-grvj5\"" Jun 12 22:26:18.121251 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.121170 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 12 22:26:18.121551 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.121537 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 12 22:26:18.121551 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.121546 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 12 22:26:18.127078 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.127056 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 12 22:26:18.133606 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.133583 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66dc9c979b-q4qgx"] Jun 12 22:26:18.150857 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.150835 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7fc2fe3f-e2c1-4260-973a-39e6c6674569-federate-client-tls\") pod \"telemeter-client-66dc9c979b-q4qgx\" (UID: \"7fc2fe3f-e2c1-4260-973a-39e6c6674569\") " pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.150974 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.150870 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7fc2fe3f-e2c1-4260-973a-39e6c6674569-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66dc9c979b-q4qgx\" (UID: \"7fc2fe3f-e2c1-4260-973a-39e6c6674569\") " pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.150974 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.150894 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7fc2fe3f-e2c1-4260-973a-39e6c6674569-metrics-client-ca\") pod \"telemeter-client-66dc9c979b-q4qgx\" (UID: \"7fc2fe3f-e2c1-4260-973a-39e6c6674569\") " pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.150974 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.150921 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fc2fe3f-e2c1-4260-973a-39e6c6674569-serving-certs-ca-bundle\") pod \"telemeter-client-66dc9c979b-q4qgx\" (UID: \"7fc2fe3f-e2c1-4260-973a-39e6c6674569\") " pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.150974 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.150959 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzzrm\" (UniqueName: \"kubernetes.io/projected/7fc2fe3f-e2c1-4260-973a-39e6c6674569-kube-api-access-xzzrm\") pod \"telemeter-client-66dc9c979b-q4qgx\" (UID: \"7fc2fe3f-e2c1-4260-973a-39e6c6674569\") " pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.151130 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.150977 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fc2fe3f-e2c1-4260-973a-39e6c6674569-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66dc9c979b-q4qgx\" (UID: \"7fc2fe3f-e2c1-4260-973a-39e6c6674569\") " pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.151130 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.151025 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7fc2fe3f-e2c1-4260-973a-39e6c6674569-secret-telemeter-client\") pod \"telemeter-client-66dc9c979b-q4qgx\" (UID: \"7fc2fe3f-e2c1-4260-973a-39e6c6674569\") " pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.151130 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.151046 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7fc2fe3f-e2c1-4260-973a-39e6c6674569-telemeter-client-tls\") pod \"telemeter-client-66dc9c979b-q4qgx\" (UID: \"7fc2fe3f-e2c1-4260-973a-39e6c6674569\") " pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.252395 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.252364 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7fc2fe3f-e2c1-4260-973a-39e6c6674569-secret-telemeter-client\") pod \"telemeter-client-66dc9c979b-q4qgx\" (UID: \"7fc2fe3f-e2c1-4260-973a-39e6c6674569\") " pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.252551 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.252401 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7fc2fe3f-e2c1-4260-973a-39e6c6674569-telemeter-client-tls\") pod \"telemeter-client-66dc9c979b-q4qgx\" (UID: \"7fc2fe3f-e2c1-4260-973a-39e6c6674569\") " pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.252551 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.252479 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7fc2fe3f-e2c1-4260-973a-39e6c6674569-federate-client-tls\") pod \"telemeter-client-66dc9c979b-q4qgx\" (UID: \"7fc2fe3f-e2c1-4260-973a-39e6c6674569\") " pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.252551 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.252504 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7fc2fe3f-e2c1-4260-973a-39e6c6674569-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66dc9c979b-q4qgx\" (UID: \"7fc2fe3f-e2c1-4260-973a-39e6c6674569\") " pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.252551 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.252528 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7fc2fe3f-e2c1-4260-973a-39e6c6674569-metrics-client-ca\") pod \"telemeter-client-66dc9c979b-q4qgx\" (UID: \"7fc2fe3f-e2c1-4260-973a-39e6c6674569\") " pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.252763 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.252558 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fc2fe3f-e2c1-4260-973a-39e6c6674569-serving-certs-ca-bundle\") pod \"telemeter-client-66dc9c979b-q4qgx\" (UID: \"7fc2fe3f-e2c1-4260-973a-39e6c6674569\") " pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.252763 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.252593 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzzrm\" (UniqueName: \"kubernetes.io/projected/7fc2fe3f-e2c1-4260-973a-39e6c6674569-kube-api-access-xzzrm\") pod \"telemeter-client-66dc9c979b-q4qgx\" (UID: \"7fc2fe3f-e2c1-4260-973a-39e6c6674569\") " pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.252763 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.252619 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fc2fe3f-e2c1-4260-973a-39e6c6674569-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66dc9c979b-q4qgx\" (UID: \"7fc2fe3f-e2c1-4260-973a-39e6c6674569\") " pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.253343 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.253314 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7fc2fe3f-e2c1-4260-973a-39e6c6674569-metrics-client-ca\") pod \"telemeter-client-66dc9c979b-q4qgx\" (UID: \"7fc2fe3f-e2c1-4260-973a-39e6c6674569\") " pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.253478 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.253340 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fc2fe3f-e2c1-4260-973a-39e6c6674569-serving-certs-ca-bundle\") pod \"telemeter-client-66dc9c979b-q4qgx\" (UID: \"7fc2fe3f-e2c1-4260-973a-39e6c6674569\") " pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.253574 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.253558 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fc2fe3f-e2c1-4260-973a-39e6c6674569-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66dc9c979b-q4qgx\" (UID: \"7fc2fe3f-e2c1-4260-973a-39e6c6674569\") " pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.255515 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.255489 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7fc2fe3f-e2c1-4260-973a-39e6c6674569-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66dc9c979b-q4qgx\" (UID: \"7fc2fe3f-e2c1-4260-973a-39e6c6674569\") " pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.255583 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.255568 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7fc2fe3f-e2c1-4260-973a-39e6c6674569-federate-client-tls\") pod \"telemeter-client-66dc9c979b-q4qgx\" (UID: \"7fc2fe3f-e2c1-4260-973a-39e6c6674569\") " pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.255627 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.255606 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7fc2fe3f-e2c1-4260-973a-39e6c6674569-secret-telemeter-client\") pod \"telemeter-client-66dc9c979b-q4qgx\" (UID: \"7fc2fe3f-e2c1-4260-973a-39e6c6674569\") " pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.255675 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.255656 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7fc2fe3f-e2c1-4260-973a-39e6c6674569-telemeter-client-tls\") pod \"telemeter-client-66dc9c979b-q4qgx\" (UID: \"7fc2fe3f-e2c1-4260-973a-39e6c6674569\") " pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.262965 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.262944 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzzrm\" (UniqueName: \"kubernetes.io/projected/7fc2fe3f-e2c1-4260-973a-39e6c6674569-kube-api-access-xzzrm\") pod \"telemeter-client-66dc9c979b-q4qgx\" (UID: \"7fc2fe3f-e2c1-4260-973a-39e6c6674569\") " pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.436009 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.435969 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" Jun 12 22:26:18.605875 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.605848 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66dc9c979b-q4qgx"] Jun 12 22:26:18.608368 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:26:18.608337 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fc2fe3f_e2c1_4260_973a_39e6c6674569.slice/crio-e20397d691db4c0dafd8b29e29d28e27c5ecb0d11d1eb678ab327d47284667f2 WatchSource:0}: Error finding container e20397d691db4c0dafd8b29e29d28e27c5ecb0d11d1eb678ab327d47284667f2: Status 404 returned error can't find the container with id e20397d691db4c0dafd8b29e29d28e27c5ecb0d11d1eb678ab327d47284667f2 Jun 12 22:26:18.914989 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.914896 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" event={"ID":"7fc2fe3f-e2c1-4260-973a-39e6c6674569","Type":"ContainerStarted","Data":"e20397d691db4c0dafd8b29e29d28e27c5ecb0d11d1eb678ab327d47284667f2"} Jun 12 22:26:18.916298 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.916272 2558 generic.go:356] "Generic (PLEG): container finished" podID="f1353a83-4b8f-43a6-bc37-c384342c5074" containerID="3a9fbd07facbbb8ec030636cb9059ba32ada383ffbe40c111ace6bb3e1bd2de7" exitCode=0 Jun 12 22:26:18.916411 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.916329 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1353a83-4b8f-43a6-bc37-c384342c5074","Type":"ContainerDied","Data":"3a9fbd07facbbb8ec030636cb9059ba32ada383ffbe40c111ace6bb3e1bd2de7"} Jun 12 22:26:18.916411 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:18.916381 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1353a83-4b8f-43a6-bc37-c384342c5074","Type":"ContainerStarted","Data":"bb07112e06d683b6fe16b2bcbd562ff59716a557e62fc0515fec2e0bad6d15f2"} Jun 12 22:26:19.924510 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:19.924469 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1353a83-4b8f-43a6-bc37-c384342c5074","Type":"ContainerStarted","Data":"471499d922afcf3d4427e4910eb3c18a9cf641ae289f36358f193ee98e5a00ab"} Jun 12 22:26:19.924896 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:19.924542 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1353a83-4b8f-43a6-bc37-c384342c5074","Type":"ContainerStarted","Data":"4dfbd790eb30664d35ee66f823db1c1e54ceab60439a4a8c93a30695c9181ad0"} Jun 12 22:26:19.924896 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:19.924568 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1353a83-4b8f-43a6-bc37-c384342c5074","Type":"ContainerStarted","Data":"1489d90d9eed01799373fe24a40420f55a919b1221cd8a9f915f72f5a280386c"} Jun 12 22:26:19.924896 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:19.924603 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1353a83-4b8f-43a6-bc37-c384342c5074","Type":"ContainerStarted","Data":"1cada7826f39e2e33880a876d64b14c1f0d5a0dc197430b346681a2ab452c9e9"} Jun 12 22:26:19.924896 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:19.924630 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1353a83-4b8f-43a6-bc37-c384342c5074","Type":"ContainerStarted","Data":"4fa0eeaab019420b4cf523f3515cf6352d4a4d7fe8a21e3e5cf121d7f00ce547"} Jun 12 22:26:19.924896 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:19.924655 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1353a83-4b8f-43a6-bc37-c384342c5074","Type":"ContainerStarted","Data":"189cbd6adfdeddb654475e3df1ef6874d4453a545b140613fdebfb0baa365734"} Jun 12 22:26:19.955099 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:19.955051 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.938009124 podStartE2EDuration="4.955033979s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.024855ms" isStatefulPod=false podCreationTimestamp="2026-06-12 22:26:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:26:19.953796144 +0000 UTC m=+379.824826265" watchObservedRunningTime="2026-06-12 22:26:19.955033979 +0000 UTC m=+379.826064099" Jun 12 22:26:20.931232 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:20.931190 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" event={"ID":"7fc2fe3f-e2c1-4260-973a-39e6c6674569","Type":"ContainerStarted","Data":"bf0ee72cc044c49c53f607ad34827731b12d706c0beda34aa7173e298c39557c"} Jun 12 22:26:20.931625 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:20.931248 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" event={"ID":"7fc2fe3f-e2c1-4260-973a-39e6c6674569","Type":"ContainerStarted","Data":"cc8158ebdbd4c6c9cdcdd20c21226f185989cd574ee337ed22a54b7077976af2"} Jun 12 22:26:20.931625 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:20.931275 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" event={"ID":"7fc2fe3f-e2c1-4260-973a-39e6c6674569","Type":"ContainerStarted","Data":"84cb47c5599eebea68dcc3214960bb2186fd83a7d62bc9a69b3b04d6b5ed6b91"} Jun 12 22:26:20.961365 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:20.961308 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-66dc9c979b-q4qgx" podStartSLOduration=1.078360916 podStartE2EDuration="2.961291907s" totalImagesPullingTime="1.882930991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:26:20.960216407 +0000 UTC m=+380.831246528" watchObservedRunningTime="2026-06-12 22:26:20.961291907 +0000 UTC m=+380.832322028" Jun 12 22:26:21.687880 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:21.687850 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-948bc78c6-jz5q7"] Jun 12 22:26:21.690018 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:21.690001 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:21.738007 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:21.737975 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-948bc78c6-jz5q7"] Jun 12 22:26:21.781875 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:21.781837 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbtxt\" (UniqueName: \"kubernetes.io/projected/edf24dee-f252-4078-8f7f-edb8c27116af-kube-api-access-jbtxt\") pod \"console-948bc78c6-jz5q7\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:21.781875 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:21.781875 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edf24dee-f252-4078-8f7f-edb8c27116af-console-config\") pod \"console-948bc78c6-jz5q7\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:21.782125 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:21.781932 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edf24dee-f252-4078-8f7f-edb8c27116af-trusted-ca-bundle\") pod \"console-948bc78c6-jz5q7\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:21.782125 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:21.781982 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edf24dee-f252-4078-8f7f-edb8c27116af-oauth-serving-cert\") pod \"console-948bc78c6-jz5q7\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:21.782125 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:21.782021 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edf24dee-f252-4078-8f7f-edb8c27116af-console-serving-cert\") pod \"console-948bc78c6-jz5q7\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:21.782125 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:21.782048 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edf24dee-f252-4078-8f7f-edb8c27116af-service-ca\") pod \"console-948bc78c6-jz5q7\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:21.782125 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:21.782098 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edf24dee-f252-4078-8f7f-edb8c27116af-console-oauth-config\") pod \"console-948bc78c6-jz5q7\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:21.882581 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:21.882541 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edf24dee-f252-4078-8f7f-edb8c27116af-console-serving-cert\") pod \"console-948bc78c6-jz5q7\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:21.882581 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:21.882581 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edf24dee-f252-4078-8f7f-edb8c27116af-service-ca\") pod \"console-948bc78c6-jz5q7\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:21.882780 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:21.882602 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edf24dee-f252-4078-8f7f-edb8c27116af-console-oauth-config\") pod \"console-948bc78c6-jz5q7\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:21.882780 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:21.882684 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbtxt\" (UniqueName: \"kubernetes.io/projected/edf24dee-f252-4078-8f7f-edb8c27116af-kube-api-access-jbtxt\") pod \"console-948bc78c6-jz5q7\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:21.882780 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:21.882708 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edf24dee-f252-4078-8f7f-edb8c27116af-console-config\") pod \"console-948bc78c6-jz5q7\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:21.882780 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:21.882744 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edf24dee-f252-4078-8f7f-edb8c27116af-trusted-ca-bundle\") pod \"console-948bc78c6-jz5q7\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:21.882780 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:21.882763 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edf24dee-f252-4078-8f7f-edb8c27116af-oauth-serving-cert\") pod \"console-948bc78c6-jz5q7\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:21.883505 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:21.883476 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edf24dee-f252-4078-8f7f-edb8c27116af-service-ca\") pod \"console-948bc78c6-jz5q7\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:21.883505 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:21.883490 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edf24dee-f252-4078-8f7f-edb8c27116af-console-config\") pod \"console-948bc78c6-jz5q7\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:21.883656 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:21.883515 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edf24dee-f252-4078-8f7f-edb8c27116af-oauth-serving-cert\") pod \"console-948bc78c6-jz5q7\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:21.883738 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:21.883720 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edf24dee-f252-4078-8f7f-edb8c27116af-trusted-ca-bundle\") pod \"console-948bc78c6-jz5q7\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:21.885675 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:21.885655 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edf24dee-f252-4078-8f7f-edb8c27116af-console-oauth-config\") pod \"console-948bc78c6-jz5q7\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:21.885725 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:21.885663 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edf24dee-f252-4078-8f7f-edb8c27116af-console-serving-cert\") pod \"console-948bc78c6-jz5q7\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:21.891315 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:21.891293 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbtxt\" (UniqueName: \"kubernetes.io/projected/edf24dee-f252-4078-8f7f-edb8c27116af-kube-api-access-jbtxt\") pod \"console-948bc78c6-jz5q7\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:21.999642 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:21.999563 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:22.132540 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:22.132514 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-948bc78c6-jz5q7"] Jun 12 22:26:22.134838 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:26:22.134811 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedf24dee_f252_4078_8f7f_edb8c27116af.slice/crio-a987ffa634f77df98be07bbb2a638c4799e026f53c75cef25dffbbb1b9d4a064 WatchSource:0}: Error finding container a987ffa634f77df98be07bbb2a638c4799e026f53c75cef25dffbbb1b9d4a064: Status 404 returned error can't find the container with id a987ffa634f77df98be07bbb2a638c4799e026f53c75cef25dffbbb1b9d4a064 Jun 12 22:26:22.941960 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:22.941922 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-948bc78c6-jz5q7" event={"ID":"edf24dee-f252-4078-8f7f-edb8c27116af","Type":"ContainerStarted","Data":"111eca11c076826e94ae2988ac5aeb522d11ac56ab9341a0896f3138aa8cc132"} Jun 12 22:26:22.942182 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:22.941978 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-948bc78c6-jz5q7" event={"ID":"edf24dee-f252-4078-8f7f-edb8c27116af","Type":"ContainerStarted","Data":"a987ffa634f77df98be07bbb2a638c4799e026f53c75cef25dffbbb1b9d4a064"} Jun 12 22:26:22.961339 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:22.961287 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-948bc78c6-jz5q7" podStartSLOduration=1.9612721149999999 podStartE2EDuration="1.961272115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:26:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:26:22.95999608 +0000 UTC m=+382.831026200" watchObservedRunningTime="2026-06-12 22:26:22.961272115 +0000 UTC m=+382.832302235" Jun 12 22:26:32.000186 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:32.000152 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:32.000653 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:32.000228 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:32.004892 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:32.004872 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:32.987051 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:32.987021 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:26:33.034310 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:33.034276 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56844fdccf-9jqkg"] Jun 12 22:26:58.056313 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:58.056254 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-56844fdccf-9jqkg" podUID="dcda5c31-d9f2-45a1-b531-a80d97e9e909" containerName="console" containerID="cri-o://8adf2a634a60164790d3a010f1e326dc1006814c6e453d54041d1c0aeeadf19f" gracePeriod=15 Jun 12 22:26:58.296299 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:58.296276 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:26:58.390314 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:58.390232 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcda5c31-d9f2-45a1-b531-a80d97e9e909-service-ca\") pod \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " Jun 12 22:26:58.390314 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:58.390274 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcda5c31-d9f2-45a1-b531-a80d97e9e909-console-oauth-config\") pod \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " Jun 12 22:26:58.390314 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:58.390314 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcda5c31-d9f2-45a1-b531-a80d97e9e909-oauth-serving-cert\") pod \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " Jun 12 22:26:58.390599 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:58.390344 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcda5c31-d9f2-45a1-b531-a80d97e9e909-trusted-ca-bundle\") pod \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " Jun 12 22:26:58.390599 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:58.390390 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvn2t\" (UniqueName: \"kubernetes.io/projected/dcda5c31-d9f2-45a1-b531-a80d97e9e909-kube-api-access-jvn2t\") pod \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " Jun 12 22:26:58.390599 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:58.390415 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcda5c31-d9f2-45a1-b531-a80d97e9e909-console-config\") pod \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " Jun 12 22:26:58.390599 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:58.390481 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcda5c31-d9f2-45a1-b531-a80d97e9e909-console-serving-cert\") pod \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\" (UID: \"dcda5c31-d9f2-45a1-b531-a80d97e9e909\") " Jun 12 22:26:58.390804 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:58.390641 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcda5c31-d9f2-45a1-b531-a80d97e9e909-service-ca" (OuterVolumeSpecName: "service-ca") pod "dcda5c31-d9f2-45a1-b531-a80d97e9e909" (UID: "dcda5c31-d9f2-45a1-b531-a80d97e9e909"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:26:58.390804 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:58.390772 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcda5c31-d9f2-45a1-b531-a80d97e9e909-service-ca\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:26:58.390915 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:58.390841 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcda5c31-d9f2-45a1-b531-a80d97e9e909-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dcda5c31-d9f2-45a1-b531-a80d97e9e909" (UID: "dcda5c31-d9f2-45a1-b531-a80d97e9e909"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:26:58.390915 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:58.390852 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcda5c31-d9f2-45a1-b531-a80d97e9e909-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dcda5c31-d9f2-45a1-b531-a80d97e9e909" (UID: "dcda5c31-d9f2-45a1-b531-a80d97e9e909"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:26:58.390915 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:58.390867 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcda5c31-d9f2-45a1-b531-a80d97e9e909-console-config" (OuterVolumeSpecName: "console-config") pod "dcda5c31-d9f2-45a1-b531-a80d97e9e909" (UID: "dcda5c31-d9f2-45a1-b531-a80d97e9e909"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:26:58.392687 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:58.392655 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcda5c31-d9f2-45a1-b531-a80d97e9e909-kube-api-access-jvn2t" (OuterVolumeSpecName: "kube-api-access-jvn2t") pod "dcda5c31-d9f2-45a1-b531-a80d97e9e909" (UID: "dcda5c31-d9f2-45a1-b531-a80d97e9e909"). InnerVolumeSpecName "kube-api-access-jvn2t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:26:58.392790 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:58.392700 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcda5c31-d9f2-45a1-b531-a80d97e9e909-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dcda5c31-d9f2-45a1-b531-a80d97e9e909" (UID: "dcda5c31-d9f2-45a1-b531-a80d97e9e909"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:26:58.392790 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:58.392715 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcda5c31-d9f2-45a1-b531-a80d97e9e909-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dcda5c31-d9f2-45a1-b531-a80d97e9e909" (UID: "dcda5c31-d9f2-45a1-b531-a80d97e9e909"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:26:58.491766 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:58.491742 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvn2t\" (UniqueName: \"kubernetes.io/projected/dcda5c31-d9f2-45a1-b531-a80d97e9e909-kube-api-access-jvn2t\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:26:58.491766 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:58.491762 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcda5c31-d9f2-45a1-b531-a80d97e9e909-console-config\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:26:58.491766 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:58.491774 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcda5c31-d9f2-45a1-b531-a80d97e9e909-console-serving-cert\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:26:58.491999 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:58.491782 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcda5c31-d9f2-45a1-b531-a80d97e9e909-console-oauth-config\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:26:58.491999 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:58.491791 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcda5c31-d9f2-45a1-b531-a80d97e9e909-oauth-serving-cert\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:26:58.491999 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:58.491800 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcda5c31-d9f2-45a1-b531-a80d97e9e909-trusted-ca-bundle\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:26:59.088518 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:59.088482 2558 generic.go:356] "Generic (PLEG): container finished" podID="dcda5c31-d9f2-45a1-b531-a80d97e9e909" containerID="8adf2a634a60164790d3a010f1e326dc1006814c6e453d54041d1c0aeeadf19f" exitCode=0 Jun 12 22:26:59.088952 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:59.088527 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56844fdccf-9jqkg" Jun 12 22:26:59.088952 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:59.088565 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56844fdccf-9jqkg" event={"ID":"dcda5c31-d9f2-45a1-b531-a80d97e9e909","Type":"ContainerDied","Data":"8adf2a634a60164790d3a010f1e326dc1006814c6e453d54041d1c0aeeadf19f"} Jun 12 22:26:59.088952 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:59.088617 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56844fdccf-9jqkg" event={"ID":"dcda5c31-d9f2-45a1-b531-a80d97e9e909","Type":"ContainerDied","Data":"ca6e3237d12104481ffd50106bcc2cb49f9850afc23d4d82283ffbc9995b926b"} Jun 12 22:26:59.088952 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:59.088638 2558 scope.go:117] "RemoveContainer" containerID="8adf2a634a60164790d3a010f1e326dc1006814c6e453d54041d1c0aeeadf19f" Jun 12 22:26:59.097079 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:59.097055 2558 scope.go:117] "RemoveContainer" containerID="8adf2a634a60164790d3a010f1e326dc1006814c6e453d54041d1c0aeeadf19f" Jun 12 22:26:59.097341 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:26:59.097324 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8adf2a634a60164790d3a010f1e326dc1006814c6e453d54041d1c0aeeadf19f\": container with ID starting with 8adf2a634a60164790d3a010f1e326dc1006814c6e453d54041d1c0aeeadf19f not found: ID does not exist" containerID="8adf2a634a60164790d3a010f1e326dc1006814c6e453d54041d1c0aeeadf19f" Jun 12 22:26:59.097404 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:59.097349 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8adf2a634a60164790d3a010f1e326dc1006814c6e453d54041d1c0aeeadf19f"} err="failed to get container status \"8adf2a634a60164790d3a010f1e326dc1006814c6e453d54041d1c0aeeadf19f\": rpc error: code = NotFound desc = could not find container \"8adf2a634a60164790d3a010f1e326dc1006814c6e453d54041d1c0aeeadf19f\": container with ID starting with 8adf2a634a60164790d3a010f1e326dc1006814c6e453d54041d1c0aeeadf19f not found: ID does not exist" Jun 12 22:26:59.106397 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:59.106374 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56844fdccf-9jqkg"] Jun 12 22:26:59.113076 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:26:59.113052 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56844fdccf-9jqkg"] Jun 12 22:27:00.573325 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:00.573284 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcda5c31-d9f2-45a1-b531-a80d97e9e909" path="/var/lib/kubelet/pods/dcda5c31-d9f2-45a1-b531-a80d97e9e909/volumes" Jun 12 22:27:59.396270 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.396234 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-786bdb6f54-9dl8l"] Jun 12 22:27:59.396747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.396575 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcda5c31-d9f2-45a1-b531-a80d97e9e909" containerName="console" Jun 12 22:27:59.396747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.396588 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcda5c31-d9f2-45a1-b531-a80d97e9e909" containerName="console" Jun 12 22:27:59.396747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.396672 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcda5c31-d9f2-45a1-b531-a80d97e9e909" containerName="console" Jun 12 22:27:59.399723 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.399701 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:27:59.415102 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.415078 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-786bdb6f54-9dl8l"] Jun 12 22:27:59.495554 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.495522 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/887b7e97-8ee7-42c2-a6ba-180447d07b5e-trusted-ca-bundle\") pod \"console-786bdb6f54-9dl8l\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:27:59.495715 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.495573 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27jz7\" (UniqueName: \"kubernetes.io/projected/887b7e97-8ee7-42c2-a6ba-180447d07b5e-kube-api-access-27jz7\") pod \"console-786bdb6f54-9dl8l\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:27:59.495715 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.495602 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/887b7e97-8ee7-42c2-a6ba-180447d07b5e-console-oauth-config\") pod \"console-786bdb6f54-9dl8l\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:27:59.495715 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.495634 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/887b7e97-8ee7-42c2-a6ba-180447d07b5e-oauth-serving-cert\") pod \"console-786bdb6f54-9dl8l\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:27:59.495715 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.495683 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/887b7e97-8ee7-42c2-a6ba-180447d07b5e-service-ca\") pod \"console-786bdb6f54-9dl8l\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:27:59.495850 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.495729 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/887b7e97-8ee7-42c2-a6ba-180447d07b5e-console-serving-cert\") pod \"console-786bdb6f54-9dl8l\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:27:59.495850 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.495772 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/887b7e97-8ee7-42c2-a6ba-180447d07b5e-console-config\") pod \"console-786bdb6f54-9dl8l\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:27:59.596899 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.596871 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/887b7e97-8ee7-42c2-a6ba-180447d07b5e-trusted-ca-bundle\") pod \"console-786bdb6f54-9dl8l\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:27:59.597013 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.596912 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27jz7\" (UniqueName: \"kubernetes.io/projected/887b7e97-8ee7-42c2-a6ba-180447d07b5e-kube-api-access-27jz7\") pod \"console-786bdb6f54-9dl8l\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:27:59.597013 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.596932 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/887b7e97-8ee7-42c2-a6ba-180447d07b5e-console-oauth-config\") pod \"console-786bdb6f54-9dl8l\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:27:59.597013 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.596962 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/887b7e97-8ee7-42c2-a6ba-180447d07b5e-oauth-serving-cert\") pod \"console-786bdb6f54-9dl8l\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:27:59.597013 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.597004 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/887b7e97-8ee7-42c2-a6ba-180447d07b5e-service-ca\") pod \"console-786bdb6f54-9dl8l\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:27:59.597220 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.597032 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/887b7e97-8ee7-42c2-a6ba-180447d07b5e-console-serving-cert\") pod \"console-786bdb6f54-9dl8l\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:27:59.597220 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.597065 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/887b7e97-8ee7-42c2-a6ba-180447d07b5e-console-config\") pod \"console-786bdb6f54-9dl8l\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:27:59.597860 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.597833 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/887b7e97-8ee7-42c2-a6ba-180447d07b5e-service-ca\") pod \"console-786bdb6f54-9dl8l\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:27:59.597970 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.597846 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/887b7e97-8ee7-42c2-a6ba-180447d07b5e-console-config\") pod \"console-786bdb6f54-9dl8l\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:27:59.597970 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.597960 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/887b7e97-8ee7-42c2-a6ba-180447d07b5e-oauth-serving-cert\") pod \"console-786bdb6f54-9dl8l\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:27:59.598042 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.597970 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/887b7e97-8ee7-42c2-a6ba-180447d07b5e-trusted-ca-bundle\") pod \"console-786bdb6f54-9dl8l\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:27:59.599984 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.599960 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/887b7e97-8ee7-42c2-a6ba-180447d07b5e-console-oauth-config\") pod \"console-786bdb6f54-9dl8l\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:27:59.600080 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.600042 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/887b7e97-8ee7-42c2-a6ba-180447d07b5e-console-serving-cert\") pod \"console-786bdb6f54-9dl8l\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:27:59.607929 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.607903 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27jz7\" (UniqueName: \"kubernetes.io/projected/887b7e97-8ee7-42c2-a6ba-180447d07b5e-kube-api-access-27jz7\") pod \"console-786bdb6f54-9dl8l\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:27:59.708768 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.708702 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:27:59.838317 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:27:59.838287 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-786bdb6f54-9dl8l"] Jun 12 22:27:59.841291 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:27:59.841264 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod887b7e97_8ee7_42c2_a6ba_180447d07b5e.slice/crio-40e306e897a74dffb6be094335050dfec99b661b2a204bad4000134d696edc5c WatchSource:0}: Error finding container 40e306e897a74dffb6be094335050dfec99b661b2a204bad4000134d696edc5c: Status 404 returned error can't find the container with id 40e306e897a74dffb6be094335050dfec99b661b2a204bad4000134d696edc5c Jun 12 22:28:00.334145 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:00.334108 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786bdb6f54-9dl8l" event={"ID":"887b7e97-8ee7-42c2-a6ba-180447d07b5e","Type":"ContainerStarted","Data":"c756aa9ed915ccf5c28cc51800492002343e09976086f8b5d8d246ac12118439"} Jun 12 22:28:00.334327 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:00.334161 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786bdb6f54-9dl8l" event={"ID":"887b7e97-8ee7-42c2-a6ba-180447d07b5e","Type":"ContainerStarted","Data":"40e306e897a74dffb6be094335050dfec99b661b2a204bad4000134d696edc5c"} Jun 12 22:28:00.352797 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:00.352742 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-786bdb6f54-9dl8l" podStartSLOduration=1.352725138 podStartE2EDuration="1.352725138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:27:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:28:00.352083545 +0000 UTC m=+480.223113667" watchObservedRunningTime="2026-06-12 22:28:00.352725138 +0000 UTC m=+480.223755280" Jun 12 22:28:09.709164 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:09.709118 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:28:09.709753 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:09.709192 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:28:09.714105 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:09.714080 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:28:10.383358 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:10.383326 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:28:10.429149 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:10.429114 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-948bc78c6-jz5q7"] Jun 12 22:28:35.450025 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:35.449959 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-948bc78c6-jz5q7" podUID="edf24dee-f252-4078-8f7f-edb8c27116af" containerName="console" containerID="cri-o://111eca11c076826e94ae2988ac5aeb522d11ac56ab9341a0896f3138aa8cc132" gracePeriod=15 Jun 12 22:28:35.696987 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:35.696961 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:28:35.715803 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:35.715728 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edf24dee-f252-4078-8f7f-edb8c27116af-oauth-serving-cert\") pod \"edf24dee-f252-4078-8f7f-edb8c27116af\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " Jun 12 22:28:35.715803 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:35.715775 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edf24dee-f252-4078-8f7f-edb8c27116af-console-serving-cert\") pod \"edf24dee-f252-4078-8f7f-edb8c27116af\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " Jun 12 22:28:35.715803 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:35.715793 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edf24dee-f252-4078-8f7f-edb8c27116af-service-ca\") pod \"edf24dee-f252-4078-8f7f-edb8c27116af\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " Jun 12 22:28:35.716081 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:35.715823 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edf24dee-f252-4078-8f7f-edb8c27116af-console-oauth-config\") pod \"edf24dee-f252-4078-8f7f-edb8c27116af\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " Jun 12 22:28:35.716248 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:35.716219 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edf24dee-f252-4078-8f7f-edb8c27116af-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "edf24dee-f252-4078-8f7f-edb8c27116af" (UID: "edf24dee-f252-4078-8f7f-edb8c27116af"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:28:35.716316 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:35.716297 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edf24dee-f252-4078-8f7f-edb8c27116af-service-ca" (OuterVolumeSpecName: "service-ca") pod "edf24dee-f252-4078-8f7f-edb8c27116af" (UID: "edf24dee-f252-4078-8f7f-edb8c27116af"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:28:35.716365 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:35.716349 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbtxt\" (UniqueName: \"kubernetes.io/projected/edf24dee-f252-4078-8f7f-edb8c27116af-kube-api-access-jbtxt\") pod \"edf24dee-f252-4078-8f7f-edb8c27116af\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " Jun 12 22:28:35.716426 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:35.716411 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edf24dee-f252-4078-8f7f-edb8c27116af-console-config\") pod \"edf24dee-f252-4078-8f7f-edb8c27116af\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " Jun 12 22:28:35.716560 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:35.716461 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edf24dee-f252-4078-8f7f-edb8c27116af-trusted-ca-bundle\") pod \"edf24dee-f252-4078-8f7f-edb8c27116af\" (UID: \"edf24dee-f252-4078-8f7f-edb8c27116af\") " Jun 12 22:28:35.716746 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:35.716727 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edf24dee-f252-4078-8f7f-edb8c27116af-oauth-serving-cert\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:28:35.716842 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:35.716751 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edf24dee-f252-4078-8f7f-edb8c27116af-service-ca\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:28:35.717208 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:35.717159 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edf24dee-f252-4078-8f7f-edb8c27116af-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "edf24dee-f252-4078-8f7f-edb8c27116af" (UID: "edf24dee-f252-4078-8f7f-edb8c27116af"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:28:35.717208 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:35.717182 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edf24dee-f252-4078-8f7f-edb8c27116af-console-config" (OuterVolumeSpecName: "console-config") pod "edf24dee-f252-4078-8f7f-edb8c27116af" (UID: "edf24dee-f252-4078-8f7f-edb8c27116af"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:28:35.718958 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:35.718929 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edf24dee-f252-4078-8f7f-edb8c27116af-kube-api-access-jbtxt" (OuterVolumeSpecName: "kube-api-access-jbtxt") pod "edf24dee-f252-4078-8f7f-edb8c27116af" (UID: "edf24dee-f252-4078-8f7f-edb8c27116af"). InnerVolumeSpecName "kube-api-access-jbtxt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:28:35.719086 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:35.718968 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edf24dee-f252-4078-8f7f-edb8c27116af-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "edf24dee-f252-4078-8f7f-edb8c27116af" (UID: "edf24dee-f252-4078-8f7f-edb8c27116af"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:28:35.719391 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:35.719360 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edf24dee-f252-4078-8f7f-edb8c27116af-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "edf24dee-f252-4078-8f7f-edb8c27116af" (UID: "edf24dee-f252-4078-8f7f-edb8c27116af"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:28:35.817362 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:35.817320 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edf24dee-f252-4078-8f7f-edb8c27116af-console-serving-cert\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:28:35.817362 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:35.817351 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edf24dee-f252-4078-8f7f-edb8c27116af-console-oauth-config\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:28:35.817362 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:35.817361 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbtxt\" (UniqueName: \"kubernetes.io/projected/edf24dee-f252-4078-8f7f-edb8c27116af-kube-api-access-jbtxt\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:28:35.817362 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:35.817370 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edf24dee-f252-4078-8f7f-edb8c27116af-console-config\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:28:35.817651 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:35.817382 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edf24dee-f252-4078-8f7f-edb8c27116af-trusted-ca-bundle\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:28:36.482903 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:36.482864 2558 generic.go:356] "Generic (PLEG): container finished" podID="edf24dee-f252-4078-8f7f-edb8c27116af" containerID="111eca11c076826e94ae2988ac5aeb522d11ac56ab9341a0896f3138aa8cc132" exitCode=0 Jun 12 22:28:36.483322 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:36.482913 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-948bc78c6-jz5q7" Jun 12 22:28:36.483322 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:36.482952 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-948bc78c6-jz5q7" event={"ID":"edf24dee-f252-4078-8f7f-edb8c27116af","Type":"ContainerDied","Data":"111eca11c076826e94ae2988ac5aeb522d11ac56ab9341a0896f3138aa8cc132"} Jun 12 22:28:36.483322 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:36.483002 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-948bc78c6-jz5q7" event={"ID":"edf24dee-f252-4078-8f7f-edb8c27116af","Type":"ContainerDied","Data":"a987ffa634f77df98be07bbb2a638c4799e026f53c75cef25dffbbb1b9d4a064"} Jun 12 22:28:36.483322 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:36.483023 2558 scope.go:117] "RemoveContainer" containerID="111eca11c076826e94ae2988ac5aeb522d11ac56ab9341a0896f3138aa8cc132" Jun 12 22:28:36.492379 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:36.492364 2558 scope.go:117] "RemoveContainer" containerID="111eca11c076826e94ae2988ac5aeb522d11ac56ab9341a0896f3138aa8cc132" Jun 12 22:28:36.492677 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:28:36.492655 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"111eca11c076826e94ae2988ac5aeb522d11ac56ab9341a0896f3138aa8cc132\": container with ID starting with 111eca11c076826e94ae2988ac5aeb522d11ac56ab9341a0896f3138aa8cc132 not found: ID does not exist" containerID="111eca11c076826e94ae2988ac5aeb522d11ac56ab9341a0896f3138aa8cc132" Jun 12 22:28:36.492746 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:36.492690 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"111eca11c076826e94ae2988ac5aeb522d11ac56ab9341a0896f3138aa8cc132"} err="failed to get container status \"111eca11c076826e94ae2988ac5aeb522d11ac56ab9341a0896f3138aa8cc132\": rpc error: code = NotFound desc = could not find container \"111eca11c076826e94ae2988ac5aeb522d11ac56ab9341a0896f3138aa8cc132\": container with ID starting with 111eca11c076826e94ae2988ac5aeb522d11ac56ab9341a0896f3138aa8cc132 not found: ID does not exist" Jun 12 22:28:36.510638 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:36.510590 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-948bc78c6-jz5q7"] Jun 12 22:28:36.513752 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:36.513729 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-948bc78c6-jz5q7"] Jun 12 22:28:36.573535 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:36.573504 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edf24dee-f252-4078-8f7f-edb8c27116af" path="/var/lib/kubelet/pods/edf24dee-f252-4078-8f7f-edb8c27116af/volumes" Jun 12 22:28:57.188688 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:57.188608 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpgfk"] Jun 12 22:28:57.189155 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:57.188929 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edf24dee-f252-4078-8f7f-edb8c27116af" containerName="console" Jun 12 22:28:57.189155 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:57.188939 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="edf24dee-f252-4078-8f7f-edb8c27116af" containerName="console" Jun 12 22:28:57.189155 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:57.188995 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="edf24dee-f252-4078-8f7f-edb8c27116af" containerName="console" Jun 12 22:28:57.192047 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:57.192032 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpgfk" Jun 12 22:28:57.194537 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:57.194513 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-bdgc6\"" Jun 12 22:28:57.194643 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:57.194549 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 12 22:28:57.194716 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:57.194702 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 12 22:28:57.206843 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:57.206820 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpgfk"] Jun 12 22:28:57.299532 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:57.299500 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqb6b\" (UniqueName: \"kubernetes.io/projected/b85c4389-8fd7-42f0-857c-dba236f8b728-kube-api-access-mqb6b\") pod \"cert-manager-operator-controller-manager-57757f7cfc-fpgfk\" (UID: \"b85c4389-8fd7-42f0-857c-dba236f8b728\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpgfk" Jun 12 22:28:57.299747 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:57.299560 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b85c4389-8fd7-42f0-857c-dba236f8b728-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-fpgfk\" (UID: \"b85c4389-8fd7-42f0-857c-dba236f8b728\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpgfk" Jun 12 22:28:57.400736 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:57.400687 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b85c4389-8fd7-42f0-857c-dba236f8b728-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-fpgfk\" (UID: \"b85c4389-8fd7-42f0-857c-dba236f8b728\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpgfk" Jun 12 22:28:57.400886 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:57.400791 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqb6b\" (UniqueName: \"kubernetes.io/projected/b85c4389-8fd7-42f0-857c-dba236f8b728-kube-api-access-mqb6b\") pod \"cert-manager-operator-controller-manager-57757f7cfc-fpgfk\" (UID: \"b85c4389-8fd7-42f0-857c-dba236f8b728\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpgfk" Jun 12 22:28:57.401050 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:57.401030 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b85c4389-8fd7-42f0-857c-dba236f8b728-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-fpgfk\" (UID: \"b85c4389-8fd7-42f0-857c-dba236f8b728\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpgfk" Jun 12 22:28:57.427451 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:57.427417 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqb6b\" (UniqueName: \"kubernetes.io/projected/b85c4389-8fd7-42f0-857c-dba236f8b728-kube-api-access-mqb6b\") pod \"cert-manager-operator-controller-manager-57757f7cfc-fpgfk\" (UID: \"b85c4389-8fd7-42f0-857c-dba236f8b728\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpgfk" Jun 12 22:28:57.501579 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:57.501559 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpgfk" Jun 12 22:28:57.638766 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:57.638736 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpgfk"] Jun 12 22:28:57.642136 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:28:57.642106 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb85c4389_8fd7_42f0_857c_dba236f8b728.slice/crio-def7ab2833ec71d064d95ccf981192e33f4dde2bc60022e6fe9f9d0994705896 WatchSource:0}: Error finding container def7ab2833ec71d064d95ccf981192e33f4dde2bc60022e6fe9f9d0994705896: Status 404 returned error can't find the container with id def7ab2833ec71d064d95ccf981192e33f4dde2bc60022e6fe9f9d0994705896 Jun 12 22:28:58.574291 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:28:58.574255 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpgfk" event={"ID":"b85c4389-8fd7-42f0-857c-dba236f8b728","Type":"ContainerStarted","Data":"def7ab2833ec71d064d95ccf981192e33f4dde2bc60022e6fe9f9d0994705896"} Jun 12 22:29:01.589107 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:01.589070 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpgfk" event={"ID":"b85c4389-8fd7-42f0-857c-dba236f8b728","Type":"ContainerStarted","Data":"df7b8bb2cde65ec25467cce2d8aceeafe1d783af0f46b6e49e9ad0ffc8c634cf"} Jun 12 22:29:03.151026 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:03.150972 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpgfk" podStartSLOduration=3.214734676 podStartE2EDuration="6.15095366s" totalImagesPullingTime="2.936218984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:28:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:29:01.650157863 +0000 UTC m=+541.521187995" watchObservedRunningTime="2026-06-12 22:29:03.15095366 +0000 UTC m=+543.021983788" Jun 12 22:29:03.151506 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:03.151462 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-5d969"] Jun 12 22:29:03.154782 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:03.154764 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5d969" Jun 12 22:29:03.158567 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:03.158544 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 12 22:29:03.159519 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:03.159501 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 12 22:29:03.159622 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:03.159520 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-5zwh5\"" Jun 12 22:29:03.165822 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:03.165804 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-5d969"] Jun 12 22:29:03.253802 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:03.253764 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z4qr\" (UniqueName: \"kubernetes.io/projected/3b32f655-2c54-4f28-83ab-aee0aea9c28d-kube-api-access-2z4qr\") pod \"cert-manager-webhook-7dc76cbb94-5d969\" (UID: \"3b32f655-2c54-4f28-83ab-aee0aea9c28d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5d969" Jun 12 22:29:03.253978 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:03.253828 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b32f655-2c54-4f28-83ab-aee0aea9c28d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-5d969\" (UID: \"3b32f655-2c54-4f28-83ab-aee0aea9c28d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5d969" Jun 12 22:29:03.355094 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:03.355061 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z4qr\" (UniqueName: \"kubernetes.io/projected/3b32f655-2c54-4f28-83ab-aee0aea9c28d-kube-api-access-2z4qr\") pod \"cert-manager-webhook-7dc76cbb94-5d969\" (UID: \"3b32f655-2c54-4f28-83ab-aee0aea9c28d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5d969" Jun 12 22:29:03.355283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:03.355125 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b32f655-2c54-4f28-83ab-aee0aea9c28d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-5d969\" (UID: \"3b32f655-2c54-4f28-83ab-aee0aea9c28d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5d969" Jun 12 22:29:03.368877 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:03.368849 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b32f655-2c54-4f28-83ab-aee0aea9c28d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-5d969\" (UID: \"3b32f655-2c54-4f28-83ab-aee0aea9c28d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5d969" Jun 12 22:29:03.371068 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:03.371041 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z4qr\" (UniqueName: \"kubernetes.io/projected/3b32f655-2c54-4f28-83ab-aee0aea9c28d-kube-api-access-2z4qr\") pod \"cert-manager-webhook-7dc76cbb94-5d969\" (UID: \"3b32f655-2c54-4f28-83ab-aee0aea9c28d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5d969" Jun 12 22:29:03.463827 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:03.463738 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5d969" Jun 12 22:29:03.605743 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:03.605717 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-5d969"] Jun 12 22:29:03.607824 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:29:03.607799 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b32f655_2c54_4f28_83ab_aee0aea9c28d.slice/crio-20daf58c41459caa51c3965943c6cd032443f8c02dd4404fd3a8801c4f59715b WatchSource:0}: Error finding container 20daf58c41459caa51c3965943c6cd032443f8c02dd4404fd3a8801c4f59715b: Status 404 returned error can't find the container with id 20daf58c41459caa51c3965943c6cd032443f8c02dd4404fd3a8801c4f59715b Jun 12 22:29:04.603152 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:04.603097 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5d969" event={"ID":"3b32f655-2c54-4f28-83ab-aee0aea9c28d","Type":"ContainerStarted","Data":"20daf58c41459caa51c3965943c6cd032443f8c02dd4404fd3a8801c4f59715b"} Jun 12 22:29:06.614316 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:06.614277 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5d969" event={"ID":"3b32f655-2c54-4f28-83ab-aee0aea9c28d","Type":"ContainerStarted","Data":"e883712ed48e586ddc211d1c2c5d3c21945fe95a851eb883844ca30f88bab491"} Jun 12 22:29:06.614715 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:06.614416 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5d969" Jun 12 22:29:06.652309 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:06.648577 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5d969" podStartSLOduration=1.224699314 podStartE2EDuration="3.648543691s" totalImagesPullingTime="2.423844377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:29:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:29:06.647126383 +0000 UTC m=+546.518156504" watchObservedRunningTime="2026-06-12 22:29:06.648543691 +0000 UTC m=+546.519573815" Jun 12 22:29:12.621488 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:12.621454 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5d969" Jun 12 22:29:34.614457 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:34.614413 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-58f59688f-4fb7b"] Jun 12 22:29:34.617970 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:34.617948 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58f59688f-4fb7b" Jun 12 22:29:34.621640 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:34.621623 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 12 22:29:34.623268 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:34.623249 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 12 22:29:34.624775 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:34.624752 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 12 22:29:34.624775 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:34.624767 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-km5s8\"" Jun 12 22:29:34.624907 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:34.624817 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 12 22:29:34.632460 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:34.632442 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 12 22:29:34.641316 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:34.641289 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58f59688f-4fb7b"] Jun 12 22:29:34.719347 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:34.719304 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bef33b05-7dce-4eda-9c80-b600414018ab-metrics-cert\") pod \"lws-controller-manager-58f59688f-4fb7b\" (UID: \"bef33b05-7dce-4eda-9c80-b600414018ab\") " pod="openshift-lws-operator/lws-controller-manager-58f59688f-4fb7b" Jun 12 22:29:34.719565 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:34.719359 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tqxk\" (UniqueName: \"kubernetes.io/projected/bef33b05-7dce-4eda-9c80-b600414018ab-kube-api-access-8tqxk\") pod \"lws-controller-manager-58f59688f-4fb7b\" (UID: \"bef33b05-7dce-4eda-9c80-b600414018ab\") " pod="openshift-lws-operator/lws-controller-manager-58f59688f-4fb7b" Jun 12 22:29:34.719565 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:34.719412 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bef33b05-7dce-4eda-9c80-b600414018ab-manager-config\") pod \"lws-controller-manager-58f59688f-4fb7b\" (UID: \"bef33b05-7dce-4eda-9c80-b600414018ab\") " pod="openshift-lws-operator/lws-controller-manager-58f59688f-4fb7b" Jun 12 22:29:34.719683 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:34.719603 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bef33b05-7dce-4eda-9c80-b600414018ab-cert\") pod \"lws-controller-manager-58f59688f-4fb7b\" (UID: \"bef33b05-7dce-4eda-9c80-b600414018ab\") " pod="openshift-lws-operator/lws-controller-manager-58f59688f-4fb7b" Jun 12 22:29:34.820200 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:34.820172 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bef33b05-7dce-4eda-9c80-b600414018ab-cert\") pod \"lws-controller-manager-58f59688f-4fb7b\" (UID: \"bef33b05-7dce-4eda-9c80-b600414018ab\") " pod="openshift-lws-operator/lws-controller-manager-58f59688f-4fb7b" Jun 12 22:29:34.820347 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:34.820225 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bef33b05-7dce-4eda-9c80-b600414018ab-metrics-cert\") pod \"lws-controller-manager-58f59688f-4fb7b\" (UID: \"bef33b05-7dce-4eda-9c80-b600414018ab\") " pod="openshift-lws-operator/lws-controller-manager-58f59688f-4fb7b" Jun 12 22:29:34.820347 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:34.820251 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tqxk\" (UniqueName: \"kubernetes.io/projected/bef33b05-7dce-4eda-9c80-b600414018ab-kube-api-access-8tqxk\") pod \"lws-controller-manager-58f59688f-4fb7b\" (UID: \"bef33b05-7dce-4eda-9c80-b600414018ab\") " pod="openshift-lws-operator/lws-controller-manager-58f59688f-4fb7b" Jun 12 22:29:34.820347 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:34.820269 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bef33b05-7dce-4eda-9c80-b600414018ab-manager-config\") pod \"lws-controller-manager-58f59688f-4fb7b\" (UID: \"bef33b05-7dce-4eda-9c80-b600414018ab\") " pod="openshift-lws-operator/lws-controller-manager-58f59688f-4fb7b" Jun 12 22:29:34.821024 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:34.821000 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bef33b05-7dce-4eda-9c80-b600414018ab-manager-config\") pod \"lws-controller-manager-58f59688f-4fb7b\" (UID: \"bef33b05-7dce-4eda-9c80-b600414018ab\") " pod="openshift-lws-operator/lws-controller-manager-58f59688f-4fb7b" Jun 12 22:29:34.822678 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:34.822651 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bef33b05-7dce-4eda-9c80-b600414018ab-metrics-cert\") pod \"lws-controller-manager-58f59688f-4fb7b\" (UID: \"bef33b05-7dce-4eda-9c80-b600414018ab\") " pod="openshift-lws-operator/lws-controller-manager-58f59688f-4fb7b" Jun 12 22:29:34.822766 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:34.822724 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bef33b05-7dce-4eda-9c80-b600414018ab-cert\") pod \"lws-controller-manager-58f59688f-4fb7b\" (UID: \"bef33b05-7dce-4eda-9c80-b600414018ab\") " pod="openshift-lws-operator/lws-controller-manager-58f59688f-4fb7b" Jun 12 22:29:34.828671 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:34.828643 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tqxk\" (UniqueName: \"kubernetes.io/projected/bef33b05-7dce-4eda-9c80-b600414018ab-kube-api-access-8tqxk\") pod \"lws-controller-manager-58f59688f-4fb7b\" (UID: \"bef33b05-7dce-4eda-9c80-b600414018ab\") " pod="openshift-lws-operator/lws-controller-manager-58f59688f-4fb7b" Jun 12 22:29:34.926909 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:34.926832 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58f59688f-4fb7b" Jun 12 22:29:35.058475 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:35.058136 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58f59688f-4fb7b"] Jun 12 22:29:35.062234 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:29:35.062203 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbef33b05_7dce_4eda_9c80_b600414018ab.slice/crio-32b71989539f6f083230cdf4c908aa7c590259cc05261d0939b515642413bfa6 WatchSource:0}: Error finding container 32b71989539f6f083230cdf4c908aa7c590259cc05261d0939b515642413bfa6: Status 404 returned error can't find the container with id 32b71989539f6f083230cdf4c908aa7c590259cc05261d0939b515642413bfa6 Jun 12 22:29:35.744067 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:35.744035 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58f59688f-4fb7b" event={"ID":"bef33b05-7dce-4eda-9c80-b600414018ab","Type":"ContainerStarted","Data":"32b71989539f6f083230cdf4c908aa7c590259cc05261d0939b515642413bfa6"} Jun 12 22:29:37.754883 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:37.754849 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58f59688f-4fb7b" event={"ID":"bef33b05-7dce-4eda-9c80-b600414018ab","Type":"ContainerStarted","Data":"c94ef299e32c728a8ad8b5bc71f0e564a2517044b7e3d4468e1fb8edfd5cfbe3"} Jun 12 22:29:37.755321 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:37.754985 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-58f59688f-4fb7b" Jun 12 22:29:37.772587 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:37.772541 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-58f59688f-4fb7b" podStartSLOduration=1.404378752 podStartE2EDuration="3.772527581s" totalImagesPullingTime="2.368148829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:29:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:29:37.771808299 +0000 UTC m=+577.642838431" watchObservedRunningTime="2026-06-12 22:29:37.772527581 +0000 UTC m=+577.643557703" Jun 12 22:29:43.446172 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:43.446133 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92"] Jun 12 22:29:43.449797 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:43.449781 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92" Jun 12 22:29:43.452411 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:43.452387 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 12 22:29:43.452565 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:43.452418 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 12 22:29:43.452565 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:43.452386 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 12 22:29:43.452565 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:43.452470 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 12 22:29:43.452565 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:43.452451 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ngh4r\"" Jun 12 22:29:43.462738 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:43.462717 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92"] Jun 12 22:29:43.600311 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:43.600275 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/886369ff-b3ca-4db8-8a07-3cb59da4b2a1-webhook-cert\") pod \"opendatahub-operator-controller-manager-845b6ff5b7-dfh92\" (UID: \"886369ff-b3ca-4db8-8a07-3cb59da4b2a1\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92" Jun 12 22:29:43.600311 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:43.600314 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mkld\" (UniqueName: \"kubernetes.io/projected/886369ff-b3ca-4db8-8a07-3cb59da4b2a1-kube-api-access-6mkld\") pod \"opendatahub-operator-controller-manager-845b6ff5b7-dfh92\" (UID: \"886369ff-b3ca-4db8-8a07-3cb59da4b2a1\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92" Jun 12 22:29:43.600547 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:43.600353 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/886369ff-b3ca-4db8-8a07-3cb59da4b2a1-manifests\") pod \"opendatahub-operator-controller-manager-845b6ff5b7-dfh92\" (UID: \"886369ff-b3ca-4db8-8a07-3cb59da4b2a1\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92" Jun 12 22:29:43.600547 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:43.600396 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/886369ff-b3ca-4db8-8a07-3cb59da4b2a1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-845b6ff5b7-dfh92\" (UID: \"886369ff-b3ca-4db8-8a07-3cb59da4b2a1\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92" Jun 12 22:29:43.600547 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:43.600417 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/886369ff-b3ca-4db8-8a07-3cb59da4b2a1-tmp\") pod \"opendatahub-operator-controller-manager-845b6ff5b7-dfh92\" (UID: \"886369ff-b3ca-4db8-8a07-3cb59da4b2a1\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92" Jun 12 22:29:43.701482 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:43.701385 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/886369ff-b3ca-4db8-8a07-3cb59da4b2a1-webhook-cert\") pod \"opendatahub-operator-controller-manager-845b6ff5b7-dfh92\" (UID: \"886369ff-b3ca-4db8-8a07-3cb59da4b2a1\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92" Jun 12 22:29:43.701482 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:43.701419 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mkld\" (UniqueName: \"kubernetes.io/projected/886369ff-b3ca-4db8-8a07-3cb59da4b2a1-kube-api-access-6mkld\") pod \"opendatahub-operator-controller-manager-845b6ff5b7-dfh92\" (UID: \"886369ff-b3ca-4db8-8a07-3cb59da4b2a1\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92" Jun 12 22:29:43.701482 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:43.701471 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/886369ff-b3ca-4db8-8a07-3cb59da4b2a1-manifests\") pod \"opendatahub-operator-controller-manager-845b6ff5b7-dfh92\" (UID: \"886369ff-b3ca-4db8-8a07-3cb59da4b2a1\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92" Jun 12 22:29:43.701743 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:43.701510 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/886369ff-b3ca-4db8-8a07-3cb59da4b2a1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-845b6ff5b7-dfh92\" (UID: \"886369ff-b3ca-4db8-8a07-3cb59da4b2a1\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92" Jun 12 22:29:43.701743 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:43.701531 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/886369ff-b3ca-4db8-8a07-3cb59da4b2a1-tmp\") pod \"opendatahub-operator-controller-manager-845b6ff5b7-dfh92\" (UID: \"886369ff-b3ca-4db8-8a07-3cb59da4b2a1\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92" Jun 12 22:29:43.701985 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:43.701961 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/886369ff-b3ca-4db8-8a07-3cb59da4b2a1-manifests\") pod \"opendatahub-operator-controller-manager-845b6ff5b7-dfh92\" (UID: \"886369ff-b3ca-4db8-8a07-3cb59da4b2a1\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92" Jun 12 22:29:43.703821 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:43.703795 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/886369ff-b3ca-4db8-8a07-3cb59da4b2a1-tmp\") pod \"opendatahub-operator-controller-manager-845b6ff5b7-dfh92\" (UID: \"886369ff-b3ca-4db8-8a07-3cb59da4b2a1\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92" Jun 12 22:29:43.703934 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:43.703830 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/886369ff-b3ca-4db8-8a07-3cb59da4b2a1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-845b6ff5b7-dfh92\" (UID: \"886369ff-b3ca-4db8-8a07-3cb59da4b2a1\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92" Jun 12 22:29:43.704012 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:43.703971 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/886369ff-b3ca-4db8-8a07-3cb59da4b2a1-webhook-cert\") pod \"opendatahub-operator-controller-manager-845b6ff5b7-dfh92\" (UID: \"886369ff-b3ca-4db8-8a07-3cb59da4b2a1\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92" Jun 12 22:29:43.712414 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:43.712394 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mkld\" (UniqueName: \"kubernetes.io/projected/886369ff-b3ca-4db8-8a07-3cb59da4b2a1-kube-api-access-6mkld\") pod \"opendatahub-operator-controller-manager-845b6ff5b7-dfh92\" (UID: \"886369ff-b3ca-4db8-8a07-3cb59da4b2a1\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92" Jun 12 22:29:43.761449 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:43.761405 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92" Jun 12 22:29:43.910877 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:43.910847 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92"] Jun 12 22:29:43.914971 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:29:43.914946 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod886369ff_b3ca_4db8_8a07_3cb59da4b2a1.slice/crio-ea10ef4d8b4eb5eca36bb7ba122cf452cd231bfe12b5923ebe5a040d575b7d69 WatchSource:0}: Error finding container ea10ef4d8b4eb5eca36bb7ba122cf452cd231bfe12b5923ebe5a040d575b7d69: Status 404 returned error can't find the container with id ea10ef4d8b4eb5eca36bb7ba122cf452cd231bfe12b5923ebe5a040d575b7d69 Jun 12 22:29:44.793072 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:44.793032 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92" event={"ID":"886369ff-b3ca-4db8-8a07-3cb59da4b2a1","Type":"ContainerStarted","Data":"ea10ef4d8b4eb5eca36bb7ba122cf452cd231bfe12b5923ebe5a040d575b7d69"} Jun 12 22:29:47.812568 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:47.812536 2558 generic.go:356] "Generic (PLEG): container finished" podID="886369ff-b3ca-4db8-8a07-3cb59da4b2a1" containerID="5a21e0e223ad77f3a355264159baf1e4ec0ad547a7d159e0fd598334842068e4" exitCode=0 Jun 12 22:29:47.812941 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:47.812625 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92" event={"ID":"886369ff-b3ca-4db8-8a07-3cb59da4b2a1","Type":"ContainerDied","Data":"5a21e0e223ad77f3a355264159baf1e4ec0ad547a7d159e0fd598334842068e4"} Jun 12 22:29:48.761909 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:48.761876 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-58f59688f-4fb7b" Jun 12 22:29:48.819618 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:48.819582 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92" event={"ID":"886369ff-b3ca-4db8-8a07-3cb59da4b2a1","Type":"ContainerStarted","Data":"f3b3b4eed9315746548b9b9928425aad3e274f81dd8fa887e363f4f15bfe75f7"} Jun 12 22:29:48.820062 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:48.819667 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92" Jun 12 22:29:48.846549 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:48.846496 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92" podStartSLOduration=1.793773152 podStartE2EDuration="5.846479009s" totalImagesPullingTime="3.113138023s" totalInitContainerRuntime="939.567834ms" isStatefulPod=false podCreationTimestamp="2026-06-12 22:29:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:29:48.844597087 +0000 UTC m=+588.715627232" watchObservedRunningTime="2026-06-12 22:29:48.846479009 +0000 UTC m=+588.717509140" Jun 12 22:29:59.826987 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:29:59.826957 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-845b6ff5b7-dfh92" Jun 12 22:30:24.848032 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:24.847999 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-67d44fbf57-ctgh4"] Jun 12 22:30:24.851405 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:24.851384 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-67d44fbf57-ctgh4" Jun 12 22:30:24.854234 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:24.854203 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-sx2tf\"" Jun 12 22:30:24.854366 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:24.854231 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 12 22:30:24.860874 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:24.860844 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-67d44fbf57-ctgh4"] Jun 12 22:30:24.973912 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:24.973876 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-php5q\" (UniqueName: \"kubernetes.io/projected/a9e5a32d-2f6f-43e0-a303-77d6f81e7d4e-kube-api-access-php5q\") pod \"dashboard-redirect-67d44fbf57-ctgh4\" (UID: \"a9e5a32d-2f6f-43e0-a303-77d6f81e7d4e\") " pod="opendatahub/dashboard-redirect-67d44fbf57-ctgh4" Jun 12 22:30:24.974083 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:24.974000 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a9e5a32d-2f6f-43e0-a303-77d6f81e7d4e-redirect-config\") pod \"dashboard-redirect-67d44fbf57-ctgh4\" (UID: \"a9e5a32d-2f6f-43e0-a303-77d6f81e7d4e\") " pod="opendatahub/dashboard-redirect-67d44fbf57-ctgh4" Jun 12 22:30:25.074757 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:25.074705 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a9e5a32d-2f6f-43e0-a303-77d6f81e7d4e-redirect-config\") pod \"dashboard-redirect-67d44fbf57-ctgh4\" (UID: \"a9e5a32d-2f6f-43e0-a303-77d6f81e7d4e\") " pod="opendatahub/dashboard-redirect-67d44fbf57-ctgh4" Jun 12 22:30:25.074935 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:25.074774 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-php5q\" (UniqueName: \"kubernetes.io/projected/a9e5a32d-2f6f-43e0-a303-77d6f81e7d4e-kube-api-access-php5q\") pod \"dashboard-redirect-67d44fbf57-ctgh4\" (UID: \"a9e5a32d-2f6f-43e0-a303-77d6f81e7d4e\") " pod="opendatahub/dashboard-redirect-67d44fbf57-ctgh4" Jun 12 22:30:25.075646 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:25.075622 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a9e5a32d-2f6f-43e0-a303-77d6f81e7d4e-redirect-config\") pod \"dashboard-redirect-67d44fbf57-ctgh4\" (UID: \"a9e5a32d-2f6f-43e0-a303-77d6f81e7d4e\") " pod="opendatahub/dashboard-redirect-67d44fbf57-ctgh4" Jun 12 22:30:25.083224 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:25.083197 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-php5q\" (UniqueName: \"kubernetes.io/projected/a9e5a32d-2f6f-43e0-a303-77d6f81e7d4e-kube-api-access-php5q\") pod \"dashboard-redirect-67d44fbf57-ctgh4\" (UID: \"a9e5a32d-2f6f-43e0-a303-77d6f81e7d4e\") " pod="opendatahub/dashboard-redirect-67d44fbf57-ctgh4" Jun 12 22:30:25.163650 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:25.163564 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-67d44fbf57-ctgh4" Jun 12 22:30:25.310919 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:25.310895 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-67d44fbf57-ctgh4"] Jun 12 22:30:25.313305 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:30:25.313276 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9e5a32d_2f6f_43e0_a303_77d6f81e7d4e.slice/crio-a5021d31020c1df2f1b66cb5fb50674f87ffc4990b10d370a4b8e53a8207dc01 WatchSource:0}: Error finding container a5021d31020c1df2f1b66cb5fb50674f87ffc4990b10d370a4b8e53a8207dc01: Status 404 returned error can't find the container with id a5021d31020c1df2f1b66cb5fb50674f87ffc4990b10d370a4b8e53a8207dc01 Jun 12 22:30:25.314605 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:25.314582 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 22:30:26.001524 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:26.001489 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-67d44fbf57-ctgh4" event={"ID":"a9e5a32d-2f6f-43e0-a303-77d6f81e7d4e","Type":"ContainerStarted","Data":"a5021d31020c1df2f1b66cb5fb50674f87ffc4990b10d370a4b8e53a8207dc01"} Jun 12 22:30:28.013501 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:28.013459 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-67d44fbf57-ctgh4" event={"ID":"a9e5a32d-2f6f-43e0-a303-77d6f81e7d4e","Type":"ContainerStarted","Data":"bc5cefcb038710082141d01577750e6c63ae196bdda9aa601936867b00e38dce"} Jun 12 22:30:28.030111 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:28.030056 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-67d44fbf57-ctgh4" podStartSLOduration=2.112567659 podStartE2EDuration="4.030040909s" totalImagesPullingTime="1.91747325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:30:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:30:28.029570836 +0000 UTC m=+627.900600958" watchObservedRunningTime="2026-06-12 22:30:28.030040909 +0000 UTC m=+627.901071051" Jun 12 22:30:46.406857 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.406825 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl"] Jun 12 22:30:46.410578 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.410559 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.413366 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.413345 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 12 22:30:46.413722 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.413703 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-m4574\"" Jun 12 22:30:46.424620 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.424595 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl"] Jun 12 22:30:46.571206 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.571151 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dad0df49-dfd8-470d-a459-64c487a15d9d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.571400 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.571231 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dad0df49-dfd8-470d-a459-64c487a15d9d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.571400 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.571272 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dad0df49-dfd8-470d-a459-64c487a15d9d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.571400 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.571306 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dad0df49-dfd8-470d-a459-64c487a15d9d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.571400 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.571337 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dad0df49-dfd8-470d-a459-64c487a15d9d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.571400 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.571377 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dad0df49-dfd8-470d-a459-64c487a15d9d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.571759 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.571485 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpxq6\" (UniqueName: \"kubernetes.io/projected/dad0df49-dfd8-470d-a459-64c487a15d9d-kube-api-access-rpxq6\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.571759 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.571523 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad0df49-dfd8-470d-a459-64c487a15d9d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.571759 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.571572 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad0df49-dfd8-470d-a459-64c487a15d9d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.672817 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.672700 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpxq6\" (UniqueName: \"kubernetes.io/projected/dad0df49-dfd8-470d-a459-64c487a15d9d-kube-api-access-rpxq6\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.672817 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.672739 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad0df49-dfd8-470d-a459-64c487a15d9d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.672817 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.672769 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad0df49-dfd8-470d-a459-64c487a15d9d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.673098 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.672838 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dad0df49-dfd8-470d-a459-64c487a15d9d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.673098 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.672869 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dad0df49-dfd8-470d-a459-64c487a15d9d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.673098 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.672891 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dad0df49-dfd8-470d-a459-64c487a15d9d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.673098 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.672914 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dad0df49-dfd8-470d-a459-64c487a15d9d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.673098 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.672937 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dad0df49-dfd8-470d-a459-64c487a15d9d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.673098 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.672968 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dad0df49-dfd8-470d-a459-64c487a15d9d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.673419 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.673300 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad0df49-dfd8-470d-a459-64c487a15d9d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.673503 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.673483 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dad0df49-dfd8-470d-a459-64c487a15d9d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.673580 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.673556 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dad0df49-dfd8-470d-a459-64c487a15d9d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.673627 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.673598 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad0df49-dfd8-470d-a459-64c487a15d9d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.673932 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.673911 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dad0df49-dfd8-470d-a459-64c487a15d9d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.675374 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.675344 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dad0df49-dfd8-470d-a459-64c487a15d9d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.675623 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.675604 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dad0df49-dfd8-470d-a459-64c487a15d9d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.680752 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.680728 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dad0df49-dfd8-470d-a459-64c487a15d9d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.680900 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.680879 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpxq6\" (UniqueName: \"kubernetes.io/projected/dad0df49-dfd8-470d-a459-64c487a15d9d-kube-api-access-rpxq6\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ccjjl\" (UID: \"dad0df49-dfd8-470d-a459-64c487a15d9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.720860 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.720829 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:46.861014 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:46.860989 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl"] Jun 12 22:30:46.863357 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:30:46.863329 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad0df49_dfd8_470d_a459_64c487a15d9d.slice/crio-9fdb43cca178a79386be543b3a8f8c97db702db13f2e3409954fb1d4e6441ad5 WatchSource:0}: Error finding container 9fdb43cca178a79386be543b3a8f8c97db702db13f2e3409954fb1d4e6441ad5: Status 404 returned error can't find the container with id 9fdb43cca178a79386be543b3a8f8c97db702db13f2e3409954fb1d4e6441ad5 Jun 12 22:30:47.099029 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:47.098991 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" event={"ID":"dad0df49-dfd8-470d-a459-64c487a15d9d","Type":"ContainerStarted","Data":"9fdb43cca178a79386be543b3a8f8c97db702db13f2e3409954fb1d4e6441ad5"} Jun 12 22:30:49.663261 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:49.663218 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jun 12 22:30:49.663548 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:49.663299 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jun 12 22:30:49.663548 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:49.663330 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jun 12 22:30:50.115834 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:50.115798 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" event={"ID":"dad0df49-dfd8-470d-a459-64c487a15d9d","Type":"ContainerStarted","Data":"0663e6d6bd3729bf9138d2fe1fad406403c3066992d2effd5b0bf724c5fac331"} Jun 12 22:30:50.137474 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:50.137408 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" podStartSLOduration=1.339949641 podStartE2EDuration="4.137393092s" totalImagesPullingTime="2.797443451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:30:50.135383652 +0000 UTC m=+650.006413774" watchObservedRunningTime="2026-06-12 22:30:50.137393092 +0000 UTC m=+650.008423257" Jun 12 22:30:50.721356 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:50.721322 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:50.726021 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:50.725988 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:51.120338 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:51.120305 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:30:51.121353 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:30:51.121334 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ccjjl" Jun 12 22:31:03.794681 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:03.794644 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rhv8p"] Jun 12 22:31:03.807376 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:03.807276 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rhv8p" Jun 12 22:31:03.810310 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:03.810282 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rhv8p"] Jun 12 22:31:03.811370 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:03.811348 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-xdg5n\"" Jun 12 22:31:03.811502 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:03.811390 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 22:31:03.811502 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:03.811460 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 22:31:03.923822 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:03.923786 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbbkp\" (UniqueName: \"kubernetes.io/projected/95dd71ff-ac1e-4290-81b0-790c321295c5-kube-api-access-tbbkp\") pod \"kuadrant-operator-catalog-rhv8p\" (UID: \"95dd71ff-ac1e-4290-81b0-790c321295c5\") " pod="kuadrant-system/kuadrant-operator-catalog-rhv8p" Jun 12 22:31:04.024349 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:04.024316 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbbkp\" (UniqueName: \"kubernetes.io/projected/95dd71ff-ac1e-4290-81b0-790c321295c5-kube-api-access-tbbkp\") pod \"kuadrant-operator-catalog-rhv8p\" (UID: \"95dd71ff-ac1e-4290-81b0-790c321295c5\") " pod="kuadrant-system/kuadrant-operator-catalog-rhv8p" Jun 12 22:31:04.033172 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:04.033142 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbbkp\" (UniqueName: \"kubernetes.io/projected/95dd71ff-ac1e-4290-81b0-790c321295c5-kube-api-access-tbbkp\") pod \"kuadrant-operator-catalog-rhv8p\" (UID: \"95dd71ff-ac1e-4290-81b0-790c321295c5\") " pod="kuadrant-system/kuadrant-operator-catalog-rhv8p" Jun 12 22:31:04.120346 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:04.120255 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rhv8p" Jun 12 22:31:04.157776 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:04.157746 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rhv8p"] Jun 12 22:31:04.253402 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:04.253377 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rhv8p"] Jun 12 22:31:04.255193 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:31:04.255169 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95dd71ff_ac1e_4290_81b0_790c321295c5.slice/crio-9e5ae563dd4cc0ee4da50b34b48bafa311da8486801b0cf18ba445bda241dcad WatchSource:0}: Error finding container 9e5ae563dd4cc0ee4da50b34b48bafa311da8486801b0cf18ba445bda241dcad: Status 404 returned error can't find the container with id 9e5ae563dd4cc0ee4da50b34b48bafa311da8486801b0cf18ba445bda241dcad Jun 12 22:31:04.368030 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:04.367995 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7rghj"] Jun 12 22:31:04.372715 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:04.372668 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7rghj" Jun 12 22:31:04.380853 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:04.380829 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7rghj"] Jun 12 22:31:04.427421 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:04.427384 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnffl\" (UniqueName: \"kubernetes.io/projected/f9977b03-8a5d-4f55-832f-dc9c32279f35-kube-api-access-tnffl\") pod \"kuadrant-operator-catalog-7rghj\" (UID: \"f9977b03-8a5d-4f55-832f-dc9c32279f35\") " pod="kuadrant-system/kuadrant-operator-catalog-7rghj" Jun 12 22:31:04.527886 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:04.527848 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnffl\" (UniqueName: \"kubernetes.io/projected/f9977b03-8a5d-4f55-832f-dc9c32279f35-kube-api-access-tnffl\") pod \"kuadrant-operator-catalog-7rghj\" (UID: \"f9977b03-8a5d-4f55-832f-dc9c32279f35\") " pod="kuadrant-system/kuadrant-operator-catalog-7rghj" Jun 12 22:31:04.536658 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:04.536632 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnffl\" (UniqueName: \"kubernetes.io/projected/f9977b03-8a5d-4f55-832f-dc9c32279f35-kube-api-access-tnffl\") pod \"kuadrant-operator-catalog-7rghj\" (UID: \"f9977b03-8a5d-4f55-832f-dc9c32279f35\") " pod="kuadrant-system/kuadrant-operator-catalog-7rghj" Jun 12 22:31:04.683174 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:04.683090 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7rghj" Jun 12 22:31:04.825787 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:04.825754 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7rghj"] Jun 12 22:31:04.829075 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:31:04.829045 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9977b03_8a5d_4f55_832f_dc9c32279f35.slice/crio-a223d4b54b661e5ef4078347d1f7490890954ee8a3666b1e008b54546daac02f WatchSource:0}: Error finding container a223d4b54b661e5ef4078347d1f7490890954ee8a3666b1e008b54546daac02f: Status 404 returned error can't find the container with id a223d4b54b661e5ef4078347d1f7490890954ee8a3666b1e008b54546daac02f Jun 12 22:31:05.189422 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:05.189383 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rhv8p" event={"ID":"95dd71ff-ac1e-4290-81b0-790c321295c5","Type":"ContainerStarted","Data":"9e5ae563dd4cc0ee4da50b34b48bafa311da8486801b0cf18ba445bda241dcad"} Jun 12 22:31:05.190709 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:05.190681 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7rghj" event={"ID":"f9977b03-8a5d-4f55-832f-dc9c32279f35","Type":"ContainerStarted","Data":"a223d4b54b661e5ef4078347d1f7490890954ee8a3666b1e008b54546daac02f"} Jun 12 22:31:07.204697 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:07.204654 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rhv8p" event={"ID":"95dd71ff-ac1e-4290-81b0-790c321295c5","Type":"ContainerStarted","Data":"1e430769115ba0d095e69117ced54382560093ba132194719c1fb09812b2a895"} Jun 12 22:31:07.205157 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:07.204655 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-rhv8p" podUID="95dd71ff-ac1e-4290-81b0-790c321295c5" containerName="registry-server" containerID="cri-o://1e430769115ba0d095e69117ced54382560093ba132194719c1fb09812b2a895" gracePeriod=2 Jun 12 22:31:07.206242 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:07.206206 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7rghj" event={"ID":"f9977b03-8a5d-4f55-832f-dc9c32279f35","Type":"ContainerStarted","Data":"ddef780cfa6a395f4819802a2450771417e1e7f0e1d267dafc62e600d15681c0"} Jun 12 22:31:07.220758 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:07.220698 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rhv8p" podStartSLOduration=2.054154551 podStartE2EDuration="4.220680815s" totalImagesPullingTime="2.166526264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:31:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:31:07.219330076 +0000 UTC m=+667.090360198" watchObservedRunningTime="2026-06-12 22:31:07.220680815 +0000 UTC m=+667.091710955" Jun 12 22:31:07.235694 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:07.235644 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7rghj" podStartSLOduration=1.640027782 podStartE2EDuration="3.235630736s" totalImagesPullingTime="1.595602954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:31:07.233865679 +0000 UTC m=+667.104895797" watchObservedRunningTime="2026-06-12 22:31:07.235630736 +0000 UTC m=+667.106660857" Jun 12 22:31:07.453103 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:07.453079 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rhv8p" Jun 12 22:31:07.556541 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:07.556513 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbbkp\" (UniqueName: \"kubernetes.io/projected/95dd71ff-ac1e-4290-81b0-790c321295c5-kube-api-access-tbbkp\") pod \"95dd71ff-ac1e-4290-81b0-790c321295c5\" (UID: \"95dd71ff-ac1e-4290-81b0-790c321295c5\") " Jun 12 22:31:07.558673 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:07.558642 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95dd71ff-ac1e-4290-81b0-790c321295c5-kube-api-access-tbbkp" (OuterVolumeSpecName: "kube-api-access-tbbkp") pod "95dd71ff-ac1e-4290-81b0-790c321295c5" (UID: "95dd71ff-ac1e-4290-81b0-790c321295c5"). InnerVolumeSpecName "kube-api-access-tbbkp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:31:07.657839 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:07.657810 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbbkp\" (UniqueName: \"kubernetes.io/projected/95dd71ff-ac1e-4290-81b0-790c321295c5-kube-api-access-tbbkp\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:31:08.212982 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:08.212941 2558 generic.go:356] "Generic (PLEG): container finished" podID="95dd71ff-ac1e-4290-81b0-790c321295c5" containerID="1e430769115ba0d095e69117ced54382560093ba132194719c1fb09812b2a895" exitCode=0 Jun 12 22:31:08.213471 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:08.212989 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rhv8p" Jun 12 22:31:08.213471 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:08.213034 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rhv8p" event={"ID":"95dd71ff-ac1e-4290-81b0-790c321295c5","Type":"ContainerDied","Data":"1e430769115ba0d095e69117ced54382560093ba132194719c1fb09812b2a895"} Jun 12 22:31:08.213471 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:08.213087 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rhv8p" event={"ID":"95dd71ff-ac1e-4290-81b0-790c321295c5","Type":"ContainerDied","Data":"9e5ae563dd4cc0ee4da50b34b48bafa311da8486801b0cf18ba445bda241dcad"} Jun 12 22:31:08.213471 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:08.213114 2558 scope.go:117] "RemoveContainer" containerID="1e430769115ba0d095e69117ced54382560093ba132194719c1fb09812b2a895" Jun 12 22:31:08.222670 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:08.222643 2558 scope.go:117] "RemoveContainer" containerID="1e430769115ba0d095e69117ced54382560093ba132194719c1fb09812b2a895" Jun 12 22:31:08.222980 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:31:08.222961 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e430769115ba0d095e69117ced54382560093ba132194719c1fb09812b2a895\": container with ID starting with 1e430769115ba0d095e69117ced54382560093ba132194719c1fb09812b2a895 not found: ID does not exist" containerID="1e430769115ba0d095e69117ced54382560093ba132194719c1fb09812b2a895" Jun 12 22:31:08.223057 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:08.222992 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e430769115ba0d095e69117ced54382560093ba132194719c1fb09812b2a895"} err="failed to get container status \"1e430769115ba0d095e69117ced54382560093ba132194719c1fb09812b2a895\": rpc error: code = NotFound desc = could not find container \"1e430769115ba0d095e69117ced54382560093ba132194719c1fb09812b2a895\": container with ID starting with 1e430769115ba0d095e69117ced54382560093ba132194719c1fb09812b2a895 not found: ID does not exist" Jun 12 22:31:08.233990 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:08.233953 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rhv8p"] Jun 12 22:31:08.237703 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:08.237684 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rhv8p"] Jun 12 22:31:08.575282 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:08.575249 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95dd71ff-ac1e-4290-81b0-790c321295c5" path="/var/lib/kubelet/pods/95dd71ff-ac1e-4290-81b0-790c321295c5/volumes" Jun 12 22:31:14.683982 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:14.683945 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-7rghj" Jun 12 22:31:14.684464 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:14.684010 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-7rghj" Jun 12 22:31:14.707345 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:14.707319 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-7rghj" Jun 12 22:31:15.270008 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:15.269977 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-7rghj" Jun 12 22:31:31.261142 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:31.261100 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7"] Jun 12 22:31:31.261760 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:31.261706 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95dd71ff-ac1e-4290-81b0-790c321295c5" containerName="registry-server" Jun 12 22:31:31.261760 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:31.261727 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="95dd71ff-ac1e-4290-81b0-790c321295c5" containerName="registry-server" Jun 12 22:31:31.261880 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:31.261807 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="95dd71ff-ac1e-4290-81b0-790c321295c5" containerName="registry-server" Jun 12 22:31:31.268222 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:31.268199 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7" Jun 12 22:31:31.271487 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:31.271467 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7p9kz\"" Jun 12 22:31:31.279284 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:31.279259 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7"] Jun 12 22:31:31.381099 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:31.381063 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bed6029-b974-43e6-8940-09b9d6dcfa97-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ntbd7\" (UID: \"9bed6029-b974-43e6-8940-09b9d6dcfa97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7" Jun 12 22:31:31.381285 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:31.381102 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jz6z\" (UniqueName: \"kubernetes.io/projected/9bed6029-b974-43e6-8940-09b9d6dcfa97-kube-api-access-2jz6z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ntbd7\" (UID: \"9bed6029-b974-43e6-8940-09b9d6dcfa97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7" Jun 12 22:31:31.481682 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:31.481651 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bed6029-b974-43e6-8940-09b9d6dcfa97-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ntbd7\" (UID: \"9bed6029-b974-43e6-8940-09b9d6dcfa97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7" Jun 12 22:31:31.481856 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:31.481687 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jz6z\" (UniqueName: \"kubernetes.io/projected/9bed6029-b974-43e6-8940-09b9d6dcfa97-kube-api-access-2jz6z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ntbd7\" (UID: \"9bed6029-b974-43e6-8940-09b9d6dcfa97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7" Jun 12 22:31:31.482062 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:31.482038 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bed6029-b974-43e6-8940-09b9d6dcfa97-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ntbd7\" (UID: \"9bed6029-b974-43e6-8940-09b9d6dcfa97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7" Jun 12 22:31:31.490816 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:31.490793 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jz6z\" (UniqueName: \"kubernetes.io/projected/9bed6029-b974-43e6-8940-09b9d6dcfa97-kube-api-access-2jz6z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ntbd7\" (UID: \"9bed6029-b974-43e6-8940-09b9d6dcfa97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7" Jun 12 22:31:31.579187 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:31.579110 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7" Jun 12 22:31:31.715859 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:31.715827 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7"] Jun 12 22:31:31.719148 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:31:31.719121 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bed6029_b974_43e6_8940_09b9d6dcfa97.slice/crio-96ffb58de688f9e29ea1df6d7e6eb38c1d93e1e2a16e5ac70c84a74abf15d496 WatchSource:0}: Error finding container 96ffb58de688f9e29ea1df6d7e6eb38c1d93e1e2a16e5ac70c84a74abf15d496: Status 404 returned error can't find the container with id 96ffb58de688f9e29ea1df6d7e6eb38c1d93e1e2a16e5ac70c84a74abf15d496 Jun 12 22:31:32.332334 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.332299 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7" event={"ID":"9bed6029-b974-43e6-8940-09b9d6dcfa97","Type":"ContainerStarted","Data":"96ffb58de688f9e29ea1df6d7e6eb38c1d93e1e2a16e5ac70c84a74abf15d496"} Jun 12 22:31:32.373117 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.373086 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b6c475974-5k694"] Jun 12 22:31:32.376450 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.376414 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:32.391892 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.391863 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b6c475974-5k694"] Jun 12 22:31:32.490705 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.490673 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd-trusted-ca-bundle\") pod \"console-b6c475974-5k694\" (UID: \"2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd\") " pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:32.490869 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.490777 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd-console-serving-cert\") pod \"console-b6c475974-5k694\" (UID: \"2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd\") " pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:32.490869 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.490816 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd-console-config\") pod \"console-b6c475974-5k694\" (UID: \"2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd\") " pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:32.490869 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.490858 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd-service-ca\") pod \"console-b6c475974-5k694\" (UID: \"2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd\") " pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:32.491036 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.490887 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd-oauth-serving-cert\") pod \"console-b6c475974-5k694\" (UID: \"2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd\") " pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:32.491036 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.490972 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd-console-oauth-config\") pod \"console-b6c475974-5k694\" (UID: \"2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd\") " pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:32.491036 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.491021 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j65t5\" (UniqueName: \"kubernetes.io/projected/2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd-kube-api-access-j65t5\") pod \"console-b6c475974-5k694\" (UID: \"2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd\") " pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:32.591767 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.591685 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd-trusted-ca-bundle\") pod \"console-b6c475974-5k694\" (UID: \"2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd\") " pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:32.591767 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.591743 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd-console-serving-cert\") pod \"console-b6c475974-5k694\" (UID: \"2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd\") " pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:32.591767 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.591767 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd-console-config\") pod \"console-b6c475974-5k694\" (UID: \"2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd\") " pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:32.591994 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.591792 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd-service-ca\") pod \"console-b6c475974-5k694\" (UID: \"2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd\") " pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:32.591994 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.591814 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd-oauth-serving-cert\") pod \"console-b6c475974-5k694\" (UID: \"2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd\") " pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:32.591994 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.591844 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd-console-oauth-config\") pod \"console-b6c475974-5k694\" (UID: \"2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd\") " pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:32.591994 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.591897 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j65t5\" (UniqueName: \"kubernetes.io/projected/2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd-kube-api-access-j65t5\") pod \"console-b6c475974-5k694\" (UID: \"2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd\") " pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:32.592655 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.592604 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd-console-config\") pod \"console-b6c475974-5k694\" (UID: \"2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd\") " pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:32.592778 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.592743 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd-service-ca\") pod \"console-b6c475974-5k694\" (UID: \"2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd\") " pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:32.592849 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.592797 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd-oauth-serving-cert\") pod \"console-b6c475974-5k694\" (UID: \"2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd\") " pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:32.593184 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.593156 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd-trusted-ca-bundle\") pod \"console-b6c475974-5k694\" (UID: \"2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd\") " pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:32.594888 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.594866 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd-console-oauth-config\") pod \"console-b6c475974-5k694\" (UID: \"2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd\") " pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:32.595041 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.595018 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd-console-serving-cert\") pod \"console-b6c475974-5k694\" (UID: \"2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd\") " pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:32.607228 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.607203 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j65t5\" (UniqueName: \"kubernetes.io/projected/2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd-kube-api-access-j65t5\") pod \"console-b6c475974-5k694\" (UID: \"2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd\") " pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:32.689882 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.689855 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:32.851167 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:32.851140 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b6c475974-5k694"] Jun 12 22:31:32.852892 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:31:32.852861 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aff9a4d_bfe7_47a0_a3a1_f87c7363e5bd.slice/crio-cce51b1e2e1fed7ddf7269f7f7263b0cee0f6dc50560bbc1173799e2d26d076b WatchSource:0}: Error finding container cce51b1e2e1fed7ddf7269f7f7263b0cee0f6dc50560bbc1173799e2d26d076b: Status 404 returned error can't find the container with id cce51b1e2e1fed7ddf7269f7f7263b0cee0f6dc50560bbc1173799e2d26d076b Jun 12 22:31:33.339804 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:33.339766 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6c475974-5k694" event={"ID":"2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd","Type":"ContainerStarted","Data":"61e3f77150e8d2abee43d00e69ec5dbe1b14aa5c3dc11e8f7c948f7175c36224"} Jun 12 22:31:33.340174 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:33.339827 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6c475974-5k694" event={"ID":"2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd","Type":"ContainerStarted","Data":"cce51b1e2e1fed7ddf7269f7f7263b0cee0f6dc50560bbc1173799e2d26d076b"} Jun 12 22:31:33.362018 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:33.361953 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b6c475974-5k694" podStartSLOduration=1.361930712 podStartE2EDuration="1.361930712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:31:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:31:33.36021707 +0000 UTC m=+693.231247228" watchObservedRunningTime="2026-06-12 22:31:33.361930712 +0000 UTC m=+693.232960833" Jun 12 22:31:36.931048 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:36.930963 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4fln"] Jun 12 22:31:36.934410 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:36.934393 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4fln" Jun 12 22:31:36.937802 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:36.937782 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 12 22:31:36.937925 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:36.937784 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-drsck\"" Jun 12 22:31:36.952549 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:36.952504 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4fln"] Jun 12 22:31:37.035378 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:37.035341 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59gdn\" (UniqueName: \"kubernetes.io/projected/e13556e1-b384-4db1-9475-5d916b144a67-kube-api-access-59gdn\") pod \"dns-operator-controller-manager-864dd78c4c-f4fln\" (UID: \"e13556e1-b384-4db1-9475-5d916b144a67\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4fln" Jun 12 22:31:37.136763 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:37.136725 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59gdn\" (UniqueName: \"kubernetes.io/projected/e13556e1-b384-4db1-9475-5d916b144a67-kube-api-access-59gdn\") pod \"dns-operator-controller-manager-864dd78c4c-f4fln\" (UID: \"e13556e1-b384-4db1-9475-5d916b144a67\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4fln" Jun 12 22:31:37.146394 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:37.146332 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59gdn\" (UniqueName: \"kubernetes.io/projected/e13556e1-b384-4db1-9475-5d916b144a67-kube-api-access-59gdn\") pod \"dns-operator-controller-manager-864dd78c4c-f4fln\" (UID: \"e13556e1-b384-4db1-9475-5d916b144a67\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4fln" Jun 12 22:31:37.245306 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:37.245220 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4fln" Jun 12 22:31:37.370707 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:37.370673 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7" event={"ID":"9bed6029-b974-43e6-8940-09b9d6dcfa97","Type":"ContainerStarted","Data":"7d3794dc7b1adb04567c9ba40f427a80d7a031597badb37142e5588462f8357e"} Jun 12 22:31:37.370859 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:37.370784 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7" Jun 12 22:31:37.403739 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:37.403709 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4fln"] Jun 12 22:31:37.404960 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:37.404916 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7" podStartSLOduration=1.478277287 podStartE2EDuration="6.404901107s" totalImagesPullingTime="4.92662382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:31:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:31:37.402510942 +0000 UTC m=+697.273541063" watchObservedRunningTime="2026-06-12 22:31:37.404901107 +0000 UTC m=+697.275931229" Jun 12 22:31:37.406391 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:31:37.406371 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode13556e1_b384_4db1_9475_5d916b144a67.slice/crio-2d608c0c09039d3c2b8598ced7a73cc4c22888a18a4b90a510d56496796bbc4f WatchSource:0}: Error finding container 2d608c0c09039d3c2b8598ced7a73cc4c22888a18a4b90a510d56496796bbc4f: Status 404 returned error can't find the container with id 2d608c0c09039d3c2b8598ced7a73cc4c22888a18a4b90a510d56496796bbc4f Jun 12 22:31:38.379720 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:38.379682 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4fln" event={"ID":"e13556e1-b384-4db1-9475-5d916b144a67","Type":"ContainerStarted","Data":"2d608c0c09039d3c2b8598ced7a73cc4c22888a18a4b90a510d56496796bbc4f"} Jun 12 22:31:39.199787 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:39.199735 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh52l"] Jun 12 22:31:39.203739 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:39.203717 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh52l" Jun 12 22:31:39.206355 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:39.206332 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-kwhtz\"" Jun 12 22:31:39.214720 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:39.214682 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh52l"] Jun 12 22:31:39.360514 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:39.360476 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtgs5\" (UniqueName: \"kubernetes.io/projected/668bafb7-bf48-4a15-8e06-8f20f17914c0-kube-api-access-dtgs5\") pod \"limitador-operator-controller-manager-859d7b78bd-bh52l\" (UID: \"668bafb7-bf48-4a15-8e06-8f20f17914c0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh52l" Jun 12 22:31:39.461173 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:39.461097 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtgs5\" (UniqueName: \"kubernetes.io/projected/668bafb7-bf48-4a15-8e06-8f20f17914c0-kube-api-access-dtgs5\") pod \"limitador-operator-controller-manager-859d7b78bd-bh52l\" (UID: \"668bafb7-bf48-4a15-8e06-8f20f17914c0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh52l" Jun 12 22:31:39.469646 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:39.469621 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtgs5\" (UniqueName: \"kubernetes.io/projected/668bafb7-bf48-4a15-8e06-8f20f17914c0-kube-api-access-dtgs5\") pod \"limitador-operator-controller-manager-859d7b78bd-bh52l\" (UID: \"668bafb7-bf48-4a15-8e06-8f20f17914c0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh52l" Jun 12 22:31:39.516945 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:39.516922 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh52l" Jun 12 22:31:39.641887 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:39.641851 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bk7rk"] Jun 12 22:31:39.646007 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:39.645973 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk7rk" Jun 12 22:31:39.649234 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:39.649124 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 12 22:31:39.649234 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:39.649171 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-98xlp\"" Jun 12 22:31:39.649419 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:39.649133 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 12 22:31:39.654865 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:39.654838 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bk7rk"] Jun 12 22:31:39.681087 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:39.681052 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh52l"] Jun 12 22:31:39.684549 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:31:39.684510 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod668bafb7_bf48_4a15_8e06_8f20f17914c0.slice/crio-ec1ba3aa93dae56dad99a977a3f7540974ec23a9b8c2fc8bf8f5480242cbbce1 WatchSource:0}: Error finding container ec1ba3aa93dae56dad99a977a3f7540974ec23a9b8c2fc8bf8f5480242cbbce1: Status 404 returned error can't find the container with id ec1ba3aa93dae56dad99a977a3f7540974ec23a9b8c2fc8bf8f5480242cbbce1 Jun 12 22:31:39.763132 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:39.763095 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/14c12412-dd4b-4f89-8da4-7d45b922fffe-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bk7rk\" (UID: \"14c12412-dd4b-4f89-8da4-7d45b922fffe\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk7rk" Jun 12 22:31:39.763323 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:39.763148 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/14c12412-dd4b-4f89-8da4-7d45b922fffe-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bk7rk\" (UID: \"14c12412-dd4b-4f89-8da4-7d45b922fffe\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk7rk" Jun 12 22:31:39.763323 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:39.763201 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7wqt\" (UniqueName: \"kubernetes.io/projected/14c12412-dd4b-4f89-8da4-7d45b922fffe-kube-api-access-t7wqt\") pod \"kuadrant-console-plugin-66b5774985-bk7rk\" (UID: \"14c12412-dd4b-4f89-8da4-7d45b922fffe\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk7rk" Jun 12 22:31:39.864359 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:39.864321 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/14c12412-dd4b-4f89-8da4-7d45b922fffe-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bk7rk\" (UID: \"14c12412-dd4b-4f89-8da4-7d45b922fffe\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk7rk" Jun 12 22:31:39.864576 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:39.864364 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7wqt\" (UniqueName: \"kubernetes.io/projected/14c12412-dd4b-4f89-8da4-7d45b922fffe-kube-api-access-t7wqt\") pod \"kuadrant-console-plugin-66b5774985-bk7rk\" (UID: \"14c12412-dd4b-4f89-8da4-7d45b922fffe\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk7rk" Jun 12 22:31:39.864576 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:39.864465 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/14c12412-dd4b-4f89-8da4-7d45b922fffe-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bk7rk\" (UID: \"14c12412-dd4b-4f89-8da4-7d45b922fffe\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk7rk" Jun 12 22:31:39.864576 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:31:39.864509 2558 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 12 22:31:39.864576 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:31:39.864575 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14c12412-dd4b-4f89-8da4-7d45b922fffe-plugin-serving-cert podName:14c12412-dd4b-4f89-8da4-7d45b922fffe nodeName:}" failed. No retries permitted until 2026-06-12 22:31:40.3645583 +0000 UTC m=+700.235588400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/14c12412-dd4b-4f89-8da4-7d45b922fffe-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-bk7rk" (UID: "14c12412-dd4b-4f89-8da4-7d45b922fffe") : secret "plugin-serving-cert" not found Jun 12 22:31:39.865119 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:39.865101 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/14c12412-dd4b-4f89-8da4-7d45b922fffe-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bk7rk\" (UID: \"14c12412-dd4b-4f89-8da4-7d45b922fffe\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk7rk" Jun 12 22:31:39.877035 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:39.877004 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7wqt\" (UniqueName: \"kubernetes.io/projected/14c12412-dd4b-4f89-8da4-7d45b922fffe-kube-api-access-t7wqt\") pod \"kuadrant-console-plugin-66b5774985-bk7rk\" (UID: \"14c12412-dd4b-4f89-8da4-7d45b922fffe\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk7rk" Jun 12 22:31:40.370020 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:40.369978 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/14c12412-dd4b-4f89-8da4-7d45b922fffe-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bk7rk\" (UID: \"14c12412-dd4b-4f89-8da4-7d45b922fffe\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk7rk" Jun 12 22:31:40.373107 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:40.373075 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/14c12412-dd4b-4f89-8da4-7d45b922fffe-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bk7rk\" (UID: \"14c12412-dd4b-4f89-8da4-7d45b922fffe\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk7rk" Jun 12 22:31:40.396000 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:40.395963 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh52l" event={"ID":"668bafb7-bf48-4a15-8e06-8f20f17914c0","Type":"ContainerStarted","Data":"ec1ba3aa93dae56dad99a977a3f7540974ec23a9b8c2fc8bf8f5480242cbbce1"} Jun 12 22:31:40.398184 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:40.398153 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4fln" event={"ID":"e13556e1-b384-4db1-9475-5d916b144a67","Type":"ContainerStarted","Data":"30b36d935301918d9408167f13920e101ffc5073ea18369344ecabf499eb890c"} Jun 12 22:31:40.398353 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:40.398337 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4fln" Jun 12 22:31:40.420556 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:40.420502 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4fln" podStartSLOduration=2.318689402 podStartE2EDuration="4.42048568s" totalImagesPullingTime="2.101796278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:31:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:31:40.418840018 +0000 UTC m=+700.289870133" watchObservedRunningTime="2026-06-12 22:31:40.42048568 +0000 UTC m=+700.291515801" Jun 12 22:31:40.560400 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:40.560372 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk7rk" Jun 12 22:31:40.710642 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:40.710591 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bk7rk"] Jun 12 22:31:40.714560 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:31:40.714508 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14c12412_dd4b_4f89_8da4_7d45b922fffe.slice/crio-818f1db33adc089968d81509a3af9f4a28f4ace0b79888c0f77dae0390b38477 WatchSource:0}: Error finding container 818f1db33adc089968d81509a3af9f4a28f4ace0b79888c0f77dae0390b38477: Status 404 returned error can't find the container with id 818f1db33adc089968d81509a3af9f4a28f4ace0b79888c0f77dae0390b38477 Jun 12 22:31:41.404555 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:41.404528 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk7rk" event={"ID":"14c12412-dd4b-4f89-8da4-7d45b922fffe","Type":"ContainerStarted","Data":"818f1db33adc089968d81509a3af9f4a28f4ace0b79888c0f77dae0390b38477"} Jun 12 22:31:42.412648 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:42.412607 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh52l" event={"ID":"668bafb7-bf48-4a15-8e06-8f20f17914c0","Type":"ContainerStarted","Data":"f325fdac8cd486f0f823e3d827c1ce7d370586c7012f1fdcb733b2549ed5a797"} Jun 12 22:31:42.413074 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:42.412706 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh52l" Jun 12 22:31:42.429293 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:42.429231 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh52l" podStartSLOduration=1.734335382 podStartE2EDuration="3.429215621s" totalImagesPullingTime="1.694880239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:31:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:31:42.42813439 +0000 UTC m=+702.299164511" watchObservedRunningTime="2026-06-12 22:31:42.429215621 +0000 UTC m=+702.300245741" Jun 12 22:31:42.690124 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:42.690039 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:42.690124 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:42.690111 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:42.695195 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:42.695167 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:43.422921 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:43.422893 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b6c475974-5k694" Jun 12 22:31:43.473283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:43.473243 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-786bdb6f54-9dl8l"] Jun 12 22:31:48.382080 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:48.382052 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7" Jun 12 22:31:50.190393 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:50.190304 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7"] Jun 12 22:31:50.190856 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:50.190527 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7" podUID="9bed6029-b974-43e6-8940-09b9d6dcfa97" containerName="manager" containerID="cri-o://7d3794dc7b1adb04567c9ba40f427a80d7a031597badb37142e5588462f8357e" gracePeriod=2 Jun 12 22:31:50.198157 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:50.198129 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7"] Jun 12 22:31:50.223225 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:50.223193 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khzsc"] Jun 12 22:31:50.223942 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:50.223769 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bed6029-b974-43e6-8940-09b9d6dcfa97" containerName="manager" Jun 12 22:31:50.223942 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:50.223787 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bed6029-b974-43e6-8940-09b9d6dcfa97" containerName="manager" Jun 12 22:31:50.223942 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:50.223898 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bed6029-b974-43e6-8940-09b9d6dcfa97" containerName="manager" Jun 12 22:31:50.227257 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:50.227235 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khzsc" Jun 12 22:31:50.233100 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:50.233077 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh52l"] Jun 12 22:31:50.233303 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:50.233280 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh52l" podUID="668bafb7-bf48-4a15-8e06-8f20f17914c0" containerName="manager" containerID="cri-o://f325fdac8cd486f0f823e3d827c1ce7d370586c7012f1fdcb733b2549ed5a797" gracePeriod=2 Jun 12 22:31:50.235361 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:50.235338 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh52l" Jun 12 22:31:50.247148 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:50.247119 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khzsc"] Jun 12 22:31:50.252764 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:50.252730 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh52l"] Jun 12 22:31:50.273930 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:31:50.273891 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ntbd7\" is forbidden: User \"system:node:ip-10-0-135-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-250.ec2.internal' and this object" podUID="9bed6029-b974-43e6-8940-09b9d6dcfa97" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7" Jun 12 22:31:50.276061 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:31:50.276030 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bh52l\" is forbidden: User \"system:node:ip-10-0-135-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-250.ec2.internal' and this object" podUID="668bafb7-bf48-4a15-8e06-8f20f17914c0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh52l" Jun 12 22:31:50.276418 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:50.276391 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-khzsc\" (UID: \"f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khzsc" Jun 12 22:31:50.276552 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:50.276521 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpdmg\" (UniqueName: \"kubernetes.io/projected/f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3-kube-api-access-lpdmg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-khzsc\" (UID: \"f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khzsc" Jun 12 22:31:50.278036 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:31:50.278003 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ntbd7\" is forbidden: User \"system:node:ip-10-0-135-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-250.ec2.internal' and this object" podUID="9bed6029-b974-43e6-8940-09b9d6dcfa97" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7" Jun 12 22:31:50.377651 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:50.377619 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-khzsc\" (UID: \"f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khzsc" Jun 12 22:31:50.377836 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:50.377671 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpdmg\" (UniqueName: \"kubernetes.io/projected/f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3-kube-api-access-lpdmg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-khzsc\" (UID: \"f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khzsc" Jun 12 22:31:50.378044 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:50.378022 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-khzsc\" (UID: \"f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khzsc" Jun 12 22:31:50.391700 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:50.391675 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpdmg\" (UniqueName: \"kubernetes.io/projected/f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3-kube-api-access-lpdmg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-khzsc\" (UID: \"f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khzsc" Jun 12 22:31:50.574047 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:31:50.573990 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bh52l\" is forbidden: User \"system:node:ip-10-0-135-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-250.ec2.internal' and this object" podUID="668bafb7-bf48-4a15-8e06-8f20f17914c0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh52l" Jun 12 22:31:50.576210 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:31:50.576177 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ntbd7\" is forbidden: User \"system:node:ip-10-0-135-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-250.ec2.internal' and this object" podUID="9bed6029-b974-43e6-8940-09b9d6dcfa97" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7" Jun 12 22:31:50.605571 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:50.605535 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khzsc" Jun 12 22:31:51.407839 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:31:51.407808 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4fln" Jun 12 22:32:02.543365 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:02.543253 2558 generic.go:356] "Generic (PLEG): container finished" podID="668bafb7-bf48-4a15-8e06-8f20f17914c0" containerID="f325fdac8cd486f0f823e3d827c1ce7d370586c7012f1fdcb733b2549ed5a797" exitCode=0 Jun 12 22:32:02.547318 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:02.547203 2558 generic.go:356] "Generic (PLEG): container finished" podID="9bed6029-b974-43e6-8940-09b9d6dcfa97" containerID="7d3794dc7b1adb04567c9ba40f427a80d7a031597badb37142e5588462f8357e" exitCode=0 Jun 12 22:32:02.597889 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:02.597861 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khzsc"] Jun 12 22:32:02.635639 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:32:02.635601 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf49b35d5_c043_4bb8_baa3_c0c5e8bf2ae3.slice/crio-1054f7ddbec756eda49ec7d1f6e17fd8f83d1c6905480686580433e81f007de1 WatchSource:0}: Error finding container 1054f7ddbec756eda49ec7d1f6e17fd8f83d1c6905480686580433e81f007de1: Status 404 returned error can't find the container with id 1054f7ddbec756eda49ec7d1f6e17fd8f83d1c6905480686580433e81f007de1 Jun 12 22:32:02.640644 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:02.640626 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh52l" Jun 12 22:32:02.642895 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:32:02.642871 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bh52l\" is forbidden: User \"system:node:ip-10-0-135-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-250.ec2.internal' and this object" podUID="668bafb7-bf48-4a15-8e06-8f20f17914c0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh52l" Jun 12 22:32:02.661456 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:02.657480 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7" Jun 12 22:32:02.664328 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:32:02.664286 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bh52l\" is forbidden: User \"system:node:ip-10-0-135-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-250.ec2.internal' and this object" podUID="668bafb7-bf48-4a15-8e06-8f20f17914c0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh52l" Jun 12 22:32:02.666548 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:32:02.666515 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ntbd7\" is forbidden: User \"system:node:ip-10-0-135-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-250.ec2.internal' and this object" podUID="9bed6029-b974-43e6-8940-09b9d6dcfa97" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7" Jun 12 22:32:02.800873 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:02.800834 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtgs5\" (UniqueName: \"kubernetes.io/projected/668bafb7-bf48-4a15-8e06-8f20f17914c0-kube-api-access-dtgs5\") pod \"668bafb7-bf48-4a15-8e06-8f20f17914c0\" (UID: \"668bafb7-bf48-4a15-8e06-8f20f17914c0\") " Jun 12 22:32:02.801044 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:02.800912 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jz6z\" (UniqueName: \"kubernetes.io/projected/9bed6029-b974-43e6-8940-09b9d6dcfa97-kube-api-access-2jz6z\") pod \"9bed6029-b974-43e6-8940-09b9d6dcfa97\" (UID: \"9bed6029-b974-43e6-8940-09b9d6dcfa97\") " Jun 12 22:32:02.801044 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:02.800963 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bed6029-b974-43e6-8940-09b9d6dcfa97-extensions-socket-volume\") pod \"9bed6029-b974-43e6-8940-09b9d6dcfa97\" (UID: \"9bed6029-b974-43e6-8940-09b9d6dcfa97\") " Jun 12 22:32:02.801752 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:02.801717 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bed6029-b974-43e6-8940-09b9d6dcfa97-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9bed6029-b974-43e6-8940-09b9d6dcfa97" (UID: "9bed6029-b974-43e6-8940-09b9d6dcfa97"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:32:02.802985 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:02.802954 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/668bafb7-bf48-4a15-8e06-8f20f17914c0-kube-api-access-dtgs5" (OuterVolumeSpecName: "kube-api-access-dtgs5") pod "668bafb7-bf48-4a15-8e06-8f20f17914c0" (UID: "668bafb7-bf48-4a15-8e06-8f20f17914c0"). InnerVolumeSpecName "kube-api-access-dtgs5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:32:02.803071 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:02.803014 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bed6029-b974-43e6-8940-09b9d6dcfa97-kube-api-access-2jz6z" (OuterVolumeSpecName: "kube-api-access-2jz6z") pod "9bed6029-b974-43e6-8940-09b9d6dcfa97" (UID: "9bed6029-b974-43e6-8940-09b9d6dcfa97"). InnerVolumeSpecName "kube-api-access-2jz6z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:32:02.902419 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:02.902380 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bed6029-b974-43e6-8940-09b9d6dcfa97-extensions-socket-volume\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:32:02.902419 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:02.902414 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtgs5\" (UniqueName: \"kubernetes.io/projected/668bafb7-bf48-4a15-8e06-8f20f17914c0-kube-api-access-dtgs5\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:32:02.902419 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:02.902424 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jz6z\" (UniqueName: \"kubernetes.io/projected/9bed6029-b974-43e6-8940-09b9d6dcfa97-kube-api-access-2jz6z\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:32:03.554843 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:03.554815 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh52l" Jun 12 22:32:03.555252 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:03.554815 2558 scope.go:117] "RemoveContainer" containerID="f325fdac8cd486f0f823e3d827c1ce7d370586c7012f1fdcb733b2549ed5a797" Jun 12 22:32:03.556452 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:03.556418 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7" Jun 12 22:32:03.557308 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:32:03.557282 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bh52l\" is forbidden: User \"system:node:ip-10-0-135-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-250.ec2.internal' and this object" podUID="668bafb7-bf48-4a15-8e06-8f20f17914c0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh52l" Jun 12 22:32:03.558241 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:03.558206 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk7rk" event={"ID":"14c12412-dd4b-4f89-8da4-7d45b922fffe","Type":"ContainerStarted","Data":"86685b86eda2cad2748f10318f68c915e61520f3a691e7a40ddf5f105d5cb0fd"} Jun 12 22:32:03.559245 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:32:03.559217 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ntbd7\" is forbidden: User \"system:node:ip-10-0-135-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-250.ec2.internal' and this object" podUID="9bed6029-b974-43e6-8940-09b9d6dcfa97" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7" Jun 12 22:32:03.560046 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:03.560023 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khzsc" event={"ID":"f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3","Type":"ContainerStarted","Data":"2a1dbdd6d7b43c1a8d1baf4f3310e8b9c745b0734ffdfc7c0ff659dda1d34b96"} Jun 12 22:32:03.560146 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:03.560103 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khzsc" event={"ID":"f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3","Type":"ContainerStarted","Data":"1054f7ddbec756eda49ec7d1f6e17fd8f83d1c6905480686580433e81f007de1"} Jun 12 22:32:03.560146 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:03.560134 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khzsc" Jun 12 22:32:03.565046 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:03.565024 2558 scope.go:117] "RemoveContainer" containerID="7d3794dc7b1adb04567c9ba40f427a80d7a031597badb37142e5588462f8357e" Jun 12 22:32:03.579064 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:03.579020 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk7rk" podStartSLOduration=2.7602476129999998 podStartE2EDuration="24.579008238s" totalImagesPullingTime="21.818760625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:31:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:32:03.576960969 +0000 UTC m=+723.447991089" watchObservedRunningTime="2026-06-12 22:32:03.579008238 +0000 UTC m=+723.450038359" Jun 12 22:32:03.579204 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:32:03.579034 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bh52l\" is forbidden: User \"system:node:ip-10-0-135-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-250.ec2.internal' and this object" podUID="668bafb7-bf48-4a15-8e06-8f20f17914c0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh52l" Jun 12 22:32:03.581018 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:32:03.580995 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ntbd7\" is forbidden: User \"system:node:ip-10-0-135-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-250.ec2.internal' and this object" podUID="9bed6029-b974-43e6-8940-09b9d6dcfa97" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7" Jun 12 22:32:03.582903 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:32:03.582882 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bh52l\" is forbidden: User \"system:node:ip-10-0-135-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-250.ec2.internal' and this object" podUID="668bafb7-bf48-4a15-8e06-8f20f17914c0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh52l" Jun 12 22:32:03.602510 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:03.602461 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khzsc" podStartSLOduration=13.602418157 podStartE2EDuration="13.602418157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:31:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:32:03.601586246 +0000 UTC m=+723.472616368" watchObservedRunningTime="2026-06-12 22:32:03.602418157 +0000 UTC m=+723.473448278" Jun 12 22:32:03.603797 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:32:03.603770 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ntbd7\" is forbidden: User \"system:node:ip-10-0-135-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-250.ec2.internal' and this object" podUID="9bed6029-b974-43e6-8940-09b9d6dcfa97" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ntbd7" Jun 12 22:32:04.574285 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:04.574244 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="668bafb7-bf48-4a15-8e06-8f20f17914c0" path="/var/lib/kubelet/pods/668bafb7-bf48-4a15-8e06-8f20f17914c0/volumes" Jun 12 22:32:04.574815 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:04.574765 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bed6029-b974-43e6-8940-09b9d6dcfa97" path="/var/lib/kubelet/pods/9bed6029-b974-43e6-8940-09b9d6dcfa97/volumes" Jun 12 22:32:07.230934 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:07.230893 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khzsc"] Jun 12 22:32:07.231394 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:07.231131 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khzsc" podUID="f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3" containerName="manager" containerID="cri-o://2a1dbdd6d7b43c1a8d1baf4f3310e8b9c745b0734ffdfc7c0ff659dda1d34b96" gracePeriod=10 Jun 12 22:32:07.233039 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:07.233014 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khzsc" Jun 12 22:32:07.489124 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:07.489063 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khzsc" Jun 12 22:32:07.583141 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:07.583107 2558 generic.go:356] "Generic (PLEG): container finished" podID="f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3" containerID="2a1dbdd6d7b43c1a8d1baf4f3310e8b9c745b0734ffdfc7c0ff659dda1d34b96" exitCode=0 Jun 12 22:32:07.583282 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:07.583151 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khzsc" Jun 12 22:32:07.583282 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:07.583191 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khzsc" event={"ID":"f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3","Type":"ContainerDied","Data":"2a1dbdd6d7b43c1a8d1baf4f3310e8b9c745b0734ffdfc7c0ff659dda1d34b96"} Jun 12 22:32:07.583282 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:07.583244 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khzsc" event={"ID":"f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3","Type":"ContainerDied","Data":"1054f7ddbec756eda49ec7d1f6e17fd8f83d1c6905480686580433e81f007de1"} Jun 12 22:32:07.583282 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:07.583275 2558 scope.go:117] "RemoveContainer" containerID="2a1dbdd6d7b43c1a8d1baf4f3310e8b9c745b0734ffdfc7c0ff659dda1d34b96" Jun 12 22:32:07.591909 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:07.591891 2558 scope.go:117] "RemoveContainer" containerID="2a1dbdd6d7b43c1a8d1baf4f3310e8b9c745b0734ffdfc7c0ff659dda1d34b96" Jun 12 22:32:07.592141 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:32:07.592124 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a1dbdd6d7b43c1a8d1baf4f3310e8b9c745b0734ffdfc7c0ff659dda1d34b96\": container with ID starting with 2a1dbdd6d7b43c1a8d1baf4f3310e8b9c745b0734ffdfc7c0ff659dda1d34b96 not found: ID does not exist" containerID="2a1dbdd6d7b43c1a8d1baf4f3310e8b9c745b0734ffdfc7c0ff659dda1d34b96" Jun 12 22:32:07.592182 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:07.592152 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a1dbdd6d7b43c1a8d1baf4f3310e8b9c745b0734ffdfc7c0ff659dda1d34b96"} err="failed to get container status \"2a1dbdd6d7b43c1a8d1baf4f3310e8b9c745b0734ffdfc7c0ff659dda1d34b96\": rpc error: code = NotFound desc = could not find container \"2a1dbdd6d7b43c1a8d1baf4f3310e8b9c745b0734ffdfc7c0ff659dda1d34b96\": container with ID starting with 2a1dbdd6d7b43c1a8d1baf4f3310e8b9c745b0734ffdfc7c0ff659dda1d34b96 not found: ID does not exist" Jun 12 22:32:07.645687 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:07.645659 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3-extensions-socket-volume\") pod \"f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3\" (UID: \"f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3\") " Jun 12 22:32:07.645687 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:07.645689 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpdmg\" (UniqueName: \"kubernetes.io/projected/f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3-kube-api-access-lpdmg\") pod \"f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3\" (UID: \"f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3\") " Jun 12 22:32:07.646089 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:07.646069 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3" (UID: "f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:32:07.647768 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:07.647744 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3-kube-api-access-lpdmg" (OuterVolumeSpecName: "kube-api-access-lpdmg") pod "f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3" (UID: "f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3"). InnerVolumeSpecName "kube-api-access-lpdmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:32:07.746768 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:07.746697 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3-extensions-socket-volume\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:32:07.746768 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:07.746720 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpdmg\" (UniqueName: \"kubernetes.io/projected/f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3-kube-api-access-lpdmg\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:32:07.906317 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:07.906285 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khzsc"] Jun 12 22:32:07.912394 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:07.912366 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khzsc"] Jun 12 22:32:08.502472 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:08.502405 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-786bdb6f54-9dl8l" podUID="887b7e97-8ee7-42c2-a6ba-180447d07b5e" containerName="console" containerID="cri-o://c756aa9ed915ccf5c28cc51800492002343e09976086f8b5d8d246ac12118439" gracePeriod=15 Jun 12 22:32:08.575085 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:08.575052 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3" path="/var/lib/kubelet/pods/f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3/volumes" Jun 12 22:32:08.755820 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:08.755761 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:32:08.857185 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:08.857148 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/887b7e97-8ee7-42c2-a6ba-180447d07b5e-trusted-ca-bundle\") pod \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " Jun 12 22:32:08.857356 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:08.857206 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/887b7e97-8ee7-42c2-a6ba-180447d07b5e-console-oauth-config\") pod \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " Jun 12 22:32:08.857356 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:08.857252 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/887b7e97-8ee7-42c2-a6ba-180447d07b5e-console-serving-cert\") pod \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " Jun 12 22:32:08.857356 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:08.857292 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27jz7\" (UniqueName: \"kubernetes.io/projected/887b7e97-8ee7-42c2-a6ba-180447d07b5e-kube-api-access-27jz7\") pod \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " Jun 12 22:32:08.857356 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:08.857314 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/887b7e97-8ee7-42c2-a6ba-180447d07b5e-console-config\") pod \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " Jun 12 22:32:08.857602 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:08.857357 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/887b7e97-8ee7-42c2-a6ba-180447d07b5e-service-ca\") pod \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " Jun 12 22:32:08.857602 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:08.857388 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/887b7e97-8ee7-42c2-a6ba-180447d07b5e-oauth-serving-cert\") pod \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\" (UID: \"887b7e97-8ee7-42c2-a6ba-180447d07b5e\") " Jun 12 22:32:08.857752 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:08.857721 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/887b7e97-8ee7-42c2-a6ba-180447d07b5e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "887b7e97-8ee7-42c2-a6ba-180447d07b5e" (UID: "887b7e97-8ee7-42c2-a6ba-180447d07b5e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:32:08.857823 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:08.857790 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/887b7e97-8ee7-42c2-a6ba-180447d07b5e-service-ca" (OuterVolumeSpecName: "service-ca") pod "887b7e97-8ee7-42c2-a6ba-180447d07b5e" (UID: "887b7e97-8ee7-42c2-a6ba-180447d07b5e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:32:08.857926 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:08.857899 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/887b7e97-8ee7-42c2-a6ba-180447d07b5e-console-config" (OuterVolumeSpecName: "console-config") pod "887b7e97-8ee7-42c2-a6ba-180447d07b5e" (UID: "887b7e97-8ee7-42c2-a6ba-180447d07b5e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:32:08.858015 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:08.857994 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/887b7e97-8ee7-42c2-a6ba-180447d07b5e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "887b7e97-8ee7-42c2-a6ba-180447d07b5e" (UID: "887b7e97-8ee7-42c2-a6ba-180447d07b5e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:32:08.859595 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:08.859566 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/887b7e97-8ee7-42c2-a6ba-180447d07b5e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "887b7e97-8ee7-42c2-a6ba-180447d07b5e" (UID: "887b7e97-8ee7-42c2-a6ba-180447d07b5e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:32:08.859707 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:08.859639 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/887b7e97-8ee7-42c2-a6ba-180447d07b5e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "887b7e97-8ee7-42c2-a6ba-180447d07b5e" (UID: "887b7e97-8ee7-42c2-a6ba-180447d07b5e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:32:08.859707 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:08.859654 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/887b7e97-8ee7-42c2-a6ba-180447d07b5e-kube-api-access-27jz7" (OuterVolumeSpecName: "kube-api-access-27jz7") pod "887b7e97-8ee7-42c2-a6ba-180447d07b5e" (UID: "887b7e97-8ee7-42c2-a6ba-180447d07b5e"). InnerVolumeSpecName "kube-api-access-27jz7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:32:08.958454 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:08.958405 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/887b7e97-8ee7-42c2-a6ba-180447d07b5e-console-serving-cert\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:32:08.958454 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:08.958450 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27jz7\" (UniqueName: \"kubernetes.io/projected/887b7e97-8ee7-42c2-a6ba-180447d07b5e-kube-api-access-27jz7\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:32:08.958454 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:08.958461 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/887b7e97-8ee7-42c2-a6ba-180447d07b5e-console-config\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:32:08.958671 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:08.958470 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/887b7e97-8ee7-42c2-a6ba-180447d07b5e-service-ca\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:32:08.958671 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:08.958478 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/887b7e97-8ee7-42c2-a6ba-180447d07b5e-oauth-serving-cert\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:32:08.958671 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:08.958487 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/887b7e97-8ee7-42c2-a6ba-180447d07b5e-trusted-ca-bundle\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:32:08.958671 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:08.958495 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/887b7e97-8ee7-42c2-a6ba-180447d07b5e-console-oauth-config\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:32:09.595805 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:09.595764 2558 generic.go:356] "Generic (PLEG): container finished" podID="887b7e97-8ee7-42c2-a6ba-180447d07b5e" containerID="c756aa9ed915ccf5c28cc51800492002343e09976086f8b5d8d246ac12118439" exitCode=0 Jun 12 22:32:09.596228 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:09.595813 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786bdb6f54-9dl8l" Jun 12 22:32:09.596228 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:09.595853 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786bdb6f54-9dl8l" event={"ID":"887b7e97-8ee7-42c2-a6ba-180447d07b5e","Type":"ContainerDied","Data":"c756aa9ed915ccf5c28cc51800492002343e09976086f8b5d8d246ac12118439"} Jun 12 22:32:09.596228 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:09.595917 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786bdb6f54-9dl8l" event={"ID":"887b7e97-8ee7-42c2-a6ba-180447d07b5e","Type":"ContainerDied","Data":"40e306e897a74dffb6be094335050dfec99b661b2a204bad4000134d696edc5c"} Jun 12 22:32:09.596228 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:09.595957 2558 scope.go:117] "RemoveContainer" containerID="c756aa9ed915ccf5c28cc51800492002343e09976086f8b5d8d246ac12118439" Jun 12 22:32:09.605110 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:09.605094 2558 scope.go:117] "RemoveContainer" containerID="c756aa9ed915ccf5c28cc51800492002343e09976086f8b5d8d246ac12118439" Jun 12 22:32:09.605381 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:32:09.605361 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c756aa9ed915ccf5c28cc51800492002343e09976086f8b5d8d246ac12118439\": container with ID starting with c756aa9ed915ccf5c28cc51800492002343e09976086f8b5d8d246ac12118439 not found: ID does not exist" containerID="c756aa9ed915ccf5c28cc51800492002343e09976086f8b5d8d246ac12118439" Jun 12 22:32:09.605427 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:09.605390 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c756aa9ed915ccf5c28cc51800492002343e09976086f8b5d8d246ac12118439"} err="failed to get container status \"c756aa9ed915ccf5c28cc51800492002343e09976086f8b5d8d246ac12118439\": rpc error: code = NotFound desc = could not find container \"c756aa9ed915ccf5c28cc51800492002343e09976086f8b5d8d246ac12118439\": container with ID starting with c756aa9ed915ccf5c28cc51800492002343e09976086f8b5d8d246ac12118439 not found: ID does not exist" Jun 12 22:32:09.618314 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:09.618275 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-786bdb6f54-9dl8l"] Jun 12 22:32:09.620155 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:09.620130 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-786bdb6f54-9dl8l"] Jun 12 22:32:10.574416 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:10.574373 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="887b7e97-8ee7-42c2-a6ba-180447d07b5e" path="/var/lib/kubelet/pods/887b7e97-8ee7-42c2-a6ba-180447d07b5e/volumes" Jun 12 22:32:23.496335 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.496300 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx"] Jun 12 22:32:23.496777 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.496752 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3" containerName="manager" Jun 12 22:32:23.496777 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.496767 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3" containerName="manager" Jun 12 22:32:23.496852 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.496783 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="668bafb7-bf48-4a15-8e06-8f20f17914c0" containerName="manager" Jun 12 22:32:23.496852 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.496788 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="668bafb7-bf48-4a15-8e06-8f20f17914c0" containerName="manager" Jun 12 22:32:23.496852 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.496797 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="887b7e97-8ee7-42c2-a6ba-180447d07b5e" containerName="console" Jun 12 22:32:23.496852 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.496801 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="887b7e97-8ee7-42c2-a6ba-180447d07b5e" containerName="console" Jun 12 22:32:23.496976 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.496861 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="887b7e97-8ee7-42c2-a6ba-180447d07b5e" containerName="console" Jun 12 22:32:23.496976 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.496868 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="668bafb7-bf48-4a15-8e06-8f20f17914c0" containerName="manager" Jun 12 22:32:23.496976 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.496876 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f49b35d5-c043-4bb8-baa3-c0c5e8bf2ae3" containerName="manager" Jun 12 22:32:23.507075 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.507053 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.509741 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.509709 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-f5gc4\"" Jun 12 22:32:23.511019 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.510999 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx"] Jun 12 22:32:23.592851 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.592801 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9066672-7a47-4441-82d1-08cb56029fad-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.593034 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.592877 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9066672-7a47-4441-82d1-08cb56029fad-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.593034 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.592998 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9066672-7a47-4441-82d1-08cb56029fad-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.593181 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.593050 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9066672-7a47-4441-82d1-08cb56029fad-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.593181 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.593084 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9066672-7a47-4441-82d1-08cb56029fad-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.593273 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.593192 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9066672-7a47-4441-82d1-08cb56029fad-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.593323 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.593263 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9066672-7a47-4441-82d1-08cb56029fad-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.593323 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.593298 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4p7c\" (UniqueName: \"kubernetes.io/projected/e9066672-7a47-4441-82d1-08cb56029fad-kube-api-access-g4p7c\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.593403 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.593336 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9066672-7a47-4441-82d1-08cb56029fad-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.693965 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.693936 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9066672-7a47-4441-82d1-08cb56029fad-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.694137 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.693973 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9066672-7a47-4441-82d1-08cb56029fad-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.694137 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.694100 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9066672-7a47-4441-82d1-08cb56029fad-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.694137 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.694134 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9066672-7a47-4441-82d1-08cb56029fad-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.694281 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.694159 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4p7c\" (UniqueName: \"kubernetes.io/projected/e9066672-7a47-4441-82d1-08cb56029fad-kube-api-access-g4p7c\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.694281 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.694187 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9066672-7a47-4441-82d1-08cb56029fad-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.694395 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.694362 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9066672-7a47-4441-82d1-08cb56029fad-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.694475 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.694423 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9066672-7a47-4441-82d1-08cb56029fad-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.694539 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.694502 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9066672-7a47-4441-82d1-08cb56029fad-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.694539 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.694528 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9066672-7a47-4441-82d1-08cb56029fad-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.694654 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.694564 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9066672-7a47-4441-82d1-08cb56029fad-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.694843 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.694818 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9066672-7a47-4441-82d1-08cb56029fad-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.694941 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.694822 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9066672-7a47-4441-82d1-08cb56029fad-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.695110 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.695081 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9066672-7a47-4441-82d1-08cb56029fad-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.696889 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.696865 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9066672-7a47-4441-82d1-08cb56029fad-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.697045 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.697025 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9066672-7a47-4441-82d1-08cb56029fad-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.702739 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.702717 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9066672-7a47-4441-82d1-08cb56029fad-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.703938 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.703920 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4p7c\" (UniqueName: \"kubernetes.io/projected/e9066672-7a47-4441-82d1-08cb56029fad-kube-api-access-g4p7c\") pod \"maas-default-gateway-openshift-default-687ff6996-fb2mx\" (UID: \"e9066672-7a47-4441-82d1-08cb56029fad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.820530 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.820502 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:23.982167 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.982146 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx"] Jun 12 22:32:23.984027 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:32:23.983996 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9066672_7a47_4441_82d1_08cb56029fad.slice/crio-1710f74b45681b89c63ae6dd36ecdd40f3b1e5ae05b8d8747c88e6bd8f4d761b WatchSource:0}: Error finding container 1710f74b45681b89c63ae6dd36ecdd40f3b1e5ae05b8d8747c88e6bd8f4d761b: Status 404 returned error can't find the container with id 1710f74b45681b89c63ae6dd36ecdd40f3b1e5ae05b8d8747c88e6bd8f4d761b Jun 12 22:32:23.986160 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.986126 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jun 12 22:32:23.986261 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.986194 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jun 12 22:32:23.986261 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:23.986229 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jun 12 22:32:24.675748 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:24.675712 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" event={"ID":"e9066672-7a47-4441-82d1-08cb56029fad","Type":"ContainerStarted","Data":"a0edf5941aed04f1789977f7b269e63351fce3448e358dd5235f015227f0ddea"} Jun 12 22:32:24.676124 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:24.675772 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" event={"ID":"e9066672-7a47-4441-82d1-08cb56029fad","Type":"ContainerStarted","Data":"1710f74b45681b89c63ae6dd36ecdd40f3b1e5ae05b8d8747c88e6bd8f4d761b"} Jun 12 22:32:24.696731 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:24.696686 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" podStartSLOduration=1.6966730970000001 podStartE2EDuration="1.696673097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:32:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:32:24.694657081 +0000 UTC m=+744.565687204" watchObservedRunningTime="2026-06-12 22:32:24.696673097 +0000 UTC m=+744.567703218" Jun 12 22:32:24.820988 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:24.820959 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:25.694725 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:25.694694 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ndn6d"] Jun 12 22:32:25.705799 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:25.705773 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ndn6d" Jun 12 22:32:25.708797 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:25.708776 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 12 22:32:25.719846 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:25.719824 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ndn6d"] Jun 12 22:32:25.786532 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:25.786483 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ndn6d"] Jun 12 22:32:25.814020 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:25.813989 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz44d\" (UniqueName: \"kubernetes.io/projected/33b3806b-ba1b-47f1-a1e6-69ac60cbb595-kube-api-access-jz44d\") pod \"limitador-limitador-64c94fd64f-ndn6d\" (UID: \"33b3806b-ba1b-47f1-a1e6-69ac60cbb595\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ndn6d" Jun 12 22:32:25.814202 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:25.814028 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/33b3806b-ba1b-47f1-a1e6-69ac60cbb595-config-file\") pod \"limitador-limitador-64c94fd64f-ndn6d\" (UID: \"33b3806b-ba1b-47f1-a1e6-69ac60cbb595\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ndn6d" Jun 12 22:32:25.826034 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:25.826009 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:25.915170 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:25.915139 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz44d\" (UniqueName: \"kubernetes.io/projected/33b3806b-ba1b-47f1-a1e6-69ac60cbb595-kube-api-access-jz44d\") pod \"limitador-limitador-64c94fd64f-ndn6d\" (UID: \"33b3806b-ba1b-47f1-a1e6-69ac60cbb595\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ndn6d" Jun 12 22:32:25.915351 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:25.915180 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/33b3806b-ba1b-47f1-a1e6-69ac60cbb595-config-file\") pod \"limitador-limitador-64c94fd64f-ndn6d\" (UID: \"33b3806b-ba1b-47f1-a1e6-69ac60cbb595\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ndn6d" Jun 12 22:32:25.915917 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:25.915899 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/33b3806b-ba1b-47f1-a1e6-69ac60cbb595-config-file\") pod \"limitador-limitador-64c94fd64f-ndn6d\" (UID: \"33b3806b-ba1b-47f1-a1e6-69ac60cbb595\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ndn6d" Jun 12 22:32:25.923042 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:25.923016 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz44d\" (UniqueName: \"kubernetes.io/projected/33b3806b-ba1b-47f1-a1e6-69ac60cbb595-kube-api-access-jz44d\") pod \"limitador-limitador-64c94fd64f-ndn6d\" (UID: \"33b3806b-ba1b-47f1-a1e6-69ac60cbb595\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ndn6d" Jun 12 22:32:26.016638 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:26.016607 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ndn6d" Jun 12 22:32:26.170957 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:26.170935 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ndn6d"] Jun 12 22:32:26.172870 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:32:26.172846 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33b3806b_ba1b_47f1_a1e6_69ac60cbb595.slice/crio-18198231cc2e33cf195bacfa94e914ed9926b70206ff7405cfdf879ab717c38f WatchSource:0}: Error finding container 18198231cc2e33cf195bacfa94e914ed9926b70206ff7405cfdf879ab717c38f: Status 404 returned error can't find the container with id 18198231cc2e33cf195bacfa94e914ed9926b70206ff7405cfdf879ab717c38f Jun 12 22:32:26.495176 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:26.495103 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-t7bfv"] Jun 12 22:32:26.536706 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:26.536677 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-t7bfv"] Jun 12 22:32:26.536866 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:26.536767 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-t7bfv" Jun 12 22:32:26.539301 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:26.539280 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jjltb\"" Jun 12 22:32:26.620894 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:26.620856 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmxtb\" (UniqueName: \"kubernetes.io/projected/ac6beed2-8a18-4e81-8d3f-ff111e248dd3-kube-api-access-zmxtb\") pod \"authorino-58cd955675-t7bfv\" (UID: \"ac6beed2-8a18-4e81-8d3f-ff111e248dd3\") " pod="kuadrant-system/authorino-58cd955675-t7bfv" Jun 12 22:32:26.640968 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:26.640936 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-59fq9"] Jun 12 22:32:26.685864 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:26.685834 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-59fq9"] Jun 12 22:32:26.686040 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:26.685939 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-59fq9" Jun 12 22:32:26.687159 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:26.687127 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ndn6d" event={"ID":"33b3806b-ba1b-47f1-a1e6-69ac60cbb595","Type":"ContainerStarted","Data":"18198231cc2e33cf195bacfa94e914ed9926b70206ff7405cfdf879ab717c38f"} Jun 12 22:32:26.687475 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:26.687462 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:26.688549 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:26.688528 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:32:26.721924 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:26.721894 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsgv4\" (UniqueName: \"kubernetes.io/projected/87f4eaaf-a8b7-415b-8259-075d5ca1d164-kube-api-access-wsgv4\") pod \"authorino-75d556bd77-59fq9\" (UID: \"87f4eaaf-a8b7-415b-8259-075d5ca1d164\") " pod="kuadrant-system/authorino-75d556bd77-59fq9" Jun 12 22:32:26.722402 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:26.722145 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmxtb\" (UniqueName: \"kubernetes.io/projected/ac6beed2-8a18-4e81-8d3f-ff111e248dd3-kube-api-access-zmxtb\") pod \"authorino-58cd955675-t7bfv\" (UID: \"ac6beed2-8a18-4e81-8d3f-ff111e248dd3\") " pod="kuadrant-system/authorino-58cd955675-t7bfv" Jun 12 22:32:26.733485 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:26.733457 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmxtb\" (UniqueName: \"kubernetes.io/projected/ac6beed2-8a18-4e81-8d3f-ff111e248dd3-kube-api-access-zmxtb\") pod \"authorino-58cd955675-t7bfv\" (UID: \"ac6beed2-8a18-4e81-8d3f-ff111e248dd3\") " pod="kuadrant-system/authorino-58cd955675-t7bfv" Jun 12 22:32:26.823700 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:26.823670 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsgv4\" (UniqueName: \"kubernetes.io/projected/87f4eaaf-a8b7-415b-8259-075d5ca1d164-kube-api-access-wsgv4\") pod \"authorino-75d556bd77-59fq9\" (UID: \"87f4eaaf-a8b7-415b-8259-075d5ca1d164\") " pod="kuadrant-system/authorino-75d556bd77-59fq9" Jun 12 22:32:26.832530 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:26.832503 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsgv4\" (UniqueName: \"kubernetes.io/projected/87f4eaaf-a8b7-415b-8259-075d5ca1d164-kube-api-access-wsgv4\") pod \"authorino-75d556bd77-59fq9\" (UID: \"87f4eaaf-a8b7-415b-8259-075d5ca1d164\") " pod="kuadrant-system/authorino-75d556bd77-59fq9" Jun 12 22:32:26.847309 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:26.847283 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-t7bfv" Jun 12 22:32:26.995365 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:26.995326 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-59fq9" Jun 12 22:32:27.009845 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:27.009791 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-t7bfv"] Jun 12 22:32:27.012598 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:32:27.012572 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac6beed2_8a18_4e81_8d3f_ff111e248dd3.slice/crio-f0d84087c54079e5ef99e891f320043b5c1a52cda308884bba7113ca264e0dfe WatchSource:0}: Error finding container f0d84087c54079e5ef99e891f320043b5c1a52cda308884bba7113ca264e0dfe: Status 404 returned error can't find the container with id f0d84087c54079e5ef99e891f320043b5c1a52cda308884bba7113ca264e0dfe Jun 12 22:32:27.191996 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:27.191929 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-59fq9"] Jun 12 22:32:27.195278 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:32:27.195251 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87f4eaaf_a8b7_415b_8259_075d5ca1d164.slice/crio-0ac9684d6edecd486f6e5ee8e6d7bc715d7fa18edd44a84baf88b5e5b8c2959f WatchSource:0}: Error finding container 0ac9684d6edecd486f6e5ee8e6d7bc715d7fa18edd44a84baf88b5e5b8c2959f: Status 404 returned error can't find the container with id 0ac9684d6edecd486f6e5ee8e6d7bc715d7fa18edd44a84baf88b5e5b8c2959f Jun 12 22:32:27.694982 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:27.694921 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-59fq9" event={"ID":"87f4eaaf-a8b7-415b-8259-075d5ca1d164","Type":"ContainerStarted","Data":"0ac9684d6edecd486f6e5ee8e6d7bc715d7fa18edd44a84baf88b5e5b8c2959f"} Jun 12 22:32:27.696270 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:27.696233 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-t7bfv" event={"ID":"ac6beed2-8a18-4e81-8d3f-ff111e248dd3","Type":"ContainerStarted","Data":"f0d84087c54079e5ef99e891f320043b5c1a52cda308884bba7113ca264e0dfe"} Jun 12 22:32:33.736702 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:33.736666 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-59fq9" event={"ID":"87f4eaaf-a8b7-415b-8259-075d5ca1d164","Type":"ContainerStarted","Data":"1a48f3b108ac1f3a9a5e58bde483d83579a53ed1c7ec71d485449b82dd7d83d4"} Jun 12 22:32:33.738212 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:33.738188 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ndn6d" event={"ID":"33b3806b-ba1b-47f1-a1e6-69ac60cbb595","Type":"ContainerStarted","Data":"e6ed96d231b242702b4f1b248a643445b08249b79a2fdbe0df1babddaf0f3b6a"} Jun 12 22:32:33.738324 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:33.738252 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-ndn6d" Jun 12 22:32:33.739585 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:33.739565 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-t7bfv" event={"ID":"ac6beed2-8a18-4e81-8d3f-ff111e248dd3","Type":"ContainerStarted","Data":"8a74c4db9d2f3a09a7c4b34e533ea4752b29e3933899972a07b70436d3e58a11"} Jun 12 22:32:33.752785 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:33.752745 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-59fq9" podStartSLOduration=1.85658854 podStartE2EDuration="7.752731108s" totalImagesPullingTime="5.896142568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:32:33.751323768 +0000 UTC m=+753.622353889" watchObservedRunningTime="2026-06-12 22:32:33.752731108 +0000 UTC m=+753.623761229" Jun 12 22:32:33.776814 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:33.776760 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-ndn6d" podStartSLOduration=2.039688223 podStartE2EDuration="8.776745828s" totalImagesPullingTime="6.737057605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:32:33.774818144 +0000 UTC m=+753.645848270" watchObservedRunningTime="2026-06-12 22:32:33.776745828 +0000 UTC m=+753.647775948" Jun 12 22:32:33.783555 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:33.783527 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-t7bfv"] Jun 12 22:32:33.795538 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:33.795497 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-t7bfv" podStartSLOduration=1.729744561 podStartE2EDuration="7.795484382s" totalImagesPullingTime="6.065739821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:32:33.794295964 +0000 UTC m=+753.665326086" watchObservedRunningTime="2026-06-12 22:32:33.795484382 +0000 UTC m=+753.666514503" Jun 12 22:32:35.749676 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:35.749636 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-t7bfv" podUID="ac6beed2-8a18-4e81-8d3f-ff111e248dd3" containerName="authorino" containerID="cri-o://8a74c4db9d2f3a09a7c4b34e533ea4752b29e3933899972a07b70436d3e58a11" gracePeriod=30 Jun 12 22:32:36.009680 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:36.009658 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-t7bfv" Jun 12 22:32:36.117163 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:36.117128 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmxtb\" (UniqueName: \"kubernetes.io/projected/ac6beed2-8a18-4e81-8d3f-ff111e248dd3-kube-api-access-zmxtb\") pod \"ac6beed2-8a18-4e81-8d3f-ff111e248dd3\" (UID: \"ac6beed2-8a18-4e81-8d3f-ff111e248dd3\") " Jun 12 22:32:36.119203 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:36.119178 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac6beed2-8a18-4e81-8d3f-ff111e248dd3-kube-api-access-zmxtb" (OuterVolumeSpecName: "kube-api-access-zmxtb") pod "ac6beed2-8a18-4e81-8d3f-ff111e248dd3" (UID: "ac6beed2-8a18-4e81-8d3f-ff111e248dd3"). InnerVolumeSpecName "kube-api-access-zmxtb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:32:36.218606 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:36.218572 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmxtb\" (UniqueName: \"kubernetes.io/projected/ac6beed2-8a18-4e81-8d3f-ff111e248dd3-kube-api-access-zmxtb\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:32:36.756095 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:36.756059 2558 generic.go:356] "Generic (PLEG): container finished" podID="ac6beed2-8a18-4e81-8d3f-ff111e248dd3" containerID="8a74c4db9d2f3a09a7c4b34e533ea4752b29e3933899972a07b70436d3e58a11" exitCode=0 Jun 12 22:32:36.756583 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:36.756102 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-t7bfv" Jun 12 22:32:36.756583 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:36.756121 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-t7bfv" event={"ID":"ac6beed2-8a18-4e81-8d3f-ff111e248dd3","Type":"ContainerDied","Data":"8a74c4db9d2f3a09a7c4b34e533ea4752b29e3933899972a07b70436d3e58a11"} Jun 12 22:32:36.756583 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:36.756159 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-t7bfv" event={"ID":"ac6beed2-8a18-4e81-8d3f-ff111e248dd3","Type":"ContainerDied","Data":"f0d84087c54079e5ef99e891f320043b5c1a52cda308884bba7113ca264e0dfe"} Jun 12 22:32:36.756583 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:36.756177 2558 scope.go:117] "RemoveContainer" containerID="8a74c4db9d2f3a09a7c4b34e533ea4752b29e3933899972a07b70436d3e58a11" Jun 12 22:32:36.764725 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:36.764708 2558 scope.go:117] "RemoveContainer" containerID="8a74c4db9d2f3a09a7c4b34e533ea4752b29e3933899972a07b70436d3e58a11" Jun 12 22:32:36.764990 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:32:36.764970 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a74c4db9d2f3a09a7c4b34e533ea4752b29e3933899972a07b70436d3e58a11\": container with ID starting with 8a74c4db9d2f3a09a7c4b34e533ea4752b29e3933899972a07b70436d3e58a11 not found: ID does not exist" containerID="8a74c4db9d2f3a09a7c4b34e533ea4752b29e3933899972a07b70436d3e58a11" Jun 12 22:32:36.765056 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:36.765001 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a74c4db9d2f3a09a7c4b34e533ea4752b29e3933899972a07b70436d3e58a11"} err="failed to get container status \"8a74c4db9d2f3a09a7c4b34e533ea4752b29e3933899972a07b70436d3e58a11\": rpc error: code = NotFound desc = could not find container \"8a74c4db9d2f3a09a7c4b34e533ea4752b29e3933899972a07b70436d3e58a11\": container with ID starting with 8a74c4db9d2f3a09a7c4b34e533ea4752b29e3933899972a07b70436d3e58a11 not found: ID does not exist" Jun 12 22:32:36.771913 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:36.771892 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-t7bfv"] Jun 12 22:32:36.776790 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:36.776772 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-t7bfv"] Jun 12 22:32:38.576006 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:38.575969 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac6beed2-8a18-4e81-8d3f-ff111e248dd3" path="/var/lib/kubelet/pods/ac6beed2-8a18-4e81-8d3f-ff111e248dd3/volumes" Jun 12 22:32:41.390383 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:41.390351 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ndn6d"] Jun 12 22:32:41.390858 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:41.390634 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-ndn6d" podUID="33b3806b-ba1b-47f1-a1e6-69ac60cbb595" containerName="limitador" containerID="cri-o://e6ed96d231b242702b4f1b248a643445b08249b79a2fdbe0df1babddaf0f3b6a" gracePeriod=30 Jun 12 22:32:41.393001 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:41.392979 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-ndn6d" Jun 12 22:32:41.784357 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:41.784300 2558 generic.go:356] "Generic (PLEG): container finished" podID="33b3806b-ba1b-47f1-a1e6-69ac60cbb595" containerID="e6ed96d231b242702b4f1b248a643445b08249b79a2fdbe0df1babddaf0f3b6a" exitCode=0 Jun 12 22:32:41.784543 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:41.784382 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ndn6d" event={"ID":"33b3806b-ba1b-47f1-a1e6-69ac60cbb595","Type":"ContainerDied","Data":"e6ed96d231b242702b4f1b248a643445b08249b79a2fdbe0df1babddaf0f3b6a"} Jun 12 22:32:42.349332 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:42.349307 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ndn6d" Jun 12 22:32:42.479421 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:42.479331 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jz44d\" (UniqueName: \"kubernetes.io/projected/33b3806b-ba1b-47f1-a1e6-69ac60cbb595-kube-api-access-jz44d\") pod \"33b3806b-ba1b-47f1-a1e6-69ac60cbb595\" (UID: \"33b3806b-ba1b-47f1-a1e6-69ac60cbb595\") " Jun 12 22:32:42.479421 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:42.479370 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/33b3806b-ba1b-47f1-a1e6-69ac60cbb595-config-file\") pod \"33b3806b-ba1b-47f1-a1e6-69ac60cbb595\" (UID: \"33b3806b-ba1b-47f1-a1e6-69ac60cbb595\") " Jun 12 22:32:42.479946 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:42.479839 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33b3806b-ba1b-47f1-a1e6-69ac60cbb595-config-file" (OuterVolumeSpecName: "config-file") pod "33b3806b-ba1b-47f1-a1e6-69ac60cbb595" (UID: "33b3806b-ba1b-47f1-a1e6-69ac60cbb595"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:32:42.481412 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:42.481392 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33b3806b-ba1b-47f1-a1e6-69ac60cbb595-kube-api-access-jz44d" (OuterVolumeSpecName: "kube-api-access-jz44d") pod "33b3806b-ba1b-47f1-a1e6-69ac60cbb595" (UID: "33b3806b-ba1b-47f1-a1e6-69ac60cbb595"). InnerVolumeSpecName "kube-api-access-jz44d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:32:42.579955 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:42.579923 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jz44d\" (UniqueName: \"kubernetes.io/projected/33b3806b-ba1b-47f1-a1e6-69ac60cbb595-kube-api-access-jz44d\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:32:42.579955 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:42.579950 2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/33b3806b-ba1b-47f1-a1e6-69ac60cbb595-config-file\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:32:42.790454 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:42.790393 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ndn6d" event={"ID":"33b3806b-ba1b-47f1-a1e6-69ac60cbb595","Type":"ContainerDied","Data":"18198231cc2e33cf195bacfa94e914ed9926b70206ff7405cfdf879ab717c38f"} Jun 12 22:32:42.790643 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:42.790405 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ndn6d" Jun 12 22:32:42.790643 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:42.790525 2558 scope.go:117] "RemoveContainer" containerID="e6ed96d231b242702b4f1b248a643445b08249b79a2fdbe0df1babddaf0f3b6a" Jun 12 22:32:42.807222 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:42.807198 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ndn6d"] Jun 12 22:32:42.810293 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:42.810270 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ndn6d"] Jun 12 22:32:44.575225 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:44.575193 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33b3806b-ba1b-47f1-a1e6-69ac60cbb595" path="/var/lib/kubelet/pods/33b3806b-ba1b-47f1-a1e6-69ac60cbb595/volumes" Jun 12 22:32:46.842475 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:46.842426 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-w2sh4"] Jun 12 22:32:46.843021 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:46.843001 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33b3806b-ba1b-47f1-a1e6-69ac60cbb595" containerName="limitador" Jun 12 22:32:46.843101 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:46.843024 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="33b3806b-ba1b-47f1-a1e6-69ac60cbb595" containerName="limitador" Jun 12 22:32:46.843101 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:46.843059 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac6beed2-8a18-4e81-8d3f-ff111e248dd3" containerName="authorino" Jun 12 22:32:46.843101 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:46.843068 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac6beed2-8a18-4e81-8d3f-ff111e248dd3" containerName="authorino" Jun 12 22:32:46.843249 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:46.843171 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="33b3806b-ba1b-47f1-a1e6-69ac60cbb595" containerName="limitador" Jun 12 22:32:46.843249 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:46.843187 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac6beed2-8a18-4e81-8d3f-ff111e248dd3" containerName="authorino" Jun 12 22:32:46.847782 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:46.847762 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-w2sh4" Jun 12 22:32:46.850368 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:46.850343 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 12 22:32:46.854538 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:46.854514 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-w2sh4"] Jun 12 22:32:47.021581 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:47.021552 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/43fe5cde-8277-4167-90e3-2b1232bfe667-data\") pod \"postgres-69fb4594cf-w2sh4\" (UID: \"43fe5cde-8277-4167-90e3-2b1232bfe667\") " pod="opendatahub/postgres-69fb4594cf-w2sh4" Jun 12 22:32:47.021748 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:47.021594 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpkmd\" (UniqueName: \"kubernetes.io/projected/43fe5cde-8277-4167-90e3-2b1232bfe667-kube-api-access-tpkmd\") pod \"postgres-69fb4594cf-w2sh4\" (UID: \"43fe5cde-8277-4167-90e3-2b1232bfe667\") " pod="opendatahub/postgres-69fb4594cf-w2sh4" Jun 12 22:32:47.122978 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:47.122896 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/43fe5cde-8277-4167-90e3-2b1232bfe667-data\") pod \"postgres-69fb4594cf-w2sh4\" (UID: \"43fe5cde-8277-4167-90e3-2b1232bfe667\") " pod="opendatahub/postgres-69fb4594cf-w2sh4" Jun 12 22:32:47.122978 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:47.122940 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpkmd\" (UniqueName: \"kubernetes.io/projected/43fe5cde-8277-4167-90e3-2b1232bfe667-kube-api-access-tpkmd\") pod \"postgres-69fb4594cf-w2sh4\" (UID: \"43fe5cde-8277-4167-90e3-2b1232bfe667\") " pod="opendatahub/postgres-69fb4594cf-w2sh4" Jun 12 22:32:47.123261 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:47.123241 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/43fe5cde-8277-4167-90e3-2b1232bfe667-data\") pod \"postgres-69fb4594cf-w2sh4\" (UID: \"43fe5cde-8277-4167-90e3-2b1232bfe667\") " pod="opendatahub/postgres-69fb4594cf-w2sh4" Jun 12 22:32:47.131972 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:47.131941 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpkmd\" (UniqueName: \"kubernetes.io/projected/43fe5cde-8277-4167-90e3-2b1232bfe667-kube-api-access-tpkmd\") pod \"postgres-69fb4594cf-w2sh4\" (UID: \"43fe5cde-8277-4167-90e3-2b1232bfe667\") " pod="opendatahub/postgres-69fb4594cf-w2sh4" Jun 12 22:32:47.159898 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:47.159877 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-w2sh4" Jun 12 22:32:47.314751 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:47.314727 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-w2sh4"] Jun 12 22:32:47.316815 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:32:47.316788 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43fe5cde_8277_4167_90e3_2b1232bfe667.slice/crio-9bb59fe937633570299ba4bd0305cd7cce96ab40b583d58b09594193b14cd732 WatchSource:0}: Error finding container 9bb59fe937633570299ba4bd0305cd7cce96ab40b583d58b09594193b14cd732: Status 404 returned error can't find the container with id 9bb59fe937633570299ba4bd0305cd7cce96ab40b583d58b09594193b14cd732 Jun 12 22:32:47.816980 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:47.816943 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-w2sh4" event={"ID":"43fe5cde-8277-4167-90e3-2b1232bfe667","Type":"ContainerStarted","Data":"9bb59fe937633570299ba4bd0305cd7cce96ab40b583d58b09594193b14cd732"} Jun 12 22:32:50.835828 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:50.835787 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-w2sh4" event={"ID":"43fe5cde-8277-4167-90e3-2b1232bfe667","Type":"ContainerStarted","Data":"f3cbbd2d1625cc6fe8500d3ef15adca3bf39e814e4a37966e700ffe6b3647683"} Jun 12 22:32:50.836237 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:50.835926 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-w2sh4" Jun 12 22:32:50.852355 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:50.852308 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-w2sh4" podStartSLOduration=2.076974001 podStartE2EDuration="4.852291783s" totalImagesPullingTime="2.775317782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:32:50.850877702 +0000 UTC m=+770.721907824" watchObservedRunningTime="2026-06-12 22:32:50.852291783 +0000 UTC m=+770.723321905" Jun 12 22:32:56.873971 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:32:56.873936 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-w2sh4" Jun 12 22:33:06.095831 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:06.095786 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-dzp44"] Jun 12 22:33:06.111416 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:06.111390 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-dzp44"] Jun 12 22:33:06.111591 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:06.111521 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-dzp44" Jun 12 22:33:06.115284 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:06.115259 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 12 22:33:06.116390 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:06.116366 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-fvtft\"" Jun 12 22:33:06.116619 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:06.116606 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 12 22:33:06.202392 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:06.202363 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2flrf\" (UniqueName: \"kubernetes.io/projected/2340de5d-e746-4dca-a74e-c0097f307c77-kube-api-access-2flrf\") pod \"keycloak-operator-d67dbbb48-dzp44\" (UID: \"2340de5d-e746-4dca-a74e-c0097f307c77\") " pod="keycloak-system/keycloak-operator-d67dbbb48-dzp44" Jun 12 22:33:06.303362 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:06.303329 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2flrf\" (UniqueName: \"kubernetes.io/projected/2340de5d-e746-4dca-a74e-c0097f307c77-kube-api-access-2flrf\") pod \"keycloak-operator-d67dbbb48-dzp44\" (UID: \"2340de5d-e746-4dca-a74e-c0097f307c77\") " pod="keycloak-system/keycloak-operator-d67dbbb48-dzp44" Jun 12 22:33:06.315372 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:06.315342 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2flrf\" (UniqueName: \"kubernetes.io/projected/2340de5d-e746-4dca-a74e-c0097f307c77-kube-api-access-2flrf\") pod \"keycloak-operator-d67dbbb48-dzp44\" (UID: \"2340de5d-e746-4dca-a74e-c0097f307c77\") " pod="keycloak-system/keycloak-operator-d67dbbb48-dzp44" Jun 12 22:33:06.424092 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:06.424020 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-dzp44" Jun 12 22:33:06.553090 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:06.553063 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-dzp44"] Jun 12 22:33:06.555222 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:33:06.555197 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2340de5d_e746_4dca_a74e_c0097f307c77.slice/crio-28a2098b1fa312b4610139aff857f6395c1ac202d9bf032187f9c1da32a2885c WatchSource:0}: Error finding container 28a2098b1fa312b4610139aff857f6395c1ac202d9bf032187f9c1da32a2885c: Status 404 returned error can't find the container with id 28a2098b1fa312b4610139aff857f6395c1ac202d9bf032187f9c1da32a2885c Jun 12 22:33:06.917226 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:06.917188 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-dzp44" event={"ID":"2340de5d-e746-4dca-a74e-c0097f307c77","Type":"ContainerStarted","Data":"28a2098b1fa312b4610139aff857f6395c1ac202d9bf032187f9c1da32a2885c"} Jun 12 22:33:11.949167 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:11.949070 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-dzp44" event={"ID":"2340de5d-e746-4dca-a74e-c0097f307c77","Type":"ContainerStarted","Data":"26b9a6e5af5d145a449d8e333bebb8b2814bb7b2d9d43c71965e7ff9b9ff8339"} Jun 12 22:33:11.967143 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:11.967083 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-dzp44" podStartSLOduration=0.944170779 podStartE2EDuration="5.967060911s" totalImagesPullingTime="5.022890132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:33:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:33:11.966256279 +0000 UTC m=+791.837286403" watchObservedRunningTime="2026-06-12 22:33:11.967060911 +0000 UTC m=+791.838091034" Jun 12 22:33:50.186391 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:50.186355 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x9m2k"] Jun 12 22:33:50.201093 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:50.201067 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x9m2k"] Jun 12 22:33:50.201253 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:50.201145 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x9m2k" Jun 12 22:33:50.304798 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:50.304764 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njpgs\" (UniqueName: \"kubernetes.io/projected/1d447d12-7cf2-494b-a850-8b345cb0398b-kube-api-access-njpgs\") pod \"authorino-5d4b67c446-x9m2k\" (UID: \"1d447d12-7cf2-494b-a850-8b345cb0398b\") " pod="kuadrant-system/authorino-5d4b67c446-x9m2k" Jun 12 22:33:50.405679 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:50.405643 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njpgs\" (UniqueName: \"kubernetes.io/projected/1d447d12-7cf2-494b-a850-8b345cb0398b-kube-api-access-njpgs\") pod \"authorino-5d4b67c446-x9m2k\" (UID: \"1d447d12-7cf2-494b-a850-8b345cb0398b\") " pod="kuadrant-system/authorino-5d4b67c446-x9m2k" Jun 12 22:33:50.413421 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:50.413389 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x9m2k"] Jun 12 22:33:50.413705 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:33:50.413685 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-njpgs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-x9m2k" podUID="1d447d12-7cf2-494b-a850-8b345cb0398b" Jun 12 22:33:50.417831 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:50.417807 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njpgs\" (UniqueName: \"kubernetes.io/projected/1d447d12-7cf2-494b-a850-8b345cb0398b-kube-api-access-njpgs\") pod \"authorino-5d4b67c446-x9m2k\" (UID: \"1d447d12-7cf2-494b-a850-8b345cb0398b\") " pod="kuadrant-system/authorino-5d4b67c446-x9m2k" Jun 12 22:33:50.440057 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:50.439994 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d98675957-stpz6"] Jun 12 22:33:50.442407 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:50.442386 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d98675957-stpz6" Jun 12 22:33:50.449694 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:50.449667 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d98675957-stpz6"] Jun 12 22:33:50.506489 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:50.506454 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwssr\" (UniqueName: \"kubernetes.io/projected/4d395ecf-7393-4a9d-916a-b63dd147cb93-kube-api-access-pwssr\") pod \"authorino-5d98675957-stpz6\" (UID: \"4d395ecf-7393-4a9d-916a-b63dd147cb93\") " pod="kuadrant-system/authorino-5d98675957-stpz6" Jun 12 22:33:50.607826 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:50.607794 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwssr\" (UniqueName: \"kubernetes.io/projected/4d395ecf-7393-4a9d-916a-b63dd147cb93-kube-api-access-pwssr\") pod \"authorino-5d98675957-stpz6\" (UID: \"4d395ecf-7393-4a9d-916a-b63dd147cb93\") " pod="kuadrant-system/authorino-5d98675957-stpz6" Jun 12 22:33:50.618050 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:50.618019 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d98675957-stpz6"] Jun 12 22:33:50.618368 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:33:50.618340 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-pwssr], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d98675957-stpz6" podUID="4d395ecf-7393-4a9d-916a-b63dd147cb93" Jun 12 22:33:50.620297 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:50.620274 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwssr\" (UniqueName: \"kubernetes.io/projected/4d395ecf-7393-4a9d-916a-b63dd147cb93-kube-api-access-pwssr\") pod \"authorino-5d98675957-stpz6\" (UID: \"4d395ecf-7393-4a9d-916a-b63dd147cb93\") " pod="kuadrant-system/authorino-5d98675957-stpz6" Jun 12 22:33:50.640458 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:50.640404 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5b54cb4f9c-lclfw"] Jun 12 22:33:50.643154 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:50.643135 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b54cb4f9c-lclfw" Jun 12 22:33:50.645609 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:50.645588 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 12 22:33:50.652776 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:50.652746 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b54cb4f9c-lclfw"] Jun 12 22:33:50.708730 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:50.708637 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmb5g\" (UniqueName: \"kubernetes.io/projected/9fb57aac-95d0-4f1c-b4f6-b497e7210873-kube-api-access-xmb5g\") pod \"authorino-5b54cb4f9c-lclfw\" (UID: \"9fb57aac-95d0-4f1c-b4f6-b497e7210873\") " pod="kuadrant-system/authorino-5b54cb4f9c-lclfw" Jun 12 22:33:50.708730 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:50.708684 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9fb57aac-95d0-4f1c-b4f6-b497e7210873-tls-cert\") pod \"authorino-5b54cb4f9c-lclfw\" (UID: \"9fb57aac-95d0-4f1c-b4f6-b497e7210873\") " pod="kuadrant-system/authorino-5b54cb4f9c-lclfw" Jun 12 22:33:50.810168 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:50.810129 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9fb57aac-95d0-4f1c-b4f6-b497e7210873-tls-cert\") pod \"authorino-5b54cb4f9c-lclfw\" (UID: \"9fb57aac-95d0-4f1c-b4f6-b497e7210873\") " pod="kuadrant-system/authorino-5b54cb4f9c-lclfw" Jun 12 22:33:50.810376 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:50.810277 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmb5g\" (UniqueName: \"kubernetes.io/projected/9fb57aac-95d0-4f1c-b4f6-b497e7210873-kube-api-access-xmb5g\") pod \"authorino-5b54cb4f9c-lclfw\" (UID: \"9fb57aac-95d0-4f1c-b4f6-b497e7210873\") " pod="kuadrant-system/authorino-5b54cb4f9c-lclfw" Jun 12 22:33:50.812746 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:50.812719 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9fb57aac-95d0-4f1c-b4f6-b497e7210873-tls-cert\") pod \"authorino-5b54cb4f9c-lclfw\" (UID: \"9fb57aac-95d0-4f1c-b4f6-b497e7210873\") " pod="kuadrant-system/authorino-5b54cb4f9c-lclfw" Jun 12 22:33:50.818183 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:50.818159 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmb5g\" (UniqueName: \"kubernetes.io/projected/9fb57aac-95d0-4f1c-b4f6-b497e7210873-kube-api-access-xmb5g\") pod \"authorino-5b54cb4f9c-lclfw\" (UID: \"9fb57aac-95d0-4f1c-b4f6-b497e7210873\") " pod="kuadrant-system/authorino-5b54cb4f9c-lclfw" Jun 12 22:33:50.953690 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:50.953650 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b54cb4f9c-lclfw" Jun 12 22:33:51.090370 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:51.090343 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b54cb4f9c-lclfw"] Jun 12 22:33:51.092622 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:33:51.092586 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fb57aac_95d0_4f1c_b4f6_b497e7210873.slice/crio-888b324ebb2eeab3d2ff57bc3e843cfb0c680c4d11a4e0e562b3e808435d4f1b WatchSource:0}: Error finding container 888b324ebb2eeab3d2ff57bc3e843cfb0c680c4d11a4e0e562b3e808435d4f1b: Status 404 returned error can't find the container with id 888b324ebb2eeab3d2ff57bc3e843cfb0c680c4d11a4e0e562b3e808435d4f1b Jun 12 22:33:51.143328 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:51.143301 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d98675957-stpz6" Jun 12 22:33:51.143328 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:51.143316 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x9m2k" Jun 12 22:33:51.143578 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:51.143301 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b54cb4f9c-lclfw" event={"ID":"9fb57aac-95d0-4f1c-b4f6-b497e7210873","Type":"ContainerStarted","Data":"888b324ebb2eeab3d2ff57bc3e843cfb0c680c4d11a4e0e562b3e808435d4f1b"} Jun 12 22:33:51.150231 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:51.150209 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x9m2k" Jun 12 22:33:51.152879 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:51.152860 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d98675957-stpz6" Jun 12 22:33:51.214272 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:51.214245 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njpgs\" (UniqueName: \"kubernetes.io/projected/1d447d12-7cf2-494b-a850-8b345cb0398b-kube-api-access-njpgs\") pod \"1d447d12-7cf2-494b-a850-8b345cb0398b\" (UID: \"1d447d12-7cf2-494b-a850-8b345cb0398b\") " Jun 12 22:33:51.214668 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:51.214323 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwssr\" (UniqueName: \"kubernetes.io/projected/4d395ecf-7393-4a9d-916a-b63dd147cb93-kube-api-access-pwssr\") pod \"4d395ecf-7393-4a9d-916a-b63dd147cb93\" (UID: \"4d395ecf-7393-4a9d-916a-b63dd147cb93\") " Jun 12 22:33:51.216355 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:51.216330 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d395ecf-7393-4a9d-916a-b63dd147cb93-kube-api-access-pwssr" (OuterVolumeSpecName: "kube-api-access-pwssr") pod "4d395ecf-7393-4a9d-916a-b63dd147cb93" (UID: "4d395ecf-7393-4a9d-916a-b63dd147cb93"). InnerVolumeSpecName "kube-api-access-pwssr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:33:51.216508 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:51.216373 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d447d12-7cf2-494b-a850-8b345cb0398b-kube-api-access-njpgs" (OuterVolumeSpecName: "kube-api-access-njpgs") pod "1d447d12-7cf2-494b-a850-8b345cb0398b" (UID: "1d447d12-7cf2-494b-a850-8b345cb0398b"). InnerVolumeSpecName "kube-api-access-njpgs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:33:51.315648 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:51.315614 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwssr\" (UniqueName: \"kubernetes.io/projected/4d395ecf-7393-4a9d-916a-b63dd147cb93-kube-api-access-pwssr\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:33:51.315648 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:51.315643 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njpgs\" (UniqueName: \"kubernetes.io/projected/1d447d12-7cf2-494b-a850-8b345cb0398b-kube-api-access-njpgs\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:33:52.149286 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:52.149246 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b54cb4f9c-lclfw" event={"ID":"9fb57aac-95d0-4f1c-b4f6-b497e7210873","Type":"ContainerStarted","Data":"1fa5c6613e2c7f71a5d3666d0b673a7fd72f0ce44f88a7f4228978e379db16fb"} Jun 12 22:33:52.149286 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:52.149270 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x9m2k" Jun 12 22:33:52.149286 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:52.149252 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d98675957-stpz6" Jun 12 22:33:52.167640 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:52.167597 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5b54cb4f9c-lclfw" podStartSLOduration=1.876981738 podStartE2EDuration="2.167583478s" totalImagesPullingTime="290.60174ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:33:52.165367705 +0000 UTC m=+832.036397825" watchObservedRunningTime="2026-06-12 22:33:52.167583478 +0000 UTC m=+832.038613624" Jun 12 22:33:52.189606 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:52.189579 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d98675957-stpz6"] Jun 12 22:33:52.192925 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:52.192901 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-59fq9"] Jun 12 22:33:52.193084 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:52.193059 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-59fq9" podUID="87f4eaaf-a8b7-415b-8259-075d5ca1d164" containerName="authorino" containerID="cri-o://1a48f3b108ac1f3a9a5e58bde483d83579a53ed1c7ec71d485449b82dd7d83d4" gracePeriod=30 Jun 12 22:33:52.196318 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:52.196262 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d98675957-stpz6"] Jun 12 22:33:52.221201 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:52.221176 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x9m2k"] Jun 12 22:33:52.225109 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:52.225087 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x9m2k"] Jun 12 22:33:52.451706 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:52.451683 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-59fq9" Jun 12 22:33:52.526548 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:52.526511 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsgv4\" (UniqueName: \"kubernetes.io/projected/87f4eaaf-a8b7-415b-8259-075d5ca1d164-kube-api-access-wsgv4\") pod \"87f4eaaf-a8b7-415b-8259-075d5ca1d164\" (UID: \"87f4eaaf-a8b7-415b-8259-075d5ca1d164\") " Jun 12 22:33:52.528506 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:52.528476 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87f4eaaf-a8b7-415b-8259-075d5ca1d164-kube-api-access-wsgv4" (OuterVolumeSpecName: "kube-api-access-wsgv4") pod "87f4eaaf-a8b7-415b-8259-075d5ca1d164" (UID: "87f4eaaf-a8b7-415b-8259-075d5ca1d164"). InnerVolumeSpecName "kube-api-access-wsgv4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:33:52.574808 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:52.574779 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d447d12-7cf2-494b-a850-8b345cb0398b" path="/var/lib/kubelet/pods/1d447d12-7cf2-494b-a850-8b345cb0398b/volumes" Jun 12 22:33:52.575040 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:52.575023 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d395ecf-7393-4a9d-916a-b63dd147cb93" path="/var/lib/kubelet/pods/4d395ecf-7393-4a9d-916a-b63dd147cb93/volumes" Jun 12 22:33:52.628172 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:52.628149 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsgv4\" (UniqueName: \"kubernetes.io/projected/87f4eaaf-a8b7-415b-8259-075d5ca1d164-kube-api-access-wsgv4\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:33:53.156450 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:53.156389 2558 generic.go:356] "Generic (PLEG): container finished" podID="87f4eaaf-a8b7-415b-8259-075d5ca1d164" containerID="1a48f3b108ac1f3a9a5e58bde483d83579a53ed1c7ec71d485449b82dd7d83d4" exitCode=0 Jun 12 22:33:53.156675 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:53.156460 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-59fq9" event={"ID":"87f4eaaf-a8b7-415b-8259-075d5ca1d164","Type":"ContainerDied","Data":"1a48f3b108ac1f3a9a5e58bde483d83579a53ed1c7ec71d485449b82dd7d83d4"} Jun 12 22:33:53.156675 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:53.156505 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-59fq9" event={"ID":"87f4eaaf-a8b7-415b-8259-075d5ca1d164","Type":"ContainerDied","Data":"0ac9684d6edecd486f6e5ee8e6d7bc715d7fa18edd44a84baf88b5e5b8c2959f"} Jun 12 22:33:53.156675 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:53.156548 2558 scope.go:117] "RemoveContainer" containerID="1a48f3b108ac1f3a9a5e58bde483d83579a53ed1c7ec71d485449b82dd7d83d4" Jun 12 22:33:53.156675 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:53.156472 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-59fq9" Jun 12 22:33:53.166084 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:53.166062 2558 scope.go:117] "RemoveContainer" containerID="1a48f3b108ac1f3a9a5e58bde483d83579a53ed1c7ec71d485449b82dd7d83d4" Jun 12 22:33:53.166362 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:33:53.166343 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a48f3b108ac1f3a9a5e58bde483d83579a53ed1c7ec71d485449b82dd7d83d4\": container with ID starting with 1a48f3b108ac1f3a9a5e58bde483d83579a53ed1c7ec71d485449b82dd7d83d4 not found: ID does not exist" containerID="1a48f3b108ac1f3a9a5e58bde483d83579a53ed1c7ec71d485449b82dd7d83d4" Jun 12 22:33:53.166417 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:53.166372 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a48f3b108ac1f3a9a5e58bde483d83579a53ed1c7ec71d485449b82dd7d83d4"} err="failed to get container status \"1a48f3b108ac1f3a9a5e58bde483d83579a53ed1c7ec71d485449b82dd7d83d4\": rpc error: code = NotFound desc = could not find container \"1a48f3b108ac1f3a9a5e58bde483d83579a53ed1c7ec71d485449b82dd7d83d4\": container with ID starting with 1a48f3b108ac1f3a9a5e58bde483d83579a53ed1c7ec71d485449b82dd7d83d4 not found: ID does not exist" Jun 12 22:33:53.176124 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:53.176100 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-59fq9"] Jun 12 22:33:53.181088 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:53.181065 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-59fq9"] Jun 12 22:33:54.575112 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:33:54.575078 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87f4eaaf-a8b7-415b-8259-075d5ca1d164" path="/var/lib/kubelet/pods/87f4eaaf-a8b7-415b-8259-075d5ca1d164/volumes" Jun 12 22:34:29.471840 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:29.471808 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5bf7cf9b69-msxlg"] Jun 12 22:34:29.472229 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:29.472194 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f4eaaf-a8b7-415b-8259-075d5ca1d164" containerName="authorino" Jun 12 22:34:29.472229 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:29.472206 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f4eaaf-a8b7-415b-8259-075d5ca1d164" containerName="authorino" Jun 12 22:34:29.472301 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:29.472281 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="87f4eaaf-a8b7-415b-8259-075d5ca1d164" containerName="authorino" Jun 12 22:34:29.475587 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:29.475560 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5bf7cf9b69-msxlg" Jun 12 22:34:29.479682 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:29.479661 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 12 22:34:29.480144 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:29.480127 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-59khb\"" Jun 12 22:34:29.490692 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:29.490666 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5bf7cf9b69-msxlg"] Jun 12 22:34:29.572207 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:29.572171 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67v42\" (UniqueName: \"kubernetes.io/projected/950742e0-fa6b-48f4-be72-8d54ab7a797b-kube-api-access-67v42\") pod \"maas-api-5bf7cf9b69-msxlg\" (UID: \"950742e0-fa6b-48f4-be72-8d54ab7a797b\") " pod="opendatahub/maas-api-5bf7cf9b69-msxlg" Jun 12 22:34:29.572393 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:29.572289 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/950742e0-fa6b-48f4-be72-8d54ab7a797b-maas-api-tls\") pod \"maas-api-5bf7cf9b69-msxlg\" (UID: \"950742e0-fa6b-48f4-be72-8d54ab7a797b\") " pod="opendatahub/maas-api-5bf7cf9b69-msxlg" Jun 12 22:34:29.572393 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:29.572327 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/950742e0-fa6b-48f4-be72-8d54ab7a797b-openshift-service-ca\") pod \"maas-api-5bf7cf9b69-msxlg\" (UID: \"950742e0-fa6b-48f4-be72-8d54ab7a797b\") " pod="opendatahub/maas-api-5bf7cf9b69-msxlg" Jun 12 22:34:29.673925 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:29.673887 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67v42\" (UniqueName: \"kubernetes.io/projected/950742e0-fa6b-48f4-be72-8d54ab7a797b-kube-api-access-67v42\") pod \"maas-api-5bf7cf9b69-msxlg\" (UID: \"950742e0-fa6b-48f4-be72-8d54ab7a797b\") " pod="opendatahub/maas-api-5bf7cf9b69-msxlg" Jun 12 22:34:29.674101 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:29.673966 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/950742e0-fa6b-48f4-be72-8d54ab7a797b-maas-api-tls\") pod \"maas-api-5bf7cf9b69-msxlg\" (UID: \"950742e0-fa6b-48f4-be72-8d54ab7a797b\") " pod="opendatahub/maas-api-5bf7cf9b69-msxlg" Jun 12 22:34:29.674101 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:29.673988 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/950742e0-fa6b-48f4-be72-8d54ab7a797b-openshift-service-ca\") pod \"maas-api-5bf7cf9b69-msxlg\" (UID: \"950742e0-fa6b-48f4-be72-8d54ab7a797b\") " pod="opendatahub/maas-api-5bf7cf9b69-msxlg" Jun 12 22:34:29.674180 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:34:29.674119 2558 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 12 22:34:29.674215 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:34:29.674208 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/950742e0-fa6b-48f4-be72-8d54ab7a797b-maas-api-tls podName:950742e0-fa6b-48f4-be72-8d54ab7a797b nodeName:}" failed. No retries permitted until 2026-06-12 22:34:30.174185507 +0000 UTC m=+870.045215611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/950742e0-fa6b-48f4-be72-8d54ab7a797b-maas-api-tls") pod "maas-api-5bf7cf9b69-msxlg" (UID: "950742e0-fa6b-48f4-be72-8d54ab7a797b") : secret "maas-api-serving-cert" not found Jun 12 22:34:29.674743 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:29.674724 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/950742e0-fa6b-48f4-be72-8d54ab7a797b-openshift-service-ca\") pod \"maas-api-5bf7cf9b69-msxlg\" (UID: \"950742e0-fa6b-48f4-be72-8d54ab7a797b\") " pod="opendatahub/maas-api-5bf7cf9b69-msxlg" Jun 12 22:34:29.682939 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:29.682913 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67v42\" (UniqueName: \"kubernetes.io/projected/950742e0-fa6b-48f4-be72-8d54ab7a797b-kube-api-access-67v42\") pod \"maas-api-5bf7cf9b69-msxlg\" (UID: \"950742e0-fa6b-48f4-be72-8d54ab7a797b\") " pod="opendatahub/maas-api-5bf7cf9b69-msxlg" Jun 12 22:34:30.180154 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:30.180112 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/950742e0-fa6b-48f4-be72-8d54ab7a797b-maas-api-tls\") pod \"maas-api-5bf7cf9b69-msxlg\" (UID: \"950742e0-fa6b-48f4-be72-8d54ab7a797b\") " pod="opendatahub/maas-api-5bf7cf9b69-msxlg" Jun 12 22:34:30.182655 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:30.182630 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/950742e0-fa6b-48f4-be72-8d54ab7a797b-maas-api-tls\") pod \"maas-api-5bf7cf9b69-msxlg\" (UID: \"950742e0-fa6b-48f4-be72-8d54ab7a797b\") " pod="opendatahub/maas-api-5bf7cf9b69-msxlg" Jun 12 22:34:30.386254 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:30.386219 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5bf7cf9b69-msxlg" Jun 12 22:34:30.535586 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:30.535533 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5bf7cf9b69-msxlg"] Jun 12 22:34:30.543177 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:34:30.543149 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod950742e0_fa6b_48f4_be72_8d54ab7a797b.slice/crio-82066ffa98d7e41517fa12bc70e9afca14ea0664695a7d5de16f14a17bb08f0c WatchSource:0}: Error finding container 82066ffa98d7e41517fa12bc70e9afca14ea0664695a7d5de16f14a17bb08f0c: Status 404 returned error can't find the container with id 82066ffa98d7e41517fa12bc70e9afca14ea0664695a7d5de16f14a17bb08f0c Jun 12 22:34:31.361188 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:31.361086 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5bf7cf9b69-msxlg" event={"ID":"950742e0-fa6b-48f4-be72-8d54ab7a797b","Type":"ContainerStarted","Data":"82066ffa98d7e41517fa12bc70e9afca14ea0664695a7d5de16f14a17bb08f0c"} Jun 12 22:34:32.372133 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:32.372094 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5bf7cf9b69-msxlg" event={"ID":"950742e0-fa6b-48f4-be72-8d54ab7a797b","Type":"ContainerStarted","Data":"514d790d828a56f69e882d82b707bc4ae279f313ec9093869713e8e4a42e1fb2"} Jun 12 22:34:32.372576 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:32.372509 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5bf7cf9b69-msxlg" Jun 12 22:34:32.393469 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:32.393402 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5bf7cf9b69-msxlg" podStartSLOduration=1.671030809 podStartE2EDuration="3.39338607s" totalImagesPullingTime="1.722355261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:34:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:34:32.391182941 +0000 UTC m=+872.262213061" watchObservedRunningTime="2026-06-12 22:34:32.39338607 +0000 UTC m=+872.264416213" Jun 12 22:34:38.383125 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:38.383094 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5bf7cf9b69-msxlg" Jun 12 22:34:38.403486 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:38.403454 2558 generic.go:356] "Generic (PLEG): container finished" podID="e9066672-7a47-4441-82d1-08cb56029fad" containerID="a0edf5941aed04f1789977f7b269e63351fce3448e358dd5235f015227f0ddea" exitCode=0 Jun 12 22:34:38.403643 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:38.403502 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" event={"ID":"e9066672-7a47-4441-82d1-08cb56029fad","Type":"ContainerDied","Data":"a0edf5941aed04f1789977f7b269e63351fce3448e358dd5235f015227f0ddea"} Jun 12 22:34:38.403900 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:38.403886 2558 scope.go:117] "RemoveContainer" containerID="a0edf5941aed04f1789977f7b269e63351fce3448e358dd5235f015227f0ddea" Jun 12 22:34:38.404966 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:38.404933 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jun 12 22:34:38.405079 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:38.405007 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jun 12 22:34:38.405079 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:38.405045 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jun 12 22:34:39.410732 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:39.410692 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" event={"ID":"e9066672-7a47-4441-82d1-08cb56029fad","Type":"ContainerStarted","Data":"9e0e01daa7bb40bdb981ca203f6bca76d8bc1d412744fdbfd80a5646e2b51382"} Jun 12 22:34:39.821516 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:39.821479 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:34:39.822742 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:39.822712 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-fb2mx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jun 12 22:34:39.823116 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:39.822758 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" podUID="e9066672-7a47-4441-82d1-08cb56029fad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jun 12 22:34:40.821143 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:40.821090 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-fb2mx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jun 12 22:34:40.821569 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:40.821207 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" podUID="e9066672-7a47-4441-82d1-08cb56029fad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jun 12 22:34:41.687910 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:41.687855 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:34:41.821826 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:41.821791 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-fb2mx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jun 12 22:34:41.822208 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:41.821861 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" podUID="e9066672-7a47-4441-82d1-08cb56029fad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jun 12 22:34:42.821479 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:42.821422 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-fb2mx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jun 12 22:34:42.821658 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:42.821500 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" podUID="e9066672-7a47-4441-82d1-08cb56029fad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jun 12 22:34:43.825041 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:43.825003 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:34:43.825926 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:34:43.825906 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fb2mx" Jun 12 22:37:19.960008 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:19.959969 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d54fd5fd9-svdss"] Jun 12 22:37:19.963636 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:19.963613 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d54fd5fd9-svdss" Jun 12 22:37:19.967300 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:19.967279 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 12 22:37:19.972695 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:19.972666 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d54fd5fd9-svdss"] Jun 12 22:37:20.149893 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:20.149857 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pskzt\" (UniqueName: \"kubernetes.io/projected/2b46cfe6-c54a-461c-8289-fbb03869bd91-kube-api-access-pskzt\") pod \"authorino-6d54fd5fd9-svdss\" (UID: \"2b46cfe6-c54a-461c-8289-fbb03869bd91\") " pod="kuadrant-system/authorino-6d54fd5fd9-svdss" Jun 12 22:37:20.149893 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:20.149896 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2b46cfe6-c54a-461c-8289-fbb03869bd91-tls-cert\") pod \"authorino-6d54fd5fd9-svdss\" (UID: \"2b46cfe6-c54a-461c-8289-fbb03869bd91\") " pod="kuadrant-system/authorino-6d54fd5fd9-svdss" Jun 12 22:37:20.150109 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:20.149916 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2b46cfe6-c54a-461c-8289-fbb03869bd91-oidc-ca\") pod \"authorino-6d54fd5fd9-svdss\" (UID: \"2b46cfe6-c54a-461c-8289-fbb03869bd91\") " pod="kuadrant-system/authorino-6d54fd5fd9-svdss" Jun 12 22:37:20.251084 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:20.251050 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pskzt\" (UniqueName: \"kubernetes.io/projected/2b46cfe6-c54a-461c-8289-fbb03869bd91-kube-api-access-pskzt\") pod \"authorino-6d54fd5fd9-svdss\" (UID: \"2b46cfe6-c54a-461c-8289-fbb03869bd91\") " pod="kuadrant-system/authorino-6d54fd5fd9-svdss" Jun 12 22:37:20.251250 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:20.251098 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2b46cfe6-c54a-461c-8289-fbb03869bd91-tls-cert\") pod \"authorino-6d54fd5fd9-svdss\" (UID: \"2b46cfe6-c54a-461c-8289-fbb03869bd91\") " pod="kuadrant-system/authorino-6d54fd5fd9-svdss" Jun 12 22:37:20.251250 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:20.251129 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2b46cfe6-c54a-461c-8289-fbb03869bd91-oidc-ca\") pod \"authorino-6d54fd5fd9-svdss\" (UID: \"2b46cfe6-c54a-461c-8289-fbb03869bd91\") " pod="kuadrant-system/authorino-6d54fd5fd9-svdss" Jun 12 22:37:20.251895 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:20.251869 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2b46cfe6-c54a-461c-8289-fbb03869bd91-oidc-ca\") pod \"authorino-6d54fd5fd9-svdss\" (UID: \"2b46cfe6-c54a-461c-8289-fbb03869bd91\") " pod="kuadrant-system/authorino-6d54fd5fd9-svdss" Jun 12 22:37:20.253611 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:20.253590 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2b46cfe6-c54a-461c-8289-fbb03869bd91-tls-cert\") pod \"authorino-6d54fd5fd9-svdss\" (UID: \"2b46cfe6-c54a-461c-8289-fbb03869bd91\") " pod="kuadrant-system/authorino-6d54fd5fd9-svdss" Jun 12 22:37:20.259991 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:20.259965 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pskzt\" (UniqueName: \"kubernetes.io/projected/2b46cfe6-c54a-461c-8289-fbb03869bd91-kube-api-access-pskzt\") pod \"authorino-6d54fd5fd9-svdss\" (UID: \"2b46cfe6-c54a-461c-8289-fbb03869bd91\") " pod="kuadrant-system/authorino-6d54fd5fd9-svdss" Jun 12 22:37:20.274347 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:20.274318 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d54fd5fd9-svdss" Jun 12 22:37:20.413406 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:20.413382 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d54fd5fd9-svdss"] Jun 12 22:37:20.415530 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:37:20.415482 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b46cfe6_c54a_461c_8289_fbb03869bd91.slice/crio-94daca82e491ee31c249a1e204c6028a4615759f6183965139e017cca2351775 WatchSource:0}: Error finding container 94daca82e491ee31c249a1e204c6028a4615759f6183965139e017cca2351775: Status 404 returned error can't find the container with id 94daca82e491ee31c249a1e204c6028a4615759f6183965139e017cca2351775 Jun 12 22:37:20.417163 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:20.417142 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 22:37:21.219729 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:21.219634 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d54fd5fd9-svdss" event={"ID":"2b46cfe6-c54a-461c-8289-fbb03869bd91","Type":"ContainerStarted","Data":"22ad4e8aa416a33eeeeabc09e634ce09f8a8c52ff3b4334d47339f4bdded5334"} Jun 12 22:37:21.219729 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:21.219681 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d54fd5fd9-svdss" event={"ID":"2b46cfe6-c54a-461c-8289-fbb03869bd91","Type":"ContainerStarted","Data":"94daca82e491ee31c249a1e204c6028a4615759f6183965139e017cca2351775"} Jun 12 22:37:21.237939 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:21.237893 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6d54fd5fd9-svdss" podStartSLOduration=1.868932944 podStartE2EDuration="2.237879099s" totalImagesPullingTime="368.946155ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:37:21.23490653 +0000 UTC m=+1041.105936642" watchObservedRunningTime="2026-06-12 22:37:21.237879099 +0000 UTC m=+1041.108909219" Jun 12 22:37:21.260517 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:21.260482 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b54cb4f9c-lclfw"] Jun 12 22:37:21.260715 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:21.260689 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5b54cb4f9c-lclfw" podUID="9fb57aac-95d0-4f1c-b4f6-b497e7210873" containerName="authorino" containerID="cri-o://1fa5c6613e2c7f71a5d3666d0b673a7fd72f0ce44f88a7f4228978e379db16fb" gracePeriod=30 Jun 12 22:37:21.521626 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:21.521600 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b54cb4f9c-lclfw" Jun 12 22:37:21.562819 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:21.562781 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9fb57aac-95d0-4f1c-b4f6-b497e7210873-tls-cert\") pod \"9fb57aac-95d0-4f1c-b4f6-b497e7210873\" (UID: \"9fb57aac-95d0-4f1c-b4f6-b497e7210873\") " Jun 12 22:37:21.563008 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:21.562826 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmb5g\" (UniqueName: \"kubernetes.io/projected/9fb57aac-95d0-4f1c-b4f6-b497e7210873-kube-api-access-xmb5g\") pod \"9fb57aac-95d0-4f1c-b4f6-b497e7210873\" (UID: \"9fb57aac-95d0-4f1c-b4f6-b497e7210873\") " Jun 12 22:37:21.564988 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:21.564953 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fb57aac-95d0-4f1c-b4f6-b497e7210873-kube-api-access-xmb5g" (OuterVolumeSpecName: "kube-api-access-xmb5g") pod "9fb57aac-95d0-4f1c-b4f6-b497e7210873" (UID: "9fb57aac-95d0-4f1c-b4f6-b497e7210873"). InnerVolumeSpecName "kube-api-access-xmb5g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:37:21.574233 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:21.574202 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fb57aac-95d0-4f1c-b4f6-b497e7210873-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9fb57aac-95d0-4f1c-b4f6-b497e7210873" (UID: "9fb57aac-95d0-4f1c-b4f6-b497e7210873"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:37:21.663574 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:21.663540 2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9fb57aac-95d0-4f1c-b4f6-b497e7210873-tls-cert\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:37:21.663574 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:21.663570 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmb5g\" (UniqueName: \"kubernetes.io/projected/9fb57aac-95d0-4f1c-b4f6-b497e7210873-kube-api-access-xmb5g\") on node \"ip-10-0-135-250.ec2.internal\" DevicePath \"\"" Jun 12 22:37:22.226654 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:22.226615 2558 generic.go:356] "Generic (PLEG): container finished" podID="9fb57aac-95d0-4f1c-b4f6-b497e7210873" containerID="1fa5c6613e2c7f71a5d3666d0b673a7fd72f0ce44f88a7f4228978e379db16fb" exitCode=0 Jun 12 22:37:22.226654 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:22.226659 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b54cb4f9c-lclfw" Jun 12 22:37:22.227162 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:22.226694 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b54cb4f9c-lclfw" event={"ID":"9fb57aac-95d0-4f1c-b4f6-b497e7210873","Type":"ContainerDied","Data":"1fa5c6613e2c7f71a5d3666d0b673a7fd72f0ce44f88a7f4228978e379db16fb"} Jun 12 22:37:22.227162 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:22.226735 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b54cb4f9c-lclfw" event={"ID":"9fb57aac-95d0-4f1c-b4f6-b497e7210873","Type":"ContainerDied","Data":"888b324ebb2eeab3d2ff57bc3e843cfb0c680c4d11a4e0e562b3e808435d4f1b"} Jun 12 22:37:22.227162 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:22.226752 2558 scope.go:117] "RemoveContainer" containerID="1fa5c6613e2c7f71a5d3666d0b673a7fd72f0ce44f88a7f4228978e379db16fb" Jun 12 22:37:22.239068 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:22.239040 2558 scope.go:117] "RemoveContainer" containerID="1fa5c6613e2c7f71a5d3666d0b673a7fd72f0ce44f88a7f4228978e379db16fb" Jun 12 22:37:22.239490 ip-10-0-135-250 kubenswrapper[2558]: E0612 22:37:22.239470 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fa5c6613e2c7f71a5d3666d0b673a7fd72f0ce44f88a7f4228978e379db16fb\": container with ID starting with 1fa5c6613e2c7f71a5d3666d0b673a7fd72f0ce44f88a7f4228978e379db16fb not found: ID does not exist" containerID="1fa5c6613e2c7f71a5d3666d0b673a7fd72f0ce44f88a7f4228978e379db16fb" Jun 12 22:37:22.239570 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:22.239501 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fa5c6613e2c7f71a5d3666d0b673a7fd72f0ce44f88a7f4228978e379db16fb"} err="failed to get container status \"1fa5c6613e2c7f71a5d3666d0b673a7fd72f0ce44f88a7f4228978e379db16fb\": rpc error: code = NotFound desc = could not find container \"1fa5c6613e2c7f71a5d3666d0b673a7fd72f0ce44f88a7f4228978e379db16fb\": container with ID starting with 1fa5c6613e2c7f71a5d3666d0b673a7fd72f0ce44f88a7f4228978e379db16fb not found: ID does not exist" Jun 12 22:37:22.248812 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:22.248789 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b54cb4f9c-lclfw"] Jun 12 22:37:22.254857 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:22.254834 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5b54cb4f9c-lclfw"] Jun 12 22:37:22.575886 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:22.575851 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fb57aac-95d0-4f1c-b4f6-b497e7210873" path="/var/lib/kubelet/pods/9fb57aac-95d0-4f1c-b4f6-b497e7210873/volumes" Jun 12 22:37:32.001649 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.001611 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6"] Jun 12 22:37:32.002049 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.002036 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fb57aac-95d0-4f1c-b4f6-b497e7210873" containerName="authorino" Jun 12 22:37:32.002049 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.002050 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fb57aac-95d0-4f1c-b4f6-b497e7210873" containerName="authorino" Jun 12 22:37:32.002128 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.002111 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fb57aac-95d0-4f1c-b4f6-b497e7210873" containerName="authorino" Jun 12 22:37:32.005396 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.005375 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" Jun 12 22:37:32.008294 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.008269 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 12 22:37:32.008549 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.008330 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-g75m7\"" Jun 12 22:37:32.008549 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.008353 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 12 22:37:32.008729 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.008353 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 12 22:37:32.016240 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.016210 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6"] Jun 12 22:37:32.063150 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.063109 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65321a0f-f1ea-43c8-91ac-fde174d5a50a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6\" (UID: \"65321a0f-f1ea-43c8-91ac-fde174d5a50a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" Jun 12 22:37:32.063329 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.063156 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/65321a0f-f1ea-43c8-91ac-fde174d5a50a-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6\" (UID: \"65321a0f-f1ea-43c8-91ac-fde174d5a50a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" Jun 12 22:37:32.063329 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.063246 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65321a0f-f1ea-43c8-91ac-fde174d5a50a-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6\" (UID: \"65321a0f-f1ea-43c8-91ac-fde174d5a50a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" Jun 12 22:37:32.063329 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.063279 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbkqt\" (UniqueName: \"kubernetes.io/projected/65321a0f-f1ea-43c8-91ac-fde174d5a50a-kube-api-access-zbkqt\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6\" (UID: \"65321a0f-f1ea-43c8-91ac-fde174d5a50a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" Jun 12 22:37:32.063329 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.063318 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65321a0f-f1ea-43c8-91ac-fde174d5a50a-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6\" (UID: \"65321a0f-f1ea-43c8-91ac-fde174d5a50a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" Jun 12 22:37:32.063557 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.063340 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65321a0f-f1ea-43c8-91ac-fde174d5a50a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6\" (UID: \"65321a0f-f1ea-43c8-91ac-fde174d5a50a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" Jun 12 22:37:32.164357 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.164316 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65321a0f-f1ea-43c8-91ac-fde174d5a50a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6\" (UID: \"65321a0f-f1ea-43c8-91ac-fde174d5a50a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" Jun 12 22:37:32.164563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.164365 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/65321a0f-f1ea-43c8-91ac-fde174d5a50a-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6\" (UID: \"65321a0f-f1ea-43c8-91ac-fde174d5a50a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" Jun 12 22:37:32.164563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.164403 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65321a0f-f1ea-43c8-91ac-fde174d5a50a-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6\" (UID: \"65321a0f-f1ea-43c8-91ac-fde174d5a50a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" Jun 12 22:37:32.164563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.164426 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbkqt\" (UniqueName: \"kubernetes.io/projected/65321a0f-f1ea-43c8-91ac-fde174d5a50a-kube-api-access-zbkqt\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6\" (UID: \"65321a0f-f1ea-43c8-91ac-fde174d5a50a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" Jun 12 22:37:32.164563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.164485 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65321a0f-f1ea-43c8-91ac-fde174d5a50a-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6\" (UID: \"65321a0f-f1ea-43c8-91ac-fde174d5a50a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" Jun 12 22:37:32.164563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.164507 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65321a0f-f1ea-43c8-91ac-fde174d5a50a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6\" (UID: \"65321a0f-f1ea-43c8-91ac-fde174d5a50a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" Jun 12 22:37:32.164846 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.164769 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65321a0f-f1ea-43c8-91ac-fde174d5a50a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6\" (UID: \"65321a0f-f1ea-43c8-91ac-fde174d5a50a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" Jun 12 22:37:32.164846 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.164813 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65321a0f-f1ea-43c8-91ac-fde174d5a50a-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6\" (UID: \"65321a0f-f1ea-43c8-91ac-fde174d5a50a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" Jun 12 22:37:32.164932 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.164915 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/65321a0f-f1ea-43c8-91ac-fde174d5a50a-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6\" (UID: \"65321a0f-f1ea-43c8-91ac-fde174d5a50a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" Jun 12 22:37:32.166779 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.166760 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65321a0f-f1ea-43c8-91ac-fde174d5a50a-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6\" (UID: \"65321a0f-f1ea-43c8-91ac-fde174d5a50a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" Jun 12 22:37:32.167038 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.167020 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65321a0f-f1ea-43c8-91ac-fde174d5a50a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6\" (UID: \"65321a0f-f1ea-43c8-91ac-fde174d5a50a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" Jun 12 22:37:32.172497 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.172478 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbkqt\" (UniqueName: \"kubernetes.io/projected/65321a0f-f1ea-43c8-91ac-fde174d5a50a-kube-api-access-zbkqt\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6\" (UID: \"65321a0f-f1ea-43c8-91ac-fde174d5a50a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" Jun 12 22:37:32.317983 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.317880 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" Jun 12 22:37:32.460872 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:32.460841 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6"] Jun 12 22:37:32.464264 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:37:32.464233 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65321a0f_f1ea_43c8_91ac_fde174d5a50a.slice/crio-9858214961a08c0e5f35849960c5411a9c13fdffbbb9b7b94190bcf07072442c WatchSource:0}: Error finding container 9858214961a08c0e5f35849960c5411a9c13fdffbbb9b7b94190bcf07072442c: Status 404 returned error can't find the container with id 9858214961a08c0e5f35849960c5411a9c13fdffbbb9b7b94190bcf07072442c Jun 12 22:37:33.289528 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:33.289476 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" event={"ID":"65321a0f-f1ea-43c8-91ac-fde174d5a50a","Type":"ContainerStarted","Data":"9858214961a08c0e5f35849960c5411a9c13fdffbbb9b7b94190bcf07072442c"} Jun 12 22:37:36.309964 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:37:36.309930 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" event={"ID":"65321a0f-f1ea-43c8-91ac-fde174d5a50a","Type":"ContainerStarted","Data":"4070f316ab2481226b600552982d42e299f0793f6d5a7c0902c832e183045755"} Jun 12 22:38:19.395563 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:19.395524 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc"] Jun 12 22:38:19.399270 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:19.399248 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" Jun 12 22:38:19.402005 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:19.401984 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 12 22:38:19.409079 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:19.409058 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc"] Jun 12 22:38:19.511554 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:19.511517 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c8ed2b3-a121-46f8-b830-3738f7699dd3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pqrbc\" (UID: \"7c8ed2b3-a121-46f8-b830-3738f7699dd3\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" Jun 12 22:38:19.511730 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:19.511566 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4w65\" (UniqueName: \"kubernetes.io/projected/7c8ed2b3-a121-46f8-b830-3738f7699dd3-kube-api-access-m4w65\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pqrbc\" (UID: \"7c8ed2b3-a121-46f8-b830-3738f7699dd3\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" Jun 12 22:38:19.511730 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:19.511624 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c8ed2b3-a121-46f8-b830-3738f7699dd3-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pqrbc\" (UID: \"7c8ed2b3-a121-46f8-b830-3738f7699dd3\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" Jun 12 22:38:19.511730 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:19.511695 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c8ed2b3-a121-46f8-b830-3738f7699dd3-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pqrbc\" (UID: \"7c8ed2b3-a121-46f8-b830-3738f7699dd3\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" Jun 12 22:38:19.511839 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:19.511755 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c8ed2b3-a121-46f8-b830-3738f7699dd3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pqrbc\" (UID: \"7c8ed2b3-a121-46f8-b830-3738f7699dd3\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" Jun 12 22:38:19.511839 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:19.511824 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7c8ed2b3-a121-46f8-b830-3738f7699dd3-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pqrbc\" (UID: \"7c8ed2b3-a121-46f8-b830-3738f7699dd3\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" Jun 12 22:38:19.613283 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:19.613244 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c8ed2b3-a121-46f8-b830-3738f7699dd3-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pqrbc\" (UID: \"7c8ed2b3-a121-46f8-b830-3738f7699dd3\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" Jun 12 22:38:19.613474 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:19.613296 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c8ed2b3-a121-46f8-b830-3738f7699dd3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pqrbc\" (UID: \"7c8ed2b3-a121-46f8-b830-3738f7699dd3\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" Jun 12 22:38:19.613474 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:19.613357 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7c8ed2b3-a121-46f8-b830-3738f7699dd3-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pqrbc\" (UID: \"7c8ed2b3-a121-46f8-b830-3738f7699dd3\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" Jun 12 22:38:19.613474 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:19.613401 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c8ed2b3-a121-46f8-b830-3738f7699dd3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pqrbc\" (UID: \"7c8ed2b3-a121-46f8-b830-3738f7699dd3\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" Jun 12 22:38:19.613474 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:19.613422 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4w65\" (UniqueName: \"kubernetes.io/projected/7c8ed2b3-a121-46f8-b830-3738f7699dd3-kube-api-access-m4w65\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pqrbc\" (UID: \"7c8ed2b3-a121-46f8-b830-3738f7699dd3\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" Jun 12 22:38:19.613474 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:19.613470 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c8ed2b3-a121-46f8-b830-3738f7699dd3-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pqrbc\" (UID: \"7c8ed2b3-a121-46f8-b830-3738f7699dd3\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" Jun 12 22:38:19.613733 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:19.613706 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c8ed2b3-a121-46f8-b830-3738f7699dd3-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pqrbc\" (UID: \"7c8ed2b3-a121-46f8-b830-3738f7699dd3\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" Jun 12 22:38:19.613787 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:19.613759 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7c8ed2b3-a121-46f8-b830-3738f7699dd3-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pqrbc\" (UID: \"7c8ed2b3-a121-46f8-b830-3738f7699dd3\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" Jun 12 22:38:19.613837 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:19.613805 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c8ed2b3-a121-46f8-b830-3738f7699dd3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pqrbc\" (UID: \"7c8ed2b3-a121-46f8-b830-3738f7699dd3\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" Jun 12 22:38:19.615596 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:19.615577 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c8ed2b3-a121-46f8-b830-3738f7699dd3-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pqrbc\" (UID: \"7c8ed2b3-a121-46f8-b830-3738f7699dd3\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" Jun 12 22:38:19.615941 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:19.615925 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c8ed2b3-a121-46f8-b830-3738f7699dd3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pqrbc\" (UID: \"7c8ed2b3-a121-46f8-b830-3738f7699dd3\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" Jun 12 22:38:19.621405 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:19.621388 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4w65\" (UniqueName: \"kubernetes.io/projected/7c8ed2b3-a121-46f8-b830-3738f7699dd3-kube-api-access-m4w65\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pqrbc\" (UID: \"7c8ed2b3-a121-46f8-b830-3738f7699dd3\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" Jun 12 22:38:19.712020 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:19.711945 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" Jun 12 22:38:19.843364 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:19.843335 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc"] Jun 12 22:38:19.845590 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:38:19.845561 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c8ed2b3_a121_46f8_b830_3738f7699dd3.slice/crio-48a681cbc58e3fc21582e95a2e322162c9232ccb8eac65fe7408505ee26ce55d WatchSource:0}: Error finding container 48a681cbc58e3fc21582e95a2e322162c9232ccb8eac65fe7408505ee26ce55d: Status 404 returned error can't find the container with id 48a681cbc58e3fc21582e95a2e322162c9232ccb8eac65fe7408505ee26ce55d Jun 12 22:38:20.537724 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:20.537687 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" event={"ID":"7c8ed2b3-a121-46f8-b830-3738f7699dd3","Type":"ContainerStarted","Data":"032fcda10221ed6cc46ad81a6ea8824ffbf52cc0f35a978e300c401abbb9424f"} Jun 12 22:38:20.537724 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:20.537728 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" event={"ID":"7c8ed2b3-a121-46f8-b830-3738f7699dd3","Type":"ContainerStarted","Data":"48a681cbc58e3fc21582e95a2e322162c9232ccb8eac65fe7408505ee26ce55d"} Jun 12 22:38:21.545631 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:21.545593 2558 generic.go:356] "Generic (PLEG): container finished" podID="7c8ed2b3-a121-46f8-b830-3738f7699dd3" containerID="032fcda10221ed6cc46ad81a6ea8824ffbf52cc0f35a978e300c401abbb9424f" exitCode=0 Jun 12 22:38:21.546018 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:21.545688 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" event={"ID":"7c8ed2b3-a121-46f8-b830-3738f7699dd3","Type":"ContainerDied","Data":"032fcda10221ed6cc46ad81a6ea8824ffbf52cc0f35a978e300c401abbb9424f"} Jun 12 22:38:23.558684 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:23.558641 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" event={"ID":"7c8ed2b3-a121-46f8-b830-3738f7699dd3","Type":"ContainerStarted","Data":"fded4aba76bfc34875d8e370c8b3fc2296e217e48c90d4c5181082378996969d"} Jun 12 22:38:23.579341 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:23.579284 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" podStartSLOduration=2.264590353 podStartE2EDuration="4.579268125s" totalImagesPullingTime="1.006613345s" totalInitContainerRuntime="1.308064427s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:38:23.577131617 +0000 UTC m=+1103.448161756" watchObservedRunningTime="2026-06-12 22:38:23.579268125 +0000 UTC m=+1103.450298245" Jun 12 22:38:29.712762 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:29.712730 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" Jun 12 22:38:29.713145 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:29.712793 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" Jun 12 22:38:29.725832 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:29.725809 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" Jun 12 22:38:30.603977 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:38:30.603941 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pqrbc" Jun 12 22:39:23.873479 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:39:23.873423 2558 generic.go:356] "Generic (PLEG): container finished" podID="65321a0f-f1ea-43c8-91ac-fde174d5a50a" containerID="4070f316ab2481226b600552982d42e299f0793f6d5a7c0902c832e183045755" exitCode=0 Jun 12 22:39:23.873924 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:39:23.873496 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" event={"ID":"65321a0f-f1ea-43c8-91ac-fde174d5a50a","Type":"ContainerDied","Data":"4070f316ab2481226b600552982d42e299f0793f6d5a7c0902c832e183045755"} Jun 12 22:39:24.880911 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:39:24.880872 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" event={"ID":"65321a0f-f1ea-43c8-91ac-fde174d5a50a","Type":"ContainerStarted","Data":"eee452669a7d64bf2d881a214045b13816e5c96762785fa0e9c40132ab29aad5"} Jun 12 22:39:24.902073 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:39:24.902024 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" podStartSLOduration=2.633115023 podStartE2EDuration="1m53.902007038s" totalImagesPullingTime="3.915257769s" totalInitContainerRuntime="1m47.353634246s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:37:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:39:24.89909812 +0000 UTC m=+1164.770128256" watchObservedRunningTime="2026-06-12 22:39:24.902007038 +0000 UTC m=+1164.773037217" Jun 12 22:39:32.318421 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:39:32.318382 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" Jun 12 22:39:32.319002 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:39:32.318472 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" Jun 12 22:39:32.331307 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:39:32.331280 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" Jun 12 22:39:32.934649 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:39:32.934618 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6" Jun 12 22:42:26.013588 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:26.013502 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d54fd5fd9-svdss_2b46cfe6-c54a-461c-8289-fbb03869bd91/authorino/0.log" Jun 12 22:42:30.352192 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:30.352165 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-67d44fbf57-ctgh4_a9e5a32d-2f6f-43e0-a303-77d6f81e7d4e/nginx/0.log" Jun 12 22:42:30.820841 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:30.820808 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5bf7cf9b69-msxlg_950742e0-fa6b-48f4-be72-8d54ab7a797b/maas-api/0.log" Jun 12 22:42:31.389850 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:31.389822 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-845b6ff5b7-dfh92_886369ff-b3ca-4db8-8a07-3cb59da4b2a1/copy-manifests/0.log" Jun 12 22:42:31.408102 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:31.408072 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-845b6ff5b7-dfh92_886369ff-b3ca-4db8-8a07-3cb59da4b2a1/manager/0.log" Jun 12 22:42:31.634252 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:31.634216 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-w2sh4_43fe5cde-8277-4167-90e3-2b1232bfe667/postgres/0.log" Jun 12 22:42:32.871798 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:32.871765 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d54fd5fd9-svdss_2b46cfe6-c54a-461c-8289-fbb03869bd91/authorino/0.log" Jun 12 22:42:33.087286 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:33.087258 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-f4fln_e13556e1-b384-4db1-9475-5d916b144a67/manager/0.log" Jun 12 22:42:33.192489 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:33.192381 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-bk7rk_14c12412-dd4b-4f89-8da4-7d45b922fffe/kuadrant-console-plugin/0.log" Jun 12 22:42:33.307081 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:33.307052 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7rghj_f9977b03-8a5d-4f55-832f-dc9c32279f35/registry-server/0.log" Jun 12 22:42:33.983246 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:33.983215 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795ccjjl_dad0df49-dfd8-470d-a459-64c487a15d9d/istio-proxy/0.log" Jun 12 22:42:34.439684 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:34.439648 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-fb2mx_e9066672-7a47-4441-82d1-08cb56029fad/istio-proxy/1.log" Jun 12 22:42:34.766782 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:34.766749 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74964b6f74-tmcld_ba5689ea-c2bd-4358-9750-677d05eb96bb/router/0.log" Jun 12 22:42:35.102109 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:35.102029 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6_65321a0f-f1ea-43c8-91ac-fde174d5a50a/storage-initializer/0.log" Jun 12 22:42:35.114486 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:35.114459 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-9bqv6_65321a0f-f1ea-43c8-91ac-fde174d5a50a/main/0.log" Jun 12 22:42:35.694760 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:35.694727 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-pqrbc_7c8ed2b3-a121-46f8-b830-3738f7699dd3/main/0.log" Jun 12 22:42:35.703169 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:35.703134 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-pqrbc_7c8ed2b3-a121-46f8-b830-3738f7699dd3/storage-initializer/0.log" Jun 12 22:42:39.471388 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:39.471346 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jdpnw/must-gather-mq5ls"] Jun 12 22:42:39.475340 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:39.475316 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jdpnw/must-gather-mq5ls" Jun 12 22:42:39.478381 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:39.478350 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jdpnw\"/\"default-dockercfg-hbb6p\"" Jun 12 22:42:39.478577 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:39.478557 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jdpnw\"/\"kube-root-ca.crt\"" Jun 12 22:42:39.479467 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:39.479420 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jdpnw\"/\"openshift-service-ca.crt\"" Jun 12 22:42:39.497479 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:39.497449 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jdpnw/must-gather-mq5ls"] Jun 12 22:42:39.621584 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:39.621543 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l68bp\" (UniqueName: \"kubernetes.io/projected/2b52246d-dd4c-4e9f-a79a-b6fcef609d79-kube-api-access-l68bp\") pod \"must-gather-mq5ls\" (UID: \"2b52246d-dd4c-4e9f-a79a-b6fcef609d79\") " pod="openshift-must-gather-jdpnw/must-gather-mq5ls" Jun 12 22:42:39.621762 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:39.621645 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2b52246d-dd4c-4e9f-a79a-b6fcef609d79-must-gather-output\") pod \"must-gather-mq5ls\" (UID: \"2b52246d-dd4c-4e9f-a79a-b6fcef609d79\") " pod="openshift-must-gather-jdpnw/must-gather-mq5ls" Jun 12 22:42:39.722921 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:39.722835 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2b52246d-dd4c-4e9f-a79a-b6fcef609d79-must-gather-output\") pod \"must-gather-mq5ls\" (UID: \"2b52246d-dd4c-4e9f-a79a-b6fcef609d79\") " pod="openshift-must-gather-jdpnw/must-gather-mq5ls" Jun 12 22:42:39.723063 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:39.722931 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l68bp\" (UniqueName: \"kubernetes.io/projected/2b52246d-dd4c-4e9f-a79a-b6fcef609d79-kube-api-access-l68bp\") pod \"must-gather-mq5ls\" (UID: \"2b52246d-dd4c-4e9f-a79a-b6fcef609d79\") " pod="openshift-must-gather-jdpnw/must-gather-mq5ls" Jun 12 22:42:39.723289 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:39.723265 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2b52246d-dd4c-4e9f-a79a-b6fcef609d79-must-gather-output\") pod \"must-gather-mq5ls\" (UID: \"2b52246d-dd4c-4e9f-a79a-b6fcef609d79\") " pod="openshift-must-gather-jdpnw/must-gather-mq5ls" Jun 12 22:42:39.733120 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:39.733084 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l68bp\" (UniqueName: \"kubernetes.io/projected/2b52246d-dd4c-4e9f-a79a-b6fcef609d79-kube-api-access-l68bp\") pod \"must-gather-mq5ls\" (UID: \"2b52246d-dd4c-4e9f-a79a-b6fcef609d79\") " pod="openshift-must-gather-jdpnw/must-gather-mq5ls" Jun 12 22:42:39.785093 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:39.785061 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jdpnw/must-gather-mq5ls" Jun 12 22:42:39.924724 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:39.924699 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jdpnw/must-gather-mq5ls"] Jun 12 22:42:39.926811 ip-10-0-135-250 kubenswrapper[2558]: W0612 22:42:39.926786 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b52246d_dd4c_4e9f_a79a_b6fcef609d79.slice/crio-53011e44ad6bdee2b6b9dfc3b7cd7ca4053dffdd0c079be0a5248229f0c5eb2a WatchSource:0}: Error finding container 53011e44ad6bdee2b6b9dfc3b7cd7ca4053dffdd0c079be0a5248229f0c5eb2a: Status 404 returned error can't find the container with id 53011e44ad6bdee2b6b9dfc3b7cd7ca4053dffdd0c079be0a5248229f0c5eb2a Jun 12 22:42:39.928636 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:39.928618 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 22:42:40.930085 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:40.930045 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdpnw/must-gather-mq5ls" event={"ID":"2b52246d-dd4c-4e9f-a79a-b6fcef609d79","Type":"ContainerStarted","Data":"53011e44ad6bdee2b6b9dfc3b7cd7ca4053dffdd0c079be0a5248229f0c5eb2a"} Jun 12 22:42:41.939686 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:41.939641 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdpnw/must-gather-mq5ls" event={"ID":"2b52246d-dd4c-4e9f-a79a-b6fcef609d79","Type":"ContainerStarted","Data":"2a3a4abf640181a4d75ecf8dceff739c72fa92005f90ca400396dbc9a7f41fe7"} Jun 12 22:42:41.940121 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:41.939705 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdpnw/must-gather-mq5ls" event={"ID":"2b52246d-dd4c-4e9f-a79a-b6fcef609d79","Type":"ContainerStarted","Data":"a932940238dfef96ff6c7bcdb30daddb7dd181e010796ef7a59f7e9dc1ba3fb4"} Jun 12 22:42:41.957010 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:41.956958 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jdpnw/must-gather-mq5ls" podStartSLOduration=2.024418159 podStartE2EDuration="2.95694131s" totalImagesPullingTime="932.523151ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:42:41.953887733 +0000 UTC m=+1361.824917898" watchObservedRunningTime="2026-06-12 22:42:41.95694131 +0000 UTC m=+1361.827971430" Jun 12 22:42:42.513277 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:42.513242 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mpzdk_ad7cebde-3bc5-4ed5-9ffd-60050c90f5d4/global-pull-secret-syncer/0.log" Jun 12 22:42:42.687236 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:42.687198 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vpbbf_f8001d08-ea1e-4afd-8e3b-1ee42cf96d35/konnectivity-agent/0.log" Jun 12 22:42:42.783532 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:42.783451 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-250.ec2.internal_31ca95e84738030244e0b10abf497390/haproxy/0.log" Jun 12 22:42:47.780626 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:47.780451 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d54fd5fd9-svdss_2b46cfe6-c54a-461c-8289-fbb03869bd91/authorino/0.log" Jun 12 22:42:47.862465 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:47.862417 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-f4fln_e13556e1-b384-4db1-9475-5d916b144a67/manager/0.log" Jun 12 22:42:47.974642 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:47.974543 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-bk7rk_14c12412-dd4b-4f89-8da4-7d45b922fffe/kuadrant-console-plugin/0.log" Jun 12 22:42:48.013300 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:48.013251 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7rghj_f9977b03-8a5d-4f55-832f-dc9c32279f35/registry-server/0.log" Jun 12 22:42:49.743693 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:49.743659 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f1353a83-4b8f-43a6-bc37-c384342c5074/alertmanager/0.log" Jun 12 22:42:49.761314 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:49.761286 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f1353a83-4b8f-43a6-bc37-c384342c5074/config-reloader/0.log" Jun 12 22:42:49.780855 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:49.780823 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f1353a83-4b8f-43a6-bc37-c384342c5074/kube-rbac-proxy-web/0.log" Jun 12 22:42:49.797890 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:49.797840 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f1353a83-4b8f-43a6-bc37-c384342c5074/kube-rbac-proxy/0.log" Jun 12 22:42:49.827676 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:49.827647 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f1353a83-4b8f-43a6-bc37-c384342c5074/kube-rbac-proxy-metric/0.log" Jun 12 22:42:49.846881 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:49.846850 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f1353a83-4b8f-43a6-bc37-c384342c5074/prom-label-proxy/0.log" Jun 12 22:42:49.875146 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:49.875114 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f1353a83-4b8f-43a6-bc37-c384342c5074/init-config-reloader/0.log" Jun 12 22:42:49.915494 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:49.915460 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-rfqql_1904869f-b574-4320-aab4-bfeaf06c63a8/cluster-monitoring-operator/0.log" Jun 12 22:42:49.964872 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:49.964834 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-ll968_1da97937-b532-4753-bebb-ddac68b4de98/kube-state-metrics/0.log" Jun 12 22:42:49.985995 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:49.985964 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-ll968_1da97937-b532-4753-bebb-ddac68b4de98/kube-rbac-proxy-main/0.log" Jun 12 22:42:50.009454 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:50.008336 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-ll968_1da97937-b532-4753-bebb-ddac68b4de98/kube-rbac-proxy-self/0.log" Jun 12 22:42:50.120417 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:50.120384 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7vc7d_2f1e2a26-d8dc-4585-926c-e781891246ae/node-exporter/0.log" Jun 12 22:42:50.144749 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:50.144726 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7vc7d_2f1e2a26-d8dc-4585-926c-e781891246ae/kube-rbac-proxy/0.log" Jun 12 22:42:50.173476 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:50.173447 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7vc7d_2f1e2a26-d8dc-4585-926c-e781891246ae/init-textfile/0.log" Jun 12 22:42:50.682252 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:50.682223 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66dc9c979b-q4qgx_7fc2fe3f-e2c1-4260-973a-39e6c6674569/telemeter-client/0.log" Jun 12 22:42:50.702611 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:50.702569 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66dc9c979b-q4qgx_7fc2fe3f-e2c1-4260-973a-39e6c6674569/reload/0.log" Jun 12 22:42:50.719355 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:50.719311 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66dc9c979b-q4qgx_7fc2fe3f-e2c1-4260-973a-39e6c6674569/kube-rbac-proxy/0.log" Jun 12 22:42:50.749927 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:50.749895 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-847d8b76f8-dm6g8_3ce7d544-4c96-4b4f-85fd-06b21b1dad2d/thanos-query/0.log" Jun 12 22:42:50.768111 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:50.768078 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-847d8b76f8-dm6g8_3ce7d544-4c96-4b4f-85fd-06b21b1dad2d/kube-rbac-proxy-web/0.log" Jun 12 22:42:50.786075 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:50.786043 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-847d8b76f8-dm6g8_3ce7d544-4c96-4b4f-85fd-06b21b1dad2d/kube-rbac-proxy/0.log" Jun 12 22:42:50.801870 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:50.801841 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-847d8b76f8-dm6g8_3ce7d544-4c96-4b4f-85fd-06b21b1dad2d/prom-label-proxy/0.log" Jun 12 22:42:50.820874 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:50.820783 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-847d8b76f8-dm6g8_3ce7d544-4c96-4b4f-85fd-06b21b1dad2d/kube-rbac-proxy-rules/0.log" Jun 12 22:42:50.841340 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:50.841281 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-847d8b76f8-dm6g8_3ce7d544-4c96-4b4f-85fd-06b21b1dad2d/kube-rbac-proxy-metrics/0.log" Jun 12 22:42:52.137946 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:52.137914 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-rxlgh_07c36375-213f-4d62-8784-35df74e77d7b/networking-console-plugin/0.log" Jun 12 22:42:53.337592 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:53.337563 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b6c475974-5k694_2aff9a4d-bfe7-47a0-a3a1-f87c7363e5bd/console/0.log" Jun 12 22:42:53.367902 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:53.367869 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-2vfjp_8a3c5eb6-6876-4f0c-a155-52c27c7e03a6/download-server/0.log" Jun 12 22:42:53.470811 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:53.470771 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jdpnw/perf-node-gather-daemonset-bnxmj"] Jun 12 22:42:53.481276 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:53.481236 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jdpnw/perf-node-gather-daemonset-bnxmj" Jun 12 22:42:53.487056 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:53.487022 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jdpnw/perf-node-gather-daemonset-bnxmj"] Jun 12 22:42:53.589723 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:53.589214 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/598c1db2-fe0f-4488-b9f6-4577ad9bb8e7-sys\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"598c1db2-fe0f-4488-b9f6-4577ad9bb8e7\") " pod="openshift-must-gather-jdpnw/perf-node-gather-daemonset-bnxmj" Jun 12 22:42:53.589723 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:53.589355 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/598c1db2-fe0f-4488-b9f6-4577ad9bb8e7-podres\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"598c1db2-fe0f-4488-b9f6-4577ad9bb8e7\") " pod="openshift-must-gather-jdpnw/perf-node-gather-daemonset-bnxmj" Jun 12 22:42:53.589723 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:53.589400 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/598c1db2-fe0f-4488-b9f6-4577ad9bb8e7-proc\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"598c1db2-fe0f-4488-b9f6-4577ad9bb8e7\") " pod="openshift-must-gather-jdpnw/perf-node-gather-daemonset-bnxmj" Jun 12 22:42:53.589723 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:53.589425 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/598c1db2-fe0f-4488-b9f6-4577ad9bb8e7-lib-modules\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"598c1db2-fe0f-4488-b9f6-4577ad9bb8e7\") " pod="openshift-must-gather-jdpnw/perf-node-gather-daemonset-bnxmj" Jun 12 22:42:53.589723 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:53.589577 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5f94\" (UniqueName: \"kubernetes.io/projected/598c1db2-fe0f-4488-b9f6-4577ad9bb8e7-kube-api-access-c5f94\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"598c1db2-fe0f-4488-b9f6-4577ad9bb8e7\") " pod="openshift-must-gather-jdpnw/perf-node-gather-daemonset-bnxmj" Jun 12 22:42:53.690392 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:53.690345 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/598c1db2-fe0f-4488-b9f6-4577ad9bb8e7-podres\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"598c1db2-fe0f-4488-b9f6-4577ad9bb8e7\") " pod="openshift-must-gather-jdpnw/perf-node-gather-daemonset-bnxmj" Jun 12 22:42:53.690605 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:53.690411 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/598c1db2-fe0f-4488-b9f6-4577ad9bb8e7-proc\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"598c1db2-fe0f-4488-b9f6-4577ad9bb8e7\") " pod="openshift-must-gather-jdpnw/perf-node-gather-daemonset-bnxmj" Jun 12 22:42:53.690605 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:53.690477 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/598c1db2-fe0f-4488-b9f6-4577ad9bb8e7-lib-modules\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"598c1db2-fe0f-4488-b9f6-4577ad9bb8e7\") " pod="openshift-must-gather-jdpnw/perf-node-gather-daemonset-bnxmj" Jun 12 22:42:53.690605 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:53.690548 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/598c1db2-fe0f-4488-b9f6-4577ad9bb8e7-podres\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"598c1db2-fe0f-4488-b9f6-4577ad9bb8e7\") " pod="openshift-must-gather-jdpnw/perf-node-gather-daemonset-bnxmj" Jun 12 22:42:53.690783 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:53.690660 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/598c1db2-fe0f-4488-b9f6-4577ad9bb8e7-lib-modules\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"598c1db2-fe0f-4488-b9f6-4577ad9bb8e7\") " pod="openshift-must-gather-jdpnw/perf-node-gather-daemonset-bnxmj" Jun 12 22:42:53.690783 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:53.690552 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/598c1db2-fe0f-4488-b9f6-4577ad9bb8e7-proc\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"598c1db2-fe0f-4488-b9f6-4577ad9bb8e7\") " pod="openshift-must-gather-jdpnw/perf-node-gather-daemonset-bnxmj" Jun 12 22:42:53.690893 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:53.690785 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5f94\" (UniqueName: \"kubernetes.io/projected/598c1db2-fe0f-4488-b9f6-4577ad9bb8e7-kube-api-access-c5f94\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"598c1db2-fe0f-4488-b9f6-4577ad9bb8e7\") " pod="openshift-must-gather-jdpnw/perf-node-gather-daemonset-bnxmj" Jun 12 22:42:53.690893 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:53.690824 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/598c1db2-fe0f-4488-b9f6-4577ad9bb8e7-sys\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"598c1db2-fe0f-4488-b9f6-4577ad9bb8e7\") " pod="openshift-must-gather-jdpnw/perf-node-gather-daemonset-bnxmj" Jun 12 22:42:53.690980 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:53.690900 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/598c1db2-fe0f-4488-b9f6-4577ad9bb8e7-sys\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"598c1db2-fe0f-4488-b9f6-4577ad9bb8e7\") " pod="openshift-must-gather-jdpnw/perf-node-gather-daemonset-bnxmj" Jun 12 22:42:53.709093 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:53.708816 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5f94\" (UniqueName: \"kubernetes.io/projected/598c1db2-fe0f-4488-b9f6-4577ad9bb8e7-kube-api-access-c5f94\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"598c1db2-fe0f-4488-b9f6-4577ad9bb8e7\") " pod="openshift-must-gather-jdpnw/perf-node-gather-daemonset-bnxmj" Jun 12 22:42:53.813547 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:53.813509 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jdpnw/perf-node-gather-daemonset-bnxmj" Jun 12 22:42:54.022912 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:54.022881 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jdpnw/perf-node-gather-daemonset-bnxmj"] Jun 12 22:42:54.039002 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:54.038965 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdpnw/perf-node-gather-daemonset-bnxmj" event={"ID":"598c1db2-fe0f-4488-b9f6-4577ad9bb8e7","Type":"ContainerStarted","Data":"cdab932f5a4f39cb0f0c55df489d7b3fee0c5814d977ef45121414917a94e748"} Jun 12 22:42:55.049226 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:55.049181 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdpnw/perf-node-gather-daemonset-bnxmj" event={"ID":"598c1db2-fe0f-4488-b9f6-4577ad9bb8e7","Type":"ContainerStarted","Data":"47815ce9fc2ec2ffca4b805b9f757c60bc9c70f50a75d5d582a2d150ae34d495"} Jun 12 22:42:55.049730 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:55.049266 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jdpnw/perf-node-gather-daemonset-bnxmj" Jun 12 22:42:55.067530 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:55.067465 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jdpnw/perf-node-gather-daemonset-bnxmj" podStartSLOduration=2.067423475 podStartE2EDuration="2.067423475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:42:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:42:55.065974531 +0000 UTC m=+1374.937004653" watchObservedRunningTime="2026-06-12 22:42:55.067423475 +0000 UTC m=+1374.938453597" Jun 12 22:42:55.205800 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:55.205773 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bgplx_97c3a625-9d8c-402e-9a2b-58626ea31c58/dns/0.log" Jun 12 22:42:55.223179 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:55.223150 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bgplx_97c3a625-9d8c-402e-9a2b-58626ea31c58/kube-rbac-proxy/0.log" Jun 12 22:42:55.328632 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:55.328549 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8l9dt_9af1eca2-b583-43aa-83dc-cf6e62837d2c/dns-node-resolver/0.log" Jun 12 22:42:55.967918 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:55.967884 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zpg7d_26b5ec6b-bd2c-4920-8737-a43044a3d820/node-ca/0.log" Jun 12 22:42:56.869499 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:56.869466 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795ccjjl_dad0df49-dfd8-470d-a459-64c487a15d9d/istio-proxy/0.log" Jun 12 22:42:57.008338 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:57.008302 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-fb2mx_e9066672-7a47-4441-82d1-08cb56029fad/istio-proxy/1.log" Jun 12 22:42:57.008985 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:57.008964 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-fb2mx_e9066672-7a47-4441-82d1-08cb56029fad/istio-proxy/0.log" Jun 12 22:42:57.073387 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:57.073353 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74964b6f74-tmcld_ba5689ea-c2bd-4358-9750-677d05eb96bb/router/0.log" Jun 12 22:42:57.654883 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:57.654849 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8s5t8_d54c5b13-ba6f-4fd5-8c27-d15c4900af5f/serve-healthcheck-canary/0.log" Jun 12 22:42:58.446169 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:58.446137 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qdfzw_986a3e0e-ee8a-432b-85c3-933cd9a7b3f3/kube-rbac-proxy/0.log" Jun 12 22:42:58.494574 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:58.494549 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qdfzw_986a3e0e-ee8a-432b-85c3-933cd9a7b3f3/exporter/0.log" Jun 12 22:42:58.525460 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:42:58.525408 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qdfzw_986a3e0e-ee8a-432b-85c3-933cd9a7b3f3/extractor/0.log" Jun 12 22:43:00.766691 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:00.766664 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-67d44fbf57-ctgh4_a9e5a32d-2f6f-43e0-a303-77d6f81e7d4e/nginx/0.log" Jun 12 22:43:00.875312 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:00.875280 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5bf7cf9b69-msxlg_950742e0-fa6b-48f4-be72-8d54ab7a797b/maas-api/0.log" Jun 12 22:43:01.070756 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:01.070678 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jdpnw/perf-node-gather-daemonset-bnxmj" Jun 12 22:43:01.130493 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:01.130456 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-845b6ff5b7-dfh92_886369ff-b3ca-4db8-8a07-3cb59da4b2a1/manager/0.log" Jun 12 22:43:01.145478 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:01.145450 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-845b6ff5b7-dfh92_886369ff-b3ca-4db8-8a07-3cb59da4b2a1/copy-manifests/0.log" Jun 12 22:43:01.210318 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:01.210288 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-w2sh4_43fe5cde-8277-4167-90e3-2b1232bfe667/postgres/0.log" Jun 12 22:43:02.948014 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:02.947983 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-58f59688f-4fb7b_bef33b05-7dce-4eda-9c80-b600414018ab/manager/0.log" Jun 12 22:43:07.614986 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:07.614954 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795ccjjl_dad0df49-dfd8-470d-a459-64c487a15d9d/istio-proxy/0.log" Jun 12 22:43:07.709057 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:07.709004 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-fb2mx_e9066672-7a47-4441-82d1-08cb56029fad/istio-proxy/1.log" Jun 12 22:43:07.709335 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:07.709315 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-fb2mx_e9066672-7a47-4441-82d1-08cb56029fad/istio-proxy/0.log" Jun 12 22:43:07.757053 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:07.757013 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74964b6f74-tmcld_ba5689ea-c2bd-4358-9750-677d05eb96bb/router/0.log" Jun 12 22:43:08.739729 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:08.739691 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-77d7f_313c738d-72a0-47ef-8eb1-c3e68c725e42/kube-storage-version-migrator-operator/1.log" Jun 12 22:43:08.741257 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:08.741231 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-77d7f_313c738d-72a0-47ef-8eb1-c3e68c725e42/kube-storage-version-migrator-operator/0.log" Jun 12 22:43:08.885132 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:08.885094 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795ccjjl_dad0df49-dfd8-470d-a459-64c487a15d9d/istio-proxy/0.log" Jun 12 22:43:08.983309 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:08.983281 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-fb2mx_e9066672-7a47-4441-82d1-08cb56029fad/istio-proxy/1.log" Jun 12 22:43:08.983624 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:08.983459 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-fb2mx_e9066672-7a47-4441-82d1-08cb56029fad/istio-proxy/0.log" Jun 12 22:43:09.026768 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:09.026739 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74964b6f74-tmcld_ba5689ea-c2bd-4358-9750-677d05eb96bb/router/0.log" Jun 12 22:43:09.994679 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:09.994652 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c2mhw_f223bd69-0e45-4401-b183-52acac69823a/kube-multus-additional-cni-plugins/0.log" Jun 12 22:43:10.012744 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:10.012714 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c2mhw_f223bd69-0e45-4401-b183-52acac69823a/egress-router-binary-copy/0.log" Jun 12 22:43:10.029638 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:10.029603 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c2mhw_f223bd69-0e45-4401-b183-52acac69823a/cni-plugins/0.log" Jun 12 22:43:10.045791 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:10.045766 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c2mhw_f223bd69-0e45-4401-b183-52acac69823a/bond-cni-plugin/0.log" Jun 12 22:43:10.062995 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:10.062950 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c2mhw_f223bd69-0e45-4401-b183-52acac69823a/routeoverride-cni/0.log" Jun 12 22:43:10.080054 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:10.080025 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c2mhw_f223bd69-0e45-4401-b183-52acac69823a/whereabouts-cni-bincopy/0.log" Jun 12 22:43:10.097275 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:10.097229 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c2mhw_f223bd69-0e45-4401-b183-52acac69823a/whereabouts-cni/0.log" Jun 12 22:43:10.438387 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:10.438353 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pb79d_a63c2dd0-dc3b-4b13-a47b-6d7c045058e7/kube-multus/0.log" Jun 12 22:43:10.499015 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:10.498989 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lqpxm_5707213e-da61-4306-96d0-03a1790eb281/network-metrics-daemon/0.log" Jun 12 22:43:10.513719 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:10.513689 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lqpxm_5707213e-da61-4306-96d0-03a1790eb281/kube-rbac-proxy/0.log" Jun 12 22:43:10.707540 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:10.707462 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795ccjjl_dad0df49-dfd8-470d-a459-64c487a15d9d/istio-proxy/0.log" Jun 12 22:43:10.796336 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:10.796290 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-fb2mx_e9066672-7a47-4441-82d1-08cb56029fad/istio-proxy/1.log" Jun 12 22:43:10.797190 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:10.797159 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-fb2mx_e9066672-7a47-4441-82d1-08cb56029fad/istio-proxy/0.log" Jun 12 22:43:10.834611 ip-10-0-135-250 kubenswrapper[2558]: I0612 22:43:10.834581 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74964b6f74-tmcld_ba5689ea-c2bd-4358-9750-677d05eb96bb/router/0.log"