Jun 05 17:49:10.691524 ip-10-0-143-199 systemd[1]: Starting Kubernetes Kubelet... Jun 05 17:49:11.114932 ip-10-0-143-199 kubenswrapper[2553]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 17:49:11.114932 ip-10-0-143-199 kubenswrapper[2553]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 17:49:11.114932 ip-10-0-143-199 kubenswrapper[2553]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 17:49:11.114932 ip-10-0-143-199 kubenswrapper[2553]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 17:49:11.114932 ip-10-0-143-199 kubenswrapper[2553]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 17:49:11.116981 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.116888 2553 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 17:49:11.120568 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120546 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 17:49:11.120568 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120564 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 17:49:11.120568 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120569 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 17:49:11.120568 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120574 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 17:49:11.120819 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120578 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 17:49:11.120819 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120582 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 17:49:11.120819 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120586 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 17:49:11.120819 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120591 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 17:49:11.120819 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120596 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 17:49:11.120819 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120601 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 17:49:11.120819 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120604 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 17:49:11.120819 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120608 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 17:49:11.120819 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120612 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 17:49:11.120819 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120616 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 17:49:11.120819 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120620 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 17:49:11.120819 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120624 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 17:49:11.120819 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120628 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 17:49:11.120819 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120632 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 17:49:11.120819 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120642 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 17:49:11.120819 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120646 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 17:49:11.120819 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120651 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 17:49:11.120819 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120654 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 17:49:11.120819 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120658 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 17:49:11.120819 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120662 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 17:49:11.121668 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120666 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 17:49:11.121668 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120670 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 17:49:11.121668 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120674 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 17:49:11.121668 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120678 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 17:49:11.121668 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120681 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 17:49:11.121668 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120685 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 17:49:11.121668 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120689 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 17:49:11.121668 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120694 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 17:49:11.121668 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120698 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 17:49:11.121668 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120703 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 17:49:11.121668 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120707 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 17:49:11.121668 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120712 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 17:49:11.121668 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120716 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 17:49:11.121668 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120721 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 17:49:11.121668 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120725 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 17:49:11.121668 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120729 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 17:49:11.121668 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120734 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 17:49:11.121668 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120738 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 17:49:11.121668 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120742 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 17:49:11.121668 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120746 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 17:49:11.122510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120750 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 17:49:11.122510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120754 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 17:49:11.122510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120759 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 17:49:11.122510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120763 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 17:49:11.122510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120767 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 17:49:11.122510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120772 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 17:49:11.122510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120777 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 17:49:11.122510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120781 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 17:49:11.122510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120786 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 17:49:11.122510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120791 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 17:49:11.122510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120795 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 17:49:11.122510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120799 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 17:49:11.122510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120803 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 17:49:11.122510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120808 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 17:49:11.122510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120812 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 17:49:11.122510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120816 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 17:49:11.122510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120820 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 17:49:11.122510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120824 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 17:49:11.122510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120831 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 17:49:11.122510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120835 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 17:49:11.123370 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120840 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 17:49:11.123370 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120844 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 17:49:11.123370 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120848 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 17:49:11.123370 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120853 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 17:49:11.123370 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120857 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 17:49:11.123370 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120862 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 17:49:11.123370 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120866 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 17:49:11.123370 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120871 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 17:49:11.123370 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120876 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 17:49:11.123370 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120880 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 17:49:11.123370 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120884 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 17:49:11.123370 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120888 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 17:49:11.123370 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120894 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 17:49:11.123370 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120901 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 17:49:11.123370 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120906 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 17:49:11.123370 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120913 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 17:49:11.123370 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120917 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 17:49:11.123370 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120922 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 17:49:11.123370 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120926 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 17:49:11.124219 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120933 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 17:49:11.124219 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120939 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 17:49:11.124219 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120943 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 17:49:11.124219 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120948 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 17:49:11.124219 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120953 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 17:49:11.124219 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120957 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 17:49:11.124219 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120961 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 17:49:11.124219 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120966 2553 feature_gate.go:328] unrecognized feature gate: Example Jun 05 17:49:11.124219 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120971 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 17:49:11.124219 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120975 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 17:49:11.124219 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120980 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 17:49:11.124219 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120985 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 17:49:11.124219 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120990 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 17:49:11.124219 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.120995 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 17:49:11.124219 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.121000 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 17:49:11.124219 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.121004 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 17:49:11.124219 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122216 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 17:49:11.124219 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122225 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 17:49:11.124219 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122230 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 17:49:11.125070 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122255 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 17:49:11.125070 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122260 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 17:49:11.125070 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122265 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 17:49:11.125070 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122270 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 17:49:11.125070 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122274 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 17:49:11.125070 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122278 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 17:49:11.125070 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122283 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 17:49:11.125070 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122288 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 17:49:11.125070 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122292 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 17:49:11.125070 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122296 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 17:49:11.125070 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122300 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 17:49:11.125070 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122305 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 17:49:11.125070 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122309 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 17:49:11.125070 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122313 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 17:49:11.125070 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122318 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 17:49:11.125070 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122322 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 17:49:11.125070 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122327 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 17:49:11.125070 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122331 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 17:49:11.125070 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122335 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 17:49:11.125070 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122363 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 17:49:11.125845 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122371 2553 feature_gate.go:328] unrecognized feature gate: Example Jun 05 17:49:11.125845 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122378 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 17:49:11.125845 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122384 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 17:49:11.125845 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122389 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 17:49:11.125845 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122394 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 17:49:11.125845 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122399 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 17:49:11.125845 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122405 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 17:49:11.125845 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122411 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 17:49:11.125845 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122417 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 17:49:11.125845 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122421 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 17:49:11.125845 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122426 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 17:49:11.125845 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122431 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 17:49:11.125845 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122436 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 17:49:11.125845 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122440 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 17:49:11.125845 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122445 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 17:49:11.125845 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122450 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 17:49:11.125845 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122454 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 17:49:11.125845 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122459 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 17:49:11.125845 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122463 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 17:49:11.126477 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122467 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 17:49:11.126477 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122472 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 17:49:11.126477 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122476 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 17:49:11.126477 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122481 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 17:49:11.126477 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122485 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 17:49:11.126477 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122489 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 17:49:11.126477 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122494 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 17:49:11.126477 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122498 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 17:49:11.126477 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122503 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 17:49:11.126477 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122508 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 17:49:11.126477 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122512 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 17:49:11.126477 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122516 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 17:49:11.126477 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122521 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 17:49:11.126477 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122525 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 17:49:11.126477 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122529 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 17:49:11.126477 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122533 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 17:49:11.126477 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122538 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 17:49:11.126477 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122542 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 17:49:11.126477 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122546 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 17:49:11.126477 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122551 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 17:49:11.127064 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122556 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 17:49:11.127064 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122561 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 17:49:11.127064 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122565 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 17:49:11.127064 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122569 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 17:49:11.127064 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122574 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 17:49:11.127064 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122579 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 17:49:11.127064 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122583 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 17:49:11.127064 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122587 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 17:49:11.127064 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122593 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 17:49:11.127064 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122598 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 17:49:11.127064 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122603 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 17:49:11.127064 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122609 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 17:49:11.127064 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122615 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 17:49:11.127064 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122620 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 17:49:11.127064 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122624 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 17:49:11.127064 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122628 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 17:49:11.127064 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122633 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 17:49:11.127064 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122637 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 17:49:11.127064 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122641 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 17:49:11.127064 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122645 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 17:49:11.127586 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122650 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 17:49:11.127586 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122654 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 17:49:11.127586 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122659 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 17:49:11.127586 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122663 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 17:49:11.127586 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122667 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 17:49:11.127586 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122671 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 17:49:11.127586 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122676 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 17:49:11.127586 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122680 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 17:49:11.127586 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122685 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 17:49:11.127586 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122690 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 17:49:11.127586 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122694 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 17:49:11.127586 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122699 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 17:49:11.127586 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122704 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 17:49:11.127586 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122708 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 17:49:11.127586 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122712 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 17:49:11.127586 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122716 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 17:49:11.127586 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.122720 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 17:49:11.127586 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123397 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 17:49:11.127586 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123408 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 17:49:11.128132 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123413 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 17:49:11.128132 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123418 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 17:49:11.128132 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123424 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 17:49:11.128132 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123429 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 17:49:11.128132 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123437 2553 feature_gate.go:328] unrecognized feature gate: Example Jun 05 17:49:11.128132 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123442 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 17:49:11.128132 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123446 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 17:49:11.128132 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123451 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 17:49:11.128132 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123455 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 17:49:11.128132 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123460 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 17:49:11.128132 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123466 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 17:49:11.128132 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123472 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 17:49:11.128132 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123477 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 17:49:11.128132 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123482 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 17:49:11.128132 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123487 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 17:49:11.128132 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123491 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 17:49:11.128132 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123496 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 17:49:11.128132 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123500 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 17:49:11.128132 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123505 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 17:49:11.128132 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123509 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 17:49:11.128641 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123514 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 17:49:11.128641 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123518 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 17:49:11.128641 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123523 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 17:49:11.128641 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123528 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 17:49:11.128641 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123532 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 17:49:11.128641 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123536 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 17:49:11.128641 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123540 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 17:49:11.128641 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123544 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 17:49:11.128641 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123548 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 17:49:11.128641 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123552 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 17:49:11.128641 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123557 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 17:49:11.128641 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123561 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 17:49:11.128641 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123565 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 17:49:11.128641 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123569 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 17:49:11.128641 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123574 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 17:49:11.128641 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123581 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 17:49:11.128641 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123591 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 17:49:11.128641 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123596 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 17:49:11.128641 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123600 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 17:49:11.129106 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123607 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 17:49:11.129106 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123613 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 17:49:11.129106 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123618 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 17:49:11.129106 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123623 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 17:49:11.129106 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123628 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 17:49:11.129106 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123633 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 17:49:11.129106 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123637 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 17:49:11.129106 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123641 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 17:49:11.129106 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123645 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 17:49:11.129106 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123650 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 17:49:11.129106 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123654 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 17:49:11.129106 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123658 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 17:49:11.129106 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123663 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 17:49:11.129106 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123667 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 17:49:11.129106 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123671 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 17:49:11.129106 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123675 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 17:49:11.129106 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123679 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 17:49:11.129106 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123683 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 17:49:11.129106 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123688 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 17:49:11.129106 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123692 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 17:49:11.129611 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123696 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 17:49:11.129611 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123700 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 17:49:11.129611 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123704 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 17:49:11.129611 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123708 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 17:49:11.129611 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123712 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 17:49:11.129611 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123716 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 17:49:11.129611 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123721 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 17:49:11.129611 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123725 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 17:49:11.129611 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123731 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 17:49:11.129611 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123738 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 17:49:11.129611 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123743 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 17:49:11.129611 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123748 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 17:49:11.129611 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123752 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 17:49:11.129611 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123756 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 17:49:11.129611 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123760 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 17:49:11.129611 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123764 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 17:49:11.129611 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123768 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 17:49:11.129611 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123773 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 17:49:11.129611 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123777 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 17:49:11.129611 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123781 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 17:49:11.130127 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123785 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 17:49:11.130127 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123789 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 17:49:11.130127 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123794 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 17:49:11.130127 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123797 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 17:49:11.130127 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123802 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 17:49:11.130127 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123806 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 17:49:11.130127 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123810 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 17:49:11.130127 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123815 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 17:49:11.130127 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123819 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 17:49:11.130127 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123822 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 17:49:11.130127 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123827 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 17:49:11.130127 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123830 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 17:49:11.130127 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123835 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 17:49:11.130127 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123839 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 17:49:11.130127 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123843 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 17:49:11.130127 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123847 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 17:49:11.130127 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123852 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 17:49:11.130127 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.123857 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 17:49:11.130127 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.123959 2553 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 17:49:11.130127 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.123970 2553 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 17:49:11.130673 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.123982 2553 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 17:49:11.130673 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.123990 2553 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 17:49:11.130673 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124001 2553 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 17:49:11.130673 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124007 2553 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 17:49:11.130673 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124014 2553 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 17:49:11.130673 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124021 2553 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 17:49:11.130673 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124026 2553 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 17:49:11.130673 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124031 2553 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 17:49:11.130673 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124037 2553 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 17:49:11.130673 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124043 2553 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 17:49:11.130673 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124048 2553 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 17:49:11.130673 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124053 2553 flags.go:64] FLAG: --cgroup-root="" Jun 05 17:49:11.130673 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124058 2553 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 17:49:11.130673 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124063 2553 flags.go:64] FLAG: --client-ca-file="" Jun 05 17:49:11.130673 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124067 2553 flags.go:64] FLAG: --cloud-provider="external" Jun 05 17:49:11.130673 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124072 2553 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 17:49:11.130673 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124098 2553 flags.go:64] FLAG: --cluster-domain="" Jun 05 17:49:11.130673 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124105 2553 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 17:49:11.130673 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124111 2553 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 17:49:11.130673 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124117 2553 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 17:49:11.130673 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124123 2553 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 17:49:11.130673 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124128 2553 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 17:49:11.130673 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124133 2553 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 17:49:11.131284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124138 2553 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 17:49:11.131284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124144 2553 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 17:49:11.131284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124149 2553 flags.go:64] FLAG: --contention-profiling="false" Jun 05 17:49:11.131284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124154 2553 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 17:49:11.131284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124158 2553 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 17:49:11.131284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124163 2553 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 17:49:11.131284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124168 2553 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 17:49:11.131284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124176 2553 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 17:49:11.131284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124181 2553 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 17:49:11.131284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124186 2553 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 17:49:11.131284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124193 2553 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 17:49:11.131284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124200 2553 flags.go:64] FLAG: --enable-server="true" Jun 05 17:49:11.131284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124205 2553 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 17:49:11.131284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124251 2553 flags.go:64] FLAG: --event-burst="100" Jun 05 17:49:11.131284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124257 2553 flags.go:64] FLAG: --event-qps="50" Jun 05 17:49:11.131284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124262 2553 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 17:49:11.131284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124267 2553 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 17:49:11.131284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124272 2553 flags.go:64] FLAG: --eviction-hard="" Jun 05 17:49:11.131284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124279 2553 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 17:49:11.131284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124283 2553 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 17:49:11.131284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124289 2553 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 17:49:11.131284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124294 2553 flags.go:64] FLAG: --eviction-soft="" Jun 05 17:49:11.131284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124299 2553 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 17:49:11.131284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124304 2553 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 17:49:11.131284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124309 2553 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 17:49:11.131907 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124313 2553 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 17:49:11.131907 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124318 2553 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 17:49:11.131907 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124323 2553 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 17:49:11.131907 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124328 2553 flags.go:64] FLAG: --feature-gates="" Jun 05 17:49:11.131907 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124335 2553 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 17:49:11.131907 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124340 2553 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 17:49:11.131907 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124345 2553 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 17:49:11.131907 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124350 2553 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 17:49:11.131907 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124355 2553 flags.go:64] FLAG: --healthz-port="10248" Jun 05 17:49:11.131907 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124360 2553 flags.go:64] FLAG: --help="false" Jun 05 17:49:11.131907 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124365 2553 flags.go:64] FLAG: --hostname-override="ip-10-0-143-199.ec2.internal" Jun 05 17:49:11.131907 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124370 2553 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 17:49:11.131907 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124375 2553 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 17:49:11.131907 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124380 2553 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 17:49:11.131907 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124386 2553 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 17:49:11.131907 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124392 2553 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 17:49:11.131907 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124396 2553 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 17:49:11.131907 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124401 2553 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 17:49:11.131907 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124408 2553 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 17:49:11.131907 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124413 2553 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 17:49:11.131907 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124419 2553 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 17:49:11.131907 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124425 2553 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 17:49:11.131907 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124430 2553 flags.go:64] FLAG: --kube-reserved="" Jun 05 17:49:11.131907 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124436 2553 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 17:49:11.132519 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124440 2553 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 17:49:11.132519 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124445 2553 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 17:49:11.132519 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124450 2553 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 17:49:11.132519 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124455 2553 flags.go:64] FLAG: --lock-file="" Jun 05 17:49:11.132519 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124459 2553 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 17:49:11.132519 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124465 2553 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 17:49:11.132519 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124470 2553 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 17:49:11.132519 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124479 2553 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 17:49:11.132519 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124483 2553 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 17:49:11.132519 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124488 2553 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 17:49:11.132519 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124492 2553 flags.go:64] FLAG: --logging-format="text" Jun 05 17:49:11.132519 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124497 2553 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 17:49:11.132519 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124503 2553 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 17:49:11.132519 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124507 2553 flags.go:64] FLAG: --manifest-url="" Jun 05 17:49:11.132519 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124512 2553 flags.go:64] FLAG: --manifest-url-header="" Jun 05 17:49:11.132519 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124519 2553 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 17:49:11.132519 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124524 2553 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 17:49:11.132519 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124530 2553 flags.go:64] FLAG: --max-pods="110" Jun 05 17:49:11.132519 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124535 2553 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 17:49:11.132519 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124540 2553 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 17:49:11.132519 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124545 2553 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 17:49:11.132519 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124550 2553 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 17:49:11.132519 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124555 2553 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 17:49:11.132519 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124560 2553 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 17:49:11.132519 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124564 2553 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 17:49:11.133139 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124576 2553 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 17:49:11.133139 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124583 2553 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 17:49:11.133139 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124588 2553 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 17:49:11.133139 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124593 2553 flags.go:64] FLAG: --pod-cidr="" Jun 05 17:49:11.133139 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124599 2553 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 17:49:11.133139 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124607 2553 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 17:49:11.133139 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124612 2553 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 17:49:11.133139 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124617 2553 flags.go:64] FLAG: --pods-per-core="0" Jun 05 17:49:11.133139 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124622 2553 flags.go:64] FLAG: --port="10250" Jun 05 17:49:11.133139 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124627 2553 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 17:49:11.133139 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124631 2553 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a64b314dcef385ab" Jun 05 17:49:11.133139 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124637 2553 flags.go:64] FLAG: --qos-reserved="" Jun 05 17:49:11.133139 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124641 2553 flags.go:64] FLAG: --read-only-port="10255" Jun 05 17:49:11.133139 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124646 2553 flags.go:64] FLAG: --register-node="true" Jun 05 17:49:11.133139 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124651 2553 flags.go:64] FLAG: --register-with-taints="" Jun 05 17:49:11.133139 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124657 2553 flags.go:64] FLAG: --registry-burst="10" Jun 05 17:49:11.133139 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124661 2553 flags.go:64] FLAG: --registry-qps="5" Jun 05 17:49:11.133139 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124666 2553 flags.go:64] FLAG: --reserved-cpus="" Jun 05 17:49:11.133139 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124670 2553 flags.go:64] FLAG: --reserved-memory="" Jun 05 17:49:11.133139 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124677 2553 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 17:49:11.133139 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124682 2553 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 17:49:11.133139 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124687 2553 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 17:49:11.133139 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124691 2553 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 17:49:11.133139 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124696 2553 flags.go:64] FLAG: --runonce="false" Jun 05 17:49:11.133139 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124700 2553 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 17:49:11.133792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124706 2553 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 17:49:11.133792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124711 2553 flags.go:64] FLAG: --seccomp-default="false" Jun 05 17:49:11.133792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124715 2553 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 17:49:11.133792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124720 2553 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 17:49:11.133792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124725 2553 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 17:49:11.133792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124730 2553 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 17:49:11.133792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124735 2553 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 17:49:11.133792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124740 2553 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 17:49:11.133792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124744 2553 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 17:49:11.133792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124751 2553 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 17:49:11.133792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124756 2553 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 17:49:11.133792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124761 2553 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 17:49:11.133792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124767 2553 flags.go:64] FLAG: --system-cgroups="" Jun 05 17:49:11.133792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124772 2553 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 17:49:11.133792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124779 2553 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 17:49:11.133792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124784 2553 flags.go:64] FLAG: --tls-cert-file="" Jun 05 17:49:11.133792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124789 2553 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 17:49:11.133792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124795 2553 flags.go:64] FLAG: --tls-min-version="" Jun 05 17:49:11.133792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124800 2553 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 17:49:11.133792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124805 2553 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 17:49:11.133792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124809 2553 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 17:49:11.133792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124814 2553 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 17:49:11.133792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124819 2553 flags.go:64] FLAG: --v="2" Jun 05 17:49:11.133792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124825 2553 flags.go:64] FLAG: --version="false" Jun 05 17:49:11.133792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124831 2553 flags.go:64] FLAG: --vmodule="" Jun 05 17:49:11.134510 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124837 2553 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 17:49:11.134510 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.124843 2553 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 17:49:11.134510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125026 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 17:49:11.134510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125033 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 17:49:11.134510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125040 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 17:49:11.134510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125044 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 17:49:11.134510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125049 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 17:49:11.134510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125053 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 17:49:11.134510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125058 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 17:49:11.134510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125062 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 17:49:11.134510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125066 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 17:49:11.134510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125070 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 17:49:11.134510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125074 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 17:49:11.134510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125078 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 17:49:11.134510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125083 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 17:49:11.134510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125087 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 17:49:11.134510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125091 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 17:49:11.134510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125096 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 17:49:11.134510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125100 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 17:49:11.134510 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125104 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 17:49:11.135008 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125110 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 17:49:11.135008 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125114 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 17:49:11.135008 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125118 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 17:49:11.135008 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125122 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 17:49:11.135008 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125127 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 17:49:11.135008 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125131 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 17:49:11.135008 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125135 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 17:49:11.135008 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125139 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 17:49:11.135008 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125143 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 17:49:11.135008 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125147 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 17:49:11.135008 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125152 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 17:49:11.135008 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125156 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 17:49:11.135008 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125160 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 17:49:11.135008 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125165 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 17:49:11.135008 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125169 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 17:49:11.135008 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125173 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 17:49:11.135008 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125177 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 17:49:11.135008 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125182 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 17:49:11.135008 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125186 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 17:49:11.135008 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125190 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 17:49:11.135530 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125195 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 17:49:11.135530 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125199 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 17:49:11.135530 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125203 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 17:49:11.135530 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125208 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 17:49:11.135530 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125214 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 17:49:11.135530 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125221 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 17:49:11.135530 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125230 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 17:49:11.135530 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125252 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 17:49:11.135530 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125257 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 17:49:11.135530 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125262 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 17:49:11.135530 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125267 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 17:49:11.135530 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125272 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 17:49:11.135530 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125277 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 17:49:11.135530 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125282 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 17:49:11.135530 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125287 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 17:49:11.135530 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125292 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 17:49:11.135530 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125296 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 17:49:11.135530 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125301 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 17:49:11.135530 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125306 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 17:49:11.136005 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125310 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 17:49:11.136005 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125314 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 17:49:11.136005 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125319 2553 feature_gate.go:328] unrecognized feature gate: Example Jun 05 17:49:11.136005 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125323 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 17:49:11.136005 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125327 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 17:49:11.136005 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125331 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 17:49:11.136005 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125336 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 17:49:11.136005 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125340 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 17:49:11.136005 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125344 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 17:49:11.136005 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125349 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 17:49:11.136005 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125353 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 17:49:11.136005 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125358 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 17:49:11.136005 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125362 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 17:49:11.136005 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125366 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 17:49:11.136005 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125370 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 17:49:11.136005 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125374 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 17:49:11.136005 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125378 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 17:49:11.136005 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125382 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 17:49:11.136005 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125386 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 17:49:11.136005 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125392 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 17:49:11.136519 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125397 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 17:49:11.136519 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125401 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 17:49:11.136519 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125405 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 17:49:11.136519 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125409 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 17:49:11.136519 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125414 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 17:49:11.136519 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125418 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 17:49:11.136519 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125422 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 17:49:11.136519 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125427 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 17:49:11.136519 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125431 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 17:49:11.136519 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125435 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 17:49:11.136519 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125446 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 17:49:11.136519 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125450 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 17:49:11.136519 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125455 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 17:49:11.136519 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125459 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 17:49:11.136519 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125463 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 17:49:11.136519 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125467 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 17:49:11.136519 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125472 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 17:49:11.136519 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125476 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 17:49:11.136519 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125481 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 17:49:11.136519 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125485 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 17:49:11.137025 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125489 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 17:49:11.137025 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.125496 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 17:49:11.137025 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.125505 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 17:49:11.137025 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.132187 2553 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 17:49:11.137025 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.132313 2553 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 17:49:11.137025 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.132333 2553 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 17:49:11.137025 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.132338 2553 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 17:49:11.137025 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132408 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 17:49:11.137025 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132415 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 17:49:11.137025 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132419 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 17:49:11.137025 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132422 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 17:49:11.137025 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132425 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 17:49:11.137025 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132428 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 17:49:11.137025 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132431 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 17:49:11.137400 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132435 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 17:49:11.137400 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132438 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 17:49:11.137400 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132441 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 17:49:11.137400 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132444 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 17:49:11.137400 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132447 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 17:49:11.137400 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132450 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 17:49:11.137400 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132453 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 17:49:11.137400 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132456 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 17:49:11.137400 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132458 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 17:49:11.137400 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132461 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 17:49:11.137400 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132464 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 17:49:11.137400 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132466 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 17:49:11.137400 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132469 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 17:49:11.137400 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132471 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 17:49:11.137400 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132474 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 17:49:11.137400 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132476 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 17:49:11.137400 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132479 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 17:49:11.137400 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132482 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 17:49:11.137400 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132484 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 17:49:11.137400 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132487 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 17:49:11.137905 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132489 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 17:49:11.137905 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132492 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 17:49:11.137905 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132496 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 17:49:11.137905 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132499 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 17:49:11.137905 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132501 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 17:49:11.137905 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132504 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 17:49:11.137905 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132507 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 17:49:11.137905 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132510 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 17:49:11.137905 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132512 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 17:49:11.137905 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132515 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 17:49:11.137905 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132517 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 17:49:11.137905 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132520 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 17:49:11.137905 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132523 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 17:49:11.137905 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132526 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 17:49:11.137905 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132528 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 17:49:11.137905 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132531 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 17:49:11.137905 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132534 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 17:49:11.137905 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132536 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 17:49:11.137905 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132539 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 17:49:11.137905 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132541 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 17:49:11.138441 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132544 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 17:49:11.138441 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132547 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 17:49:11.138441 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132549 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 17:49:11.138441 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132552 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 17:49:11.138441 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132555 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 17:49:11.138441 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132557 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 17:49:11.138441 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132560 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 17:49:11.138441 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132562 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 17:49:11.138441 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132565 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 17:49:11.138441 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132568 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 17:49:11.138441 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132570 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 17:49:11.138441 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132573 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 17:49:11.138441 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132576 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 17:49:11.138441 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132578 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 17:49:11.138441 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132582 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 17:49:11.138441 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132585 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 17:49:11.138441 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132588 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 17:49:11.138441 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132590 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 17:49:11.138441 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132594 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 17:49:11.138904 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132599 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 17:49:11.138904 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132603 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 17:49:11.138904 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132606 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 17:49:11.138904 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132609 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 17:49:11.138904 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132612 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 17:49:11.138904 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132614 2553 feature_gate.go:328] unrecognized feature gate: Example Jun 05 17:49:11.138904 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132617 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 17:49:11.138904 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132620 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 17:49:11.138904 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132623 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 17:49:11.138904 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132625 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 17:49:11.138904 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132628 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 17:49:11.138904 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132630 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 17:49:11.138904 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132633 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 17:49:11.138904 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132636 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 17:49:11.138904 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132639 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 17:49:11.138904 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132641 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 17:49:11.138904 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132644 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 17:49:11.138904 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132646 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 17:49:11.138904 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132649 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 17:49:11.138904 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132651 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 17:49:11.139413 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132654 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 17:49:11.139413 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132657 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 17:49:11.139413 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132659 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 17:49:11.139413 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132662 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 17:49:11.139413 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132665 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 17:49:11.139413 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132667 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 17:49:11.139413 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132670 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 17:49:11.139413 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132673 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 17:49:11.139413 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132675 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 17:49:11.139413 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132679 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 17:49:11.139413 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132681 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 17:49:11.139413 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132684 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 17:49:11.139413 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132687 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 17:49:11.139413 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.132691 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 17:49:11.139413 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132809 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 17:49:11.139866 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132814 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 17:49:11.139866 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132818 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 17:49:11.139866 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132821 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 17:49:11.139866 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132824 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 17:49:11.139866 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132826 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 17:49:11.139866 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132829 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 17:49:11.139866 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132832 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 17:49:11.139866 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132835 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 17:49:11.139866 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132838 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 17:49:11.139866 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132840 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 17:49:11.139866 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132843 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 17:49:11.139866 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132846 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 17:49:11.139866 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132848 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 17:49:11.139866 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132851 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 17:49:11.139866 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132853 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 17:49:11.139866 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132856 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 17:49:11.139866 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132860 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 17:49:11.139866 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132863 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 17:49:11.139866 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132866 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 17:49:11.140624 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132869 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 17:49:11.140624 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132871 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 17:49:11.140624 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132874 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 17:49:11.140624 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132877 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 17:49:11.140624 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132879 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 17:49:11.140624 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132882 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 17:49:11.140624 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132885 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 17:49:11.140624 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132887 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 17:49:11.140624 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132890 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 17:49:11.140624 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132893 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 17:49:11.140624 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132896 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 17:49:11.140624 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132899 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 17:49:11.140624 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132903 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 17:49:11.140624 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132906 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 17:49:11.140624 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132908 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 17:49:11.140624 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132911 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 17:49:11.140624 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132913 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 17:49:11.140624 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132916 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 17:49:11.140624 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132918 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 17:49:11.140624 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132921 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 17:49:11.141248 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132924 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 17:49:11.141248 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132926 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 17:49:11.141248 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132929 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 17:49:11.141248 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132931 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 17:49:11.141248 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132934 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 17:49:11.141248 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132936 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 17:49:11.141248 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132939 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 17:49:11.141248 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132941 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 17:49:11.141248 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132944 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 17:49:11.141248 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132946 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 17:49:11.141248 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132949 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 17:49:11.141248 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132951 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 17:49:11.141248 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132954 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 17:49:11.141248 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132956 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 17:49:11.141248 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132959 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 17:49:11.141248 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132962 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 17:49:11.141248 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132964 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 17:49:11.141248 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132967 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 17:49:11.141248 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132969 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 17:49:11.141248 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132972 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 17:49:11.141751 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132974 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 17:49:11.141751 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132977 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 17:49:11.141751 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132980 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 17:49:11.141751 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132982 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 17:49:11.141751 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132985 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 17:49:11.141751 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132988 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 17:49:11.141751 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132990 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 17:49:11.141751 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132993 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 17:49:11.141751 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132995 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 17:49:11.141751 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.132998 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 17:49:11.141751 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133000 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 17:49:11.141751 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133003 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 17:49:11.141751 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133005 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 17:49:11.141751 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133008 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 17:49:11.141751 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133011 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 17:49:11.141751 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133013 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 17:49:11.141751 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133015 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 17:49:11.141751 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133018 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 17:49:11.141751 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133020 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 17:49:11.142207 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133023 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 17:49:11.142207 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133027 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 17:49:11.142207 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133031 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 17:49:11.142207 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133034 2553 feature_gate.go:328] unrecognized feature gate: Example Jun 05 17:49:11.142207 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133036 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 17:49:11.142207 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133039 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 17:49:11.142207 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133042 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 17:49:11.142207 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133045 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 17:49:11.142207 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133048 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 17:49:11.142207 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133050 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 17:49:11.142207 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133053 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 17:49:11.142207 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133056 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 17:49:11.142207 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133058 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 17:49:11.142207 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133061 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 17:49:11.142207 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133063 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 17:49:11.142207 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133066 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 17:49:11.142207 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133069 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 17:49:11.142207 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133074 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 17:49:11.142207 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133076 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 17:49:11.142207 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:11.133079 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 17:49:11.142704 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.133084 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 17:49:11.142704 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.133190 2553 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 17:49:11.142704 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.135143 2553 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 17:49:11.142704 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.136417 2553 server.go:1019] "Starting client certificate rotation" Jun 05 17:49:11.142704 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.136513 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 17:49:11.142704 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.136547 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 17:49:11.142704 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.138937 2553 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 17:49:11.144745 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.144727 2553 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 17:49:11.151184 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.151171 2553 log.go:25] "Validated CRI v1 runtime API" Jun 05 17:49:11.153532 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.153520 2553 log.go:25] "Validated CRI v1 image API" Jun 05 17:49:11.156786 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.156771 2553 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 17:49:11.159174 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.159151 2553 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 cac449b9-a028-4491-b10e-6d3f71047bd2:/dev/nvme0n1p4 da3f9747-9761-40e1-bfbd-048fdc387e70:/dev/nvme0n1p3] Jun 05 17:49:11.159226 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.159175 2553 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 17:49:11.164297 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.164169 2553 manager.go:216] Machine: {Timestamp:2026-06-05 17:49:11.162825226 +0000 UTC m=+0.352804389 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3117927 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24739f6eb02cc14619530eda1038ff SystemUUID:ec24739f-6eb0-2cc1-4619-530eda1038ff BootID:3f636b67-d1fd-4f0f-a7c2-1eb909c6b7cd Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5e:aa:23:0c:5f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5e:aa:23:0c:5f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:0c:d6:3e:77:6b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 17:49:11.164297 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.164296 2553 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 17:49:11.164400 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.164366 2553 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 17:49:11.167719 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.167687 2553 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 17:49:11.167849 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.167720 2553 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-199.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 17:49:11.167849 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.167841 2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 17:49:11.168986 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.168975 2553 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 17:49:11.169028 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.168988 2553 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 17:49:11.169028 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.168996 2553 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 17:49:11.169591 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.169581 2553 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 17:49:11.170360 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.170349 2553 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 17:49:11.173534 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.173522 2553 state_mem.go:36] "Initialized new in-memory state store" Jun 05 17:49:11.173647 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.173638 2553 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 17:49:11.173682 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.173670 2553 kubelet.go:486] "Attempting to sync node with API server" Jun 05 17:49:11.173715 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.173692 2553 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 17:49:11.173742 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.173715 2553 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 17:49:11.173742 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.173737 2553 kubelet.go:398] "Adding apiserver pod source" Jun 05 17:49:11.173800 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.173748 2553 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 17:49:11.174187 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.174173 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 17:49:11.174231 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.174198 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 17:49:11.176586 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.176559 2553 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 17:49:11.178216 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.178197 2553 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 17:49:11.178311 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.178254 2553 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 17:49:11.180096 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.180083 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 17:49:11.180174 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.180103 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 17:49:11.180174 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.180111 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 17:49:11.180174 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.180119 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 17:49:11.180174 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.180131 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 17:49:11.180174 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.180140 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 17:49:11.180174 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.180151 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 17:49:11.180174 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.180160 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 17:49:11.180174 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.180175 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 17:49:11.180447 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.180184 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 17:49:11.180447 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.180196 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 17:49:11.180447 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.180204 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 17:49:11.181020 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.181008 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 17:49:11.181066 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.181022 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 17:49:11.184226 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.184208 2553 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-199.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 17:49:11.184420 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.184407 2553 server.go:1268] "Started kubelet" Jun 05 17:49:11.184549 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.184493 2553 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 17:49:11.187689 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:11.187549 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-199.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 17:49:11.187689 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:11.187541 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 17:49:11.187817 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.187722 2553 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 17:49:11.187817 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.187769 2553 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 17:49:11.188493 ip-10-0-143-199 systemd[1]: Started Kubernetes Kubelet. Jun 05 17:49:11.190497 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.190084 2553 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 17:49:11.190711 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.190579 2553 server.go:310] "Adding debug handlers to kubelet server" Jun 05 17:49:11.191462 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.191440 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pdlbd" Jun 05 17:49:11.194866 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:11.193632 2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-199.ec2.internal.18b6409e455d99f1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-199.ec2.internal,UID:ip-10-0-143-199.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-199.ec2.internal,},FirstTimestamp:2026-06-05 17:49:11.184382449 +0000 UTC m=+0.374361609,LastTimestamp:2026-06-05 17:49:11.184382449 +0000 UTC m=+0.374361609,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-199.ec2.internal,}" Jun 05 17:49:11.195143 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:11.195126 2553 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 17:49:11.196320 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.196306 2553 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 17:49:11.196368 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.196351 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 17:49:11.196425 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:11.196407 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-199.ec2.internal\" not found" Jun 05 17:49:11.196917 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.196897 2553 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 17:49:11.196917 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.196917 2553 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 17:49:11.197039 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.196904 2553 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 17:49:11.197039 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.197008 2553 reconstruct.go:97] "Volume reconstruction finished" Jun 05 17:49:11.197039 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.197017 2553 reconciler.go:29] "Reconciler: start to sync state" Jun 05 17:49:11.197212 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.197197 2553 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 17:49:11.197291 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.197213 2553 factory.go:55] Registering systemd factory Jun 05 17:49:11.197291 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.197223 2553 factory.go:223] Registration of the systemd container factory successfully Jun 05 17:49:11.197477 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.197458 2553 factory.go:153] Registering CRI-O factory Jun 05 17:49:11.197477 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.197474 2553 factory.go:223] Registration of the crio container factory successfully Jun 05 17:49:11.197624 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.197497 2553 factory.go:103] Registering Raw factory Jun 05 17:49:11.197624 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.197516 2553 manager.go:1196] Started watching for new ooms in manager Jun 05 17:49:11.197974 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.197961 2553 manager.go:349] Starting recovery of all containers Jun 05 17:49:11.198797 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.198779 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pdlbd" Jun 05 17:49:11.208063 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.208043 2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 17:49:11.209053 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.209036 2553 manager.go:354] Recovery completed Jun 05 17:49:11.211188 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:11.211173 2553 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-199.ec2.internal\" not found" node="ip-10-0-143-199.ec2.internal" Jun 05 17:49:11.212974 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.212962 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 17:49:11.214854 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.214839 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-199.ec2.internal" event="NodeHasSufficientMemory" Jun 05 17:49:11.214924 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.214865 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-199.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 17:49:11.214924 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.214875 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-199.ec2.internal" event="NodeHasSufficientPID" Jun 05 17:49:11.215338 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.215323 2553 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 17:49:11.215338 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.215336 2553 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 17:49:11.215417 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.215352 2553 state_mem.go:36] "Initialized new in-memory state store" Jun 05 17:49:11.215758 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.215746 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 17:49:11.216473 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.216458 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-199.ec2.internal" event="NodeHasSufficientMemory" Jun 05 17:49:11.216524 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.216485 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-199.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 17:49:11.216524 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.216497 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-199.ec2.internal" event="NodeHasSufficientPID" Jun 05 17:49:11.216864 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.216853 2553 policy_none.go:49] "None policy: Start" Jun 05 17:49:11.216894 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.216868 2553 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 17:49:11.216894 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.216878 2553 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 17:49:11.217760 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.217745 2553 policy_none.go:47] "Start" Jun 05 17:49:11.262272 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.262222 2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 17:49:11.265024 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.263465 2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 17:49:11.265024 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.263512 2553 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 17:49:11.265024 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.263538 2553 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 17:49:11.265024 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:11.263581 2553 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 05 17:49:11.265024 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.264015 2553 manager.go:337] "Starting Device Plugin manager" Jun 05 17:49:11.265024 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:11.264049 2553 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 17:49:11.265024 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.264063 2553 server.go:87] "Starting device plugin registration server" Jun 05 17:49:11.265024 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.264383 2553 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 17:49:11.265024 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.264398 2553 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 17:49:11.265024 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.264484 2553 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 17:49:11.265024 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.264634 2553 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 17:49:11.265024 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.264644 2553 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 17:49:11.265572 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:11.265378 2553 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 17:49:11.265572 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:11.265441 2553 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-199.ec2.internal\" not found" Jun 05 17:49:11.265765 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.265752 2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 17:49:11.364269 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.364225 2553 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-199.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-199.ec2.internal"] Jun 05 17:49:11.364365 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.364316 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 17:49:11.364654 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.364621 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 17:49:11.366108 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.366050 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-199.ec2.internal" event="NodeHasSufficientMemory" Jun 05 17:49:11.366108 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.366085 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-199.ec2.internal" event="NodeHasSufficientMemory" Jun 05 17:49:11.366108 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.366106 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-199.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 17:49:11.366263 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.366115 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-199.ec2.internal" event="NodeHasSufficientPID" Jun 05 17:49:11.366263 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.366088 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-199.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 17:49:11.366263 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.366185 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-199.ec2.internal" event="NodeHasSufficientPID" Jun 05 17:49:11.366263 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.366215 2553 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-199.ec2.internal" Jun 05 17:49:11.367427 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.367414 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 17:49:11.367570 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.367557 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-199.ec2.internal" Jun 05 17:49:11.367609 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.367585 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 17:49:11.368112 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.368098 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-199.ec2.internal" event="NodeHasSufficientMemory" Jun 05 17:49:11.368169 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.368120 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-199.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 17:49:11.368169 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.368132 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-199.ec2.internal" event="NodeHasSufficientPID" Jun 05 17:49:11.368268 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.368187 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-199.ec2.internal" event="NodeHasSufficientMemory" Jun 05 17:49:11.368268 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.368221 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-199.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 17:49:11.368268 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.368248 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-199.ec2.internal" event="NodeHasSufficientPID" Jun 05 17:49:11.369344 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.369329 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-199.ec2.internal" Jun 05 17:49:11.369426 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.369355 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 17:49:11.370380 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.370363 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-199.ec2.internal" event="NodeHasSufficientMemory" Jun 05 17:49:11.370438 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.370398 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-199.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 17:49:11.370438 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.370415 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-199.ec2.internal" event="NodeHasSufficientPID" Jun 05 17:49:11.372280 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.372266 2553 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-199.ec2.internal" Jun 05 17:49:11.372340 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:11.372285 2553 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-199.ec2.internal\": node \"ip-10-0-143-199.ec2.internal\" not found" Jun 05 17:49:11.388819 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:11.388798 2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-199.ec2.internal\" not found" node="ip-10-0-143-199.ec2.internal" Jun 05 17:49:11.388899 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:11.388831 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-199.ec2.internal\" not found" Jun 05 17:49:11.392138 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:11.392123 2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-199.ec2.internal\" not found" node="ip-10-0-143-199.ec2.internal" Jun 05 17:49:11.489814 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:11.489790 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-199.ec2.internal\" not found" Jun 05 17:49:11.498092 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.498073 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2da0c469e1f6c43dd080495b19164f17-config\") pod \"kube-apiserver-proxy-ip-10-0-143-199.ec2.internal\" (UID: \"2da0c469e1f6c43dd080495b19164f17\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-199.ec2.internal" Jun 05 17:49:11.498158 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.498097 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ffecca0816be25591ea66d893555604-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-199.ec2.internal\" (UID: \"4ffecca0816be25591ea66d893555604\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-199.ec2.internal" Jun 05 17:49:11.498207 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.498145 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ffecca0816be25591ea66d893555604-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-199.ec2.internal\" (UID: \"4ffecca0816be25591ea66d893555604\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-199.ec2.internal" Jun 05 17:49:11.590153 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:11.590128 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-199.ec2.internal\" not found" Jun 05 17:49:11.598390 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.598368 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ffecca0816be25591ea66d893555604-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-199.ec2.internal\" (UID: \"4ffecca0816be25591ea66d893555604\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-199.ec2.internal" Jun 05 17:49:11.598458 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.598408 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ffecca0816be25591ea66d893555604-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-199.ec2.internal\" (UID: \"4ffecca0816be25591ea66d893555604\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-199.ec2.internal" Jun 05 17:49:11.598458 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.598425 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2da0c469e1f6c43dd080495b19164f17-config\") pod \"kube-apiserver-proxy-ip-10-0-143-199.ec2.internal\" (UID: \"2da0c469e1f6c43dd080495b19164f17\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-199.ec2.internal" Jun 05 17:49:11.598549 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.598462 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2da0c469e1f6c43dd080495b19164f17-config\") pod \"kube-apiserver-proxy-ip-10-0-143-199.ec2.internal\" (UID: \"2da0c469e1f6c43dd080495b19164f17\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-199.ec2.internal" Jun 05 17:49:11.598549 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.598478 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ffecca0816be25591ea66d893555604-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-199.ec2.internal\" (UID: \"4ffecca0816be25591ea66d893555604\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-199.ec2.internal" Jun 05 17:49:11.598549 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.598487 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ffecca0816be25591ea66d893555604-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-199.ec2.internal\" (UID: \"4ffecca0816be25591ea66d893555604\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-199.ec2.internal" Jun 05 17:49:11.690826 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:11.690761 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-199.ec2.internal\" not found" Jun 05 17:49:11.692921 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.692905 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-199.ec2.internal" Jun 05 17:49:11.696895 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:11.696469 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-199.ec2.internal" Jun 05 17:49:11.791799 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:11.791765 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-199.ec2.internal\" not found" Jun 05 17:49:11.892276 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:11.892248 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-199.ec2.internal\" not found" Jun 05 17:49:11.992776 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:11.992704 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-199.ec2.internal\" not found" Jun 05 17:49:12.093277 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:12.093245 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-199.ec2.internal\" not found" Jun 05 17:49:12.135712 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:12.135677 2553 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 17:49:12.136338 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:12.135823 2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 17:49:12.136338 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:12.135856 2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 17:49:12.193588 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:12.193555 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-199.ec2.internal\" not found" Jun 05 17:49:12.201392 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:12.201353 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 17:44:11 +0000 UTC" deadline="2027-10-31 02:40:47.391704533 +0000 UTC" Jun 05 17:49:12.201392 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:12.201389 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12296h51m35.190318178s" Jun 05 17:49:12.201925 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:12.201900 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ffecca0816be25591ea66d893555604.slice/crio-ea2888635ac133d05976a2bb6a18ddb7a544e780d90f6a7331e75fd36cc031d0 WatchSource:0}: Error finding container ea2888635ac133d05976a2bb6a18ddb7a544e780d90f6a7331e75fd36cc031d0: Status 404 returned error can't find the container with id ea2888635ac133d05976a2bb6a18ddb7a544e780d90f6a7331e75fd36cc031d0 Jun 05 17:49:12.202255 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:12.202226 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2da0c469e1f6c43dd080495b19164f17.slice/crio-c9adc5758e70bfa36c9f610d2c34b5fc754e39d93abdc80be8590fd5bac3a736 WatchSource:0}: Error finding container c9adc5758e70bfa36c9f610d2c34b5fc754e39d93abdc80be8590fd5bac3a736: Status 404 returned error can't find the container with id c9adc5758e70bfa36c9f610d2c34b5fc754e39d93abdc80be8590fd5bac3a736 Jun 05 17:49:12.206350 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:12.206331 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 17:49:12.267333 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:12.267262 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-199.ec2.internal" event={"ID":"2da0c469e1f6c43dd080495b19164f17","Type":"ContainerStarted","Data":"c9adc5758e70bfa36c9f610d2c34b5fc754e39d93abdc80be8590fd5bac3a736"} Jun 05 17:49:12.268253 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:12.268217 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-199.ec2.internal" event={"ID":"4ffecca0816be25591ea66d893555604","Type":"ContainerStarted","Data":"ea2888635ac133d05976a2bb6a18ddb7a544e780d90f6a7331e75fd36cc031d0"} Jun 05 17:49:12.294374 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:12.294355 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-199.ec2.internal\" not found" Jun 05 17:49:12.394880 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:12.394847 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-199.ec2.internal\" not found" Jun 05 17:49:12.458019 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:12.457993 2553 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 17:49:12.497190 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:12.497168 2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-199.ec2.internal" Jun 05 17:49:12.508216 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:12.508190 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 17:49:12.510220 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:12.510195 2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-199.ec2.internal" Jun 05 17:49:12.519216 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:12.519150 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 17:49:12.661998 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:12.661969 2553 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 17:49:12.987281 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:12.987199 2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 17:49:13.174488 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.174458 2553 apiserver.go:52] "Watching apiserver" Jun 05 17:49:13.183836 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.183809 2553 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 17:49:13.184206 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.184184 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-cd8cb","kube-system/konnectivity-agent-v67cc","kube-system/kube-apiserver-proxy-ip-10-0-143-199.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb","openshift-cluster-node-tuning-operator/tuned-k6678","openshift-multus/multus-additional-cni-plugins-sbdm2","openshift-network-diagnostics/network-check-target-kq6rg","openshift-network-operator/iptables-alerter-pf5g7","openshift-dns/node-resolver-t7jhz","openshift-image-registry/node-ca-wlsj8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-199.ec2.internal","openshift-multus/multus-svjbf","openshift-multus/network-metrics-daemon-nbsjk","openshift-ovn-kubernetes/ovnkube-node-7z87q"] Jun 05 17:49:13.185815 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.185772 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:13.185908 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:13.185851 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq6rg" podUID="935d4fd0-70b3-44bd-b083-3ff1e61b3710" Jun 05 17:49:13.186888 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.186863 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:13.186990 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:13.186944 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbsjk" podUID="0e0bcb41-a6ca-4334-b790-165d44925258" Jun 05 17:49:13.188182 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.188163 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.189381 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.189350 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" Jun 05 17:49:13.190544 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.190524 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.190633 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.190568 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 17:49:13.190693 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.190650 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 17:49:13.191269 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.191231 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 17:49:13.191346 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.191305 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 17:49:13.191551 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.191528 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 17:49:13.191752 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.191734 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 17:49:13.192386 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.191942 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hr64p\"" Jun 05 17:49:13.192386 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.192055 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 17:49:13.192386 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.192106 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 17:49:13.192386 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.192138 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.192386 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.192161 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 17:49:13.192386 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.192167 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hsvr2\"" Jun 05 17:49:13.192676 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.192628 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sx6z9\"" Jun 05 17:49:13.192861 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.192844 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 17:49:13.193101 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.193084 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 17:49:13.193334 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.193314 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t7jhz" Jun 05 17:49:13.194681 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.194660 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:13.194774 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:13.194716 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cd8cb" podUID="ceaba4c9-2e0e-45d6-a060-9033db497249" Jun 05 17:49:13.195904 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.195873 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v67cc" Jun 05 17:49:13.196840 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.196454 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 17:49:13.196840 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.196504 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 17:49:13.196840 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.196523 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 17:49:13.196840 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.196542 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 17:49:13.196840 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.196676 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 17:49:13.196840 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.196684 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 17:49:13.196840 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.196693 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 17:49:13.196840 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.196709 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nqgr6\"" Jun 05 17:49:13.196840 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.196679 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wzcmm\"" Jun 05 17:49:13.197361 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.196896 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 17:49:13.197361 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.197213 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wlsj8" Jun 05 17:49:13.198198 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.198180 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 17:49:13.198632 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.198616 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pf5g7" Jun 05 17:49:13.198718 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.198650 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 17:49:13.198913 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.198889 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mhnjc\"" Jun 05 17:49:13.199869 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.199815 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ktd66\"" Jun 05 17:49:13.199869 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.199861 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 17:49:13.200033 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.199861 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 17:49:13.200133 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.200116 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.200217 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.200125 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 17:49:13.200979 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.200959 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 17:49:13.201068 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.200980 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 17:49:13.201068 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.200965 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 17:49:13.201396 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.201378 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bhxl7\"" Jun 05 17:49:13.202460 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.202439 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6t2zd\"" Jun 05 17:49:13.204728 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.202613 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 17:49:13.204728 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.203897 2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 17:49:13.206288 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.206270 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/18237004-740d-4413-8ba4-9817e0d59f46-sys-fs\") pod \"aws-ebs-csi-driver-node-njkdb\" (UID: \"18237004-740d-4413-8ba4-9817e0d59f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" Jun 05 17:49:13.206389 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.206301 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-etc-sysconfig\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.206389 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.206323 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ceaba4c9-2e0e-45d6-a060-9033db497249-dbus\") pod \"global-pull-secret-syncer-cd8cb\" (UID: \"ceaba4c9-2e0e-45d6-a060-9033db497249\") " pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:13.206389 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.206348 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-host-cni-bin\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.206389 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.206371 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-lib-modules\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.206576 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.206435 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-run-systemd\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.206576 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.206505 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mlvt\" (UniqueName: \"kubernetes.io/projected/1412064f-459e-4d05-9771-f48e3fdf62b1-kube-api-access-6mlvt\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.206576 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.206547 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-run-ovn\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.206689 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.206582 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1412064f-459e-4d05-9771-f48e3fdf62b1-ovn-node-metrics-cert\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.206689 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.206610 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-etc-sysctl-d\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.206689 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.206628 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-sys\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.206848 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.206680 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-host\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.206848 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.206716 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/edd82459-428f-4d73-86c1-f75e5b8b0fd6-etc-tuned\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.206848 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.206744 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgtfn\" (UniqueName: \"kubernetes.io/projected/0e0bcb41-a6ca-4334-b790-165d44925258-kube-api-access-pgtfn\") pod \"network-metrics-daemon-nbsjk\" (UID: \"0e0bcb41-a6ca-4334-b790-165d44925258\") " pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:13.206848 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.206769 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-systemd-units\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.206848 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.206800 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-log-socket\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.206848 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.206823 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1412064f-459e-4d05-9771-f48e3fdf62b1-ovnkube-config\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.207122 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.206851 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frkff\" (UniqueName: \"kubernetes.io/projected/7f32c561-c9cd-4f88-8f31-303673c53503-kube-api-access-frkff\") pod \"node-resolver-t7jhz\" (UID: \"7f32c561-c9cd-4f88-8f31-303673c53503\") " pod="openshift-dns/node-resolver-t7jhz" Jun 05 17:49:13.207122 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.206882 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-host-slash\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.207122 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.206916 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.207122 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.206945 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8121e0ee-fe1b-414e-9a15-c073dbddb81f-os-release\") pod \"multus-additional-cni-plugins-sbdm2\" (UID: \"8121e0ee-fe1b-414e-9a15-c073dbddb81f\") " pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.207122 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.206986 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8121e0ee-fe1b-414e-9a15-c073dbddb81f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sbdm2\" (UID: \"8121e0ee-fe1b-414e-9a15-c073dbddb81f\") " pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.207122 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207008 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-run-openvswitch\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.207122 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207027 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsqqv\" (UniqueName: \"kubernetes.io/projected/8121e0ee-fe1b-414e-9a15-c073dbddb81f-kube-api-access-jsqqv\") pod \"multus-additional-cni-plugins-sbdm2\" (UID: \"8121e0ee-fe1b-414e-9a15-c073dbddb81f\") " pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.207122 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207055 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-var-lib-kubelet\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.207122 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207076 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs\") pod \"network-metrics-daemon-nbsjk\" (UID: \"0e0bcb41-a6ca-4334-b790-165d44925258\") " pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:13.207122 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207093 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-etc-openvswitch\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.207597 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207137 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1412064f-459e-4d05-9771-f48e3fdf62b1-ovnkube-script-lib\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.207597 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207157 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8121e0ee-fe1b-414e-9a15-c073dbddb81f-cni-binary-copy\") pod \"multus-additional-cni-plugins-sbdm2\" (UID: \"8121e0ee-fe1b-414e-9a15-c073dbddb81f\") " pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.207597 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207173 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/18237004-740d-4413-8ba4-9817e0d59f46-socket-dir\") pod \"aws-ebs-csi-driver-node-njkdb\" (UID: \"18237004-740d-4413-8ba4-9817e0d59f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" Jun 05 17:49:13.207597 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207191 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-etc-systemd\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.207597 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207220 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz9c5\" (UniqueName: \"kubernetes.io/projected/935d4fd0-70b3-44bd-b083-3ff1e61b3710-kube-api-access-vz9c5\") pod \"network-check-target-kq6rg\" (UID: \"935d4fd0-70b3-44bd-b083-3ff1e61b3710\") " pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:13.207597 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207260 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-etc-sysctl-conf\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.207597 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207284 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edd82459-428f-4d73-86c1-f75e5b8b0fd6-tmp\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.207597 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207316 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6gzb\" (UniqueName: \"kubernetes.io/projected/edd82459-428f-4d73-86c1-f75e5b8b0fd6-kube-api-access-v6gzb\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.207597 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207339 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/18237004-740d-4413-8ba4-9817e0d59f46-device-dir\") pod \"aws-ebs-csi-driver-node-njkdb\" (UID: \"18237004-740d-4413-8ba4-9817e0d59f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" Jun 05 17:49:13.207597 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207359 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llfrz\" (UniqueName: \"kubernetes.io/projected/18237004-740d-4413-8ba4-9817e0d59f46-kube-api-access-llfrz\") pod \"aws-ebs-csi-driver-node-njkdb\" (UID: \"18237004-740d-4413-8ba4-9817e0d59f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" Jun 05 17:49:13.207597 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207372 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-run\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.207597 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207410 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/823d3bd4-667c-4582-a9c6-d54db925edf4-agent-certs\") pod \"konnectivity-agent-v67cc\" (UID: \"823d3bd4-667c-4582-a9c6-d54db925edf4\") " pod="kube-system/konnectivity-agent-v67cc" Jun 05 17:49:13.207597 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207443 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vrjd\" (UniqueName: \"kubernetes.io/projected/9f55e627-03d9-48da-ba1a-0c0fb6b40398-kube-api-access-9vrjd\") pod \"node-ca-wlsj8\" (UID: \"9f55e627-03d9-48da-ba1a-0c0fb6b40398\") " pod="openshift-image-registry/node-ca-wlsj8" Jun 05 17:49:13.207597 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207473 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/18237004-740d-4413-8ba4-9817e0d59f46-registration-dir\") pod \"aws-ebs-csi-driver-node-njkdb\" (UID: \"18237004-740d-4413-8ba4-9817e0d59f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" Jun 05 17:49:13.207597 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207537 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-etc-kubernetes\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.207597 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207566 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-host-kubelet\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.208189 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207601 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-etc-modprobe-d\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.208189 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207628 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-host-run-netns\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.208189 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207663 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-node-log\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.208189 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207684 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/823d3bd4-667c-4582-a9c6-d54db925edf4-konnectivity-ca\") pod \"konnectivity-agent-v67cc\" (UID: \"823d3bd4-667c-4582-a9c6-d54db925edf4\") " pod="kube-system/konnectivity-agent-v67cc" Jun 05 17:49:13.208189 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207710 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1412064f-459e-4d05-9771-f48e3fdf62b1-env-overrides\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.208189 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207732 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8121e0ee-fe1b-414e-9a15-c073dbddb81f-system-cni-dir\") pod \"multus-additional-cni-plugins-sbdm2\" (UID: \"8121e0ee-fe1b-414e-9a15-c073dbddb81f\") " pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.208189 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207754 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8121e0ee-fe1b-414e-9a15-c073dbddb81f-cnibin\") pod \"multus-additional-cni-plugins-sbdm2\" (UID: \"8121e0ee-fe1b-414e-9a15-c073dbddb81f\") " pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.208189 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207776 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/18237004-740d-4413-8ba4-9817e0d59f46-kubelet-dir\") pod \"aws-ebs-csi-driver-node-njkdb\" (UID: \"18237004-740d-4413-8ba4-9817e0d59f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" Jun 05 17:49:13.208189 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207797 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f32c561-c9cd-4f88-8f31-303673c53503-tmp-dir\") pod \"node-resolver-t7jhz\" (UID: \"7f32c561-c9cd-4f88-8f31-303673c53503\") " pod="openshift-dns/node-resolver-t7jhz" Jun 05 17:49:13.208189 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207820 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8121e0ee-fe1b-414e-9a15-c073dbddb81f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sbdm2\" (UID: \"8121e0ee-fe1b-414e-9a15-c073dbddb81f\") " pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.208189 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207844 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/18237004-740d-4413-8ba4-9817e0d59f46-etc-selinux\") pod \"aws-ebs-csi-driver-node-njkdb\" (UID: \"18237004-740d-4413-8ba4-9817e0d59f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" Jun 05 17:49:13.208189 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207865 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7f32c561-c9cd-4f88-8f31-303673c53503-hosts-file\") pod \"node-resolver-t7jhz\" (UID: \"7f32c561-c9cd-4f88-8f31-303673c53503\") " pod="openshift-dns/node-resolver-t7jhz" Jun 05 17:49:13.208189 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207889 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceaba4c9-2e0e-45d6-a060-9033db497249-original-pull-secret\") pod \"global-pull-secret-syncer-cd8cb\" (UID: \"ceaba4c9-2e0e-45d6-a060-9033db497249\") " pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:13.208189 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207924 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-var-lib-openvswitch\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.208189 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207955 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-host-cni-netd\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.208189 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.207981 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8121e0ee-fe1b-414e-9a15-c073dbddb81f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sbdm2\" (UID: \"8121e0ee-fe1b-414e-9a15-c073dbddb81f\") " pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.208802 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.208003 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f55e627-03d9-48da-ba1a-0c0fb6b40398-host\") pod \"node-ca-wlsj8\" (UID: \"9f55e627-03d9-48da-ba1a-0c0fb6b40398\") " pod="openshift-image-registry/node-ca-wlsj8" Jun 05 17:49:13.208802 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.208025 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f55e627-03d9-48da-ba1a-0c0fb6b40398-serviceca\") pod \"node-ca-wlsj8\" (UID: \"9f55e627-03d9-48da-ba1a-0c0fb6b40398\") " pod="openshift-image-registry/node-ca-wlsj8" Jun 05 17:49:13.208802 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.208054 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ceaba4c9-2e0e-45d6-a060-9033db497249-kubelet-config\") pod \"global-pull-secret-syncer-cd8cb\" (UID: \"ceaba4c9-2e0e-45d6-a060-9033db497249\") " pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:13.208802 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.208079 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.209338 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.209322 2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 17:49:13.228690 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.228669 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hftms" Jun 05 17:49:13.238629 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.238576 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hftms" Jun 05 17:49:13.297809 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.297784 2553 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 17:49:13.308705 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.308678 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-os-release\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.308705 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.308705 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-cni-binary-copy\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.308894 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.308734 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-lib-modules\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.308894 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.308757 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-run-systemd\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.308894 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.308813 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-run-systemd\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.308894 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.308830 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mlvt\" (UniqueName: \"kubernetes.io/projected/1412064f-459e-4d05-9771-f48e3fdf62b1-kube-api-access-6mlvt\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.308894 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.308873 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-multus-conf-dir\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.309129 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.308911 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-multus-daemon-config\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.309129 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.308918 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-lib-modules\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.309129 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.308948 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-run-ovn\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.309129 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.308973 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1412064f-459e-4d05-9771-f48e3fdf62b1-ovn-node-metrics-cert\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.309129 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309009 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-run-ovn\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.309129 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309025 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-etc-sysctl-d\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.309129 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309040 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-sys\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.309129 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309059 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-host\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.309129 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309074 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/edd82459-428f-4d73-86c1-f75e5b8b0fd6-etc-tuned\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.309129 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309089 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgtfn\" (UniqueName: \"kubernetes.io/projected/0e0bcb41-a6ca-4334-b790-165d44925258-kube-api-access-pgtfn\") pod \"network-metrics-daemon-nbsjk\" (UID: \"0e0bcb41-a6ca-4334-b790-165d44925258\") " pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:13.309129 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309106 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-systemd-units\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.309661 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309140 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-sys\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.309661 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309128 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-log-socket\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.309661 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309174 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-systemd-units\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.309661 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309185 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1412064f-459e-4d05-9771-f48e3fdf62b1-ovnkube-config\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.309661 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309180 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-log-socket\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.309661 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309211 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frkff\" (UniqueName: \"kubernetes.io/projected/7f32c561-c9cd-4f88-8f31-303673c53503-kube-api-access-frkff\") pod \"node-resolver-t7jhz\" (UID: \"7f32c561-c9cd-4f88-8f31-303673c53503\") " pod="openshift-dns/node-resolver-t7jhz" Jun 05 17:49:13.309661 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309217 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-host\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.309661 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309222 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-etc-sysctl-d\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.309661 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309251 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-host-slash\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.309661 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309277 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.309661 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309302 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8121e0ee-fe1b-414e-9a15-c073dbddb81f-os-release\") pod \"multus-additional-cni-plugins-sbdm2\" (UID: \"8121e0ee-fe1b-414e-9a15-c073dbddb81f\") " pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.309661 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309324 2553 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 17:49:13.309661 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309360 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8121e0ee-fe1b-414e-9a15-c073dbddb81f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sbdm2\" (UID: \"8121e0ee-fe1b-414e-9a15-c073dbddb81f\") " pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.309661 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309378 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-host-slash\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.309661 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309404 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.309661 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309387 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-host-run-k8s-cni-cncf-io\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.309661 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309443 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-host-var-lib-kubelet\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.309661 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309448 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8121e0ee-fe1b-414e-9a15-c073dbddb81f-os-release\") pod \"multus-additional-cni-plugins-sbdm2\" (UID: \"8121e0ee-fe1b-414e-9a15-c073dbddb81f\") " pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.310498 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309464 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-etc-kubernetes\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.310498 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309493 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-run-openvswitch\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.310498 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309529 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsqqv\" (UniqueName: \"kubernetes.io/projected/8121e0ee-fe1b-414e-9a15-c073dbddb81f-kube-api-access-jsqqv\") pod \"multus-additional-cni-plugins-sbdm2\" (UID: \"8121e0ee-fe1b-414e-9a15-c073dbddb81f\") " pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.310498 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309554 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc36eb63-6d8d-40f7-878c-b9a1ae4200f6-host-slash\") pod \"iptables-alerter-pf5g7\" (UID: \"cc36eb63-6d8d-40f7-878c-b9a1ae4200f6\") " pod="openshift-network-operator/iptables-alerter-pf5g7" Jun 05 17:49:13.310498 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309584 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-var-lib-kubelet\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.310498 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309617 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-run-openvswitch\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.310498 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309677 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs\") pod \"network-metrics-daemon-nbsjk\" (UID: \"0e0bcb41-a6ca-4334-b790-165d44925258\") " pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:13.310498 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309702 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-var-lib-kubelet\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.310498 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309753 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-etc-openvswitch\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.310498 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:13.309785 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:13.310498 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309790 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1412064f-459e-4d05-9771-f48e3fdf62b1-ovnkube-script-lib\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.310498 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309814 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8121e0ee-fe1b-414e-9a15-c073dbddb81f-cni-binary-copy\") pod \"multus-additional-cni-plugins-sbdm2\" (UID: \"8121e0ee-fe1b-414e-9a15-c073dbddb81f\") " pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.310498 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309824 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1412064f-459e-4d05-9771-f48e3fdf62b1-ovnkube-config\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.310498 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309867 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-etc-openvswitch\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.310498 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:13.309894 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs podName:0e0bcb41-a6ca-4334-b790-165d44925258 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:13.80983437 +0000 UTC m=+2.999813533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs") pod "network-metrics-daemon-nbsjk" (UID: "0e0bcb41-a6ca-4334-b790-165d44925258") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:13.310498 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309913 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-system-cni-dir\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.310498 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309943 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmf98\" (UniqueName: \"kubernetes.io/projected/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-kube-api-access-lmf98\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.311320 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309976 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/18237004-740d-4413-8ba4-9817e0d59f46-socket-dir\") pod \"aws-ebs-csi-driver-node-njkdb\" (UID: \"18237004-740d-4413-8ba4-9817e0d59f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" Jun 05 17:49:13.311320 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.309980 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8121e0ee-fe1b-414e-9a15-c073dbddb81f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sbdm2\" (UID: \"8121e0ee-fe1b-414e-9a15-c073dbddb81f\") " pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.311320 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310005 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-etc-systemd\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.311320 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310030 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz9c5\" (UniqueName: \"kubernetes.io/projected/935d4fd0-70b3-44bd-b083-3ff1e61b3710-kube-api-access-vz9c5\") pod \"network-check-target-kq6rg\" (UID: \"935d4fd0-70b3-44bd-b083-3ff1e61b3710\") " pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:13.311320 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310059 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-host-var-lib-cni-bin\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.311320 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310089 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-hostroot\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.311320 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310112 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-etc-systemd\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.311320 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310117 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-etc-sysctl-conf\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.311320 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310113 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/18237004-740d-4413-8ba4-9817e0d59f46-socket-dir\") pod \"aws-ebs-csi-driver-node-njkdb\" (UID: \"18237004-740d-4413-8ba4-9817e0d59f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" Jun 05 17:49:13.311320 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310150 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edd82459-428f-4d73-86c1-f75e5b8b0fd6-tmp\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.311320 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310211 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6gzb\" (UniqueName: \"kubernetes.io/projected/edd82459-428f-4d73-86c1-f75e5b8b0fd6-kube-api-access-v6gzb\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.311320 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310256 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/18237004-740d-4413-8ba4-9817e0d59f46-device-dir\") pod \"aws-ebs-csi-driver-node-njkdb\" (UID: \"18237004-740d-4413-8ba4-9817e0d59f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" Jun 05 17:49:13.311320 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310268 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-etc-sysctl-conf\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.311320 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310301 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llfrz\" (UniqueName: \"kubernetes.io/projected/18237004-740d-4413-8ba4-9817e0d59f46-kube-api-access-llfrz\") pod \"aws-ebs-csi-driver-node-njkdb\" (UID: \"18237004-740d-4413-8ba4-9817e0d59f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" Jun 05 17:49:13.311320 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310319 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/18237004-740d-4413-8ba4-9817e0d59f46-device-dir\") pod \"aws-ebs-csi-driver-node-njkdb\" (UID: \"18237004-740d-4413-8ba4-9817e0d59f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" Jun 05 17:49:13.311320 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310329 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-run\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.311320 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310365 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8121e0ee-fe1b-414e-9a15-c073dbddb81f-cni-binary-copy\") pod \"multus-additional-cni-plugins-sbdm2\" (UID: \"8121e0ee-fe1b-414e-9a15-c073dbddb81f\") " pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.312056 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310373 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/823d3bd4-667c-4582-a9c6-d54db925edf4-agent-certs\") pod \"konnectivity-agent-v67cc\" (UID: \"823d3bd4-667c-4582-a9c6-d54db925edf4\") " pod="kube-system/konnectivity-agent-v67cc" Jun 05 17:49:13.312056 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310408 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-multus-socket-dir-parent\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.312056 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310475 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1412064f-459e-4d05-9771-f48e3fdf62b1-ovnkube-script-lib\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.312056 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310519 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vrjd\" (UniqueName: \"kubernetes.io/projected/9f55e627-03d9-48da-ba1a-0c0fb6b40398-kube-api-access-9vrjd\") pod \"node-ca-wlsj8\" (UID: \"9f55e627-03d9-48da-ba1a-0c0fb6b40398\") " pod="openshift-image-registry/node-ca-wlsj8" Jun 05 17:49:13.312056 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310546 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/18237004-740d-4413-8ba4-9817e0d59f46-registration-dir\") pod \"aws-ebs-csi-driver-node-njkdb\" (UID: \"18237004-740d-4413-8ba4-9817e0d59f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" Jun 05 17:49:13.312056 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310576 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-run\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.312056 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310587 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-etc-kubernetes\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.312056 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310645 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-host-kubelet\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.312056 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310659 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/18237004-740d-4413-8ba4-9817e0d59f46-registration-dir\") pod \"aws-ebs-csi-driver-node-njkdb\" (UID: \"18237004-740d-4413-8ba4-9817e0d59f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" Jun 05 17:49:13.312056 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310712 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cc36eb63-6d8d-40f7-878c-b9a1ae4200f6-iptables-alerter-script\") pod \"iptables-alerter-pf5g7\" (UID: \"cc36eb63-6d8d-40f7-878c-b9a1ae4200f6\") " pod="openshift-network-operator/iptables-alerter-pf5g7" Jun 05 17:49:13.312056 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310720 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-etc-kubernetes\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.312056 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310739 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-multus-cni-dir\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.312056 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310784 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-host-kubelet\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.312056 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310840 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-etc-modprobe-d\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.312056 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310893 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-host-run-netns\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.312056 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310956 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-node-log\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.312056 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310973 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-etc-modprobe-d\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.312892 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.310982 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-host-run-multus-certs\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.312892 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311016 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/823d3bd4-667c-4582-a9c6-d54db925edf4-konnectivity-ca\") pod \"konnectivity-agent-v67cc\" (UID: \"823d3bd4-667c-4582-a9c6-d54db925edf4\") " pod="kube-system/konnectivity-agent-v67cc" Jun 05 17:49:13.312892 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311032 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-host-run-netns\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.312892 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311059 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-node-log\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.312892 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311075 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1412064f-459e-4d05-9771-f48e3fdf62b1-env-overrides\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.312892 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311098 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8121e0ee-fe1b-414e-9a15-c073dbddb81f-system-cni-dir\") pod \"multus-additional-cni-plugins-sbdm2\" (UID: \"8121e0ee-fe1b-414e-9a15-c073dbddb81f\") " pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.312892 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311132 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8121e0ee-fe1b-414e-9a15-c073dbddb81f-cnibin\") pod \"multus-additional-cni-plugins-sbdm2\" (UID: \"8121e0ee-fe1b-414e-9a15-c073dbddb81f\") " pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.312892 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311159 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rknf7\" (UniqueName: \"kubernetes.io/projected/cc36eb63-6d8d-40f7-878c-b9a1ae4200f6-kube-api-access-rknf7\") pod \"iptables-alerter-pf5g7\" (UID: \"cc36eb63-6d8d-40f7-878c-b9a1ae4200f6\") " pod="openshift-network-operator/iptables-alerter-pf5g7" Jun 05 17:49:13.312892 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311199 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/18237004-740d-4413-8ba4-9817e0d59f46-kubelet-dir\") pod \"aws-ebs-csi-driver-node-njkdb\" (UID: \"18237004-740d-4413-8ba4-9817e0d59f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" Jun 05 17:49:13.312892 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311269 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f32c561-c9cd-4f88-8f31-303673c53503-tmp-dir\") pod \"node-resolver-t7jhz\" (UID: \"7f32c561-c9cd-4f88-8f31-303673c53503\") " pod="openshift-dns/node-resolver-t7jhz" Jun 05 17:49:13.312892 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311307 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8121e0ee-fe1b-414e-9a15-c073dbddb81f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sbdm2\" (UID: \"8121e0ee-fe1b-414e-9a15-c073dbddb81f\") " pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.312892 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311345 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-host-run-netns\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.312892 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311379 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/18237004-740d-4413-8ba4-9817e0d59f46-etc-selinux\") pod \"aws-ebs-csi-driver-node-njkdb\" (UID: \"18237004-740d-4413-8ba4-9817e0d59f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" Jun 05 17:49:13.312892 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311403 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7f32c561-c9cd-4f88-8f31-303673c53503-hosts-file\") pod \"node-resolver-t7jhz\" (UID: \"7f32c561-c9cd-4f88-8f31-303673c53503\") " pod="openshift-dns/node-resolver-t7jhz" Jun 05 17:49:13.312892 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311489 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceaba4c9-2e0e-45d6-a060-9033db497249-original-pull-secret\") pod \"global-pull-secret-syncer-cd8cb\" (UID: \"ceaba4c9-2e0e-45d6-a060-9033db497249\") " pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:13.312892 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311512 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-var-lib-openvswitch\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.312892 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311541 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-host-cni-netd\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.313791 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311561 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8121e0ee-fe1b-414e-9a15-c073dbddb81f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sbdm2\" (UID: \"8121e0ee-fe1b-414e-9a15-c073dbddb81f\") " pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.313791 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311581 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-host-var-lib-cni-multus\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.313791 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311608 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1412064f-459e-4d05-9771-f48e3fdf62b1-env-overrides\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.313791 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311816 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/18237004-740d-4413-8ba4-9817e0d59f46-kubelet-dir\") pod \"aws-ebs-csi-driver-node-njkdb\" (UID: \"18237004-740d-4413-8ba4-9817e0d59f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" Jun 05 17:49:13.313791 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311660 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/823d3bd4-667c-4582-a9c6-d54db925edf4-konnectivity-ca\") pod \"konnectivity-agent-v67cc\" (UID: \"823d3bd4-667c-4582-a9c6-d54db925edf4\") " pod="kube-system/konnectivity-agent-v67cc" Jun 05 17:49:13.313791 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311662 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f55e627-03d9-48da-ba1a-0c0fb6b40398-host\") pod \"node-ca-wlsj8\" (UID: \"9f55e627-03d9-48da-ba1a-0c0fb6b40398\") " pod="openshift-image-registry/node-ca-wlsj8" Jun 05 17:49:13.313791 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311712 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8121e0ee-fe1b-414e-9a15-c073dbddb81f-system-cni-dir\") pod \"multus-additional-cni-plugins-sbdm2\" (UID: \"8121e0ee-fe1b-414e-9a15-c073dbddb81f\") " pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.313791 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311734 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/18237004-740d-4413-8ba4-9817e0d59f46-etc-selinux\") pod \"aws-ebs-csi-driver-node-njkdb\" (UID: \"18237004-740d-4413-8ba4-9817e0d59f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" Jun 05 17:49:13.313791 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311770 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8121e0ee-fe1b-414e-9a15-c073dbddb81f-cnibin\") pod \"multus-additional-cni-plugins-sbdm2\" (UID: \"8121e0ee-fe1b-414e-9a15-c073dbddb81f\") " pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.313791 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311865 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f55e627-03d9-48da-ba1a-0c0fb6b40398-serviceca\") pod \"node-ca-wlsj8\" (UID: \"9f55e627-03d9-48da-ba1a-0c0fb6b40398\") " pod="openshift-image-registry/node-ca-wlsj8" Jun 05 17:49:13.313791 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311792 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7f32c561-c9cd-4f88-8f31-303673c53503-hosts-file\") pod \"node-resolver-t7jhz\" (UID: \"7f32c561-c9cd-4f88-8f31-303673c53503\") " pod="openshift-dns/node-resolver-t7jhz" Jun 05 17:49:13.313791 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:13.311892 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:13.313791 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311898 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ceaba4c9-2e0e-45d6-a060-9033db497249-kubelet-config\") pod \"global-pull-secret-syncer-cd8cb\" (UID: \"ceaba4c9-2e0e-45d6-a060-9033db497249\") " pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:13.313791 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311928 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.313791 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311982 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/18237004-740d-4413-8ba4-9817e0d59f46-sys-fs\") pod \"aws-ebs-csi-driver-node-njkdb\" (UID: \"18237004-740d-4413-8ba4-9817e0d59f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" Jun 05 17:49:13.313791 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.312009 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-etc-sysconfig\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.313791 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.312032 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ceaba4c9-2e0e-45d6-a060-9033db497249-dbus\") pod \"global-pull-secret-syncer-cd8cb\" (UID: \"ceaba4c9-2e0e-45d6-a060-9033db497249\") " pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:13.313791 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.312040 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-var-lib-openvswitch\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.314666 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.312056 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-host-cni-bin\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.314666 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.312083 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-cnibin\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.314666 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.312093 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-host-cni-netd\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.314666 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.312326 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/edd82459-428f-4d73-86c1-f75e5b8b0fd6-etc-tuned\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.314666 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.312333 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f55e627-03d9-48da-ba1a-0c0fb6b40398-serviceca\") pod \"node-ca-wlsj8\" (UID: \"9f55e627-03d9-48da-ba1a-0c0fb6b40398\") " pod="openshift-image-registry/node-ca-wlsj8" Jun 05 17:49:13.314666 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.311738 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f55e627-03d9-48da-ba1a-0c0fb6b40398-host\") pod \"node-ca-wlsj8\" (UID: \"9f55e627-03d9-48da-ba1a-0c0fb6b40398\") " pod="openshift-image-registry/node-ca-wlsj8" Jun 05 17:49:13.314666 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.312457 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ceaba4c9-2e0e-45d6-a060-9033db497249-dbus\") pod \"global-pull-secret-syncer-cd8cb\" (UID: \"ceaba4c9-2e0e-45d6-a060-9033db497249\") " pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:13.314666 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.312463 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f32c561-c9cd-4f88-8f31-303673c53503-tmp-dir\") pod \"node-resolver-t7jhz\" (UID: \"7f32c561-c9cd-4f88-8f31-303673c53503\") " pod="openshift-dns/node-resolver-t7jhz" Jun 05 17:49:13.314666 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:13.312490 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceaba4c9-2e0e-45d6-a060-9033db497249-original-pull-secret podName:ceaba4c9-2e0e-45d6-a060-9033db497249 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:13.812474547 +0000 UTC m=+3.002453710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ceaba4c9-2e0e-45d6-a060-9033db497249-original-pull-secret") pod "global-pull-secret-syncer-cd8cb" (UID: "ceaba4c9-2e0e-45d6-a060-9033db497249") : object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:13.314666 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.312492 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8121e0ee-fe1b-414e-9a15-c073dbddb81f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sbdm2\" (UID: \"8121e0ee-fe1b-414e-9a15-c073dbddb81f\") " pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.314666 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.312512 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-host-cni-bin\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.314666 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.312534 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ceaba4c9-2e0e-45d6-a060-9033db497249-kubelet-config\") pod \"global-pull-secret-syncer-cd8cb\" (UID: \"ceaba4c9-2e0e-45d6-a060-9033db497249\") " pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:13.314666 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.312552 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1412064f-459e-4d05-9771-f48e3fdf62b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.314666 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.312564 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/edd82459-428f-4d73-86c1-f75e5b8b0fd6-etc-sysconfig\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.314666 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.312582 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/18237004-740d-4413-8ba4-9817e0d59f46-sys-fs\") pod \"aws-ebs-csi-driver-node-njkdb\" (UID: \"18237004-740d-4413-8ba4-9817e0d59f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" Jun 05 17:49:13.314666 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.312680 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8121e0ee-fe1b-414e-9a15-c073dbddb81f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sbdm2\" (UID: \"8121e0ee-fe1b-414e-9a15-c073dbddb81f\") " pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.314666 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.312886 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edd82459-428f-4d73-86c1-f75e5b8b0fd6-tmp\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.315468 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.313170 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1412064f-459e-4d05-9771-f48e3fdf62b1-ovn-node-metrics-cert\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.315468 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.313295 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/823d3bd4-667c-4582-a9c6-d54db925edf4-agent-certs\") pod \"konnectivity-agent-v67cc\" (UID: \"823d3bd4-667c-4582-a9c6-d54db925edf4\") " pod="kube-system/konnectivity-agent-v67cc" Jun 05 17:49:13.319179 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.317608 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgtfn\" (UniqueName: \"kubernetes.io/projected/0e0bcb41-a6ca-4334-b790-165d44925258-kube-api-access-pgtfn\") pod \"network-metrics-daemon-nbsjk\" (UID: \"0e0bcb41-a6ca-4334-b790-165d44925258\") " pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:13.319531 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.319505 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frkff\" (UniqueName: \"kubernetes.io/projected/7f32c561-c9cd-4f88-8f31-303673c53503-kube-api-access-frkff\") pod \"node-resolver-t7jhz\" (UID: \"7f32c561-c9cd-4f88-8f31-303673c53503\") " pod="openshift-dns/node-resolver-t7jhz" Jun 05 17:49:13.321446 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.321422 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mlvt\" (UniqueName: \"kubernetes.io/projected/1412064f-459e-4d05-9771-f48e3fdf62b1-kube-api-access-6mlvt\") pod \"ovnkube-node-7z87q\" (UID: \"1412064f-459e-4d05-9771-f48e3fdf62b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.321545 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:13.321505 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 17:49:13.321545 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:13.321521 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 17:49:13.321545 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:13.321534 2553 projected.go:196] Error preparing data for projected volume kube-api-access-vz9c5 for pod openshift-network-diagnostics/network-check-target-kq6rg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:13.321687 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:13.321585 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/935d4fd0-70b3-44bd-b083-3ff1e61b3710-kube-api-access-vz9c5 podName:935d4fd0-70b3-44bd-b083-3ff1e61b3710 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:13.821569267 +0000 UTC m=+3.011548433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vz9c5" (UniqueName: "kubernetes.io/projected/935d4fd0-70b3-44bd-b083-3ff1e61b3710-kube-api-access-vz9c5") pod "network-check-target-kq6rg" (UID: "935d4fd0-70b3-44bd-b083-3ff1e61b3710") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:13.323404 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.323383 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsqqv\" (UniqueName: \"kubernetes.io/projected/8121e0ee-fe1b-414e-9a15-c073dbddb81f-kube-api-access-jsqqv\") pod \"multus-additional-cni-plugins-sbdm2\" (UID: \"8121e0ee-fe1b-414e-9a15-c073dbddb81f\") " pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.323804 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.323784 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llfrz\" (UniqueName: \"kubernetes.io/projected/18237004-740d-4413-8ba4-9817e0d59f46-kube-api-access-llfrz\") pod \"aws-ebs-csi-driver-node-njkdb\" (UID: \"18237004-740d-4413-8ba4-9817e0d59f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" Jun 05 17:49:13.324360 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.324342 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vrjd\" (UniqueName: \"kubernetes.io/projected/9f55e627-03d9-48da-ba1a-0c0fb6b40398-kube-api-access-9vrjd\") pod \"node-ca-wlsj8\" (UID: \"9f55e627-03d9-48da-ba1a-0c0fb6b40398\") " pod="openshift-image-registry/node-ca-wlsj8" Jun 05 17:49:13.324807 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.324789 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6gzb\" (UniqueName: \"kubernetes.io/projected/edd82459-428f-4d73-86c1-f75e5b8b0fd6-kube-api-access-v6gzb\") pod \"tuned-k6678\" (UID: \"edd82459-428f-4d73-86c1-f75e5b8b0fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.412964 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.412931 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-multus-socket-dir-parent\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.413142 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.412980 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cc36eb63-6d8d-40f7-878c-b9a1ae4200f6-iptables-alerter-script\") pod \"iptables-alerter-pf5g7\" (UID: \"cc36eb63-6d8d-40f7-878c-b9a1ae4200f6\") " pod="openshift-network-operator/iptables-alerter-pf5g7" Jun 05 17:49:13.413142 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413005 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-multus-cni-dir\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.413142 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413009 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-multus-socket-dir-parent\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.413142 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413047 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-host-run-multus-certs\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.413142 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413069 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-multus-cni-dir\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.413142 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413075 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rknf7\" (UniqueName: \"kubernetes.io/projected/cc36eb63-6d8d-40f7-878c-b9a1ae4200f6-kube-api-access-rknf7\") pod \"iptables-alerter-pf5g7\" (UID: \"cc36eb63-6d8d-40f7-878c-b9a1ae4200f6\") " pod="openshift-network-operator/iptables-alerter-pf5g7" Jun 05 17:49:13.413142 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413103 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-host-run-netns\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.413142 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413108 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-host-run-multus-certs\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.413532 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413153 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-host-run-netns\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.413532 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413220 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-host-var-lib-cni-multus\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.413532 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413285 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-cnibin\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.413532 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413312 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-os-release\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.413532 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413335 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-cni-binary-copy\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.413532 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413368 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-multus-conf-dir\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.413532 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413376 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-host-var-lib-cni-multus\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.413532 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413391 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-multus-daemon-config\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.413532 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413392 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-cnibin\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.413532 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413424 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-os-release\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.413532 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413426 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-multus-conf-dir\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.413532 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413516 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-host-run-k8s-cni-cncf-io\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.414081 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413544 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-host-var-lib-kubelet\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.414081 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413583 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-host-run-k8s-cni-cncf-io\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.414081 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413594 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-etc-kubernetes\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.414081 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413622 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc36eb63-6d8d-40f7-878c-b9a1ae4200f6-host-slash\") pod \"iptables-alerter-pf5g7\" (UID: \"cc36eb63-6d8d-40f7-878c-b9a1ae4200f6\") " pod="openshift-network-operator/iptables-alerter-pf5g7" Jun 05 17:49:13.414081 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413632 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-host-var-lib-kubelet\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.414081 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413630 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cc36eb63-6d8d-40f7-878c-b9a1ae4200f6-iptables-alerter-script\") pod \"iptables-alerter-pf5g7\" (UID: \"cc36eb63-6d8d-40f7-878c-b9a1ae4200f6\") " pod="openshift-network-operator/iptables-alerter-pf5g7" Jun 05 17:49:13.414081 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413666 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-system-cni-dir\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.414081 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413677 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc36eb63-6d8d-40f7-878c-b9a1ae4200f6-host-slash\") pod \"iptables-alerter-pf5g7\" (UID: \"cc36eb63-6d8d-40f7-878c-b9a1ae4200f6\") " pod="openshift-network-operator/iptables-alerter-pf5g7" Jun 05 17:49:13.414081 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413703 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-system-cni-dir\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.414081 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413706 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmf98\" (UniqueName: \"kubernetes.io/projected/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-kube-api-access-lmf98\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.414081 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413714 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-etc-kubernetes\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.414081 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413748 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-host-var-lib-cni-bin\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.414081 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413764 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-hostroot\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.414081 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413828 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-hostroot\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.414081 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413830 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-host-var-lib-cni-bin\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.414081 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.413948 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-cni-binary-copy\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.414081 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.414009 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-multus-daemon-config\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.424899 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.424875 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rknf7\" (UniqueName: \"kubernetes.io/projected/cc36eb63-6d8d-40f7-878c-b9a1ae4200f6-kube-api-access-rknf7\") pod \"iptables-alerter-pf5g7\" (UID: \"cc36eb63-6d8d-40f7-878c-b9a1ae4200f6\") " pod="openshift-network-operator/iptables-alerter-pf5g7" Jun 05 17:49:13.425183 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.425166 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmf98\" (UniqueName: \"kubernetes.io/projected/939d3ed8-32b9-48f4-85e8-4ca3bfb226ec-kube-api-access-lmf98\") pod \"multus-svjbf\" (UID: \"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec\") " pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.501451 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.501330 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:13.509560 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.509539 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t7jhz" Jun 05 17:49:13.517726 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.517706 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" Jun 05 17:49:13.522338 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.522322 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k6678" Jun 05 17:49:13.529906 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.529885 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sbdm2" Jun 05 17:49:13.540499 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.540479 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v67cc" Jun 05 17:49:13.546947 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.546926 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wlsj8" Jun 05 17:49:13.554375 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.554355 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pf5g7" Jun 05 17:49:13.555851 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.555832 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-svjbf" Jun 05 17:49:13.816406 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.816337 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceaba4c9-2e0e-45d6-a060-9033db497249-original-pull-secret\") pod \"global-pull-secret-syncer-cd8cb\" (UID: \"ceaba4c9-2e0e-45d6-a060-9033db497249\") " pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:13.816406 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.816405 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs\") pod \"network-metrics-daemon-nbsjk\" (UID: \"0e0bcb41-a6ca-4334-b790-165d44925258\") " pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:13.816626 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:13.816471 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:13.816626 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:13.816499 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:13.816626 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:13.816555 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceaba4c9-2e0e-45d6-a060-9033db497249-original-pull-secret podName:ceaba4c9-2e0e-45d6-a060-9033db497249 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:14.816533048 +0000 UTC m=+4.006512204 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ceaba4c9-2e0e-45d6-a060-9033db497249-original-pull-secret") pod "global-pull-secret-syncer-cd8cb" (UID: "ceaba4c9-2e0e-45d6-a060-9033db497249") : object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:13.816626 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:13.816580 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs podName:0e0bcb41-a6ca-4334-b790-165d44925258 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:14.816568532 +0000 UTC m=+4.006547681 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs") pod "network-metrics-daemon-nbsjk" (UID: "0e0bcb41-a6ca-4334-b790-165d44925258") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:13.917464 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:13.917359 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz9c5\" (UniqueName: \"kubernetes.io/projected/935d4fd0-70b3-44bd-b083-3ff1e61b3710-kube-api-access-vz9c5\") pod \"network-check-target-kq6rg\" (UID: \"935d4fd0-70b3-44bd-b083-3ff1e61b3710\") " pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:13.917641 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:13.917494 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 17:49:13.917641 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:13.917519 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 17:49:13.917641 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:13.917531 2553 projected.go:196] Error preparing data for projected volume kube-api-access-vz9c5 for pod openshift-network-diagnostics/network-check-target-kq6rg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:13.917641 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:13.917585 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/935d4fd0-70b3-44bd-b083-3ff1e61b3710-kube-api-access-vz9c5 podName:935d4fd0-70b3-44bd-b083-3ff1e61b3710 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:14.917567708 +0000 UTC m=+4.107546864 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vz9c5" (UniqueName: "kubernetes.io/projected/935d4fd0-70b3-44bd-b083-3ff1e61b3710-kube-api-access-vz9c5") pod "network-check-target-kq6rg" (UID: "935d4fd0-70b3-44bd-b083-3ff1e61b3710") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:13.967930 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:13.967810 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc36eb63_6d8d_40f7_878c_b9a1ae4200f6.slice/crio-3f09922124ea805d9cd8d749f6be157ef33980bb88477ab78ddd808a018c9f2b WatchSource:0}: Error finding container 3f09922124ea805d9cd8d749f6be157ef33980bb88477ab78ddd808a018c9f2b: Status 404 returned error can't find the container with id 3f09922124ea805d9cd8d749f6be157ef33980bb88477ab78ddd808a018c9f2b Jun 05 17:49:13.969893 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:13.969857 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod823d3bd4_667c_4582_a9c6_d54db925edf4.slice/crio-8490226e53890003fa263134642efb3ac841bc33d5ce9ac3cfb3e75b1a5f7b44 WatchSource:0}: Error finding container 8490226e53890003fa263134642efb3ac841bc33d5ce9ac3cfb3e75b1a5f7b44: Status 404 returned error can't find the container with id 8490226e53890003fa263134642efb3ac841bc33d5ce9ac3cfb3e75b1a5f7b44 Jun 05 17:49:13.972620 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:13.972538 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f32c561_c9cd_4f88_8f31_303673c53503.slice/crio-262923ef8b604c7963f7b72ca1d4929c767e2275fe7805b348b9c5ca8b6a1bce WatchSource:0}: Error finding container 262923ef8b604c7963f7b72ca1d4929c767e2275fe7805b348b9c5ca8b6a1bce: Status 404 returned error can't find the container with id 262923ef8b604c7963f7b72ca1d4929c767e2275fe7805b348b9c5ca8b6a1bce Jun 05 17:49:13.974298 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:13.974272 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1412064f_459e_4d05_9771_f48e3fdf62b1.slice/crio-e04471b415aff280433bb5e4d570a10b23a5193641a19290bf43fcfe8641659f WatchSource:0}: Error finding container e04471b415aff280433bb5e4d570a10b23a5193641a19290bf43fcfe8641659f: Status 404 returned error can't find the container with id e04471b415aff280433bb5e4d570a10b23a5193641a19290bf43fcfe8641659f Jun 05 17:49:13.975076 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:13.975045 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8121e0ee_fe1b_414e_9a15_c073dbddb81f.slice/crio-4f1481b6939f50e22492eef236090557833ab1eaa9696564b5d9bcb9e16b3815 WatchSource:0}: Error finding container 4f1481b6939f50e22492eef236090557833ab1eaa9696564b5d9bcb9e16b3815: Status 404 returned error can't find the container with id 4f1481b6939f50e22492eef236090557833ab1eaa9696564b5d9bcb9e16b3815 Jun 05 17:49:13.976138 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:13.976005 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod939d3ed8_32b9_48f4_85e8_4ca3bfb226ec.slice/crio-3a82e89ee2b1cec86ebc2ae0ee09c5508dbfd6088da35dfdc7aedf3653543076 WatchSource:0}: Error finding container 3a82e89ee2b1cec86ebc2ae0ee09c5508dbfd6088da35dfdc7aedf3653543076: Status 404 returned error can't find the container with id 3a82e89ee2b1cec86ebc2ae0ee09c5508dbfd6088da35dfdc7aedf3653543076 Jun 05 17:49:13.977624 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:13.977575 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f55e627_03d9_48da_ba1a_0c0fb6b40398.slice/crio-97bb352e2b93f509a8241e57eecc134db1854cf342a9ebb47ba53530827da08a WatchSource:0}: Error finding container 97bb352e2b93f509a8241e57eecc134db1854cf342a9ebb47ba53530827da08a: Status 404 returned error can't find the container with id 97bb352e2b93f509a8241e57eecc134db1854cf342a9ebb47ba53530827da08a Jun 05 17:49:13.979322 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:13.979209 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedd82459_428f_4d73_86c1_f75e5b8b0fd6.slice/crio-5b1e41cb697876a2c84585018c70c53bbadb23d58dc8887f8c699ed5e80ff943 WatchSource:0}: Error finding container 5b1e41cb697876a2c84585018c70c53bbadb23d58dc8887f8c699ed5e80ff943: Status 404 returned error can't find the container with id 5b1e41cb697876a2c84585018c70c53bbadb23d58dc8887f8c699ed5e80ff943 Jun 05 17:49:13.980559 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:13.980522 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18237004_740d_4413_8ba4_9817e0d59f46.slice/crio-6e853d87bf9d5921a75dcb64c7f86c5bdad99f3ca869fa355783ef9c54bdd7aa WatchSource:0}: Error finding container 6e853d87bf9d5921a75dcb64c7f86c5bdad99f3ca869fa355783ef9c54bdd7aa: Status 404 returned error can't find the container with id 6e853d87bf9d5921a75dcb64c7f86c5bdad99f3ca869fa355783ef9c54bdd7aa Jun 05 17:49:14.240391 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:14.240350 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 17:44:13 +0000 UTC" deadline="2028-01-22 00:02:55.557913202 +0000 UTC" Jun 05 17:49:14.240391 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:14.240391 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14286h13m41.317526014s" Jun 05 17:49:14.274672 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:14.274639 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-199.ec2.internal" event={"ID":"2da0c469e1f6c43dd080495b19164f17","Type":"ContainerStarted","Data":"5c5a889fbd94db6b19215be457d9962507d054856be8d8a4eeaeb8c094ab0b78"} Jun 05 17:49:14.276728 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:14.276547 2553 generic.go:356] "Generic (PLEG): container finished" podID="4ffecca0816be25591ea66d893555604" containerID="fce40b8daa8b83aa122f55ddb881e56328757dfed5c47bf9f513b5f251f591fd" exitCode=0 Jun 05 17:49:14.276728 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:14.276655 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-199.ec2.internal" event={"ID":"4ffecca0816be25591ea66d893555604","Type":"ContainerDied","Data":"fce40b8daa8b83aa122f55ddb881e56328757dfed5c47bf9f513b5f251f591fd"} Jun 05 17:49:14.278445 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:14.278396 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k6678" event={"ID":"edd82459-428f-4d73-86c1-f75e5b8b0fd6","Type":"ContainerStarted","Data":"5b1e41cb697876a2c84585018c70c53bbadb23d58dc8887f8c699ed5e80ff943"} Jun 05 17:49:14.280518 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:14.280493 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wlsj8" event={"ID":"9f55e627-03d9-48da-ba1a-0c0fb6b40398","Type":"ContainerStarted","Data":"97bb352e2b93f509a8241e57eecc134db1854cf342a9ebb47ba53530827da08a"} Jun 05 17:49:14.282729 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:14.282681 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbdm2" event={"ID":"8121e0ee-fe1b-414e-9a15-c073dbddb81f","Type":"ContainerStarted","Data":"4f1481b6939f50e22492eef236090557833ab1eaa9696564b5d9bcb9e16b3815"} Jun 05 17:49:14.285943 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:14.285919 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-svjbf" event={"ID":"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec","Type":"ContainerStarted","Data":"3a82e89ee2b1cec86ebc2ae0ee09c5508dbfd6088da35dfdc7aedf3653543076"} Jun 05 17:49:14.288641 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:14.288526 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" event={"ID":"1412064f-459e-4d05-9771-f48e3fdf62b1","Type":"ContainerStarted","Data":"e04471b415aff280433bb5e4d570a10b23a5193641a19290bf43fcfe8641659f"} Jun 05 17:49:14.290390 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:14.290341 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-199.ec2.internal" podStartSLOduration=2.290324055 podStartE2EDuration="2.290324055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:49:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:14.289738162 +0000 UTC m=+3.479717332" watchObservedRunningTime="2026-06-05 17:49:14.290324055 +0000 UTC m=+3.480303229" Jun 05 17:49:14.291328 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:14.291229 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" event={"ID":"18237004-740d-4413-8ba4-9817e0d59f46","Type":"ContainerStarted","Data":"6e853d87bf9d5921a75dcb64c7f86c5bdad99f3ca869fa355783ef9c54bdd7aa"} Jun 05 17:49:14.293474 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:14.293406 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t7jhz" event={"ID":"7f32c561-c9cd-4f88-8f31-303673c53503","Type":"ContainerStarted","Data":"262923ef8b604c7963f7b72ca1d4929c767e2275fe7805b348b9c5ca8b6a1bce"} Jun 05 17:49:14.295830 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:14.295776 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v67cc" event={"ID":"823d3bd4-667c-4582-a9c6-d54db925edf4","Type":"ContainerStarted","Data":"8490226e53890003fa263134642efb3ac841bc33d5ce9ac3cfb3e75b1a5f7b44"} Jun 05 17:49:14.297323 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:14.297276 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pf5g7" event={"ID":"cc36eb63-6d8d-40f7-878c-b9a1ae4200f6","Type":"ContainerStarted","Data":"3f09922124ea805d9cd8d749f6be157ef33980bb88477ab78ddd808a018c9f2b"} Jun 05 17:49:14.823682 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:14.822788 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs\") pod \"network-metrics-daemon-nbsjk\" (UID: \"0e0bcb41-a6ca-4334-b790-165d44925258\") " pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:14.823682 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:14.822877 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceaba4c9-2e0e-45d6-a060-9033db497249-original-pull-secret\") pod \"global-pull-secret-syncer-cd8cb\" (UID: \"ceaba4c9-2e0e-45d6-a060-9033db497249\") " pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:14.823682 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:14.823023 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:14.823682 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:14.823106 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceaba4c9-2e0e-45d6-a060-9033db497249-original-pull-secret podName:ceaba4c9-2e0e-45d6-a060-9033db497249 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:16.823066804 +0000 UTC m=+6.013045969 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ceaba4c9-2e0e-45d6-a060-9033db497249-original-pull-secret") pod "global-pull-secret-syncer-cd8cb" (UID: "ceaba4c9-2e0e-45d6-a060-9033db497249") : object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:14.823682 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:14.823536 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:14.823682 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:14.823586 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs podName:0e0bcb41-a6ca-4334-b790-165d44925258 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:16.823571992 +0000 UTC m=+6.013551143 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs") pod "network-metrics-daemon-nbsjk" (UID: "0e0bcb41-a6ca-4334-b790-165d44925258") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:14.923789 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:14.923750 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz9c5\" (UniqueName: \"kubernetes.io/projected/935d4fd0-70b3-44bd-b083-3ff1e61b3710-kube-api-access-vz9c5\") pod \"network-check-target-kq6rg\" (UID: \"935d4fd0-70b3-44bd-b083-3ff1e61b3710\") " pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:14.923970 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:14.923911 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 17:49:14.923970 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:14.923933 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 17:49:14.923970 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:14.923946 2553 projected.go:196] Error preparing data for projected volume kube-api-access-vz9c5 for pod openshift-network-diagnostics/network-check-target-kq6rg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:14.924124 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:14.924002 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/935d4fd0-70b3-44bd-b083-3ff1e61b3710-kube-api-access-vz9c5 podName:935d4fd0-70b3-44bd-b083-3ff1e61b3710 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:16.923983492 +0000 UTC m=+6.113962647 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vz9c5" (UniqueName: "kubernetes.io/projected/935d4fd0-70b3-44bd-b083-3ff1e61b3710-kube-api-access-vz9c5") pod "network-check-target-kq6rg" (UID: "935d4fd0-70b3-44bd-b083-3ff1e61b3710") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:15.240833 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:15.240740 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 17:44:13 +0000 UTC" deadline="2028-01-02 03:20:59.242520317 +0000 UTC" Jun 05 17:49:15.240833 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:15.240783 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13809h31m44.001741815s" Jun 05 17:49:15.267566 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:15.267532 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:15.267711 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:15.267658 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq6rg" podUID="935d4fd0-70b3-44bd-b083-3ff1e61b3710" Jun 05 17:49:15.267770 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:15.267738 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:15.267835 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:15.267819 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbsjk" podUID="0e0bcb41-a6ca-4334-b790-165d44925258" Jun 05 17:49:15.267902 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:15.267877 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:15.267971 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:15.267950 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cd8cb" podUID="ceaba4c9-2e0e-45d6-a060-9033db497249" Jun 05 17:49:15.313771 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:15.313702 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-199.ec2.internal" event={"ID":"4ffecca0816be25591ea66d893555604","Type":"ContainerStarted","Data":"5f9372f41beebf22bb96a5aeccaabb509d3566d68ee0cd20885fb956f776ab2e"} Jun 05 17:49:16.839062 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:16.839026 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceaba4c9-2e0e-45d6-a060-9033db497249-original-pull-secret\") pod \"global-pull-secret-syncer-cd8cb\" (UID: \"ceaba4c9-2e0e-45d6-a060-9033db497249\") " pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:16.839603 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:16.839097 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs\") pod \"network-metrics-daemon-nbsjk\" (UID: \"0e0bcb41-a6ca-4334-b790-165d44925258\") " pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:16.839603 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:16.839195 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:16.839603 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:16.839269 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:16.839603 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:16.839284 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceaba4c9-2e0e-45d6-a060-9033db497249-original-pull-secret podName:ceaba4c9-2e0e-45d6-a060-9033db497249 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:20.839264488 +0000 UTC m=+10.029243641 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ceaba4c9-2e0e-45d6-a060-9033db497249-original-pull-secret") pod "global-pull-secret-syncer-cd8cb" (UID: "ceaba4c9-2e0e-45d6-a060-9033db497249") : object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:16.839603 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:16.839329 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs podName:0e0bcb41-a6ca-4334-b790-165d44925258 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:20.839313481 +0000 UTC m=+10.029292633 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs") pod "network-metrics-daemon-nbsjk" (UID: "0e0bcb41-a6ca-4334-b790-165d44925258") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:16.939644 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:16.939599 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz9c5\" (UniqueName: \"kubernetes.io/projected/935d4fd0-70b3-44bd-b083-3ff1e61b3710-kube-api-access-vz9c5\") pod \"network-check-target-kq6rg\" (UID: \"935d4fd0-70b3-44bd-b083-3ff1e61b3710\") " pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:16.939812 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:16.939753 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 17:49:16.939812 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:16.939772 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 17:49:16.939812 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:16.939784 2553 projected.go:196] Error preparing data for projected volume kube-api-access-vz9c5 for pod openshift-network-diagnostics/network-check-target-kq6rg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:16.939962 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:16.939839 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/935d4fd0-70b3-44bd-b083-3ff1e61b3710-kube-api-access-vz9c5 podName:935d4fd0-70b3-44bd-b083-3ff1e61b3710 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:20.939821692 +0000 UTC m=+10.129800840 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vz9c5" (UniqueName: "kubernetes.io/projected/935d4fd0-70b3-44bd-b083-3ff1e61b3710-kube-api-access-vz9c5") pod "network-check-target-kq6rg" (UID: "935d4fd0-70b3-44bd-b083-3ff1e61b3710") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:17.264852 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:17.264775 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:17.265006 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:17.264775 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:17.265006 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:17.264909 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cd8cb" podUID="ceaba4c9-2e0e-45d6-a060-9033db497249" Jun 05 17:49:17.265115 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:17.265052 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbsjk" podUID="0e0bcb41-a6ca-4334-b790-165d44925258" Jun 05 17:49:17.265115 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:17.264775 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:17.265220 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:17.265142 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq6rg" podUID="935d4fd0-70b3-44bd-b083-3ff1e61b3710" Jun 05 17:49:19.264079 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:19.264046 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:19.264525 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:19.264182 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cd8cb" podUID="ceaba4c9-2e0e-45d6-a060-9033db497249" Jun 05 17:49:19.264525 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:19.264195 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:19.264525 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:19.264323 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbsjk" podUID="0e0bcb41-a6ca-4334-b790-165d44925258" Jun 05 17:49:19.264525 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:19.264058 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:19.264525 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:19.264407 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq6rg" podUID="935d4fd0-70b3-44bd-b083-3ff1e61b3710" Jun 05 17:49:20.876569 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:20.876311 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs\") pod \"network-metrics-daemon-nbsjk\" (UID: \"0e0bcb41-a6ca-4334-b790-165d44925258\") " pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:20.876569 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:20.876401 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceaba4c9-2e0e-45d6-a060-9033db497249-original-pull-secret\") pod \"global-pull-secret-syncer-cd8cb\" (UID: \"ceaba4c9-2e0e-45d6-a060-9033db497249\") " pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:20.876569 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:20.876445 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:20.876569 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:20.876502 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:20.876569 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:20.876504 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs podName:0e0bcb41-a6ca-4334-b790-165d44925258 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:28.876485872 +0000 UTC m=+18.066465036 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs") pod "network-metrics-daemon-nbsjk" (UID: "0e0bcb41-a6ca-4334-b790-165d44925258") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:20.876569 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:20.876547 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceaba4c9-2e0e-45d6-a060-9033db497249-original-pull-secret podName:ceaba4c9-2e0e-45d6-a060-9033db497249 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:28.876534349 +0000 UTC m=+18.066513514 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ceaba4c9-2e0e-45d6-a060-9033db497249-original-pull-secret") pod "global-pull-secret-syncer-cd8cb" (UID: "ceaba4c9-2e0e-45d6-a060-9033db497249") : object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:20.977151 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:20.977052 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz9c5\" (UniqueName: \"kubernetes.io/projected/935d4fd0-70b3-44bd-b083-3ff1e61b3710-kube-api-access-vz9c5\") pod \"network-check-target-kq6rg\" (UID: \"935d4fd0-70b3-44bd-b083-3ff1e61b3710\") " pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:20.977355 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:20.977214 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 17:49:20.977355 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:20.977255 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 17:49:20.977355 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:20.977270 2553 projected.go:196] Error preparing data for projected volume kube-api-access-vz9c5 for pod openshift-network-diagnostics/network-check-target-kq6rg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:20.977355 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:20.977332 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/935d4fd0-70b3-44bd-b083-3ff1e61b3710-kube-api-access-vz9c5 podName:935d4fd0-70b3-44bd-b083-3ff1e61b3710 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:28.977312019 +0000 UTC m=+18.167291169 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vz9c5" (UniqueName: "kubernetes.io/projected/935d4fd0-70b3-44bd-b083-3ff1e61b3710-kube-api-access-vz9c5") pod "network-check-target-kq6rg" (UID: "935d4fd0-70b3-44bd-b083-3ff1e61b3710") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:21.266537 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:21.265278 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:21.266537 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:21.265407 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cd8cb" podUID="ceaba4c9-2e0e-45d6-a060-9033db497249" Jun 05 17:49:21.266537 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:21.265627 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:21.266537 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:21.265742 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq6rg" podUID="935d4fd0-70b3-44bd-b083-3ff1e61b3710" Jun 05 17:49:21.266537 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:21.265797 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:21.266537 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:21.265876 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbsjk" podUID="0e0bcb41-a6ca-4334-b790-165d44925258" Jun 05 17:49:23.265261 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:23.264211 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:23.265261 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:23.264344 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cd8cb" podUID="ceaba4c9-2e0e-45d6-a060-9033db497249" Jun 05 17:49:23.265261 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:23.264731 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:23.265261 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:23.264817 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq6rg" podUID="935d4fd0-70b3-44bd-b083-3ff1e61b3710" Jun 05 17:49:23.265261 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:23.264882 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:23.265261 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:23.264987 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbsjk" podUID="0e0bcb41-a6ca-4334-b790-165d44925258" Jun 05 17:49:25.264554 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:25.264352 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:25.265000 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:25.264358 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:25.265000 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:25.264649 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cd8cb" podUID="ceaba4c9-2e0e-45d6-a060-9033db497249" Jun 05 17:49:25.265000 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:25.264366 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:25.265000 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:25.264721 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq6rg" podUID="935d4fd0-70b3-44bd-b083-3ff1e61b3710" Jun 05 17:49:25.265000 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:25.264819 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbsjk" podUID="0e0bcb41-a6ca-4334-b790-165d44925258" Jun 05 17:49:27.264177 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:27.264139 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:27.264632 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:27.264145 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:27.264632 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:27.264282 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq6rg" podUID="935d4fd0-70b3-44bd-b083-3ff1e61b3710" Jun 05 17:49:27.264632 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:27.264153 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:27.264632 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:27.264343 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cd8cb" podUID="ceaba4c9-2e0e-45d6-a060-9033db497249" Jun 05 17:49:27.264632 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:27.264461 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbsjk" podUID="0e0bcb41-a6ca-4334-b790-165d44925258" Jun 05 17:49:28.933436 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:28.933405 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceaba4c9-2e0e-45d6-a060-9033db497249-original-pull-secret\") pod \"global-pull-secret-syncer-cd8cb\" (UID: \"ceaba4c9-2e0e-45d6-a060-9033db497249\") " pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:28.933892 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:28.933474 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs\") pod \"network-metrics-daemon-nbsjk\" (UID: \"0e0bcb41-a6ca-4334-b790-165d44925258\") " pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:28.933892 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:28.933578 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:28.933892 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:28.933648 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs podName:0e0bcb41-a6ca-4334-b790-165d44925258 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:44.933625031 +0000 UTC m=+34.123604187 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs") pod "network-metrics-daemon-nbsjk" (UID: "0e0bcb41-a6ca-4334-b790-165d44925258") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:28.933892 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:28.933578 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:28.933892 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:28.933743 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceaba4c9-2e0e-45d6-a060-9033db497249-original-pull-secret podName:ceaba4c9-2e0e-45d6-a060-9033db497249 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:44.933722527 +0000 UTC m=+34.123701679 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ceaba4c9-2e0e-45d6-a060-9033db497249-original-pull-secret") pod "global-pull-secret-syncer-cd8cb" (UID: "ceaba4c9-2e0e-45d6-a060-9033db497249") : object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:29.034750 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:29.034718 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz9c5\" (UniqueName: \"kubernetes.io/projected/935d4fd0-70b3-44bd-b083-3ff1e61b3710-kube-api-access-vz9c5\") pod \"network-check-target-kq6rg\" (UID: \"935d4fd0-70b3-44bd-b083-3ff1e61b3710\") " pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:29.034924 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:29.034885 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 17:49:29.034924 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:29.034909 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 17:49:29.034924 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:29.034924 2553 projected.go:196] Error preparing data for projected volume kube-api-access-vz9c5 for pod openshift-network-diagnostics/network-check-target-kq6rg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:29.035063 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:29.034988 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/935d4fd0-70b3-44bd-b083-3ff1e61b3710-kube-api-access-vz9c5 podName:935d4fd0-70b3-44bd-b083-3ff1e61b3710 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:45.034969627 +0000 UTC m=+34.224948781 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vz9c5" (UniqueName: "kubernetes.io/projected/935d4fd0-70b3-44bd-b083-3ff1e61b3710-kube-api-access-vz9c5") pod "network-check-target-kq6rg" (UID: "935d4fd0-70b3-44bd-b083-3ff1e61b3710") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:29.267140 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:29.267067 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:29.267140 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:29.267119 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:29.267358 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:29.267231 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:29.267358 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:29.267257 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbsjk" podUID="0e0bcb41-a6ca-4334-b790-165d44925258" Jun 05 17:49:29.267358 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:29.267337 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq6rg" podUID="935d4fd0-70b3-44bd-b083-3ff1e61b3710" Jun 05 17:49:29.267494 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:29.267429 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cd8cb" podUID="ceaba4c9-2e0e-45d6-a060-9033db497249" Jun 05 17:49:31.265637 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:31.265589 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:31.266103 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:31.265694 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq6rg" podUID="935d4fd0-70b3-44bd-b083-3ff1e61b3710" Jun 05 17:49:31.266103 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:31.265707 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:31.266103 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:31.265793 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:31.266103 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:31.265892 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cd8cb" podUID="ceaba4c9-2e0e-45d6-a060-9033db497249" Jun 05 17:49:31.266103 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:31.266019 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbsjk" podUID="0e0bcb41-a6ca-4334-b790-165d44925258" Jun 05 17:49:33.265917 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:33.265725 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:33.266633 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:33.265937 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cd8cb" podUID="ceaba4c9-2e0e-45d6-a060-9033db497249" Jun 05 17:49:33.266633 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:33.266287 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:33.266633 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:33.266401 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq6rg" podUID="935d4fd0-70b3-44bd-b083-3ff1e61b3710" Jun 05 17:49:33.266633 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:33.266458 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:33.266633 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:33.266544 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbsjk" podUID="0e0bcb41-a6ca-4334-b790-165d44925258" Jun 05 17:49:33.379953 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:33.379932 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z87q_1412064f-459e-4d05-9771-f48e3fdf62b1/ovn-acl-logging/0.log" Jun 05 17:49:33.380202 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:33.380181 2553 generic.go:356] "Generic (PLEG): container finished" podID="1412064f-459e-4d05-9771-f48e3fdf62b1" containerID="75bc628e1541d811e05fceae1627bd1c9c9b88b7a0454d40959d2917ebc7f945" exitCode=1 Jun 05 17:49:33.380313 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:33.380253 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" event={"ID":"1412064f-459e-4d05-9771-f48e3fdf62b1","Type":"ContainerStarted","Data":"73d111c8518633f13d4bd47450566d4a01bab0543418487e739b05a950aa34ce"} Jun 05 17:49:33.380376 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:33.380316 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" event={"ID":"1412064f-459e-4d05-9771-f48e3fdf62b1","Type":"ContainerDied","Data":"75bc628e1541d811e05fceae1627bd1c9c9b88b7a0454d40959d2917ebc7f945"} Jun 05 17:49:33.380376 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:33.380350 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" event={"ID":"1412064f-459e-4d05-9771-f48e3fdf62b1","Type":"ContainerStarted","Data":"9c05d6e56d63ac590dfe9ac268b3d2515d74798361df0acce0fd50870d847509"} Jun 05 17:49:33.381617 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:33.381593 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" event={"ID":"18237004-740d-4413-8ba4-9817e0d59f46","Type":"ContainerStarted","Data":"dfd14daabfd023306cc56e9715687855f629d1b68ecf1e4ddd94125e13a02077"} Jun 05 17:49:33.382807 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:33.382780 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t7jhz" event={"ID":"7f32c561-c9cd-4f88-8f31-303673c53503","Type":"ContainerStarted","Data":"01c13ef987086566a6379271260a4d644a82686e0f472e368c461549e3d7efec"} Jun 05 17:49:33.384526 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:33.384502 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v67cc" event={"ID":"823d3bd4-667c-4582-a9c6-d54db925edf4","Type":"ContainerStarted","Data":"3ab972488352968591c8208ec558ec921dcc8e71380c0621a647baeea1ddfac2"} Jun 05 17:49:33.385926 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:33.385894 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k6678" event={"ID":"edd82459-428f-4d73-86c1-f75e5b8b0fd6","Type":"ContainerStarted","Data":"34e10c088811b4615ffb84a65ea330632cee8e0538c46ed5b2e754a2903b25f3"} Jun 05 17:49:33.389990 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:33.389952 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wlsj8" event={"ID":"9f55e627-03d9-48da-ba1a-0c0fb6b40398","Type":"ContainerStarted","Data":"a3bd0d2270926d1873567d620d6b603cbfe556c7522cab8bd9ea1e68028f8444"} Jun 05 17:49:33.391707 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:33.391682 2553 generic.go:356] "Generic (PLEG): container finished" podID="8121e0ee-fe1b-414e-9a15-c073dbddb81f" containerID="2ee5dc299335fbef14126d59c68e08c53cd946b4aa217c201f3e5321ff09ca5c" exitCode=0 Jun 05 17:49:33.391801 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:33.391760 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbdm2" event={"ID":"8121e0ee-fe1b-414e-9a15-c073dbddb81f","Type":"ContainerDied","Data":"2ee5dc299335fbef14126d59c68e08c53cd946b4aa217c201f3e5321ff09ca5c"} Jun 05 17:49:33.393953 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:33.393926 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-svjbf" event={"ID":"939d3ed8-32b9-48f4-85e8-4ca3bfb226ec","Type":"ContainerStarted","Data":"7531503cfee5b8d8feff0c5ed0870dccc84df933b627045b98014f32b157a764"} Jun 05 17:49:33.403699 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:33.403652 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-t7jhz" podStartSLOduration=3.46164236 podStartE2EDuration="22.403625489s" totalImagesPullingTime="18.941983129s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:33.403545909 +0000 UTC m=+22.593525079" watchObservedRunningTime="2026-06-05 17:49:33.403625489 +0000 UTC m=+22.593604659" Jun 05 17:49:33.403852 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:33.403823 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-199.ec2.internal" podStartSLOduration=21.40381434 podStartE2EDuration="21.40381434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:49:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:15.331279463 +0000 UTC m=+4.521258633" watchObservedRunningTime="2026-06-05 17:49:33.40381434 +0000 UTC m=+22.593793510" Jun 05 17:49:33.418403 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:33.418368 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wlsj8" podStartSLOduration=3.481143128 podStartE2EDuration="22.418356067s" totalImagesPullingTime="18.937212939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:33.418120416 +0000 UTC m=+22.608099587" watchObservedRunningTime="2026-06-05 17:49:33.418356067 +0000 UTC m=+22.608335236" Jun 05 17:49:33.457497 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:33.457457 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k6678" podStartSLOduration=3.520084191 podStartE2EDuration="22.457442117s" totalImagesPullingTime="18.937357926s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:33.457361203 +0000 UTC m=+22.647340369" watchObservedRunningTime="2026-06-05 17:49:33.457442117 +0000 UTC m=+22.647421286" Jun 05 17:49:33.457759 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:33.457741 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-svjbf" podStartSLOduration=3.256294763 podStartE2EDuration="22.457736739s" totalImagesPullingTime="19.201441976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:33.437295306 +0000 UTC m=+22.627274474" watchObservedRunningTime="2026-06-05 17:49:33.457736739 +0000 UTC m=+22.647715931" Jun 05 17:49:33.476393 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:33.476351 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-v67cc" podStartSLOduration=11.817316745 podStartE2EDuration="22.476338265s" totalImagesPullingTime="10.65902152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:33.475434917 +0000 UTC m=+22.665414085" watchObservedRunningTime="2026-06-05 17:49:33.476338265 +0000 UTC m=+22.666317433" Jun 05 17:49:34.399727 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:34.399699 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z87q_1412064f-459e-4d05-9771-f48e3fdf62b1/ovn-acl-logging/0.log" Jun 05 17:49:34.400199 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:34.400173 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" event={"ID":"1412064f-459e-4d05-9771-f48e3fdf62b1","Type":"ContainerStarted","Data":"fa0d96303cf0a4481c0113b3c57e7de346f19f740393f13a9b6d6a98b998bf3e"} Jun 05 17:49:34.400328 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:34.400308 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" event={"ID":"1412064f-459e-4d05-9771-f48e3fdf62b1","Type":"ContainerStarted","Data":"fb149759b7eef811673afee09f586a8487e5bf1ea3c2de663190d0bd6f9c9656"} Jun 05 17:49:34.400449 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:34.400356 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" event={"ID":"1412064f-459e-4d05-9771-f48e3fdf62b1","Type":"ContainerStarted","Data":"ac044b7c58ef3c68b09517675f983aa721def26a76124e7713844fddc7cb6b19"} Jun 05 17:49:34.402198 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:34.402124 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pf5g7" event={"ID":"cc36eb63-6d8d-40f7-878c-b9a1ae4200f6","Type":"ContainerStarted","Data":"6389ac41375195ca3f20718a673130aedca510d78c4a7bbf0a0fb869c46b713a"} Jun 05 17:49:34.422611 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:34.422570 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pf5g7" podStartSLOduration=4.490298374 podStartE2EDuration="23.422556925s" totalImagesPullingTime="18.932258551s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:34.422379474 +0000 UTC m=+23.612358643" watchObservedRunningTime="2026-06-05 17:49:34.422556925 +0000 UTC m=+23.612536095" Jun 05 17:49:34.483685 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:34.483639 2553 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 17:49:35.264408 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:35.264370 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:35.264595 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:35.264370 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:35.264595 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:35.264515 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:35.264595 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:35.264510 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cd8cb" podUID="ceaba4c9-2e0e-45d6-a060-9033db497249" Jun 05 17:49:35.264765 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:35.264603 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq6rg" podUID="935d4fd0-70b3-44bd-b083-3ff1e61b3710" Jun 05 17:49:35.264765 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:35.264686 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbsjk" podUID="0e0bcb41-a6ca-4334-b790-165d44925258" Jun 05 17:49:35.279270 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:35.279188 2553 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T17:49:34.483657312Z","UUID":"44dae7ad-8c59-4a30-b6b9-45039baf328c","Handler":null,"Name":"","Endpoint":""} Jun 05 17:49:35.280980 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:35.280962 2553 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 17:49:35.281112 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:35.280999 2553 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 17:49:35.406343 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:35.406304 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" event={"ID":"18237004-740d-4413-8ba4-9817e0d59f46","Type":"ContainerStarted","Data":"6709933c4280a2d971d668edbfa9ec86c6ee193ba56b1e12a463c2dda1db4785"} Jun 05 17:49:36.412126 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:36.412095 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z87q_1412064f-459e-4d05-9771-f48e3fdf62b1/ovn-acl-logging/0.log" Jun 05 17:49:36.412766 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:36.412561 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" event={"ID":"1412064f-459e-4d05-9771-f48e3fdf62b1","Type":"ContainerStarted","Data":"b6cba3b4a754b7969c2ebba217a0f96a7ac883d95e35cb974725fd4138f9dc14"} Jun 05 17:49:36.417676 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:36.417639 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" event={"ID":"18237004-740d-4413-8ba4-9817e0d59f46","Type":"ContainerStarted","Data":"7cf10d7b7129484e33050a7a3b1a7e741a832ceddcb1c37dc673619ecf915da1"} Jun 05 17:49:36.435776 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:36.435727 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njkdb" podStartSLOduration=4.287396418 podStartE2EDuration="25.435711501s" totalImagesPullingTime="21.148315083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:49:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:36.435462479 +0000 UTC m=+25.625441651" watchObservedRunningTime="2026-06-05 17:49:36.435711501 +0000 UTC m=+25.625690672" Jun 05 17:49:36.491363 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:36.491337 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-v67cc" Jun 05 17:49:36.491873 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:36.491855 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-v67cc" Jun 05 17:49:37.263952 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:37.263921 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:37.264102 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:37.263925 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:37.264102 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:37.264032 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cd8cb" podUID="ceaba4c9-2e0e-45d6-a060-9033db497249" Jun 05 17:49:37.264102 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:37.264050 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:37.264265 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:37.264121 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq6rg" podUID="935d4fd0-70b3-44bd-b083-3ff1e61b3710" Jun 05 17:49:37.264265 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:37.264219 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbsjk" podUID="0e0bcb41-a6ca-4334-b790-165d44925258" Jun 05 17:49:37.420060 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:37.419984 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-v67cc" Jun 05 17:49:37.420723 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:37.420459 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-v67cc" Jun 05 17:49:38.423651 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:38.423415 2553 generic.go:356] "Generic (PLEG): container finished" podID="8121e0ee-fe1b-414e-9a15-c073dbddb81f" containerID="3047ee6f5e0b55588b8926f2efbe25dcd396559ad81718cf619e44828e969f25" exitCode=0 Jun 05 17:49:38.423651 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:38.423460 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbdm2" event={"ID":"8121e0ee-fe1b-414e-9a15-c073dbddb81f","Type":"ContainerDied","Data":"3047ee6f5e0b55588b8926f2efbe25dcd396559ad81718cf619e44828e969f25"} Jun 05 17:49:38.427249 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:38.427218 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z87q_1412064f-459e-4d05-9771-f48e3fdf62b1/ovn-acl-logging/0.log" Jun 05 17:49:38.427635 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:38.427613 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" event={"ID":"1412064f-459e-4d05-9771-f48e3fdf62b1","Type":"ContainerStarted","Data":"a55c093e0a991bf10b4ae11f0f9882f3a9e9db798b23361fbc38382a467d554c"} Jun 05 17:49:38.428089 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:38.428074 2553 scope.go:117] "RemoveContainer" containerID="75bc628e1541d811e05fceae1627bd1c9c9b88b7a0454d40959d2917ebc7f945" Jun 05 17:49:39.264482 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:39.264451 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:39.264482 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:39.264478 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:39.264739 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:39.264459 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:39.264739 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:39.264573 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq6rg" podUID="935d4fd0-70b3-44bd-b083-3ff1e61b3710" Jun 05 17:49:39.264739 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:39.264669 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbsjk" podUID="0e0bcb41-a6ca-4334-b790-165d44925258" Jun 05 17:49:39.264885 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:39.264745 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cd8cb" podUID="ceaba4c9-2e0e-45d6-a060-9033db497249" Jun 05 17:49:39.434223 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:39.434200 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z87q_1412064f-459e-4d05-9771-f48e3fdf62b1/ovn-acl-logging/0.log" Jun 05 17:49:39.434668 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:39.434626 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" event={"ID":"1412064f-459e-4d05-9771-f48e3fdf62b1","Type":"ContainerStarted","Data":"c539a22130c8b81fde2d6410824d6586cf6612375818c8b8d67391e88dd34eb5"} Jun 05 17:49:39.434860 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:39.434836 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:39.434954 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:39.434908 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:39.435013 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:39.434961 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:39.450249 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:39.450210 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:39.450374 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:39.450325 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:49:39.465568 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:39.465530 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" podStartSLOduration=9.501755886 podStartE2EDuration="28.46551657s" totalImagesPullingTime="18.963760684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:39.464259783 +0000 UTC m=+28.654238952" watchObservedRunningTime="2026-06-05 17:49:39.46551657 +0000 UTC m=+28.655495738" Jun 05 17:49:39.945939 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:39.945698 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kq6rg"] Jun 05 17:49:39.946128 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:39.945956 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:39.946128 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:39.946037 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq6rg" podUID="935d4fd0-70b3-44bd-b083-3ff1e61b3710" Jun 05 17:49:39.948219 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:39.948196 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nbsjk"] Jun 05 17:49:39.948335 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:39.948286 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:39.948399 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:39.948371 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbsjk" podUID="0e0bcb41-a6ca-4334-b790-165d44925258" Jun 05 17:49:39.956922 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:39.956898 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cd8cb"] Jun 05 17:49:39.957001 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:39.956984 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:39.957125 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:39.957079 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cd8cb" podUID="ceaba4c9-2e0e-45d6-a060-9033db497249" Jun 05 17:49:40.449592 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:40.449560 2553 generic.go:356] "Generic (PLEG): container finished" podID="8121e0ee-fe1b-414e-9a15-c073dbddb81f" containerID="060efda2b959863c77a35b3d78f323ce0e8c60cc46505e8bbfbc4fef0d2b1604" exitCode=0 Jun 05 17:49:40.450158 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:40.449640 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbdm2" event={"ID":"8121e0ee-fe1b-414e-9a15-c073dbddb81f","Type":"ContainerDied","Data":"060efda2b959863c77a35b3d78f323ce0e8c60cc46505e8bbfbc4fef0d2b1604"} Jun 05 17:49:41.266757 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:41.266733 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:41.266911 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:41.266839 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbsjk" podUID="0e0bcb41-a6ca-4334-b790-165d44925258" Jun 05 17:49:42.264475 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:42.264409 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:42.264866 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:42.264409 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:42.264866 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:42.264502 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq6rg" podUID="935d4fd0-70b3-44bd-b083-3ff1e61b3710" Jun 05 17:49:42.264866 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:42.264584 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cd8cb" podUID="ceaba4c9-2e0e-45d6-a060-9033db497249" Jun 05 17:49:42.457295 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:42.457257 2553 generic.go:356] "Generic (PLEG): container finished" podID="8121e0ee-fe1b-414e-9a15-c073dbddb81f" containerID="9dfbf08c65d1a8fb70149e8c37908995c1de38d6e2f5713ab2509df398031ff8" exitCode=0 Jun 05 17:49:42.457467 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:42.457322 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbdm2" event={"ID":"8121e0ee-fe1b-414e-9a15-c073dbddb81f","Type":"ContainerDied","Data":"9dfbf08c65d1a8fb70149e8c37908995c1de38d6e2f5713ab2509df398031ff8"} Jun 05 17:49:43.264028 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:43.263998 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:43.264193 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:43.264115 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbsjk" podUID="0e0bcb41-a6ca-4334-b790-165d44925258" Jun 05 17:49:44.264450 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:44.264415 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:44.264953 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:44.264426 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:44.264953 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:44.264529 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cd8cb" podUID="ceaba4c9-2e0e-45d6-a060-9033db497249" Jun 05 17:49:44.264953 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:44.264627 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq6rg" podUID="935d4fd0-70b3-44bd-b083-3ff1e61b3710" Jun 05 17:49:44.949113 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:44.948893 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs\") pod \"network-metrics-daemon-nbsjk\" (UID: \"0e0bcb41-a6ca-4334-b790-165d44925258\") " pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:44.949307 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:44.949162 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceaba4c9-2e0e-45d6-a060-9033db497249-original-pull-secret\") pod \"global-pull-secret-syncer-cd8cb\" (UID: \"ceaba4c9-2e0e-45d6-a060-9033db497249\") " pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:44.949307 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:44.949043 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:44.949307 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:44.949258 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs podName:0e0bcb41-a6ca-4334-b790-165d44925258 nodeName:}" failed. No retries permitted until 2026-06-05 17:50:16.949222751 +0000 UTC m=+66.139201913 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs") pod "network-metrics-daemon-nbsjk" (UID: "0e0bcb41-a6ca-4334-b790-165d44925258") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:44.949307 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:44.949288 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:44.949525 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:44.949323 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceaba4c9-2e0e-45d6-a060-9033db497249-original-pull-secret podName:ceaba4c9-2e0e-45d6-a060-9033db497249 nodeName:}" failed. No retries permitted until 2026-06-05 17:50:16.949312157 +0000 UTC m=+66.139291306 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ceaba4c9-2e0e-45d6-a060-9033db497249-original-pull-secret") pod "global-pull-secret-syncer-cd8cb" (UID: "ceaba4c9-2e0e-45d6-a060-9033db497249") : object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:45.050258 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.050208 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz9c5\" (UniqueName: \"kubernetes.io/projected/935d4fd0-70b3-44bd-b083-3ff1e61b3710-kube-api-access-vz9c5\") pod \"network-check-target-kq6rg\" (UID: \"935d4fd0-70b3-44bd-b083-3ff1e61b3710\") " pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:45.050417 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:45.050349 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 17:49:45.050417 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:45.050369 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 17:49:45.050417 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:45.050379 2553 projected.go:196] Error preparing data for projected volume kube-api-access-vz9c5 for pod openshift-network-diagnostics/network-check-target-kq6rg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:45.050545 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:45.050429 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/935d4fd0-70b3-44bd-b083-3ff1e61b3710-kube-api-access-vz9c5 podName:935d4fd0-70b3-44bd-b083-3ff1e61b3710 nodeName:}" failed. No retries permitted until 2026-06-05 17:50:17.050411763 +0000 UTC m=+66.240390923 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vz9c5" (UniqueName: "kubernetes.io/projected/935d4fd0-70b3-44bd-b083-3ff1e61b3710-kube-api-access-vz9c5") pod "network-check-target-kq6rg" (UID: "935d4fd0-70b3-44bd-b083-3ff1e61b3710") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:45.267437 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.267347 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:45.267924 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:45.267468 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbsjk" podUID="0e0bcb41-a6ca-4334-b790-165d44925258" Jun 05 17:49:45.648824 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.648799 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-199.ec2.internal" event="NodeReady" Jun 05 17:49:45.648979 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.648936 2553 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 17:49:45.697422 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.697282 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z7h9r"] Jun 05 17:49:45.699791 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.699771 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z7h9r" Jun 05 17:49:45.702252 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.702217 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 17:49:45.702356 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.702228 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 17:49:45.702356 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.702292 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6c4cc\"" Jun 05 17:49:45.705014 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.704989 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x2wwq"] Jun 05 17:49:45.706686 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.706669 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x2wwq" Jun 05 17:49:45.709324 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.709097 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 17:49:45.709324 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.709165 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xwlsz\"" Jun 05 17:49:45.709324 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.709258 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 17:49:45.709657 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.709638 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 17:49:45.711038 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.711010 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z7h9r"] Jun 05 17:49:45.718639 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.718619 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x2wwq"] Jun 05 17:49:45.856946 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.856865 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sf9s\" (UniqueName: \"kubernetes.io/projected/3d366d70-6cb1-4172-9b93-9606ed9c66ba-kube-api-access-5sf9s\") pod \"ingress-canary-x2wwq\" (UID: \"3d366d70-6cb1-4172-9b93-9606ed9c66ba\") " pod="openshift-ingress-canary/ingress-canary-x2wwq" Jun 05 17:49:45.856946 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.856913 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b586fdc-e65a-4afc-91c4-2f6307527422-tmp-dir\") pod \"dns-default-z7h9r\" (UID: \"0b586fdc-e65a-4afc-91c4-2f6307527422\") " pod="openshift-dns/dns-default-z7h9r" Jun 05 17:49:45.856946 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.856937 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d366d70-6cb1-4172-9b93-9606ed9c66ba-cert\") pod \"ingress-canary-x2wwq\" (UID: \"3d366d70-6cb1-4172-9b93-9606ed9c66ba\") " pod="openshift-ingress-canary/ingress-canary-x2wwq" Jun 05 17:49:45.857219 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.857079 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hplhr\" (UniqueName: \"kubernetes.io/projected/0b586fdc-e65a-4afc-91c4-2f6307527422-kube-api-access-hplhr\") pod \"dns-default-z7h9r\" (UID: \"0b586fdc-e65a-4afc-91c4-2f6307527422\") " pod="openshift-dns/dns-default-z7h9r" Jun 05 17:49:45.857219 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.857124 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0b586fdc-e65a-4afc-91c4-2f6307527422-config-volume\") pod \"dns-default-z7h9r\" (UID: \"0b586fdc-e65a-4afc-91c4-2f6307527422\") " pod="openshift-dns/dns-default-z7h9r" Jun 05 17:49:45.857219 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.857154 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls\") pod \"dns-default-z7h9r\" (UID: \"0b586fdc-e65a-4afc-91c4-2f6307527422\") " pod="openshift-dns/dns-default-z7h9r" Jun 05 17:49:45.958220 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.958178 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b586fdc-e65a-4afc-91c4-2f6307527422-tmp-dir\") pod \"dns-default-z7h9r\" (UID: \"0b586fdc-e65a-4afc-91c4-2f6307527422\") " pod="openshift-dns/dns-default-z7h9r" Jun 05 17:49:45.958425 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.958228 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d366d70-6cb1-4172-9b93-9606ed9c66ba-cert\") pod \"ingress-canary-x2wwq\" (UID: \"3d366d70-6cb1-4172-9b93-9606ed9c66ba\") " pod="openshift-ingress-canary/ingress-canary-x2wwq" Jun 05 17:49:45.958425 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.958314 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hplhr\" (UniqueName: \"kubernetes.io/projected/0b586fdc-e65a-4afc-91c4-2f6307527422-kube-api-access-hplhr\") pod \"dns-default-z7h9r\" (UID: \"0b586fdc-e65a-4afc-91c4-2f6307527422\") " pod="openshift-dns/dns-default-z7h9r" Jun 05 17:49:45.958425 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.958336 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0b586fdc-e65a-4afc-91c4-2f6307527422-config-volume\") pod \"dns-default-z7h9r\" (UID: \"0b586fdc-e65a-4afc-91c4-2f6307527422\") " pod="openshift-dns/dns-default-z7h9r" Jun 05 17:49:45.958425 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.958353 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls\") pod \"dns-default-z7h9r\" (UID: \"0b586fdc-e65a-4afc-91c4-2f6307527422\") " pod="openshift-dns/dns-default-z7h9r" Jun 05 17:49:45.958425 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.958414 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sf9s\" (UniqueName: \"kubernetes.io/projected/3d366d70-6cb1-4172-9b93-9606ed9c66ba-kube-api-access-5sf9s\") pod \"ingress-canary-x2wwq\" (UID: \"3d366d70-6cb1-4172-9b93-9606ed9c66ba\") " pod="openshift-ingress-canary/ingress-canary-x2wwq" Jun 05 17:49:45.958680 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.958643 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b586fdc-e65a-4afc-91c4-2f6307527422-tmp-dir\") pod \"dns-default-z7h9r\" (UID: \"0b586fdc-e65a-4afc-91c4-2f6307527422\") " pod="openshift-dns/dns-default-z7h9r" Jun 05 17:49:45.958737 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:45.958654 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:49:45.958789 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:45.958744 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls podName:0b586fdc-e65a-4afc-91c4-2f6307527422 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:46.458721907 +0000 UTC m=+35.648701062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls") pod "dns-default-z7h9r" (UID: "0b586fdc-e65a-4afc-91c4-2f6307527422") : secret "dns-default-metrics-tls" not found Jun 05 17:49:45.959100 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.959076 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0b586fdc-e65a-4afc-91c4-2f6307527422-config-volume\") pod \"dns-default-z7h9r\" (UID: \"0b586fdc-e65a-4afc-91c4-2f6307527422\") " pod="openshift-dns/dns-default-z7h9r" Jun 05 17:49:45.963201 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.963178 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d366d70-6cb1-4172-9b93-9606ed9c66ba-cert\") pod \"ingress-canary-x2wwq\" (UID: \"3d366d70-6cb1-4172-9b93-9606ed9c66ba\") " pod="openshift-ingress-canary/ingress-canary-x2wwq" Jun 05 17:49:45.969374 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.969347 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hplhr\" (UniqueName: \"kubernetes.io/projected/0b586fdc-e65a-4afc-91c4-2f6307527422-kube-api-access-hplhr\") pod \"dns-default-z7h9r\" (UID: \"0b586fdc-e65a-4afc-91c4-2f6307527422\") " pod="openshift-dns/dns-default-z7h9r" Jun 05 17:49:45.969773 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:45.969756 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sf9s\" (UniqueName: \"kubernetes.io/projected/3d366d70-6cb1-4172-9b93-9606ed9c66ba-kube-api-access-5sf9s\") pod \"ingress-canary-x2wwq\" (UID: \"3d366d70-6cb1-4172-9b93-9606ed9c66ba\") " pod="openshift-ingress-canary/ingress-canary-x2wwq" Jun 05 17:49:46.020253 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:46.020209 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x2wwq" Jun 05 17:49:46.264168 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:46.264085 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:49:46.264168 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:46.264113 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:49:46.267122 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:46.267101 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 17:49:46.268437 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:46.268309 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s9z2b\"" Jun 05 17:49:46.268437 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:46.268325 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 17:49:46.268437 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:46.268325 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 17:49:46.441919 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:46.441895 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x2wwq"] Jun 05 17:49:46.446214 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:49:46.446188 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d366d70_6cb1_4172_9b93_9606ed9c66ba.slice/crio-95ccb413a71f952f145150bcce7375f024fc5348f3bac1a5181952ea91741761 WatchSource:0}: Error finding container 95ccb413a71f952f145150bcce7375f024fc5348f3bac1a5181952ea91741761: Status 404 returned error can't find the container with id 95ccb413a71f952f145150bcce7375f024fc5348f3bac1a5181952ea91741761 Jun 05 17:49:46.462190 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:46.462169 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls\") pod \"dns-default-z7h9r\" (UID: \"0b586fdc-e65a-4afc-91c4-2f6307527422\") " pod="openshift-dns/dns-default-z7h9r" Jun 05 17:49:46.462371 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:46.462354 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:49:46.462438 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:46.462424 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls podName:0b586fdc-e65a-4afc-91c4-2f6307527422 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:47.462403349 +0000 UTC m=+36.652382504 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls") pod "dns-default-z7h9r" (UID: "0b586fdc-e65a-4afc-91c4-2f6307527422") : secret "dns-default-metrics-tls" not found Jun 05 17:49:46.470654 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:46.470629 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbdm2" event={"ID":"8121e0ee-fe1b-414e-9a15-c073dbddb81f","Type":"ContainerStarted","Data":"1e08a5a08d6da67fe5e3a0edca2fb65ac38e2ebe7ad8077bfb7184fc9f55f6ff"} Jun 05 17:49:46.471714 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:46.471694 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x2wwq" event={"ID":"3d366d70-6cb1-4172-9b93-9606ed9c66ba","Type":"ContainerStarted","Data":"95ccb413a71f952f145150bcce7375f024fc5348f3bac1a5181952ea91741761"} Jun 05 17:49:47.264073 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:47.264032 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:49:47.267143 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:47.267117 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 17:49:47.267331 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:47.267165 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-42j2w\"" Jun 05 17:49:47.470186 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:47.470154 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls\") pod \"dns-default-z7h9r\" (UID: \"0b586fdc-e65a-4afc-91c4-2f6307527422\") " pod="openshift-dns/dns-default-z7h9r" Jun 05 17:49:47.470628 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:47.470339 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:49:47.470628 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:47.470409 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls podName:0b586fdc-e65a-4afc-91c4-2f6307527422 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:49.470393448 +0000 UTC m=+38.660372597 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls") pod "dns-default-z7h9r" (UID: "0b586fdc-e65a-4afc-91c4-2f6307527422") : secret "dns-default-metrics-tls" not found Jun 05 17:49:47.477418 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:47.477380 2553 generic.go:356] "Generic (PLEG): container finished" podID="8121e0ee-fe1b-414e-9a15-c073dbddb81f" containerID="1e08a5a08d6da67fe5e3a0edca2fb65ac38e2ebe7ad8077bfb7184fc9f55f6ff" exitCode=0 Jun 05 17:49:47.477559 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:47.477447 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbdm2" event={"ID":"8121e0ee-fe1b-414e-9a15-c073dbddb81f","Type":"ContainerDied","Data":"1e08a5a08d6da67fe5e3a0edca2fb65ac38e2ebe7ad8077bfb7184fc9f55f6ff"} Jun 05 17:49:48.482164 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:48.482125 2553 generic.go:356] "Generic (PLEG): container finished" podID="8121e0ee-fe1b-414e-9a15-c073dbddb81f" containerID="d9ffc1a78624a26e64fcc0c4cb20aa43b31f61f016a9b0d9c9e97c45693424a5" exitCode=0 Jun 05 17:49:48.482730 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:48.482204 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbdm2" event={"ID":"8121e0ee-fe1b-414e-9a15-c073dbddb81f","Type":"ContainerDied","Data":"d9ffc1a78624a26e64fcc0c4cb20aa43b31f61f016a9b0d9c9e97c45693424a5"} Jun 05 17:49:48.483629 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:48.483606 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x2wwq" event={"ID":"3d366d70-6cb1-4172-9b93-9606ed9c66ba","Type":"ContainerStarted","Data":"fdc3b733b177f39782227491f94ce456b73c2db98a95f349b6c3789cab69d0ec"} Jun 05 17:49:48.523345 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:48.523298 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x2wwq" podStartSLOduration=1.888216305 podStartE2EDuration="3.523278256s" totalImagesPullingTime="1.635061951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:48.523205925 +0000 UTC m=+37.713185095" watchObservedRunningTime="2026-06-05 17:49:48.523278256 +0000 UTC m=+37.713257430" Jun 05 17:49:49.486070 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:49.486040 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls\") pod \"dns-default-z7h9r\" (UID: \"0b586fdc-e65a-4afc-91c4-2f6307527422\") " pod="openshift-dns/dns-default-z7h9r" Jun 05 17:49:49.486671 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:49.486164 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:49:49.486671 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:49.486255 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls podName:0b586fdc-e65a-4afc-91c4-2f6307527422 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:53.48621722 +0000 UTC m=+42.676196373 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls") pod "dns-default-z7h9r" (UID: "0b586fdc-e65a-4afc-91c4-2f6307527422") : secret "dns-default-metrics-tls" not found Jun 05 17:49:49.489861 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:49.489835 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbdm2" event={"ID":"8121e0ee-fe1b-414e-9a15-c073dbddb81f","Type":"ContainerStarted","Data":"fb49dddcd9e31b29f6b91d2f638888fa6f36a4f811d47fd2522e5a7c88399a19"} Jun 05 17:49:49.512058 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:49.512013 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sbdm2" podStartSLOduration=9.280076485 podStartE2EDuration="38.511998807s" totalImagesPullingTime="29.231922322s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:49:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:49.511707579 +0000 UTC m=+38.701686761" watchObservedRunningTime="2026-06-05 17:49:49.511998807 +0000 UTC m=+38.701978024" Jun 05 17:49:53.513914 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:49:53.513880 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls\") pod \"dns-default-z7h9r\" (UID: \"0b586fdc-e65a-4afc-91c4-2f6307527422\") " pod="openshift-dns/dns-default-z7h9r" Jun 05 17:49:53.514282 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:53.514023 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:49:53.514282 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:49:53.514086 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls podName:0b586fdc-e65a-4afc-91c4-2f6307527422 nodeName:}" failed. No retries permitted until 2026-06-05 17:50:01.514067582 +0000 UTC m=+50.704046739 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls") pod "dns-default-z7h9r" (UID: "0b586fdc-e65a-4afc-91c4-2f6307527422") : secret "dns-default-metrics-tls" not found Jun 05 17:50:00.728087 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:00.728055 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f874b4cf9-82hqc"] Jun 05 17:50:00.740795 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:00.740761 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f874b4cf9-82hqc"] Jun 05 17:50:00.740933 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:00.740891 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f874b4cf9-82hqc" Jun 05 17:50:00.744668 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:00.744647 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 05 17:50:00.744782 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:00.744667 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 05 17:50:00.744782 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:00.744672 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 05 17:50:00.744782 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:00.744651 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 05 17:50:00.858846 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:00.858816 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vjzv\" (UniqueName: \"kubernetes.io/projected/a6c7947b-298c-4fbe-ab9f-6df67bcc23c2-kube-api-access-5vjzv\") pod \"klusterlet-addon-workmgr-7f874b4cf9-82hqc\" (UID: \"a6c7947b-298c-4fbe-ab9f-6df67bcc23c2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f874b4cf9-82hqc" Jun 05 17:50:00.859021 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:00.858891 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6c7947b-298c-4fbe-ab9f-6df67bcc23c2-tmp\") pod \"klusterlet-addon-workmgr-7f874b4cf9-82hqc\" (UID: \"a6c7947b-298c-4fbe-ab9f-6df67bcc23c2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f874b4cf9-82hqc" Jun 05 17:50:00.859021 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:00.858914 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a6c7947b-298c-4fbe-ab9f-6df67bcc23c2-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f874b4cf9-82hqc\" (UID: \"a6c7947b-298c-4fbe-ab9f-6df67bcc23c2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f874b4cf9-82hqc" Jun 05 17:50:00.960067 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:00.960036 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vjzv\" (UniqueName: \"kubernetes.io/projected/a6c7947b-298c-4fbe-ab9f-6df67bcc23c2-kube-api-access-5vjzv\") pod \"klusterlet-addon-workmgr-7f874b4cf9-82hqc\" (UID: \"a6c7947b-298c-4fbe-ab9f-6df67bcc23c2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f874b4cf9-82hqc" Jun 05 17:50:00.960211 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:00.960091 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6c7947b-298c-4fbe-ab9f-6df67bcc23c2-tmp\") pod \"klusterlet-addon-workmgr-7f874b4cf9-82hqc\" (UID: \"a6c7947b-298c-4fbe-ab9f-6df67bcc23c2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f874b4cf9-82hqc" Jun 05 17:50:00.960211 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:00.960114 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a6c7947b-298c-4fbe-ab9f-6df67bcc23c2-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f874b4cf9-82hqc\" (UID: \"a6c7947b-298c-4fbe-ab9f-6df67bcc23c2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f874b4cf9-82hqc" Jun 05 17:50:00.960459 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:00.960437 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6c7947b-298c-4fbe-ab9f-6df67bcc23c2-tmp\") pod \"klusterlet-addon-workmgr-7f874b4cf9-82hqc\" (UID: \"a6c7947b-298c-4fbe-ab9f-6df67bcc23c2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f874b4cf9-82hqc" Jun 05 17:50:00.963704 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:00.963686 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a6c7947b-298c-4fbe-ab9f-6df67bcc23c2-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f874b4cf9-82hqc\" (UID: \"a6c7947b-298c-4fbe-ab9f-6df67bcc23c2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f874b4cf9-82hqc" Jun 05 17:50:00.968826 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:00.968806 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vjzv\" (UniqueName: \"kubernetes.io/projected/a6c7947b-298c-4fbe-ab9f-6df67bcc23c2-kube-api-access-5vjzv\") pod \"klusterlet-addon-workmgr-7f874b4cf9-82hqc\" (UID: \"a6c7947b-298c-4fbe-ab9f-6df67bcc23c2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f874b4cf9-82hqc" Jun 05 17:50:01.050753 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:01.050675 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f874b4cf9-82hqc" Jun 05 17:50:01.187670 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:01.187642 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f874b4cf9-82hqc"] Jun 05 17:50:01.190743 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:50:01.190715 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c7947b_298c_4fbe_ab9f_6df67bcc23c2.slice/crio-e70b089c27b5c927e93e8a814d6f51bf6ba5dc2ff7a15275484a3df4e8507bb4 WatchSource:0}: Error finding container e70b089c27b5c927e93e8a814d6f51bf6ba5dc2ff7a15275484a3df4e8507bb4: Status 404 returned error can't find the container with id e70b089c27b5c927e93e8a814d6f51bf6ba5dc2ff7a15275484a3df4e8507bb4 Jun 05 17:50:01.516569 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:01.516531 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f874b4cf9-82hqc" event={"ID":"a6c7947b-298c-4fbe-ab9f-6df67bcc23c2","Type":"ContainerStarted","Data":"e70b089c27b5c927e93e8a814d6f51bf6ba5dc2ff7a15275484a3df4e8507bb4"} Jun 05 17:50:01.563874 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:01.563847 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls\") pod \"dns-default-z7h9r\" (UID: \"0b586fdc-e65a-4afc-91c4-2f6307527422\") " pod="openshift-dns/dns-default-z7h9r" Jun 05 17:50:01.563980 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:50:01.563969 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:50:01.564030 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:50:01.564022 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls podName:0b586fdc-e65a-4afc-91c4-2f6307527422 nodeName:}" failed. No retries permitted until 2026-06-05 17:50:17.564006643 +0000 UTC m=+66.753985790 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls") pod "dns-default-z7h9r" (UID: "0b586fdc-e65a-4afc-91c4-2f6307527422") : secret "dns-default-metrics-tls" not found Jun 05 17:50:05.529625 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:05.529532 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f874b4cf9-82hqc" event={"ID":"a6c7947b-298c-4fbe-ab9f-6df67bcc23c2","Type":"ContainerStarted","Data":"72d61d82464934429ab6581957a73173bd719285d9ecbafb6f24e148b976e60c"} Jun 05 17:50:05.529974 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:05.529734 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f874b4cf9-82hqc" Jun 05 17:50:05.531328 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:05.531300 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f874b4cf9-82hqc" Jun 05 17:50:05.546028 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:05.545983 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f874b4cf9-82hqc" podStartSLOduration=1.6182511910000001 podStartE2EDuration="5.545969936s" totalImagesPullingTime="3.927718745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:50:05.545645359 +0000 UTC m=+54.735624529" watchObservedRunningTime="2026-06-05 17:50:05.545969936 +0000 UTC m=+54.735949104" Jun 05 17:50:11.466001 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:11.465975 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7z87q" Jun 05 17:50:16.981252 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:16.981202 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs\") pod \"network-metrics-daemon-nbsjk\" (UID: \"0e0bcb41-a6ca-4334-b790-165d44925258\") " pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:50:16.981648 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:16.981288 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceaba4c9-2e0e-45d6-a060-9033db497249-original-pull-secret\") pod \"global-pull-secret-syncer-cd8cb\" (UID: \"ceaba4c9-2e0e-45d6-a060-9033db497249\") " pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:50:16.984576 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:16.984556 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 17:50:16.984677 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:16.984624 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 17:50:16.991708 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:50:16.991686 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 17:50:16.991785 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:50:16.991766 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs podName:0e0bcb41-a6ca-4334-b790-165d44925258 nodeName:}" failed. No retries permitted until 2026-06-05 17:51:20.991744745 +0000 UTC m=+130.181723894 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs") pod "network-metrics-daemon-nbsjk" (UID: "0e0bcb41-a6ca-4334-b790-165d44925258") : secret "metrics-daemon-secret" not found Jun 05 17:50:16.993749 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:16.993723 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceaba4c9-2e0e-45d6-a060-9033db497249-original-pull-secret\") pod \"global-pull-secret-syncer-cd8cb\" (UID: \"ceaba4c9-2e0e-45d6-a060-9033db497249\") " pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:50:17.082262 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:17.082222 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz9c5\" (UniqueName: \"kubernetes.io/projected/935d4fd0-70b3-44bd-b083-3ff1e61b3710-kube-api-access-vz9c5\") pod \"network-check-target-kq6rg\" (UID: \"935d4fd0-70b3-44bd-b083-3ff1e61b3710\") " pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:50:17.085219 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:17.085202 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 17:50:17.095707 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:17.095692 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 17:50:17.106012 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:17.105992 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz9c5\" (UniqueName: \"kubernetes.io/projected/935d4fd0-70b3-44bd-b083-3ff1e61b3710-kube-api-access-vz9c5\") pod \"network-check-target-kq6rg\" (UID: \"935d4fd0-70b3-44bd-b083-3ff1e61b3710\") " pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:50:17.177151 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:17.177126 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cd8cb" Jun 05 17:50:17.185023 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:17.185005 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s9z2b\"" Jun 05 17:50:17.193193 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:17.193177 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:50:17.321289 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:17.321208 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cd8cb"] Jun 05 17:50:17.324724 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:50:17.324698 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceaba4c9_2e0e_45d6_a060_9033db497249.slice/crio-8613ae266cf8020fea0bcf2041aac347bc9537a6653e2aac3a5319bc6018c453 WatchSource:0}: Error finding container 8613ae266cf8020fea0bcf2041aac347bc9537a6653e2aac3a5319bc6018c453: Status 404 returned error can't find the container with id 8613ae266cf8020fea0bcf2041aac347bc9537a6653e2aac3a5319bc6018c453 Jun 05 17:50:17.340474 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:17.340450 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kq6rg"] Jun 05 17:50:17.343448 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:50:17.343426 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod935d4fd0_70b3_44bd_b083_3ff1e61b3710.slice/crio-aee18bc5eb541413b9cfd491a14920a02fd4804996a71a0bc655c1b599ae04ef WatchSource:0}: Error finding container aee18bc5eb541413b9cfd491a14920a02fd4804996a71a0bc655c1b599ae04ef: Status 404 returned error can't find the container with id aee18bc5eb541413b9cfd491a14920a02fd4804996a71a0bc655c1b599ae04ef Jun 05 17:50:17.558223 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:17.558151 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cd8cb" event={"ID":"ceaba4c9-2e0e-45d6-a060-9033db497249","Type":"ContainerStarted","Data":"8613ae266cf8020fea0bcf2041aac347bc9537a6653e2aac3a5319bc6018c453"} Jun 05 17:50:17.559222 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:17.559193 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kq6rg" event={"ID":"935d4fd0-70b3-44bd-b083-3ff1e61b3710","Type":"ContainerStarted","Data":"aee18bc5eb541413b9cfd491a14920a02fd4804996a71a0bc655c1b599ae04ef"} Jun 05 17:50:17.585709 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:17.585683 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls\") pod \"dns-default-z7h9r\" (UID: \"0b586fdc-e65a-4afc-91c4-2f6307527422\") " pod="openshift-dns/dns-default-z7h9r" Jun 05 17:50:17.585806 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:50:17.585790 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:50:17.585849 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:50:17.585842 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls podName:0b586fdc-e65a-4afc-91c4-2f6307527422 nodeName:}" failed. No retries permitted until 2026-06-05 17:50:49.585825705 +0000 UTC m=+98.775804868 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls") pod "dns-default-z7h9r" (UID: "0b586fdc-e65a-4afc-91c4-2f6307527422") : secret "dns-default-metrics-tls" not found Jun 05 17:50:22.573563 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:22.573523 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kq6rg" event={"ID":"935d4fd0-70b3-44bd-b083-3ff1e61b3710","Type":"ContainerStarted","Data":"a9d59aac379c963930fbc87e6f4462dd40a894c202b22ee87fa4180010724bf8"} Jun 05 17:50:22.574098 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:22.573650 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:50:22.574988 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:22.574963 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cd8cb" event={"ID":"ceaba4c9-2e0e-45d6-a060-9033db497249","Type":"ContainerStarted","Data":"f1f85fea03a0db098bc249a7ed87af2e4265bb000f21f60a531cf60ade21549e"} Jun 05 17:50:22.590196 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:22.590154 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kq6rg" podStartSLOduration=67.33760724 podStartE2EDuration="1m11.590140222s" totalImagesPullingTime="4.252532982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:50:22.589461231 +0000 UTC m=+71.779440401" watchObservedRunningTime="2026-06-05 17:50:22.590140222 +0000 UTC m=+71.780119390" Jun 05 17:50:22.603784 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:22.603741 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cd8cb" podStartSLOduration=67.329658068 podStartE2EDuration="1m11.603726679s" totalImagesPullingTime="4.274068611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:50:22.603593734 +0000 UTC m=+71.793572904" watchObservedRunningTime="2026-06-05 17:50:22.603726679 +0000 UTC m=+71.793705849" Jun 05 17:50:49.597137 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:49.597104 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls\") pod \"dns-default-z7h9r\" (UID: \"0b586fdc-e65a-4afc-91c4-2f6307527422\") " pod="openshift-dns/dns-default-z7h9r" Jun 05 17:50:49.597461 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:50:49.597210 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:50:49.597461 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:50:49.597281 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls podName:0b586fdc-e65a-4afc-91c4-2f6307527422 nodeName:}" failed. No retries permitted until 2026-06-05 17:51:53.597267362 +0000 UTC m=+162.787246509 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls") pod "dns-default-z7h9r" (UID: "0b586fdc-e65a-4afc-91c4-2f6307527422") : secret "dns-default-metrics-tls" not found Jun 05 17:50:53.580063 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:50:53.580035 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kq6rg" Jun 05 17:51:20.999179 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:51:20.999123 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs\") pod \"network-metrics-daemon-nbsjk\" (UID: \"0e0bcb41-a6ca-4334-b790-165d44925258\") " pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:51:20.999638 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:51:20.999284 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 17:51:20.999638 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:51:20.999358 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs podName:0e0bcb41-a6ca-4334-b790-165d44925258 nodeName:}" failed. No retries permitted until 2026-06-05 17:53:22.999340586 +0000 UTC m=+252.189319733 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs") pod "network-metrics-daemon-nbsjk" (UID: "0e0bcb41-a6ca-4334-b790-165d44925258") : secret "metrics-daemon-secret" not found Jun 05 17:51:48.713315 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:51:48.713269 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-z7h9r" podUID="0b586fdc-e65a-4afc-91c4-2f6307527422" Jun 05 17:51:48.779279 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:51:48.779253 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z7h9r" Jun 05 17:51:50.275711 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:51:50.275673 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-nbsjk" podUID="0e0bcb41-a6ca-4334-b790-165d44925258" Jun 05 17:51:53.614008 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:51:53.613974 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls\") pod \"dns-default-z7h9r\" (UID: \"0b586fdc-e65a-4afc-91c4-2f6307527422\") " pod="openshift-dns/dns-default-z7h9r" Jun 05 17:51:53.614424 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:51:53.614114 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:51:53.614424 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:51:53.614175 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls podName:0b586fdc-e65a-4afc-91c4-2f6307527422 nodeName:}" failed. No retries permitted until 2026-06-05 17:53:55.614159601 +0000 UTC m=+284.804138748 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls") pod "dns-default-z7h9r" (UID: "0b586fdc-e65a-4afc-91c4-2f6307527422") : secret "dns-default-metrics-tls" not found Jun 05 17:52:02.265067 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:02.264974 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:52:05.530849 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:05.530750 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f874b4cf9-82hqc" podUID="a6c7947b-298c-4fbe-ab9f-6df67bcc23c2" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused" Jun 05 17:52:05.821431 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:05.821338 2553 generic.go:356] "Generic (PLEG): container finished" podID="a6c7947b-298c-4fbe-ab9f-6df67bcc23c2" containerID="72d61d82464934429ab6581957a73173bd719285d9ecbafb6f24e148b976e60c" exitCode=1 Jun 05 17:52:05.821431 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:05.821406 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f874b4cf9-82hqc" event={"ID":"a6c7947b-298c-4fbe-ab9f-6df67bcc23c2","Type":"ContainerDied","Data":"72d61d82464934429ab6581957a73173bd719285d9ecbafb6f24e148b976e60c"} Jun 05 17:52:05.821715 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:05.821702 2553 scope.go:117] "RemoveContainer" containerID="72d61d82464934429ab6581957a73173bd719285d9ecbafb6f24e148b976e60c" Jun 05 17:52:06.828573 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:06.828542 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f874b4cf9-82hqc" event={"ID":"a6c7947b-298c-4fbe-ab9f-6df67bcc23c2","Type":"ContainerStarted","Data":"e9e4a3c158eff797107e0daad2c0c57d3642e0d1dbc5514b3e4eede235ea5f7c"} Jun 05 17:52:06.828983 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:06.828813 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f874b4cf9-82hqc" Jun 05 17:52:06.829418 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:06.829402 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f874b4cf9-82hqc" Jun 05 17:52:35.328206 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.328171 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wb9nd"] Jun 05 17:52:35.330026 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.330007 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wb9nd" Jun 05 17:52:35.332776 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.332750 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 05 17:52:35.332913 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.332760 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-jk5t2\"" Jun 05 17:52:35.333836 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.333815 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 05 17:52:35.337911 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.337890 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-747f8db4c5-z98th"] Jun 05 17:52:35.340089 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.340073 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:35.342633 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.342616 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 05 17:52:35.342724 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.342680 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 05 17:52:35.342809 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.342790 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vknkw\"" Jun 05 17:52:35.343421 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.343405 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 05 17:52:35.344544 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.344523 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wb9nd"] Jun 05 17:52:35.353838 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.353817 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 05 17:52:35.370964 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.370943 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-747f8db4c5-z98th"] Jun 05 17:52:35.380820 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.380795 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa87a257-375d-4340-97d4-baff45f80c89-ca-trust-extracted\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:35.380820 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.380821 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-bound-sa-token\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:35.380949 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.380842 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm9mp\" (UniqueName: \"kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-kube-api-access-pm9mp\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:35.380949 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.380895 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7mrg\" (UniqueName: \"kubernetes.io/projected/abf1ee15-6a4e-4850-a9f3-54ee56fa6bd3-kube-api-access-n7mrg\") pod \"volume-data-source-validator-78dd696465-wb9nd\" (UID: \"abf1ee15-6a4e-4850-a9f3-54ee56fa6bd3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wb9nd" Jun 05 17:52:35.380949 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.380934 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa87a257-375d-4340-97d4-baff45f80c89-installation-pull-secrets\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:35.381041 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.380979 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa87a257-375d-4340-97d4-baff45f80c89-trusted-ca\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:35.381041 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.381007 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa87a257-375d-4340-97d4-baff45f80c89-image-registry-private-configuration\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:35.381041 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.381032 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-registry-tls\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:35.381141 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.381047 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa87a257-375d-4340-97d4-baff45f80c89-registry-certificates\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:35.430668 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.430644 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9t7l6"] Jun 05 17:52:35.432471 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.432455 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9t7l6" Jun 05 17:52:35.434664 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.434631 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xbt54"] Jun 05 17:52:35.436432 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.436412 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5cb4fdffb5-hq64f"] Jun 05 17:52:35.436536 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.436470 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xbt54" Jun 05 17:52:35.438270 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.438251 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:52:35.438761 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.438747 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 05 17:52:35.439021 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.439004 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 05 17:52:35.439131 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.439048 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 05 17:52:35.439318 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.439303 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-tztrl\"" Jun 05 17:52:35.439385 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.439370 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 05 17:52:35.443319 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.443302 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hv78t\"" Jun 05 17:52:35.443319 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.443309 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 05 17:52:35.443319 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.443331 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 05 17:52:35.443576 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.443309 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 05 17:52:35.443576 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.443396 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 17:52:35.444079 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.444058 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 17:52:35.444161 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.444104 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 05 17:52:35.444161 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.444066 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 05 17:52:35.444293 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.444068 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 05 17:52:35.444293 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.444105 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pprwd\"" Jun 05 17:52:35.444293 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.444062 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 05 17:52:35.452936 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.452916 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xbt54"] Jun 05 17:52:35.454023 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.454003 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9t7l6"] Jun 05 17:52:35.455809 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.455786 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5cb4fdffb5-hq64f"] Jun 05 17:52:35.481343 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.481317 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa87a257-375d-4340-97d4-baff45f80c89-trusted-ca\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:35.481450 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.481346 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-metrics-certs\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:52:35.481450 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.481378 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa87a257-375d-4340-97d4-baff45f80c89-image-registry-private-configuration\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:35.481450 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.481396 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-default-certificate\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:52:35.481566 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.481458 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xbt54\" (UID: \"8e0ba5fe-8bc9-4b38-beda-f77a42e673cd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xbt54" Jun 05 17:52:35.481566 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.481500 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-service-ca-bundle\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:52:35.481566 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.481526 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa87a257-375d-4340-97d4-baff45f80c89-ca-trust-extracted\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:35.481566 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.481542 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-bound-sa-token\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:35.481703 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.481607 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa87a257-375d-4340-97d4-baff45f80c89-installation-pull-secrets\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:35.481703 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.481633 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-xbt54\" (UID: \"8e0ba5fe-8bc9-4b38-beda-f77a42e673cd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xbt54" Jun 05 17:52:35.481703 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.481665 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7mrg\" (UniqueName: \"kubernetes.io/projected/abf1ee15-6a4e-4850-a9f3-54ee56fa6bd3-kube-api-access-n7mrg\") pod \"volume-data-source-validator-78dd696465-wb9nd\" (UID: \"abf1ee15-6a4e-4850-a9f3-54ee56fa6bd3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wb9nd" Jun 05 17:52:35.481889 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.481794 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv8hm\" (UniqueName: \"kubernetes.io/projected/47aa83d5-5c29-4f32-b6c8-e90e744cb241-kube-api-access-xv8hm\") pod \"cluster-samples-operator-854f8b96b6-9t7l6\" (UID: \"47aa83d5-5c29-4f32-b6c8-e90e744cb241\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9t7l6" Jun 05 17:52:35.481889 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.481831 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-stats-auth\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:52:35.481889 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.481867 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sxjx\" (UniqueName: \"kubernetes.io/projected/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-kube-api-access-5sxjx\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:52:35.482072 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.481890 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa87a257-375d-4340-97d4-baff45f80c89-ca-trust-extracted\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:35.482072 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.481898 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa87a257-375d-4340-97d4-baff45f80c89-registry-certificates\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:35.482072 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.481945 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47aa83d5-5c29-4f32-b6c8-e90e744cb241-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-9t7l6\" (UID: \"47aa83d5-5c29-4f32-b6c8-e90e744cb241\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9t7l6" Jun 05 17:52:35.482072 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.481973 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm9mp\" (UniqueName: \"kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-kube-api-access-pm9mp\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:35.482072 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.481993 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xrqb\" (UniqueName: \"kubernetes.io/projected/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-kube-api-access-9xrqb\") pod \"cluster-monitoring-operator-74bbf69bbb-xbt54\" (UID: \"8e0ba5fe-8bc9-4b38-beda-f77a42e673cd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xbt54" Jun 05 17:52:35.482072 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.482028 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-registry-tls\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:35.482409 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:35.482110 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 17:52:35.482409 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:35.482124 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747f8db4c5-z98th: secret "image-registry-tls" not found Jun 05 17:52:35.482409 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:35.482179 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-registry-tls podName:aa87a257-375d-4340-97d4-baff45f80c89 nodeName:}" failed. No retries permitted until 2026-06-05 17:52:35.982161238 +0000 UTC m=+205.172140397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-registry-tls") pod "image-registry-747f8db4c5-z98th" (UID: "aa87a257-375d-4340-97d4-baff45f80c89") : secret "image-registry-tls" not found Jun 05 17:52:35.482409 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.482381 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa87a257-375d-4340-97d4-baff45f80c89-trusted-ca\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:35.482409 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.482398 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa87a257-375d-4340-97d4-baff45f80c89-registry-certificates\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:35.483966 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.483936 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa87a257-375d-4340-97d4-baff45f80c89-image-registry-private-configuration\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:35.484047 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.484022 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa87a257-375d-4340-97d4-baff45f80c89-installation-pull-secrets\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:35.496357 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.496329 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-bound-sa-token\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:35.496927 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.496909 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm9mp\" (UniqueName: \"kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-kube-api-access-pm9mp\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:35.496967 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.496935 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7mrg\" (UniqueName: \"kubernetes.io/projected/abf1ee15-6a4e-4850-a9f3-54ee56fa6bd3-kube-api-access-n7mrg\") pod \"volume-data-source-validator-78dd696465-wb9nd\" (UID: \"abf1ee15-6a4e-4850-a9f3-54ee56fa6bd3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wb9nd" Jun 05 17:52:35.582865 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.582808 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-xbt54\" (UID: \"8e0ba5fe-8bc9-4b38-beda-f77a42e673cd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xbt54" Jun 05 17:52:35.582865 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.582845 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv8hm\" (UniqueName: \"kubernetes.io/projected/47aa83d5-5c29-4f32-b6c8-e90e744cb241-kube-api-access-xv8hm\") pod \"cluster-samples-operator-854f8b96b6-9t7l6\" (UID: \"47aa83d5-5c29-4f32-b6c8-e90e744cb241\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9t7l6" Jun 05 17:52:35.582865 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.582861 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-stats-auth\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:52:35.583011 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.582977 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sxjx\" (UniqueName: \"kubernetes.io/projected/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-kube-api-access-5sxjx\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:52:35.583060 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.583017 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47aa83d5-5c29-4f32-b6c8-e90e744cb241-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-9t7l6\" (UID: \"47aa83d5-5c29-4f32-b6c8-e90e744cb241\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9t7l6" Jun 05 17:52:35.583122 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:35.583105 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 17:52:35.583189 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:35.583178 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47aa83d5-5c29-4f32-b6c8-e90e744cb241-samples-operator-tls podName:47aa83d5-5c29-4f32-b6c8-e90e744cb241 nodeName:}" failed. No retries permitted until 2026-06-05 17:52:36.083158796 +0000 UTC m=+205.273137956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/47aa83d5-5c29-4f32-b6c8-e90e744cb241-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-9t7l6" (UID: "47aa83d5-5c29-4f32-b6c8-e90e744cb241") : secret "samples-operator-tls" not found Jun 05 17:52:35.583261 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.583113 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xrqb\" (UniqueName: \"kubernetes.io/projected/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-kube-api-access-9xrqb\") pod \"cluster-monitoring-operator-74bbf69bbb-xbt54\" (UID: \"8e0ba5fe-8bc9-4b38-beda-f77a42e673cd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xbt54" Jun 05 17:52:35.583261 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.583227 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-metrics-certs\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:52:35.583414 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.583272 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-default-certificate\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:52:35.583414 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.583296 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xbt54\" (UID: \"8e0ba5fe-8bc9-4b38-beda-f77a42e673cd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xbt54" Jun 05 17:52:35.583414 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.583316 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-service-ca-bundle\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:52:35.583414 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:35.583354 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 17:52:35.583414 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:35.583411 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-metrics-certs podName:1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3 nodeName:}" failed. No retries permitted until 2026-06-05 17:52:36.083394041 +0000 UTC m=+205.273373190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-metrics-certs") pod "router-default-5cb4fdffb5-hq64f" (UID: "1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3") : secret "router-metrics-certs-default" not found Jun 05 17:52:35.583594 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:35.583415 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 17:52:35.583594 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:35.583432 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-service-ca-bundle podName:1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3 nodeName:}" failed. No retries permitted until 2026-06-05 17:52:36.083417819 +0000 UTC m=+205.273396992 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-service-ca-bundle") pod "router-default-5cb4fdffb5-hq64f" (UID: "1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3") : configmap references non-existent config key: service-ca.crt Jun 05 17:52:35.583594 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:35.583460 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-cluster-monitoring-operator-tls podName:8e0ba5fe-8bc9-4b38-beda-f77a42e673cd nodeName:}" failed. No retries permitted until 2026-06-05 17:52:36.08344789 +0000 UTC m=+205.273427048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xbt54" (UID: "8e0ba5fe-8bc9-4b38-beda-f77a42e673cd") : secret "cluster-monitoring-operator-tls" not found Jun 05 17:52:35.583594 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.583584 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-xbt54\" (UID: \"8e0ba5fe-8bc9-4b38-beda-f77a42e673cd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xbt54" Jun 05 17:52:35.585158 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.585130 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-stats-auth\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:52:35.585505 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.585474 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-default-certificate\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:52:35.591324 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.591298 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sxjx\" (UniqueName: \"kubernetes.io/projected/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-kube-api-access-5sxjx\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:52:35.591693 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.591664 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv8hm\" (UniqueName: \"kubernetes.io/projected/47aa83d5-5c29-4f32-b6c8-e90e744cb241-kube-api-access-xv8hm\") pod \"cluster-samples-operator-854f8b96b6-9t7l6\" (UID: \"47aa83d5-5c29-4f32-b6c8-e90e744cb241\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9t7l6" Jun 05 17:52:35.591978 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.591962 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xrqb\" (UniqueName: \"kubernetes.io/projected/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-kube-api-access-9xrqb\") pod \"cluster-monitoring-operator-74bbf69bbb-xbt54\" (UID: \"8e0ba5fe-8bc9-4b38-beda-f77a42e673cd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xbt54" Jun 05 17:52:35.639469 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.639450 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wb9nd" Jun 05 17:52:35.757385 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.757345 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wb9nd"] Jun 05 17:52:35.760540 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:52:35.760516 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabf1ee15_6a4e_4850_a9f3_54ee56fa6bd3.slice/crio-2ab7e196e109d962e375ac9044660b25809bce0891b5d569de52eb2b1d9a744a WatchSource:0}: Error finding container 2ab7e196e109d962e375ac9044660b25809bce0891b5d569de52eb2b1d9a744a: Status 404 returned error can't find the container with id 2ab7e196e109d962e375ac9044660b25809bce0891b5d569de52eb2b1d9a744a Jun 05 17:52:35.914384 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.914354 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wb9nd" event={"ID":"abf1ee15-6a4e-4850-a9f3-54ee56fa6bd3","Type":"ContainerStarted","Data":"2ab7e196e109d962e375ac9044660b25809bce0891b5d569de52eb2b1d9a744a"} Jun 05 17:52:35.988044 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:35.988013 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-registry-tls\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:35.988174 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:35.988153 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 17:52:35.988174 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:35.988169 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747f8db4c5-z98th: secret "image-registry-tls" not found Jun 05 17:52:35.988279 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:35.988224 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-registry-tls podName:aa87a257-375d-4340-97d4-baff45f80c89 nodeName:}" failed. No retries permitted until 2026-06-05 17:52:36.988204345 +0000 UTC m=+206.178183506 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-registry-tls") pod "image-registry-747f8db4c5-z98th" (UID: "aa87a257-375d-4340-97d4-baff45f80c89") : secret "image-registry-tls" not found Jun 05 17:52:36.089137 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:36.089103 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47aa83d5-5c29-4f32-b6c8-e90e744cb241-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-9t7l6\" (UID: \"47aa83d5-5c29-4f32-b6c8-e90e744cb241\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9t7l6" Jun 05 17:52:36.089300 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:36.089156 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-metrics-certs\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:52:36.089300 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:36.089183 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xbt54\" (UID: \"8e0ba5fe-8bc9-4b38-beda-f77a42e673cd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xbt54" Jun 05 17:52:36.089300 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:36.089201 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-service-ca-bundle\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:52:36.089300 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:36.089267 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 17:52:36.089507 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:36.089302 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 17:52:36.089507 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:36.089322 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-service-ca-bundle podName:1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3 nodeName:}" failed. No retries permitted until 2026-06-05 17:52:37.089308408 +0000 UTC m=+206.279287556 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-service-ca-bundle") pod "router-default-5cb4fdffb5-hq64f" (UID: "1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3") : configmap references non-existent config key: service-ca.crt Jun 05 17:52:36.089507 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:36.089347 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-metrics-certs podName:1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3 nodeName:}" failed. No retries permitted until 2026-06-05 17:52:37.089329211 +0000 UTC m=+206.279308376 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-metrics-certs") pod "router-default-5cb4fdffb5-hq64f" (UID: "1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3") : secret "router-metrics-certs-default" not found Jun 05 17:52:36.089507 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:36.089367 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 17:52:36.089507 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:36.089375 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47aa83d5-5c29-4f32-b6c8-e90e744cb241-samples-operator-tls podName:47aa83d5-5c29-4f32-b6c8-e90e744cb241 nodeName:}" failed. No retries permitted until 2026-06-05 17:52:37.089366343 +0000 UTC m=+206.279345491 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/47aa83d5-5c29-4f32-b6c8-e90e744cb241-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-9t7l6" (UID: "47aa83d5-5c29-4f32-b6c8-e90e744cb241") : secret "samples-operator-tls" not found Jun 05 17:52:36.089507 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:36.089441 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-cluster-monitoring-operator-tls podName:8e0ba5fe-8bc9-4b38-beda-f77a42e673cd nodeName:}" failed. No retries permitted until 2026-06-05 17:52:37.089425554 +0000 UTC m=+206.279404702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xbt54" (UID: "8e0ba5fe-8bc9-4b38-beda-f77a42e673cd") : secret "cluster-monitoring-operator-tls" not found Jun 05 17:52:36.918780 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:36.918752 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wb9nd" event={"ID":"abf1ee15-6a4e-4850-a9f3-54ee56fa6bd3","Type":"ContainerStarted","Data":"1d5daedc81de0136f4073e4c4063d55b8d53effd47c7f2e29ae7c7ce9f67a853"} Jun 05 17:52:36.936397 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:36.936357 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wb9nd" podStartSLOduration=0.862930407 podStartE2EDuration="1.936341929s" totalImagesPullingTime="1.073411522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:52:36.935986506 +0000 UTC m=+206.125965677" watchObservedRunningTime="2026-06-05 17:52:36.936341929 +0000 UTC m=+206.126321097" Jun 05 17:52:36.997886 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:36.997854 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-registry-tls\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:36.998007 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:36.997990 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 17:52:36.998059 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:36.998011 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747f8db4c5-z98th: secret "image-registry-tls" not found Jun 05 17:52:36.998093 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:36.998071 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-registry-tls podName:aa87a257-375d-4340-97d4-baff45f80c89 nodeName:}" failed. No retries permitted until 2026-06-05 17:52:38.99805498 +0000 UTC m=+208.188034127 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-registry-tls") pod "image-registry-747f8db4c5-z98th" (UID: "aa87a257-375d-4340-97d4-baff45f80c89") : secret "image-registry-tls" not found Jun 05 17:52:37.098422 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:37.098391 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xbt54\" (UID: \"8e0ba5fe-8bc9-4b38-beda-f77a42e673cd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xbt54" Jun 05 17:52:37.098520 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:37.098437 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-service-ca-bundle\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:52:37.098520 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:37.098484 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47aa83d5-5c29-4f32-b6c8-e90e744cb241-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-9t7l6\" (UID: \"47aa83d5-5c29-4f32-b6c8-e90e744cb241\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9t7l6" Jun 05 17:52:37.098601 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:37.098522 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 17:52:37.098601 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:37.098574 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-cluster-monitoring-operator-tls podName:8e0ba5fe-8bc9-4b38-beda-f77a42e673cd nodeName:}" failed. No retries permitted until 2026-06-05 17:52:39.098559975 +0000 UTC m=+208.288539122 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xbt54" (UID: "8e0ba5fe-8bc9-4b38-beda-f77a42e673cd") : secret "cluster-monitoring-operator-tls" not found Jun 05 17:52:37.098685 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:37.098598 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-service-ca-bundle podName:1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3 nodeName:}" failed. No retries permitted until 2026-06-05 17:52:39.098584618 +0000 UTC m=+208.288563764 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-service-ca-bundle") pod "router-default-5cb4fdffb5-hq64f" (UID: "1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3") : configmap references non-existent config key: service-ca.crt Jun 05 17:52:37.098685 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:37.098529 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-metrics-certs\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:52:37.098685 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:37.098603 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 17:52:37.098685 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:37.098665 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-metrics-certs podName:1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3 nodeName:}" failed. No retries permitted until 2026-06-05 17:52:39.09865442 +0000 UTC m=+208.288633566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-metrics-certs") pod "router-default-5cb4fdffb5-hq64f" (UID: "1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3") : secret "router-metrics-certs-default" not found Jun 05 17:52:37.098685 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:37.098612 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 17:52:37.098861 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:37.098707 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47aa83d5-5c29-4f32-b6c8-e90e744cb241-samples-operator-tls podName:47aa83d5-5c29-4f32-b6c8-e90e744cb241 nodeName:}" failed. No retries permitted until 2026-06-05 17:52:39.098701068 +0000 UTC m=+208.288680215 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/47aa83d5-5c29-4f32-b6c8-e90e744cb241-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-9t7l6" (UID: "47aa83d5-5c29-4f32-b6c8-e90e744cb241") : secret "samples-operator-tls" not found Jun 05 17:52:39.012915 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:39.012874 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-registry-tls\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:39.013304 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:39.013027 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 17:52:39.013304 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:39.013043 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747f8db4c5-z98th: secret "image-registry-tls" not found Jun 05 17:52:39.013304 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:39.013103 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-registry-tls podName:aa87a257-375d-4340-97d4-baff45f80c89 nodeName:}" failed. No retries permitted until 2026-06-05 17:52:43.013083249 +0000 UTC m=+212.203062410 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-registry-tls") pod "image-registry-747f8db4c5-z98th" (UID: "aa87a257-375d-4340-97d4-baff45f80c89") : secret "image-registry-tls" not found Jun 05 17:52:39.113499 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:39.113458 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47aa83d5-5c29-4f32-b6c8-e90e744cb241-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-9t7l6\" (UID: \"47aa83d5-5c29-4f32-b6c8-e90e744cb241\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9t7l6" Jun 05 17:52:39.113587 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:39.113527 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-metrics-certs\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:52:39.113587 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:39.113559 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xbt54\" (UID: \"8e0ba5fe-8bc9-4b38-beda-f77a42e673cd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xbt54" Jun 05 17:52:39.113587 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:39.113579 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-service-ca-bundle\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:52:39.113689 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:39.113605 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 17:52:39.113689 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:39.113663 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47aa83d5-5c29-4f32-b6c8-e90e744cb241-samples-operator-tls podName:47aa83d5-5c29-4f32-b6c8-e90e744cb241 nodeName:}" failed. No retries permitted until 2026-06-05 17:52:43.113649203 +0000 UTC m=+212.303628350 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/47aa83d5-5c29-4f32-b6c8-e90e744cb241-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-9t7l6" (UID: "47aa83d5-5c29-4f32-b6c8-e90e744cb241") : secret "samples-operator-tls" not found Jun 05 17:52:39.113774 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:39.113684 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 17:52:39.113774 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:39.113695 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 17:52:39.113774 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:39.113721 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-service-ca-bundle podName:1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3 nodeName:}" failed. No retries permitted until 2026-06-05 17:52:43.113705922 +0000 UTC m=+212.303685089 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-service-ca-bundle") pod "router-default-5cb4fdffb5-hq64f" (UID: "1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3") : configmap references non-existent config key: service-ca.crt Jun 05 17:52:39.113774 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:39.113739 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-metrics-certs podName:1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3 nodeName:}" failed. No retries permitted until 2026-06-05 17:52:43.113730623 +0000 UTC m=+212.303709769 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-metrics-certs") pod "router-default-5cb4fdffb5-hq64f" (UID: "1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3") : secret "router-metrics-certs-default" not found Jun 05 17:52:39.113774 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:39.113752 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-cluster-monitoring-operator-tls podName:8e0ba5fe-8bc9-4b38-beda-f77a42e673cd nodeName:}" failed. No retries permitted until 2026-06-05 17:52:43.113745381 +0000 UTC m=+212.303724527 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xbt54" (UID: "8e0ba5fe-8bc9-4b38-beda-f77a42e673cd") : secret "cluster-monitoring-operator-tls" not found Jun 05 17:52:43.045442 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.045385 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-registry-tls\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:43.045841 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:43.045564 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 17:52:43.045841 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:43.045579 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747f8db4c5-z98th: secret "image-registry-tls" not found Jun 05 17:52:43.045841 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:43.045638 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-registry-tls podName:aa87a257-375d-4340-97d4-baff45f80c89 nodeName:}" failed. No retries permitted until 2026-06-05 17:52:51.045621734 +0000 UTC m=+220.235600890 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-registry-tls") pod "image-registry-747f8db4c5-z98th" (UID: "aa87a257-375d-4340-97d4-baff45f80c89") : secret "image-registry-tls" not found Jun 05 17:52:43.146119 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.146088 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47aa83d5-5c29-4f32-b6c8-e90e744cb241-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-9t7l6\" (UID: \"47aa83d5-5c29-4f32-b6c8-e90e744cb241\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9t7l6" Jun 05 17:52:43.146253 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.146142 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-metrics-certs\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:52:43.146253 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.146174 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xbt54\" (UID: \"8e0ba5fe-8bc9-4b38-beda-f77a42e673cd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xbt54" Jun 05 17:52:43.146253 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.146194 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-service-ca-bundle\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:52:43.146253 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:43.146226 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 17:52:43.146454 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:43.146303 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47aa83d5-5c29-4f32-b6c8-e90e744cb241-samples-operator-tls podName:47aa83d5-5c29-4f32-b6c8-e90e744cb241 nodeName:}" failed. No retries permitted until 2026-06-05 17:52:51.146287139 +0000 UTC m=+220.336266286 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/47aa83d5-5c29-4f32-b6c8-e90e744cb241-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-9t7l6" (UID: "47aa83d5-5c29-4f32-b6c8-e90e744cb241") : secret "samples-operator-tls" not found Jun 05 17:52:43.146454 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:43.146395 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 17:52:43.146454 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:43.146420 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-service-ca-bundle podName:1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3 nodeName:}" failed. No retries permitted until 2026-06-05 17:52:51.146403812 +0000 UTC m=+220.336382959 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-service-ca-bundle") pod "router-default-5cb4fdffb5-hq64f" (UID: "1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3") : configmap references non-existent config key: service-ca.crt Jun 05 17:52:43.146454 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:43.146434 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 17:52:43.146454 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:43.146452 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-cluster-monitoring-operator-tls podName:8e0ba5fe-8bc9-4b38-beda-f77a42e673cd nodeName:}" failed. No retries permitted until 2026-06-05 17:52:51.146434829 +0000 UTC m=+220.336413980 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xbt54" (UID: "8e0ba5fe-8bc9-4b38-beda-f77a42e673cd") : secret "cluster-monitoring-operator-tls" not found Jun 05 17:52:43.146623 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:43.146480 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-metrics-certs podName:1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3 nodeName:}" failed. No retries permitted until 2026-06-05 17:52:51.146466804 +0000 UTC m=+220.336445973 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-metrics-certs") pod "router-default-5cb4fdffb5-hq64f" (UID: "1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3") : secret "router-metrics-certs-default" not found Jun 05 17:52:43.284796 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.284763 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-rp5p4"] Jun 05 17:52:43.286658 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.286643 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-rp5p4" Jun 05 17:52:43.289340 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.289316 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 05 17:52:43.289340 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.289325 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 05 17:52:43.289542 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.289391 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 05 17:52:43.289542 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.289429 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 05 17:52:43.290616 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.290597 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gws9b\"" Jun 05 17:52:43.296735 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.296682 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-rp5p4"] Jun 05 17:52:43.347936 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.347906 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1e342ea0-782a-432e-a28c-9a85f9fc0d37-signing-key\") pod \"service-ca-7d74d578b8-rp5p4\" (UID: \"1e342ea0-782a-432e-a28c-9a85f9fc0d37\") " pod="openshift-service-ca/service-ca-7d74d578b8-rp5p4" Jun 05 17:52:43.348060 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.348013 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kgx9\" (UniqueName: \"kubernetes.io/projected/1e342ea0-782a-432e-a28c-9a85f9fc0d37-kube-api-access-9kgx9\") pod \"service-ca-7d74d578b8-rp5p4\" (UID: \"1e342ea0-782a-432e-a28c-9a85f9fc0d37\") " pod="openshift-service-ca/service-ca-7d74d578b8-rp5p4" Jun 05 17:52:43.348114 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.348060 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1e342ea0-782a-432e-a28c-9a85f9fc0d37-signing-cabundle\") pod \"service-ca-7d74d578b8-rp5p4\" (UID: \"1e342ea0-782a-432e-a28c-9a85f9fc0d37\") " pod="openshift-service-ca/service-ca-7d74d578b8-rp5p4" Jun 05 17:52:43.449255 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.449206 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1e342ea0-782a-432e-a28c-9a85f9fc0d37-signing-key\") pod \"service-ca-7d74d578b8-rp5p4\" (UID: \"1e342ea0-782a-432e-a28c-9a85f9fc0d37\") " pod="openshift-service-ca/service-ca-7d74d578b8-rp5p4" Jun 05 17:52:43.449417 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.449314 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kgx9\" (UniqueName: \"kubernetes.io/projected/1e342ea0-782a-432e-a28c-9a85f9fc0d37-kube-api-access-9kgx9\") pod \"service-ca-7d74d578b8-rp5p4\" (UID: \"1e342ea0-782a-432e-a28c-9a85f9fc0d37\") " pod="openshift-service-ca/service-ca-7d74d578b8-rp5p4" Jun 05 17:52:43.449417 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.449375 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1e342ea0-782a-432e-a28c-9a85f9fc0d37-signing-cabundle\") pod \"service-ca-7d74d578b8-rp5p4\" (UID: \"1e342ea0-782a-432e-a28c-9a85f9fc0d37\") " pod="openshift-service-ca/service-ca-7d74d578b8-rp5p4" Jun 05 17:52:43.450013 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.449994 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1e342ea0-782a-432e-a28c-9a85f9fc0d37-signing-cabundle\") pod \"service-ca-7d74d578b8-rp5p4\" (UID: \"1e342ea0-782a-432e-a28c-9a85f9fc0d37\") " pod="openshift-service-ca/service-ca-7d74d578b8-rp5p4" Jun 05 17:52:43.451592 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.451573 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1e342ea0-782a-432e-a28c-9a85f9fc0d37-signing-key\") pod \"service-ca-7d74d578b8-rp5p4\" (UID: \"1e342ea0-782a-432e-a28c-9a85f9fc0d37\") " pod="openshift-service-ca/service-ca-7d74d578b8-rp5p4" Jun 05 17:52:43.457694 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.457666 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kgx9\" (UniqueName: \"kubernetes.io/projected/1e342ea0-782a-432e-a28c-9a85f9fc0d37-kube-api-access-9kgx9\") pod \"service-ca-7d74d578b8-rp5p4\" (UID: \"1e342ea0-782a-432e-a28c-9a85f9fc0d37\") " pod="openshift-service-ca/service-ca-7d74d578b8-rp5p4" Jun 05 17:52:43.595052 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.595027 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-rp5p4" Jun 05 17:52:43.714455 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.714426 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-rp5p4"] Jun 05 17:52:43.717427 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:52:43.717399 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e342ea0_782a_432e_a28c_9a85f9fc0d37.slice/crio-7918f89940923527f66ca697a51cbea4af571cd30cdfba71cb503d1db88ced64 WatchSource:0}: Error finding container 7918f89940923527f66ca697a51cbea4af571cd30cdfba71cb503d1db88ced64: Status 404 returned error can't find the container with id 7918f89940923527f66ca697a51cbea4af571cd30cdfba71cb503d1db88ced64 Jun 05 17:52:43.939357 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.939277 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-rp5p4" event={"ID":"1e342ea0-782a-432e-a28c-9a85f9fc0d37","Type":"ContainerStarted","Data":"7918f89940923527f66ca697a51cbea4af571cd30cdfba71cb503d1db88ced64"} Jun 05 17:52:43.941045 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:43.941025 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t7jhz_7f32c561-c9cd-4f88-8f31-303673c53503/dns-node-resolver/0.log" Jun 05 17:52:44.942417 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:44.942388 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wlsj8_9f55e627-03d9-48da-ba1a-0c0fb6b40398/node-ca/0.log" Jun 05 17:52:45.741461 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:45.741384 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x2wwq_3d366d70-6cb1-4172-9b93-9606ed9c66ba/serve-healthcheck-canary/0.log" Jun 05 17:52:45.947122 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:45.947087 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-rp5p4" event={"ID":"1e342ea0-782a-432e-a28c-9a85f9fc0d37","Type":"ContainerStarted","Data":"1a4907dab5d5d3ba0d36ffff7f797079b2f8b9089c7ae38890e9ac7293e9ca68"} Jun 05 17:52:45.967511 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:45.967459 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-rp5p4" podStartSLOduration=1.232108182 podStartE2EDuration="2.967439166s" totalImagesPullingTime="1.735330984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:52:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:52:45.965005763 +0000 UTC m=+215.154984931" watchObservedRunningTime="2026-06-05 17:52:45.967439166 +0000 UTC m=+215.157418336" Jun 05 17:52:51.110963 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:51.110923 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-registry-tls\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:51.113315 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:51.113294 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-registry-tls\") pod \"image-registry-747f8db4c5-z98th\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:51.212325 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:51.212289 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-service-ca-bundle\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:52:51.212509 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:51.212360 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47aa83d5-5c29-4f32-b6c8-e90e744cb241-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-9t7l6\" (UID: \"47aa83d5-5c29-4f32-b6c8-e90e744cb241\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9t7l6" Jun 05 17:52:51.212509 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:51.212395 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-metrics-certs\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:52:51.212509 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:51.212421 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xbt54\" (UID: \"8e0ba5fe-8bc9-4b38-beda-f77a42e673cd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xbt54" Jun 05 17:52:51.212509 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:51.212496 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-service-ca-bundle podName:1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3 nodeName:}" failed. No retries permitted until 2026-06-05 17:53:07.212472898 +0000 UTC m=+236.402452059 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-service-ca-bundle") pod "router-default-5cb4fdffb5-hq64f" (UID: "1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3") : configmap references non-existent config key: service-ca.crt Jun 05 17:52:51.212509 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:51.212510 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 17:52:51.212776 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:52:51.212559 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-cluster-monitoring-operator-tls podName:8e0ba5fe-8bc9-4b38-beda-f77a42e673cd nodeName:}" failed. No retries permitted until 2026-06-05 17:53:07.212544305 +0000 UTC m=+236.402523452 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xbt54" (UID: "8e0ba5fe-8bc9-4b38-beda-f77a42e673cd") : secret "cluster-monitoring-operator-tls" not found Jun 05 17:52:51.214789 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:51.214763 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-metrics-certs\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:52:51.214789 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:51.214781 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47aa83d5-5c29-4f32-b6c8-e90e744cb241-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-9t7l6\" (UID: \"47aa83d5-5c29-4f32-b6c8-e90e744cb241\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9t7l6" Jun 05 17:52:51.250218 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:51.250192 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:51.343162 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:51.343103 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9t7l6" Jun 05 17:52:51.387189 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:51.387105 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-747f8db4c5-z98th"] Jun 05 17:52:51.392955 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:52:51.392923 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa87a257_375d_4340_97d4_baff45f80c89.slice/crio-431f8be4c18473c93632e1cdde8a92b67092a3a482713e69a8203d4fe0956645 WatchSource:0}: Error finding container 431f8be4c18473c93632e1cdde8a92b67092a3a482713e69a8203d4fe0956645: Status 404 returned error can't find the container with id 431f8be4c18473c93632e1cdde8a92b67092a3a482713e69a8203d4fe0956645 Jun 05 17:52:51.474524 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:51.474499 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9t7l6"] Jun 05 17:52:51.967956 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:51.967923 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-747f8db4c5-z98th" event={"ID":"aa87a257-375d-4340-97d4-baff45f80c89","Type":"ContainerStarted","Data":"cdb5be2862771d3f3ce64983b5a3165d93d693caaf12d4308da4c2ec3ed1a9cd"} Jun 05 17:52:51.968137 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:51.967976 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-747f8db4c5-z98th" event={"ID":"aa87a257-375d-4340-97d4-baff45f80c89","Type":"ContainerStarted","Data":"431f8be4c18473c93632e1cdde8a92b67092a3a482713e69a8203d4fe0956645"} Jun 05 17:52:51.968137 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:51.968026 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:52:51.969136 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:51.969113 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9t7l6" event={"ID":"47aa83d5-5c29-4f32-b6c8-e90e744cb241","Type":"ContainerStarted","Data":"52346bc33cadd28cb6aa9484a9669c45624622469424bc354dc1c234868dfef7"} Jun 05 17:52:51.989049 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:51.989002 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-747f8db4c5-z98th" podStartSLOduration=16.98898757 podStartE2EDuration="16.98898757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:52:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:52:51.987802496 +0000 UTC m=+221.177781666" watchObservedRunningTime="2026-06-05 17:52:51.98898757 +0000 UTC m=+221.178966738" Jun 05 17:52:53.978070 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:53.978031 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9t7l6" event={"ID":"47aa83d5-5c29-4f32-b6c8-e90e744cb241","Type":"ContainerStarted","Data":"07e7b4ce825460c761ed4f096145d889e0bffe208f9486d0c2892419c986f0dd"} Jun 05 17:52:53.978465 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:53.978094 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9t7l6" event={"ID":"47aa83d5-5c29-4f32-b6c8-e90e744cb241","Type":"ContainerStarted","Data":"e2ba9d8659558c100491117631ba71f44485f9e584edca5ef6bb7443a5d0ec99"} Jun 05 17:52:53.998512 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:52:53.998464 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9t7l6" podStartSLOduration=17.075343328 podStartE2EDuration="18.998450289s" totalImagesPullingTime="1.923106961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:52:53.997599448 +0000 UTC m=+223.187578617" watchObservedRunningTime="2026-06-05 17:52:53.998450289 +0000 UTC m=+223.188429457" Jun 05 17:53:05.711019 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:05.710987 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-747f8db4c5-z98th"] Jun 05 17:53:05.787805 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:05.787776 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6dfb6cdb54-kjnhs"] Jun 05 17:53:05.789880 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:05.789863 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:05.810125 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:05.810094 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dfb6cdb54-kjnhs"] Jun 05 17:53:05.859412 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:05.859388 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pqxrg"] Jun 05 17:53:05.861818 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:05.861796 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pqxrg" Jun 05 17:53:05.881837 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:53:05.881810 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-tls\" is forbidden: User \"system:node:ip-10-0-143-199.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-143-199.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" Jun 05 17:53:05.884268 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:53:05.884204 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-sa-dockercfg-mz8gr\" is forbidden: User \"system:node:ip-10-0-143-199.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-143-199.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mz8gr\"" type="*v1.Secret" Jun 05 17:53:05.890750 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:53:05.890728 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-143-199.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-143-199.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jun 05 17:53:05.915895 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:53:05.915868 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-143-199.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-143-199.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jun 05 17:53:05.916169 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:53:05.916154 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-143-199.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-143-199.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" Jun 05 17:53:05.921626 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:05.921610 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bebd4bc2-e6ce-4b74-a711-f33ac12486e9-data-volume\") pod \"insights-runtime-extractor-pqxrg\" (UID: \"bebd4bc2-e6ce-4b74-a711-f33ac12486e9\") " pod="openshift-insights/insights-runtime-extractor-pqxrg" Jun 05 17:53:05.921682 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:05.921637 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/48a91cf5-c282-4fa5-bf5c-8f3f224c2f65-ca-trust-extracted\") pod \"image-registry-6dfb6cdb54-kjnhs\" (UID: \"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65\") " pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:05.921682 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:05.921654 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/48a91cf5-c282-4fa5-bf5c-8f3f224c2f65-installation-pull-secrets\") pod \"image-registry-6dfb6cdb54-kjnhs\" (UID: \"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65\") " pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:05.921754 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:05.921697 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bebd4bc2-e6ce-4b74-a711-f33ac12486e9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pqxrg\" (UID: \"bebd4bc2-e6ce-4b74-a711-f33ac12486e9\") " pod="openshift-insights/insights-runtime-extractor-pqxrg" Jun 05 17:53:05.921754 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:05.921728 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-292b4\" (UniqueName: \"kubernetes.io/projected/bebd4bc2-e6ce-4b74-a711-f33ac12486e9-kube-api-access-292b4\") pod \"insights-runtime-extractor-pqxrg\" (UID: \"bebd4bc2-e6ce-4b74-a711-f33ac12486e9\") " pod="openshift-insights/insights-runtime-extractor-pqxrg" Jun 05 17:53:05.921829 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:05.921759 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc86r\" (UniqueName: \"kubernetes.io/projected/48a91cf5-c282-4fa5-bf5c-8f3f224c2f65-kube-api-access-dc86r\") pod \"image-registry-6dfb6cdb54-kjnhs\" (UID: \"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65\") " pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:05.921829 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:05.921800 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48a91cf5-c282-4fa5-bf5c-8f3f224c2f65-registry-tls\") pod \"image-registry-6dfb6cdb54-kjnhs\" (UID: \"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65\") " pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:05.921829 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:05.921818 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/48a91cf5-c282-4fa5-bf5c-8f3f224c2f65-registry-certificates\") pod \"image-registry-6dfb6cdb54-kjnhs\" (UID: \"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65\") " pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:05.921970 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:05.921837 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/48a91cf5-c282-4fa5-bf5c-8f3f224c2f65-image-registry-private-configuration\") pod \"image-registry-6dfb6cdb54-kjnhs\" (UID: \"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65\") " pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:05.921970 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:05.921914 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bebd4bc2-e6ce-4b74-a711-f33ac12486e9-crio-socket\") pod \"insights-runtime-extractor-pqxrg\" (UID: \"bebd4bc2-e6ce-4b74-a711-f33ac12486e9\") " pod="openshift-insights/insights-runtime-extractor-pqxrg" Jun 05 17:53:05.921970 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:05.921957 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bebd4bc2-e6ce-4b74-a711-f33ac12486e9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pqxrg\" (UID: \"bebd4bc2-e6ce-4b74-a711-f33ac12486e9\") " pod="openshift-insights/insights-runtime-extractor-pqxrg" Jun 05 17:53:05.922107 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:05.921991 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/48a91cf5-c282-4fa5-bf5c-8f3f224c2f65-trusted-ca\") pod \"image-registry-6dfb6cdb54-kjnhs\" (UID: \"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65\") " pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:05.922107 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:05.922015 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48a91cf5-c282-4fa5-bf5c-8f3f224c2f65-bound-sa-token\") pod \"image-registry-6dfb6cdb54-kjnhs\" (UID: \"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65\") " pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:05.935368 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:05.935337 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pqxrg"] Jun 05 17:53:06.022634 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.022546 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bebd4bc2-e6ce-4b74-a711-f33ac12486e9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pqxrg\" (UID: \"bebd4bc2-e6ce-4b74-a711-f33ac12486e9\") " pod="openshift-insights/insights-runtime-extractor-pqxrg" Jun 05 17:53:06.022634 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.022587 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-292b4\" (UniqueName: \"kubernetes.io/projected/bebd4bc2-e6ce-4b74-a711-f33ac12486e9-kube-api-access-292b4\") pod \"insights-runtime-extractor-pqxrg\" (UID: \"bebd4bc2-e6ce-4b74-a711-f33ac12486e9\") " pod="openshift-insights/insights-runtime-extractor-pqxrg" Jun 05 17:53:06.022634 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.022607 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc86r\" (UniqueName: \"kubernetes.io/projected/48a91cf5-c282-4fa5-bf5c-8f3f224c2f65-kube-api-access-dc86r\") pod \"image-registry-6dfb6cdb54-kjnhs\" (UID: \"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65\") " pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:06.022861 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.022657 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48a91cf5-c282-4fa5-bf5c-8f3f224c2f65-registry-tls\") pod \"image-registry-6dfb6cdb54-kjnhs\" (UID: \"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65\") " pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:06.022861 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.022681 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/48a91cf5-c282-4fa5-bf5c-8f3f224c2f65-registry-certificates\") pod \"image-registry-6dfb6cdb54-kjnhs\" (UID: \"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65\") " pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:06.022861 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.022699 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/48a91cf5-c282-4fa5-bf5c-8f3f224c2f65-image-registry-private-configuration\") pod \"image-registry-6dfb6cdb54-kjnhs\" (UID: \"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65\") " pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:06.022861 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.022735 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bebd4bc2-e6ce-4b74-a711-f33ac12486e9-crio-socket\") pod \"insights-runtime-extractor-pqxrg\" (UID: \"bebd4bc2-e6ce-4b74-a711-f33ac12486e9\") " pod="openshift-insights/insights-runtime-extractor-pqxrg" Jun 05 17:53:06.022861 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.022764 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bebd4bc2-e6ce-4b74-a711-f33ac12486e9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pqxrg\" (UID: \"bebd4bc2-e6ce-4b74-a711-f33ac12486e9\") " pod="openshift-insights/insights-runtime-extractor-pqxrg" Jun 05 17:53:06.022861 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.022793 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/48a91cf5-c282-4fa5-bf5c-8f3f224c2f65-trusted-ca\") pod \"image-registry-6dfb6cdb54-kjnhs\" (UID: \"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65\") " pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:06.023145 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.022815 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48a91cf5-c282-4fa5-bf5c-8f3f224c2f65-bound-sa-token\") pod \"image-registry-6dfb6cdb54-kjnhs\" (UID: \"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65\") " pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:06.023145 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.022936 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bebd4bc2-e6ce-4b74-a711-f33ac12486e9-crio-socket\") pod \"insights-runtime-extractor-pqxrg\" (UID: \"bebd4bc2-e6ce-4b74-a711-f33ac12486e9\") " pod="openshift-insights/insights-runtime-extractor-pqxrg" Jun 05 17:53:06.023145 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.022975 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bebd4bc2-e6ce-4b74-a711-f33ac12486e9-data-volume\") pod \"insights-runtime-extractor-pqxrg\" (UID: \"bebd4bc2-e6ce-4b74-a711-f33ac12486e9\") " pod="openshift-insights/insights-runtime-extractor-pqxrg" Jun 05 17:53:06.023145 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.023017 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/48a91cf5-c282-4fa5-bf5c-8f3f224c2f65-ca-trust-extracted\") pod \"image-registry-6dfb6cdb54-kjnhs\" (UID: \"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65\") " pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:06.023145 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.023048 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/48a91cf5-c282-4fa5-bf5c-8f3f224c2f65-installation-pull-secrets\") pod \"image-registry-6dfb6cdb54-kjnhs\" (UID: \"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65\") " pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:06.023606 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.023542 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bebd4bc2-e6ce-4b74-a711-f33ac12486e9-data-volume\") pod \"insights-runtime-extractor-pqxrg\" (UID: \"bebd4bc2-e6ce-4b74-a711-f33ac12486e9\") " pod="openshift-insights/insights-runtime-extractor-pqxrg" Jun 05 17:53:06.023606 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.023586 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/48a91cf5-c282-4fa5-bf5c-8f3f224c2f65-ca-trust-extracted\") pod \"image-registry-6dfb6cdb54-kjnhs\" (UID: \"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65\") " pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:06.023788 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.023680 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/48a91cf5-c282-4fa5-bf5c-8f3f224c2f65-registry-certificates\") pod \"image-registry-6dfb6cdb54-kjnhs\" (UID: \"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65\") " pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:06.023982 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.023957 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/48a91cf5-c282-4fa5-bf5c-8f3f224c2f65-trusted-ca\") pod \"image-registry-6dfb6cdb54-kjnhs\" (UID: \"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65\") " pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:06.025276 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.025254 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/48a91cf5-c282-4fa5-bf5c-8f3f224c2f65-image-registry-private-configuration\") pod \"image-registry-6dfb6cdb54-kjnhs\" (UID: \"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65\") " pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:06.025415 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.025398 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/48a91cf5-c282-4fa5-bf5c-8f3f224c2f65-installation-pull-secrets\") pod \"image-registry-6dfb6cdb54-kjnhs\" (UID: \"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65\") " pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:06.025475 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.025413 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48a91cf5-c282-4fa5-bf5c-8f3f224c2f65-registry-tls\") pod \"image-registry-6dfb6cdb54-kjnhs\" (UID: \"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65\") " pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:06.034619 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.034592 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc86r\" (UniqueName: \"kubernetes.io/projected/48a91cf5-c282-4fa5-bf5c-8f3f224c2f65-kube-api-access-dc86r\") pod \"image-registry-6dfb6cdb54-kjnhs\" (UID: \"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65\") " pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:06.034721 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.034685 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48a91cf5-c282-4fa5-bf5c-8f3f224c2f65-bound-sa-token\") pod \"image-registry-6dfb6cdb54-kjnhs\" (UID: \"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65\") " pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:06.099128 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.099100 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:06.233543 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.233514 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dfb6cdb54-kjnhs"] Jun 05 17:53:06.236398 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:53:06.236375 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a91cf5_c282_4fa5_bf5c_8f3f224c2f65.slice/crio-4e2aeab39180901b3abe207b5e72f255d48b3f3a98a4bfe7c344172310b9dead WatchSource:0}: Error finding container 4e2aeab39180901b3abe207b5e72f255d48b3f3a98a4bfe7c344172310b9dead: Status 404 returned error can't find the container with id 4e2aeab39180901b3abe207b5e72f255d48b3f3a98a4bfe7c344172310b9dead Jun 05 17:53:06.834454 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:06.834425 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 17:53:07.018103 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:07.018072 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" event={"ID":"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65","Type":"ContainerStarted","Data":"3979ebbf5b50c6b6537fedb1bbeb02eb80089ca1ac35bf1a9d1a377e91750fe6"} Jun 05 17:53:07.018289 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:07.018124 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" event={"ID":"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65","Type":"ContainerStarted","Data":"4e2aeab39180901b3abe207b5e72f255d48b3f3a98a4bfe7c344172310b9dead"} Jun 05 17:53:07.018289 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:07.018213 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:07.023298 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:53:07.023283 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: failed to sync configmap cache: timed out waiting for the condition Jun 05 17:53:07.023366 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:53:07.023348 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bebd4bc2-e6ce-4b74-a711-f33ac12486e9-kube-rbac-proxy-cm podName:bebd4bc2-e6ce-4b74-a711-f33ac12486e9 nodeName:}" failed. No retries permitted until 2026-06-05 17:53:07.523333407 +0000 UTC m=+236.713312554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bebd4bc2-e6ce-4b74-a711-f33ac12486e9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pqxrg" (UID: "bebd4bc2-e6ce-4b74-a711-f33ac12486e9") : failed to sync configmap cache: timed out waiting for the condition Jun 05 17:53:07.023410 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:53:07.023287 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: failed to sync secret cache: timed out waiting for the condition Jun 05 17:53:07.023443 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:53:07.023413 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bebd4bc2-e6ce-4b74-a711-f33ac12486e9-insights-runtime-extractor-tls podName:bebd4bc2-e6ce-4b74-a711-f33ac12486e9 nodeName:}" failed. No retries permitted until 2026-06-05 17:53:07.523398215 +0000 UTC m=+236.713377364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bebd4bc2-e6ce-4b74-a711-f33ac12486e9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pqxrg" (UID: "bebd4bc2-e6ce-4b74-a711-f33ac12486e9") : failed to sync secret cache: timed out waiting for the condition Jun 05 17:53:07.038621 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:07.038585 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" podStartSLOduration=2.038572618 podStartE2EDuration="2.038572618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:53:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:07.037603312 +0000 UTC m=+236.227582481" watchObservedRunningTime="2026-06-05 17:53:07.038572618 +0000 UTC m=+236.228551787" Jun 05 17:53:07.149538 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:07.149516 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 17:53:07.154943 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:07.154924 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-292b4\" (UniqueName: \"kubernetes.io/projected/bebd4bc2-e6ce-4b74-a711-f33ac12486e9-kube-api-access-292b4\") pod \"insights-runtime-extractor-pqxrg\" (UID: \"bebd4bc2-e6ce-4b74-a711-f33ac12486e9\") " pod="openshift-insights/insights-runtime-extractor-pqxrg" Jun 05 17:53:07.231880 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:07.231838 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xbt54\" (UID: \"8e0ba5fe-8bc9-4b38-beda-f77a42e673cd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xbt54" Jun 05 17:53:07.231976 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:07.231884 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-service-ca-bundle\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:53:07.232430 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:07.232413 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3-service-ca-bundle\") pod \"router-default-5cb4fdffb5-hq64f\" (UID: \"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3\") " pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:53:07.234179 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:07.234155 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e0ba5fe-8bc9-4b38-beda-f77a42e673cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xbt54\" (UID: \"8e0ba5fe-8bc9-4b38-beda-f77a42e673cd\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xbt54" Jun 05 17:53:07.248939 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:07.248920 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xbt54" Jun 05 17:53:07.254514 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:07.254500 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:53:07.298774 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:07.298743 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mz8gr\"" Jun 05 17:53:07.324732 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:07.324708 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 17:53:07.393777 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:07.393754 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5cb4fdffb5-hq64f"] Jun 05 17:53:07.394173 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:53:07.394148 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f4b3896_4dff_4c8c_92bb_a75d2c5dd1c3.slice/crio-efc389112458a80247f57d997e2b103f266470cf1412f1ee58d7966d300adebf WatchSource:0}: Error finding container efc389112458a80247f57d997e2b103f266470cf1412f1ee58d7966d300adebf: Status 404 returned error can't find the container with id efc389112458a80247f57d997e2b103f266470cf1412f1ee58d7966d300adebf Jun 05 17:53:07.405508 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:07.405455 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xbt54"] Jun 05 17:53:07.407740 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:53:07.407720 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e0ba5fe_8bc9_4b38_beda_f77a42e673cd.slice/crio-f0450f2761b385ed864623006385f14d0fee11e72e64c3d66d38e40e564bab1b WatchSource:0}: Error finding container f0450f2761b385ed864623006385f14d0fee11e72e64c3d66d38e40e564bab1b: Status 404 returned error can't find the container with id f0450f2761b385ed864623006385f14d0fee11e72e64c3d66d38e40e564bab1b Jun 05 17:53:07.484298 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:07.484272 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 17:53:07.534066 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:07.534037 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bebd4bc2-e6ce-4b74-a711-f33ac12486e9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pqxrg\" (UID: \"bebd4bc2-e6ce-4b74-a711-f33ac12486e9\") " pod="openshift-insights/insights-runtime-extractor-pqxrg" Jun 05 17:53:07.534227 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:07.534205 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bebd4bc2-e6ce-4b74-a711-f33ac12486e9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pqxrg\" (UID: \"bebd4bc2-e6ce-4b74-a711-f33ac12486e9\") " pod="openshift-insights/insights-runtime-extractor-pqxrg" Jun 05 17:53:07.534596 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:07.534581 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bebd4bc2-e6ce-4b74-a711-f33ac12486e9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pqxrg\" (UID: \"bebd4bc2-e6ce-4b74-a711-f33ac12486e9\") " pod="openshift-insights/insights-runtime-extractor-pqxrg" Jun 05 17:53:07.536407 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:07.536389 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bebd4bc2-e6ce-4b74-a711-f33ac12486e9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pqxrg\" (UID: \"bebd4bc2-e6ce-4b74-a711-f33ac12486e9\") " pod="openshift-insights/insights-runtime-extractor-pqxrg" Jun 05 17:53:07.670502 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:07.670432 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pqxrg" Jun 05 17:53:07.791328 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:07.791300 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pqxrg"] Jun 05 17:53:07.793910 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:53:07.793885 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbebd4bc2_e6ce_4b74_a711_f33ac12486e9.slice/crio-a73540f553c968497e962e2f32086c33952f797f889b3277ef0aaa63990a36e9 WatchSource:0}: Error finding container a73540f553c968497e962e2f32086c33952f797f889b3277ef0aaa63990a36e9: Status 404 returned error can't find the container with id a73540f553c968497e962e2f32086c33952f797f889b3277ef0aaa63990a36e9 Jun 05 17:53:08.023359 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:08.023276 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pqxrg" event={"ID":"bebd4bc2-e6ce-4b74-a711-f33ac12486e9","Type":"ContainerStarted","Data":"c6be368bebe5966c9ef6249a8a9cd84b616b1febf525b81c41fa3601d53a5033"} Jun 05 17:53:08.023359 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:08.023333 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pqxrg" event={"ID":"bebd4bc2-e6ce-4b74-a711-f33ac12486e9","Type":"ContainerStarted","Data":"a73540f553c968497e962e2f32086c33952f797f889b3277ef0aaa63990a36e9"} Jun 05 17:53:08.024535 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:08.024505 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xbt54" event={"ID":"8e0ba5fe-8bc9-4b38-beda-f77a42e673cd","Type":"ContainerStarted","Data":"f0450f2761b385ed864623006385f14d0fee11e72e64c3d66d38e40e564bab1b"} Jun 05 17:53:08.026125 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:08.026096 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" event={"ID":"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3","Type":"ContainerStarted","Data":"6932bac8ec4e6af245888843ce8d8feaf017b528ccc52839e917fd25fd1e6e66"} Jun 05 17:53:08.026622 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:08.026591 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" event={"ID":"1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3","Type":"ContainerStarted","Data":"efc389112458a80247f57d997e2b103f266470cf1412f1ee58d7966d300adebf"} Jun 05 17:53:08.047989 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:08.047936 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" podStartSLOduration=33.047917592 podStartE2EDuration="33.047917592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:52:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:08.047079718 +0000 UTC m=+237.237058901" watchObservedRunningTime="2026-06-05 17:53:08.047917592 +0000 UTC m=+237.237896763" Jun 05 17:53:08.255792 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:08.255756 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:53:08.258801 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:08.258771 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:53:09.031619 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:09.031579 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pqxrg" event={"ID":"bebd4bc2-e6ce-4b74-a711-f33ac12486e9","Type":"ContainerStarted","Data":"cb94be5d6bd77198252bc1a4c46ea896454e5c7e73311838167a0051dd11323e"} Jun 05 17:53:09.032056 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:09.031826 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:53:09.033319 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:09.033297 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5cb4fdffb5-hq64f" Jun 05 17:53:10.038508 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:10.038469 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xbt54" event={"ID":"8e0ba5fe-8bc9-4b38-beda-f77a42e673cd","Type":"ContainerStarted","Data":"324aeb30a6cc1d0f2ce5e6fc03a5393b487e36b51f3708c44fc0f591940a8ea3"} Jun 05 17:53:10.056508 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:10.056453 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xbt54" podStartSLOduration=33.170067075 podStartE2EDuration="35.056433122s" totalImagesPullingTime="1.886366047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:10.054961176 +0000 UTC m=+239.244940362" watchObservedRunningTime="2026-06-05 17:53:10.056433122 +0000 UTC m=+239.246412292" Jun 05 17:53:11.044363 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:11.044322 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pqxrg" event={"ID":"bebd4bc2-e6ce-4b74-a711-f33ac12486e9","Type":"ContainerStarted","Data":"3047b110c2ffe6768f191319b8d726667a5824295dde98d40b664c2bb27d5847"} Jun 05 17:53:11.066531 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:11.066486 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pqxrg" podStartSLOduration=3.660574023 podStartE2EDuration="6.06647018s" totalImagesPullingTime="2.405896157s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:53:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:11.064658571 +0000 UTC m=+240.254637740" watchObservedRunningTime="2026-06-05 17:53:11.06647018 +0000 UTC m=+240.256449385" Jun 05 17:53:15.716444 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:15.716409 2553 patch_prober.go:28] interesting pod/image-registry-747f8db4c5-z98th container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 17:53:15.716872 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:15.716465 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-747f8db4c5-z98th" podUID="aa87a257-375d-4340-97d4-baff45f80c89" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 17:53:19.304011 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.303980 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p7bb8"] Jun 05 17:53:19.309310 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.309283 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.312005 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.311982 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-chqsh\"" Jun 05 17:53:19.312277 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.312260 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 17:53:19.312362 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.312310 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 17:53:19.313712 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.312967 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 17:53:19.313712 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.312987 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 17:53:19.425602 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.425569 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0465ba43-6326-4314-a1bf-4b1bef2a001d-metrics-client-ca\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.425797 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.425606 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0465ba43-6326-4314-a1bf-4b1bef2a001d-node-exporter-accelerators-collector-config\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.425797 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.425692 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pddp\" (UniqueName: \"kubernetes.io/projected/0465ba43-6326-4314-a1bf-4b1bef2a001d-kube-api-access-8pddp\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.425923 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.425858 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0465ba43-6326-4314-a1bf-4b1bef2a001d-sys\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.425923 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.425911 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0465ba43-6326-4314-a1bf-4b1bef2a001d-node-exporter-textfile\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.426022 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.425962 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0465ba43-6326-4314-a1bf-4b1bef2a001d-node-exporter-tls\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.426022 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.425985 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0465ba43-6326-4314-a1bf-4b1bef2a001d-node-exporter-wtmp\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.426022 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.426011 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0465ba43-6326-4314-a1bf-4b1bef2a001d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.426137 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.426035 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0465ba43-6326-4314-a1bf-4b1bef2a001d-root\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.527201 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.527171 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0465ba43-6326-4314-a1bf-4b1bef2a001d-metrics-client-ca\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.527201 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.527204 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0465ba43-6326-4314-a1bf-4b1bef2a001d-node-exporter-accelerators-collector-config\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.527433 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.527247 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pddp\" (UniqueName: \"kubernetes.io/projected/0465ba43-6326-4314-a1bf-4b1bef2a001d-kube-api-access-8pddp\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.527433 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.527269 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0465ba43-6326-4314-a1bf-4b1bef2a001d-sys\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.527433 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.527295 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0465ba43-6326-4314-a1bf-4b1bef2a001d-node-exporter-textfile\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.527433 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.527338 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0465ba43-6326-4314-a1bf-4b1bef2a001d-node-exporter-tls\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.527433 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.527361 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0465ba43-6326-4314-a1bf-4b1bef2a001d-node-exporter-wtmp\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.527433 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.527365 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0465ba43-6326-4314-a1bf-4b1bef2a001d-sys\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.527433 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.527384 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0465ba43-6326-4314-a1bf-4b1bef2a001d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.527433 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.527426 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0465ba43-6326-4314-a1bf-4b1bef2a001d-root\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.527835 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.527551 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0465ba43-6326-4314-a1bf-4b1bef2a001d-root\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.527835 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.527666 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0465ba43-6326-4314-a1bf-4b1bef2a001d-node-exporter-wtmp\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.527935 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.527886 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0465ba43-6326-4314-a1bf-4b1bef2a001d-metrics-client-ca\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.527935 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.527924 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0465ba43-6326-4314-a1bf-4b1bef2a001d-node-exporter-textfile\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.528027 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.527945 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0465ba43-6326-4314-a1bf-4b1bef2a001d-node-exporter-accelerators-collector-config\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.529890 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.529865 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0465ba43-6326-4314-a1bf-4b1bef2a001d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.530173 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.530152 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0465ba43-6326-4314-a1bf-4b1bef2a001d-node-exporter-tls\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.536076 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.536048 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pddp\" (UniqueName: \"kubernetes.io/projected/0465ba43-6326-4314-a1bf-4b1bef2a001d-kube-api-access-8pddp\") pod \"node-exporter-p7bb8\" (UID: \"0465ba43-6326-4314-a1bf-4b1bef2a001d\") " pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.620161 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:19.620130 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p7bb8" Jun 05 17:53:19.632018 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:53:19.631993 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0465ba43_6326_4314_a1bf_4b1bef2a001d.slice/crio-8bc827a74546451ff9344ba64d8e692392037f3745c98124c32876c0a1a7e940 WatchSource:0}: Error finding container 8bc827a74546451ff9344ba64d8e692392037f3745c98124c32876c0a1a7e940: Status 404 returned error can't find the container with id 8bc827a74546451ff9344ba64d8e692392037f3745c98124c32876c0a1a7e940 Jun 05 17:53:20.074192 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:20.074105 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p7bb8" event={"ID":"0465ba43-6326-4314-a1bf-4b1bef2a001d","Type":"ContainerStarted","Data":"8bc827a74546451ff9344ba64d8e692392037f3745c98124c32876c0a1a7e940"} Jun 05 17:53:21.079102 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:21.079013 2553 generic.go:356] "Generic (PLEG): container finished" podID="0465ba43-6326-4314-a1bf-4b1bef2a001d" containerID="350ea94c7de95b5e8510cb19a8581990a9fe46fa7c6e1d8f2fc4a437fd4a01d4" exitCode=0 Jun 05 17:53:21.079102 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:21.079066 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p7bb8" event={"ID":"0465ba43-6326-4314-a1bf-4b1bef2a001d","Type":"ContainerDied","Data":"350ea94c7de95b5e8510cb19a8581990a9fe46fa7c6e1d8f2fc4a437fd4a01d4"} Jun 05 17:53:22.088477 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:22.088444 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p7bb8" event={"ID":"0465ba43-6326-4314-a1bf-4b1bef2a001d","Type":"ContainerStarted","Data":"7d5eec6a1a08b546b1d619da73f48a5e926aa12c4391bc50f43e707de0433521"} Jun 05 17:53:22.088845 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:22.088518 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p7bb8" event={"ID":"0465ba43-6326-4314-a1bf-4b1bef2a001d","Type":"ContainerStarted","Data":"8a57ff73f28b98173c2ab2199503b6b66e45285f7e6a439c8429b9203a3dc95f"} Jun 05 17:53:22.110069 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:22.110020 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p7bb8" podStartSLOduration=2.074337479 podStartE2EDuration="3.110005826s" totalImagesPullingTime="973.249322ms" totalInitContainerRuntime="62.419025ms" isStatefulPod=true podCreationTimestamp="2026-06-05 17:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:22.107453971 +0000 UTC m=+251.297433143" watchObservedRunningTime="2026-06-05 17:53:22.110005826 +0000 UTC m=+251.299985041" Jun 05 17:53:23.057474 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:23.057442 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs\") pod \"network-metrics-daemon-nbsjk\" (UID: \"0e0bcb41-a6ca-4334-b790-165d44925258\") " pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:53:23.059628 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:23.059610 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e0bcb41-a6ca-4334-b790-165d44925258-metrics-certs\") pod \"network-metrics-daemon-nbsjk\" (UID: \"0e0bcb41-a6ca-4334-b790-165d44925258\") " pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:53:23.268491 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:23.268467 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-42j2w\"" Jun 05 17:53:23.276010 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:23.275989 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbsjk" Jun 05 17:53:23.398066 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:23.398037 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nbsjk"] Jun 05 17:53:23.401750 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:53:23.401719 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e0bcb41_a6ca_4334_b790_165d44925258.slice/crio-7521943e516aa7103ffbcef49867b6310623f453bc49c8e400e4f3484511c471 WatchSource:0}: Error finding container 7521943e516aa7103ffbcef49867b6310623f453bc49c8e400e4f3484511c471: Status 404 returned error can't find the container with id 7521943e516aa7103ffbcef49867b6310623f453bc49c8e400e4f3484511c471 Jun 05 17:53:24.096879 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.096837 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nbsjk" event={"ID":"0e0bcb41-a6ca-4334-b790-165d44925258","Type":"ContainerStarted","Data":"7521943e516aa7103ffbcef49867b6310623f453bc49c8e400e4f3484511c471"} Jun 05 17:53:24.416186 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.416111 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-dcbf484f7-w6wfj"] Jun 05 17:53:24.419144 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.419126 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.421741 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.421715 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 05 17:53:24.421851 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.421834 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 05 17:53:24.422156 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.422132 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 05 17:53:24.422156 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.422146 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-5dmk5\"" Jun 05 17:53:24.422345 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.422158 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 05 17:53:24.422345 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.422145 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 05 17:53:24.426786 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.426730 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 05 17:53:24.435368 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.435349 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-dcbf484f7-w6wfj"] Jun 05 17:53:24.571481 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.571453 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2262c61-9780-4c31-a5cd-479d5305786a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-dcbf484f7-w6wfj\" (UID: \"b2262c61-9780-4c31-a5cd-479d5305786a\") " pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.571543 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.571527 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2262c61-9780-4c31-a5cd-479d5305786a-serving-certs-ca-bundle\") pod \"telemeter-client-dcbf484f7-w6wfj\" (UID: \"b2262c61-9780-4c31-a5cd-479d5305786a\") " pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.571584 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.571572 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2262c61-9780-4c31-a5cd-479d5305786a-metrics-client-ca\") pod \"telemeter-client-dcbf484f7-w6wfj\" (UID: \"b2262c61-9780-4c31-a5cd-479d5305786a\") " pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.571651 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.571637 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b2262c61-9780-4c31-a5cd-479d5305786a-telemeter-client-tls\") pod \"telemeter-client-dcbf484f7-w6wfj\" (UID: \"b2262c61-9780-4c31-a5cd-479d5305786a\") " pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.571704 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.571685 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2262c61-9780-4c31-a5cd-479d5305786a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-dcbf484f7-w6wfj\" (UID: \"b2262c61-9780-4c31-a5cd-479d5305786a\") " pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.571736 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.571724 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b2262c61-9780-4c31-a5cd-479d5305786a-federate-client-tls\") pod \"telemeter-client-dcbf484f7-w6wfj\" (UID: \"b2262c61-9780-4c31-a5cd-479d5305786a\") " pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.571768 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.571743 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b2262c61-9780-4c31-a5cd-479d5305786a-secret-telemeter-client\") pod \"telemeter-client-dcbf484f7-w6wfj\" (UID: \"b2262c61-9780-4c31-a5cd-479d5305786a\") " pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.571768 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.571758 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkxlq\" (UniqueName: \"kubernetes.io/projected/b2262c61-9780-4c31-a5cd-479d5305786a-kube-api-access-fkxlq\") pod \"telemeter-client-dcbf484f7-w6wfj\" (UID: \"b2262c61-9780-4c31-a5cd-479d5305786a\") " pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.673272 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.673182 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2262c61-9780-4c31-a5cd-479d5305786a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-dcbf484f7-w6wfj\" (UID: \"b2262c61-9780-4c31-a5cd-479d5305786a\") " pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.673272 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.673230 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2262c61-9780-4c31-a5cd-479d5305786a-serving-certs-ca-bundle\") pod \"telemeter-client-dcbf484f7-w6wfj\" (UID: \"b2262c61-9780-4c31-a5cd-479d5305786a\") " pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.673452 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.673281 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2262c61-9780-4c31-a5cd-479d5305786a-metrics-client-ca\") pod \"telemeter-client-dcbf484f7-w6wfj\" (UID: \"b2262c61-9780-4c31-a5cd-479d5305786a\") " pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.673452 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.673311 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b2262c61-9780-4c31-a5cd-479d5305786a-telemeter-client-tls\") pod \"telemeter-client-dcbf484f7-w6wfj\" (UID: \"b2262c61-9780-4c31-a5cd-479d5305786a\") " pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.673452 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.673336 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2262c61-9780-4c31-a5cd-479d5305786a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-dcbf484f7-w6wfj\" (UID: \"b2262c61-9780-4c31-a5cd-479d5305786a\") " pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.673577 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.673503 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b2262c61-9780-4c31-a5cd-479d5305786a-federate-client-tls\") pod \"telemeter-client-dcbf484f7-w6wfj\" (UID: \"b2262c61-9780-4c31-a5cd-479d5305786a\") " pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.673577 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.673549 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b2262c61-9780-4c31-a5cd-479d5305786a-secret-telemeter-client\") pod \"telemeter-client-dcbf484f7-w6wfj\" (UID: \"b2262c61-9780-4c31-a5cd-479d5305786a\") " pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.673670 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.673581 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkxlq\" (UniqueName: \"kubernetes.io/projected/b2262c61-9780-4c31-a5cd-479d5305786a-kube-api-access-fkxlq\") pod \"telemeter-client-dcbf484f7-w6wfj\" (UID: \"b2262c61-9780-4c31-a5cd-479d5305786a\") " pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.674128 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.674097 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2262c61-9780-4c31-a5cd-479d5305786a-serving-certs-ca-bundle\") pod \"telemeter-client-dcbf484f7-w6wfj\" (UID: \"b2262c61-9780-4c31-a5cd-479d5305786a\") " pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.674267 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.674144 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2262c61-9780-4c31-a5cd-479d5305786a-metrics-client-ca\") pod \"telemeter-client-dcbf484f7-w6wfj\" (UID: \"b2262c61-9780-4c31-a5cd-479d5305786a\") " pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.674351 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.674328 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2262c61-9780-4c31-a5cd-479d5305786a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-dcbf484f7-w6wfj\" (UID: \"b2262c61-9780-4c31-a5cd-479d5305786a\") " pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.675966 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.675946 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b2262c61-9780-4c31-a5cd-479d5305786a-federate-client-tls\") pod \"telemeter-client-dcbf484f7-w6wfj\" (UID: \"b2262c61-9780-4c31-a5cd-479d5305786a\") " pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.676116 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.676085 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b2262c61-9780-4c31-a5cd-479d5305786a-secret-telemeter-client\") pod \"telemeter-client-dcbf484f7-w6wfj\" (UID: \"b2262c61-9780-4c31-a5cd-479d5305786a\") " pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.676195 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.676172 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2262c61-9780-4c31-a5cd-479d5305786a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-dcbf484f7-w6wfj\" (UID: \"b2262c61-9780-4c31-a5cd-479d5305786a\") " pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.676280 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.676266 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b2262c61-9780-4c31-a5cd-479d5305786a-telemeter-client-tls\") pod \"telemeter-client-dcbf484f7-w6wfj\" (UID: \"b2262c61-9780-4c31-a5cd-479d5305786a\") " pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.684440 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.684418 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkxlq\" (UniqueName: \"kubernetes.io/projected/b2262c61-9780-4c31-a5cd-479d5305786a-kube-api-access-fkxlq\") pod \"telemeter-client-dcbf484f7-w6wfj\" (UID: \"b2262c61-9780-4c31-a5cd-479d5305786a\") " pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.728590 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.728564 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" Jun 05 17:53:24.881402 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:24.881368 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-dcbf484f7-w6wfj"] Jun 05 17:53:24.883854 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:53:24.883828 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2262c61_9780_4c31_a5cd_479d5305786a.slice/crio-21d8519811c13678cb07cac3369cc12fa29d52a973ef41d82f08fc6ea5a3e9d7 WatchSource:0}: Error finding container 21d8519811c13678cb07cac3369cc12fa29d52a973ef41d82f08fc6ea5a3e9d7: Status 404 returned error can't find the container with id 21d8519811c13678cb07cac3369cc12fa29d52a973ef41d82f08fc6ea5a3e9d7 Jun 05 17:53:25.102384 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.102344 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nbsjk" event={"ID":"0e0bcb41-a6ca-4334-b790-165d44925258","Type":"ContainerStarted","Data":"f04fbbd64d1a2a2dd1fa0956b9ec2a297c7a3cef080ea43685c2a4c8b1b36d92"} Jun 05 17:53:25.102564 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.102413 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nbsjk" event={"ID":"0e0bcb41-a6ca-4334-b790-165d44925258","Type":"ContainerStarted","Data":"9d8b06adec6ab8f7e08a7e2af3a7b304063cf1f0e54631d0bf3d0eaa2454fc32"} Jun 05 17:53:25.103474 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.103451 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" event={"ID":"b2262c61-9780-4c31-a5cd-479d5305786a","Type":"ContainerStarted","Data":"21d8519811c13678cb07cac3369cc12fa29d52a973ef41d82f08fc6ea5a3e9d7"} Jun 05 17:53:25.123531 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.123482 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nbsjk" podStartSLOduration=253.085701898 podStartE2EDuration="4m14.123468123s" totalImagesPullingTime="1.037766225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:25.122762417 +0000 UTC m=+254.312741587" watchObservedRunningTime="2026-06-05 17:53:25.123468123 +0000 UTC m=+254.313447295" Jun 05 17:53:25.490131 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.489479 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 17:53:25.493530 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.493504 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.496488 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.496461 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 05 17:53:25.496598 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.496463 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 05 17:53:25.496736 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.496709 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 05 17:53:25.496861 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.496772 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-affls3gubk92q\"" Jun 05 17:53:25.496861 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.496832 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 05 17:53:25.496861 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.496839 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 05 17:53:25.497097 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.496975 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 05 17:53:25.497373 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.497214 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-d6z9r\"" Jun 05 17:53:25.497373 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.497227 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 05 17:53:25.497531 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.497417 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 05 17:53:25.497531 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.497493 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 05 17:53:25.497637 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.497577 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 05 17:53:25.497699 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.497654 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 05 17:53:25.498228 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.498154 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 05 17:53:25.498228 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.498180 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 05 17:53:25.501828 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.501802 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 05 17:53:25.504969 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.504950 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 05 17:53:25.516153 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.516129 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 17:53:25.683297 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.683267 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.683483 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.683309 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.683483 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.683412 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.683483 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.683438 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.683483 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.683470 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69399686-bb25-4fa4-80c1-4ad9e2ec0064-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.683693 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.683497 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.683693 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.683528 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69399686-bb25-4fa4-80c1-4ad9e2ec0064-config-out\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.683693 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.683555 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.683693 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.683624 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-config\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.683693 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.683652 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-web-config\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.683693 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.683677 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.683978 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.683737 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.683978 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.683777 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.683978 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.683801 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.683978 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.683859 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.683978 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.683897 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv2j8\" (UniqueName: \"kubernetes.io/projected/69399686-bb25-4fa4-80c1-4ad9e2ec0064-kube-api-access-xv2j8\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.683978 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.683938 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.683978 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.683966 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.684339 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.684012 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.684339 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.684037 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.715587 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.715561 2553 patch_prober.go:28] interesting pod/image-registry-747f8db4c5-z98th container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 17:53:25.715737 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.715603 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-747f8db4c5-z98th" podUID="aa87a257-375d-4340-97d4-baff45f80c89" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 17:53:25.784843 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.784768 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.784843 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.784811 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.784843 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.784835 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.785072 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.784879 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.785072 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.784898 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.785072 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.784924 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69399686-bb25-4fa4-80c1-4ad9e2ec0064-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.785072 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.784952 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.785072 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.784975 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69399686-bb25-4fa4-80c1-4ad9e2ec0064-config-out\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.785072 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.784997 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.785072 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.785021 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-config\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.785072 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.785044 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-web-config\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.785072 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.785065 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.785496 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.785095 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.785496 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.785124 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.785496 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.785146 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.785496 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.785183 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.785496 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.785207 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv2j8\" (UniqueName: \"kubernetes.io/projected/69399686-bb25-4fa4-80c1-4ad9e2ec0064-kube-api-access-xv2j8\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.785496 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.785306 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.785496 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.785347 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.785496 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.785409 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.785866 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.785669 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.785866 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.785856 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.786095 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.786043 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.786661 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.786634 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.788121 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.787922 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.788257 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.788185 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.788634 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.788611 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.788717 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.788671 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.788886 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.788859 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.789078 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.789053 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69399686-bb25-4fa4-80c1-4ad9e2ec0064-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.789146 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.789127 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.789447 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.789251 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.789849 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.789824 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-config\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.790742 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.790712 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.790845 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.790818 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.790899 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.790852 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69399686-bb25-4fa4-80c1-4ad9e2ec0064-config-out\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.790960 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.790936 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-web-config\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.791073 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.791052 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.791658 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.791636 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.794377 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.794353 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv2j8\" (UniqueName: \"kubernetes.io/projected/69399686-bb25-4fa4-80c1-4ad9e2ec0064-kube-api-access-xv2j8\") pod \"prometheus-k8s-0\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.806331 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.806293 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:25.951558 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:25.951520 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 17:53:25.955347 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:53:25.955322 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69399686_bb25_4fa4_80c1_4ad9e2ec0064.slice/crio-ee8b50597565955713a57d501760e443b117197eaba03281cc39297e2ac0149d WatchSource:0}: Error finding container ee8b50597565955713a57d501760e443b117197eaba03281cc39297e2ac0149d: Status 404 returned error can't find the container with id ee8b50597565955713a57d501760e443b117197eaba03281cc39297e2ac0149d Jun 05 17:53:26.105249 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:26.105194 2553 patch_prober.go:28] interesting pod/image-registry-6dfb6cdb54-kjnhs container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 17:53:26.105410 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:26.105280 2553 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" podUID="48a91cf5-c282-4fa5-bf5c-8f3f224c2f65" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 17:53:26.108700 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:26.108668 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69399686-bb25-4fa4-80c1-4ad9e2ec0064","Type":"ContainerStarted","Data":"ee8b50597565955713a57d501760e443b117197eaba03281cc39297e2ac0149d"} Jun 05 17:53:27.113463 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:27.113437 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" event={"ID":"b2262c61-9780-4c31-a5cd-479d5305786a","Type":"ContainerStarted","Data":"96ae62745baf685f8444eb5317cc63cf59bd7bb09971ef748f2b9fe4da69aadf"} Jun 05 17:53:28.031443 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:28.031413 2553 patch_prober.go:28] interesting pod/image-registry-6dfb6cdb54-kjnhs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 17:53:28.031611 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:28.031459 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" podUID="48a91cf5-c282-4fa5-bf5c-8f3f224c2f65" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 17:53:28.119289 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:28.119256 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" event={"ID":"b2262c61-9780-4c31-a5cd-479d5305786a","Type":"ContainerStarted","Data":"eaa1a836f8490d17fe21320207ee878d8f9ec55a95faf7492421900cf4778a6b"} Jun 05 17:53:28.119693 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:28.119314 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" event={"ID":"b2262c61-9780-4c31-a5cd-479d5305786a","Type":"ContainerStarted","Data":"80987d3fe9cba1cae9341ede37cfaf0ded28c19dd2db68d49b4c4bcf8907d16a"} Jun 05 17:53:28.120821 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:28.120798 2553 generic.go:356] "Generic (PLEG): container finished" podID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerID="9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464" exitCode=0 Jun 05 17:53:28.120913 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:28.120833 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69399686-bb25-4fa4-80c1-4ad9e2ec0064","Type":"ContainerDied","Data":"9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464"} Jun 05 17:53:28.142943 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:28.142896 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-dcbf484f7-w6wfj" podStartSLOduration=2.003765101 podStartE2EDuration="4.142878698s" totalImagesPullingTime="2.139113597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:53:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:28.14255284 +0000 UTC m=+257.332532007" watchObservedRunningTime="2026-06-05 17:53:28.142878698 +0000 UTC m=+257.332857867" Jun 05 17:53:30.730101 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:30.729997 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-747f8db4c5-z98th" podUID="aa87a257-375d-4340-97d4-baff45f80c89" containerName="registry" containerID="cri-o://cdb5be2862771d3f3ce64983b5a3165d93d693caaf12d4308da4c2ec3ed1a9cd" gracePeriod=30 Jun 05 17:53:31.610219 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:31.610196 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:53:31.635766 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:31.635745 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-registry-tls\") pod \"aa87a257-375d-4340-97d4-baff45f80c89\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " Jun 05 17:53:31.635866 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:31.635784 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa87a257-375d-4340-97d4-baff45f80c89-image-registry-private-configuration\") pod \"aa87a257-375d-4340-97d4-baff45f80c89\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " Jun 05 17:53:31.636204 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:31.636180 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pm9mp\" (UniqueName: \"kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-kube-api-access-pm9mp\") pod \"aa87a257-375d-4340-97d4-baff45f80c89\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " Jun 05 17:53:31.636299 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:31.636257 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-bound-sa-token\") pod \"aa87a257-375d-4340-97d4-baff45f80c89\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " Jun 05 17:53:31.636299 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:31.636291 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa87a257-375d-4340-97d4-baff45f80c89-installation-pull-secrets\") pod \"aa87a257-375d-4340-97d4-baff45f80c89\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " Jun 05 17:53:31.636410 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:31.636328 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa87a257-375d-4340-97d4-baff45f80c89-trusted-ca\") pod \"aa87a257-375d-4340-97d4-baff45f80c89\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " Jun 05 17:53:31.636410 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:31.636364 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa87a257-375d-4340-97d4-baff45f80c89-ca-trust-extracted\") pod \"aa87a257-375d-4340-97d4-baff45f80c89\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " Jun 05 17:53:31.636524 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:31.636415 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa87a257-375d-4340-97d4-baff45f80c89-registry-certificates\") pod \"aa87a257-375d-4340-97d4-baff45f80c89\" (UID: \"aa87a257-375d-4340-97d4-baff45f80c89\") " Jun 05 17:53:31.638254 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:31.638034 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa87a257-375d-4340-97d4-baff45f80c89-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "aa87a257-375d-4340-97d4-baff45f80c89" (UID: "aa87a257-375d-4340-97d4-baff45f80c89"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:53:31.638254 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:31.638200 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa87a257-375d-4340-97d4-baff45f80c89-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "aa87a257-375d-4340-97d4-baff45f80c89" (UID: "aa87a257-375d-4340-97d4-baff45f80c89"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:53:31.638254 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:31.638222 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "aa87a257-375d-4340-97d4-baff45f80c89" (UID: "aa87a257-375d-4340-97d4-baff45f80c89"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:53:31.639481 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:31.639452 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa87a257-375d-4340-97d4-baff45f80c89-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "aa87a257-375d-4340-97d4-baff45f80c89" (UID: "aa87a257-375d-4340-97d4-baff45f80c89"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:53:31.639888 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:31.639861 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa87a257-375d-4340-97d4-baff45f80c89-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "aa87a257-375d-4340-97d4-baff45f80c89" (UID: "aa87a257-375d-4340-97d4-baff45f80c89"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:53:31.640264 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:31.640217 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "aa87a257-375d-4340-97d4-baff45f80c89" (UID: "aa87a257-375d-4340-97d4-baff45f80c89"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:53:31.640449 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:31.640421 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-kube-api-access-pm9mp" (OuterVolumeSpecName: "kube-api-access-pm9mp") pod "aa87a257-375d-4340-97d4-baff45f80c89" (UID: "aa87a257-375d-4340-97d4-baff45f80c89"). InnerVolumeSpecName "kube-api-access-pm9mp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:53:31.646932 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:31.646910 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa87a257-375d-4340-97d4-baff45f80c89-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "aa87a257-375d-4340-97d4-baff45f80c89" (UID: "aa87a257-375d-4340-97d4-baff45f80c89"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:53:31.739835 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:31.739716 2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa87a257-375d-4340-97d4-baff45f80c89-trusted-ca\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:53:31.739835 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:31.739764 2553 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa87a257-375d-4340-97d4-baff45f80c89-ca-trust-extracted\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:53:31.739835 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:31.739787 2553 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa87a257-375d-4340-97d4-baff45f80c89-registry-certificates\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:53:31.739835 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:31.739799 2553 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-registry-tls\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:53:31.739835 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:31.739812 2553 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa87a257-375d-4340-97d4-baff45f80c89-image-registry-private-configuration\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:53:31.739835 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:31.739824 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pm9mp\" (UniqueName: \"kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-kube-api-access-pm9mp\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:53:31.739835 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:31.739839 2553 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa87a257-375d-4340-97d4-baff45f80c89-bound-sa-token\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:53:31.739835 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:31.739852 2553 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa87a257-375d-4340-97d4-baff45f80c89-installation-pull-secrets\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:53:32.139661 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:32.139631 2553 generic.go:356] "Generic (PLEG): container finished" podID="aa87a257-375d-4340-97d4-baff45f80c89" containerID="cdb5be2862771d3f3ce64983b5a3165d93d693caaf12d4308da4c2ec3ed1a9cd" exitCode=0 Jun 05 17:53:32.139817 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:32.139670 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-747f8db4c5-z98th" Jun 05 17:53:32.139817 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:32.139720 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-747f8db4c5-z98th" event={"ID":"aa87a257-375d-4340-97d4-baff45f80c89","Type":"ContainerDied","Data":"cdb5be2862771d3f3ce64983b5a3165d93d693caaf12d4308da4c2ec3ed1a9cd"} Jun 05 17:53:32.139817 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:32.139779 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-747f8db4c5-z98th" event={"ID":"aa87a257-375d-4340-97d4-baff45f80c89","Type":"ContainerDied","Data":"431f8be4c18473c93632e1cdde8a92b67092a3a482713e69a8203d4fe0956645"} Jun 05 17:53:32.139976 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:32.139822 2553 scope.go:117] "RemoveContainer" containerID="cdb5be2862771d3f3ce64983b5a3165d93d693caaf12d4308da4c2ec3ed1a9cd" Jun 05 17:53:32.141949 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:32.141927 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69399686-bb25-4fa4-80c1-4ad9e2ec0064","Type":"ContainerStarted","Data":"76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9"} Jun 05 17:53:32.142062 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:32.141994 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69399686-bb25-4fa4-80c1-4ad9e2ec0064","Type":"ContainerStarted","Data":"ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048"} Jun 05 17:53:32.149341 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:32.149325 2553 scope.go:117] "RemoveContainer" containerID="cdb5be2862771d3f3ce64983b5a3165d93d693caaf12d4308da4c2ec3ed1a9cd" Jun 05 17:53:32.149604 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:53:32.149583 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdb5be2862771d3f3ce64983b5a3165d93d693caaf12d4308da4c2ec3ed1a9cd\": container with ID starting with cdb5be2862771d3f3ce64983b5a3165d93d693caaf12d4308da4c2ec3ed1a9cd not found: ID does not exist" containerID="cdb5be2862771d3f3ce64983b5a3165d93d693caaf12d4308da4c2ec3ed1a9cd" Jun 05 17:53:32.149649 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:32.149613 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdb5be2862771d3f3ce64983b5a3165d93d693caaf12d4308da4c2ec3ed1a9cd"} err="failed to get container status \"cdb5be2862771d3f3ce64983b5a3165d93d693caaf12d4308da4c2ec3ed1a9cd\": rpc error: code = NotFound desc = could not find container \"cdb5be2862771d3f3ce64983b5a3165d93d693caaf12d4308da4c2ec3ed1a9cd\": container with ID starting with cdb5be2862771d3f3ce64983b5a3165d93d693caaf12d4308da4c2ec3ed1a9cd not found: ID does not exist" Jun 05 17:53:32.162915 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:32.162893 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-747f8db4c5-z98th"] Jun 05 17:53:32.166952 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:32.166935 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-747f8db4c5-z98th"] Jun 05 17:53:33.269683 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:33.269655 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa87a257-375d-4340-97d4-baff45f80c89" path="/var/lib/kubelet/pods/aa87a257-375d-4340-97d4-baff45f80c89/volumes" Jun 05 17:53:34.153067 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:34.153029 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69399686-bb25-4fa4-80c1-4ad9e2ec0064","Type":"ContainerStarted","Data":"4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0"} Jun 05 17:53:34.153230 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:34.153096 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69399686-bb25-4fa4-80c1-4ad9e2ec0064","Type":"ContainerStarted","Data":"69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb"} Jun 05 17:53:34.153230 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:34.153128 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69399686-bb25-4fa4-80c1-4ad9e2ec0064","Type":"ContainerStarted","Data":"404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd"} Jun 05 17:53:34.153230 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:34.153158 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69399686-bb25-4fa4-80c1-4ad9e2ec0064","Type":"ContainerStarted","Data":"2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364"} Jun 05 17:53:34.184565 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:34.184515 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.6858539649999997 podStartE2EDuration="9.1844997s" totalImagesPullingTime="6.479594674s" totalInitContainerRuntime="19.051061ms" isStatefulPod=false podCreationTimestamp="2026-06-05 17:53:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:34.182291154 +0000 UTC m=+263.372270324" watchObservedRunningTime="2026-06-05 17:53:34.1844997 +0000 UTC m=+263.374478868" Jun 05 17:53:35.807368 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:35.807335 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:53:36.103985 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:36.103957 2553 patch_prober.go:28] interesting pod/image-registry-6dfb6cdb54-kjnhs container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 17:53:36.104123 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:36.104003 2553 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" podUID="48a91cf5-c282-4fa5-bf5c-8f3f224c2f65" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 17:53:38.031034 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:38.031001 2553 patch_prober.go:28] interesting pod/image-registry-6dfb6cdb54-kjnhs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 17:53:38.031501 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:38.031051 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" podUID="48a91cf5-c282-4fa5-bf5c-8f3f224c2f65" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 17:53:46.103216 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:46.103181 2553 patch_prober.go:28] interesting pod/image-registry-6dfb6cdb54-kjnhs container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 17:53:46.103592 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:46.103228 2553 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" podUID="48a91cf5-c282-4fa5-bf5c-8f3f224c2f65" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 17:53:46.103592 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:46.103285 2553 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:53:46.103672 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:46.103652 2553 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"3979ebbf5b50c6b6537fedb1bbeb02eb80089ca1ac35bf1a9d1a377e91750fe6"} pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" containerMessage="Container registry failed liveness probe, will be restarted" Jun 05 17:53:46.107158 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:46.107134 2553 patch_prober.go:28] interesting pod/image-registry-6dfb6cdb54-kjnhs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 17:53:46.107293 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:46.107183 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" podUID="48a91cf5-c282-4fa5-bf5c-8f3f224c2f65" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 17:53:51.780318 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:53:51.780265 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-z7h9r" podUID="0b586fdc-e65a-4afc-91c4-2f6307527422" Jun 05 17:53:52.221321 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:52.221292 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z7h9r" Jun 05 17:53:55.643963 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:55.643924 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls\") pod \"dns-default-z7h9r\" (UID: \"0b586fdc-e65a-4afc-91c4-2f6307527422\") " pod="openshift-dns/dns-default-z7h9r" Jun 05 17:53:55.646146 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:55.646118 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b586fdc-e65a-4afc-91c4-2f6307527422-metrics-tls\") pod \"dns-default-z7h9r\" (UID: \"0b586fdc-e65a-4afc-91c4-2f6307527422\") " pod="openshift-dns/dns-default-z7h9r" Jun 05 17:53:55.824990 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:55.824959 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6c4cc\"" Jun 05 17:53:55.833122 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:55.833098 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z7h9r" Jun 05 17:53:55.958064 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:55.958030 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z7h9r"] Jun 05 17:53:55.961431 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:53:55.961404 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b586fdc_e65a_4afc_91c4_2f6307527422.slice/crio-3acfb6d85afa23ab2526cb43b84f4931c69e7495548a3c6be02018165ea606db WatchSource:0}: Error finding container 3acfb6d85afa23ab2526cb43b84f4931c69e7495548a3c6be02018165ea606db: Status 404 returned error can't find the container with id 3acfb6d85afa23ab2526cb43b84f4931c69e7495548a3c6be02018165ea606db Jun 05 17:53:56.108072 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:56.108034 2553 patch_prober.go:28] interesting pod/image-registry-6dfb6cdb54-kjnhs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 17:53:56.108216 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:56.108096 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" podUID="48a91cf5-c282-4fa5-bf5c-8f3f224c2f65" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 17:53:56.235951 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:56.235867 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z7h9r" event={"ID":"0b586fdc-e65a-4afc-91c4-2f6307527422","Type":"ContainerStarted","Data":"3acfb6d85afa23ab2526cb43b84f4931c69e7495548a3c6be02018165ea606db"} Jun 05 17:53:58.245215 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:58.245177 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z7h9r" event={"ID":"0b586fdc-e65a-4afc-91c4-2f6307527422","Type":"ContainerStarted","Data":"4dd264037a4668fe0418201245373e180d1a3d6a7700e348188d9662952d2b4e"} Jun 05 17:53:58.245707 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:58.245228 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z7h9r" event={"ID":"0b586fdc-e65a-4afc-91c4-2f6307527422","Type":"ContainerStarted","Data":"e29769fd120b33414a87f88caea0b6093c4c858ccc98bebd6d6a6381e521234c"} Jun 05 17:53:58.245707 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:58.245279 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z7h9r" Jun 05 17:53:58.263589 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:53:58.263528 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z7h9r" podStartSLOduration=251.732035186 podStartE2EDuration="4m13.263501364s" totalImagesPullingTime="1.531466178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:58.262483293 +0000 UTC m=+287.452462463" watchObservedRunningTime="2026-06-05 17:53:58.263501364 +0000 UTC m=+287.453480538" Jun 05 17:54:04.030016 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:04.029984 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z7h9r_0b586fdc-e65a-4afc-91c4-2f6307527422/dns/0.log" Jun 05 17:54:04.230119 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:04.230091 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z7h9r_0b586fdc-e65a-4afc-91c4-2f6307527422/kube-rbac-proxy/0.log" Jun 05 17:54:04.830354 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:04.830313 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t7jhz_7f32c561-c9cd-4f88-8f31-303673c53503/dns-node-resolver/0.log" Jun 05 17:54:05.029542 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:05.029514 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cb4fdffb5-hq64f_1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3/router/0.log" Jun 05 17:54:05.629156 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:05.629060 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x2wwq_3d366d70-6cb1-4172-9b93-9606ed9c66ba/serve-healthcheck-canary/0.log" Jun 05 17:54:05.831213 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:05.831177 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-9t7l6_47aa83d5-5c29-4f32-b6c8-e90e744cb241/cluster-samples-operator/0.log" Jun 05 17:54:06.030317 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:06.030230 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-9t7l6_47aa83d5-5c29-4f32-b6c8-e90e744cb241/cluster-samples-operator-watch/0.log" Jun 05 17:54:06.107871 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:06.107846 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:54:08.253523 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:08.253495 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z7h9r" Jun 05 17:54:11.122397 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:11.122352 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" podUID="48a91cf5-c282-4fa5-bf5c-8f3f224c2f65" containerName="registry" containerID="cri-o://3979ebbf5b50c6b6537fedb1bbeb02eb80089ca1ac35bf1a9d1a377e91750fe6" gracePeriod=30 Jun 05 17:54:11.219516 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:11.219491 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z87q_1412064f-459e-4d05-9771-f48e3fdf62b1/ovn-acl-logging/0.log" Jun 05 17:54:11.222151 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:11.222130 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z87q_1412064f-459e-4d05-9771-f48e3fdf62b1/ovn-acl-logging/0.log" Jun 05 17:54:11.223928 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:11.223910 2553 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 17:54:12.295006 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:12.294982 2553 generic.go:356] "Generic (PLEG): container finished" podID="48a91cf5-c282-4fa5-bf5c-8f3f224c2f65" containerID="3979ebbf5b50c6b6537fedb1bbeb02eb80089ca1ac35bf1a9d1a377e91750fe6" exitCode=0 Jun 05 17:54:12.295341 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:12.295049 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" event={"ID":"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65","Type":"ContainerDied","Data":"3979ebbf5b50c6b6537fedb1bbeb02eb80089ca1ac35bf1a9d1a377e91750fe6"} Jun 05 17:54:13.302039 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:13.302002 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" event={"ID":"48a91cf5-c282-4fa5-bf5c-8f3f224c2f65","Type":"ContainerStarted","Data":"2299fcc0d4b9a254e5aacf77367f37bea9197c2c05d3a033fddfebfdb31e052f"} Jun 05 17:54:13.302468 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:13.302116 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:54:25.807417 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:25.807384 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:25.822645 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:25.822613 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:26.365054 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:26.365028 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:34.310946 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:34.310915 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6dfb6cdb54-kjnhs" Jun 05 17:54:43.819745 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:43.819708 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 17:54:43.820370 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:43.820078 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="kube-rbac-proxy-thanos" containerID="cri-o://4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0" gracePeriod=600 Jun 05 17:54:43.820370 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:43.820110 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="config-reloader" containerID="cri-o://76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9" gracePeriod=600 Jun 05 17:54:43.820370 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:43.820149 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="kube-rbac-proxy" containerID="cri-o://69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb" gracePeriod=600 Jun 05 17:54:43.820370 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:43.820084 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="prometheus" containerID="cri-o://ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048" gracePeriod=600 Jun 05 17:54:43.820370 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:43.820161 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="thanos-sidecar" containerID="cri-o://2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364" gracePeriod=600 Jun 05 17:54:43.820370 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:43.820170 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="kube-rbac-proxy-web" containerID="cri-o://404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd" gracePeriod=600 Jun 05 17:54:44.062791 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.062765 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.149005 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.148971 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-k8s-db\") pod \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " Jun 05 17:54:44.149162 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.149025 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-web-config\") pod \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " Jun 05 17:54:44.149162 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.149055 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-kube-rbac-proxy\") pod \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " Jun 05 17:54:44.149162 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.149096 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-configmap-serving-certs-ca-bundle\") pod \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " Jun 05 17:54:44.149162 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.149136 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-metrics-client-certs\") pod \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " Jun 05 17:54:44.149385 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.149277 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-k8s-rulefiles-2\") pod \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " Jun 05 17:54:44.149385 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.149323 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-k8s-rulefiles-0\") pod \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " Jun 05 17:54:44.149385 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.149352 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " Jun 05 17:54:44.149548 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.149390 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-configmap-metrics-client-ca\") pod \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " Jun 05 17:54:44.149548 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.149437 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xv2j8\" (UniqueName: \"kubernetes.io/projected/69399686-bb25-4fa4-80c1-4ad9e2ec0064-kube-api-access-xv2j8\") pod \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " Jun 05 17:54:44.149548 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.149474 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-grpc-tls\") pod \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " Jun 05 17:54:44.149548 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.149504 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-prometheus-k8s-tls\") pod \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " Jun 05 17:54:44.149548 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.149533 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-config\") pod \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " Jun 05 17:54:44.149784 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.149564 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-thanos-prometheus-http-client-file\") pod \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " Jun 05 17:54:44.149784 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.149515 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "69399686-bb25-4fa4-80c1-4ad9e2ec0064" (UID: "69399686-bb25-4fa4-80c1-4ad9e2ec0064"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:54:44.149784 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.149595 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-trusted-ca-bundle\") pod \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " Jun 05 17:54:44.149784 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.149638 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-configmap-kubelet-serving-ca-bundle\") pod \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " Jun 05 17:54:44.149784 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.149652 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "69399686-bb25-4fa4-80c1-4ad9e2ec0064" (UID: "69399686-bb25-4fa4-80c1-4ad9e2ec0064"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:54:44.149784 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.149681 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69399686-bb25-4fa4-80c1-4ad9e2ec0064-config-out\") pod \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " Jun 05 17:54:44.149784 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.149711 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " Jun 05 17:54:44.149784 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.149736 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-k8s-rulefiles-1\") pod \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " Jun 05 17:54:44.149784 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.149765 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69399686-bb25-4fa4-80c1-4ad9e2ec0064-tls-assets\") pod \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\" (UID: \"69399686-bb25-4fa4-80c1-4ad9e2ec0064\") " Jun 05 17:54:44.150178 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.150019 2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:54:44.150178 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.150145 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "69399686-bb25-4fa4-80c1-4ad9e2ec0064" (UID: "69399686-bb25-4fa4-80c1-4ad9e2ec0064"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:54:44.150590 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.150037 2553 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:54:44.150590 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.150518 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "69399686-bb25-4fa4-80c1-4ad9e2ec0064" (UID: "69399686-bb25-4fa4-80c1-4ad9e2ec0064"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:54:44.150590 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.150541 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "69399686-bb25-4fa4-80c1-4ad9e2ec0064" (UID: "69399686-bb25-4fa4-80c1-4ad9e2ec0064"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:54:44.151993 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.151891 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "69399686-bb25-4fa4-80c1-4ad9e2ec0064" (UID: "69399686-bb25-4fa4-80c1-4ad9e2ec0064"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:54:44.152310 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.152137 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "69399686-bb25-4fa4-80c1-4ad9e2ec0064" (UID: "69399686-bb25-4fa4-80c1-4ad9e2ec0064"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:54:44.152310 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.152277 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69399686-bb25-4fa4-80c1-4ad9e2ec0064-kube-api-access-xv2j8" (OuterVolumeSpecName: "kube-api-access-xv2j8") pod "69399686-bb25-4fa4-80c1-4ad9e2ec0064" (UID: "69399686-bb25-4fa4-80c1-4ad9e2ec0064"). InnerVolumeSpecName "kube-api-access-xv2j8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:54:44.152562 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.152305 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "69399686-bb25-4fa4-80c1-4ad9e2ec0064" (UID: "69399686-bb25-4fa4-80c1-4ad9e2ec0064"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:54:44.152562 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.152494 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "69399686-bb25-4fa4-80c1-4ad9e2ec0064" (UID: "69399686-bb25-4fa4-80c1-4ad9e2ec0064"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:54:44.153043 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.153006 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "69399686-bb25-4fa4-80c1-4ad9e2ec0064" (UID: "69399686-bb25-4fa4-80c1-4ad9e2ec0064"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:54:44.153334 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.153301 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-config" (OuterVolumeSpecName: "config") pod "69399686-bb25-4fa4-80c1-4ad9e2ec0064" (UID: "69399686-bb25-4fa4-80c1-4ad9e2ec0064"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:54:44.153437 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.153364 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "69399686-bb25-4fa4-80c1-4ad9e2ec0064" (UID: "69399686-bb25-4fa4-80c1-4ad9e2ec0064"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:54:44.153570 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.153534 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69399686-bb25-4fa4-80c1-4ad9e2ec0064-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "69399686-bb25-4fa4-80c1-4ad9e2ec0064" (UID: "69399686-bb25-4fa4-80c1-4ad9e2ec0064"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:54:44.153789 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.153762 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "69399686-bb25-4fa4-80c1-4ad9e2ec0064" (UID: "69399686-bb25-4fa4-80c1-4ad9e2ec0064"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:54:44.154630 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.154604 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "69399686-bb25-4fa4-80c1-4ad9e2ec0064" (UID: "69399686-bb25-4fa4-80c1-4ad9e2ec0064"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:54:44.154715 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.154662 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "69399686-bb25-4fa4-80c1-4ad9e2ec0064" (UID: "69399686-bb25-4fa4-80c1-4ad9e2ec0064"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:54:44.155168 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.155151 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69399686-bb25-4fa4-80c1-4ad9e2ec0064-config-out" (OuterVolumeSpecName: "config-out") pod "69399686-bb25-4fa4-80c1-4ad9e2ec0064" (UID: "69399686-bb25-4fa4-80c1-4ad9e2ec0064"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:54:44.155570 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.155543 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "69399686-bb25-4fa4-80c1-4ad9e2ec0064" (UID: "69399686-bb25-4fa4-80c1-4ad9e2ec0064"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:54:44.164428 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.164407 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-web-config" (OuterVolumeSpecName: "web-config") pod "69399686-bb25-4fa4-80c1-4ad9e2ec0064" (UID: "69399686-bb25-4fa4-80c1-4ad9e2ec0064"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:54:44.251077 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.251046 2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:54:44.251200 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.251082 2553 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:54:44.251200 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.251098 2553 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-configmap-metrics-client-ca\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:54:44.251200 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.251112 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xv2j8\" (UniqueName: \"kubernetes.io/projected/69399686-bb25-4fa4-80c1-4ad9e2ec0064-kube-api-access-xv2j8\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:54:44.251200 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.251126 2553 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-grpc-tls\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:54:44.251200 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.251139 2553 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:54:44.251200 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.251153 2553 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-config\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:54:44.251200 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.251166 2553 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:54:44.251200 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.251177 2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:54:44.251200 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.251185 2553 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:54:44.251200 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.251193 2553 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69399686-bb25-4fa4-80c1-4ad9e2ec0064-config-out\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:54:44.251200 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.251201 2553 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:54:44.251579 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.251210 2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:54:44.251579 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.251218 2553 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69399686-bb25-4fa4-80c1-4ad9e2ec0064-tls-assets\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:54:44.251579 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.251226 2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/69399686-bb25-4fa4-80c1-4ad9e2ec0064-prometheus-k8s-db\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:54:44.251579 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.251256 2553 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-web-config\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:54:44.251579 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.251266 2553 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-kube-rbac-proxy\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:54:44.251579 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.251274 2553 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/69399686-bb25-4fa4-80c1-4ad9e2ec0064-secret-metrics-client-certs\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 17:54:44.418803 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.418715 2553 generic.go:356] "Generic (PLEG): container finished" podID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerID="4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0" exitCode=0 Jun 05 17:54:44.418803 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.418739 2553 generic.go:356] "Generic (PLEG): container finished" podID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerID="69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb" exitCode=0 Jun 05 17:54:44.418803 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.418745 2553 generic.go:356] "Generic (PLEG): container finished" podID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerID="404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd" exitCode=0 Jun 05 17:54:44.418803 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.418750 2553 generic.go:356] "Generic (PLEG): container finished" podID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerID="2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364" exitCode=0 Jun 05 17:54:44.418803 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.418755 2553 generic.go:356] "Generic (PLEG): container finished" podID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerID="76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9" exitCode=0 Jun 05 17:54:44.418803 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.418760 2553 generic.go:356] "Generic (PLEG): container finished" podID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerID="ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048" exitCode=0 Jun 05 17:54:44.418803 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.418795 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.419161 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.418800 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69399686-bb25-4fa4-80c1-4ad9e2ec0064","Type":"ContainerDied","Data":"4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0"} Jun 05 17:54:44.419161 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.418895 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69399686-bb25-4fa4-80c1-4ad9e2ec0064","Type":"ContainerDied","Data":"69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb"} Jun 05 17:54:44.419161 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.418922 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69399686-bb25-4fa4-80c1-4ad9e2ec0064","Type":"ContainerDied","Data":"404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd"} Jun 05 17:54:44.419161 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.418947 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69399686-bb25-4fa4-80c1-4ad9e2ec0064","Type":"ContainerDied","Data":"2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364"} Jun 05 17:54:44.419161 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.418962 2553 scope.go:117] "RemoveContainer" containerID="4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0" Jun 05 17:54:44.419161 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.418972 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69399686-bb25-4fa4-80c1-4ad9e2ec0064","Type":"ContainerDied","Data":"76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9"} Jun 05 17:54:44.419161 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.418997 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69399686-bb25-4fa4-80c1-4ad9e2ec0064","Type":"ContainerDied","Data":"ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048"} Jun 05 17:54:44.419161 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.419021 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69399686-bb25-4fa4-80c1-4ad9e2ec0064","Type":"ContainerDied","Data":"ee8b50597565955713a57d501760e443b117197eaba03281cc39297e2ac0149d"} Jun 05 17:54:44.427465 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.427443 2553 scope.go:117] "RemoveContainer" containerID="69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb" Jun 05 17:54:44.434460 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.434442 2553 scope.go:117] "RemoveContainer" containerID="404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd" Jun 05 17:54:44.441017 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.440999 2553 scope.go:117] "RemoveContainer" containerID="2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364" Jun 05 17:54:44.446063 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.446032 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 17:54:44.448128 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.448111 2553 scope.go:117] "RemoveContainer" containerID="76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9" Jun 05 17:54:44.453203 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.453179 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 17:54:44.456063 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.456047 2553 scope.go:117] "RemoveContainer" containerID="ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048" Jun 05 17:54:44.463293 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.463276 2553 scope.go:117] "RemoveContainer" containerID="9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464" Jun 05 17:54:44.470015 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.469999 2553 scope.go:117] "RemoveContainer" containerID="4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0" Jun 05 17:54:44.470366 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:54:44.470346 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0\": container with ID starting with 4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0 not found: ID does not exist" containerID="4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0" Jun 05 17:54:44.470427 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.470378 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0"} err="failed to get container status \"4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0\": rpc error: code = NotFound desc = could not find container \"4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0\": container with ID starting with 4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0 not found: ID does not exist" Jun 05 17:54:44.470427 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.470396 2553 scope.go:117] "RemoveContainer" containerID="69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb" Jun 05 17:54:44.470648 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:54:44.470632 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb\": container with ID starting with 69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb not found: ID does not exist" containerID="69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb" Jun 05 17:54:44.470688 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.470656 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb"} err="failed to get container status \"69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb\": rpc error: code = NotFound desc = could not find container \"69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb\": container with ID starting with 69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb not found: ID does not exist" Jun 05 17:54:44.470688 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.470673 2553 scope.go:117] "RemoveContainer" containerID="404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd" Jun 05 17:54:44.470913 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:54:44.470899 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd\": container with ID starting with 404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd not found: ID does not exist" containerID="404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd" Jun 05 17:54:44.470948 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.470916 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd"} err="failed to get container status \"404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd\": rpc error: code = NotFound desc = could not find container \"404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd\": container with ID starting with 404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd not found: ID does not exist" Jun 05 17:54:44.470948 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.470929 2553 scope.go:117] "RemoveContainer" containerID="2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364" Jun 05 17:54:44.471151 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:54:44.471127 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364\": container with ID starting with 2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364 not found: ID does not exist" containerID="2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364" Jun 05 17:54:44.471284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.471155 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364"} err="failed to get container status \"2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364\": rpc error: code = NotFound desc = could not find container \"2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364\": container with ID starting with 2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364 not found: ID does not exist" Jun 05 17:54:44.471284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.471172 2553 scope.go:117] "RemoveContainer" containerID="76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9" Jun 05 17:54:44.471482 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:54:44.471464 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9\": container with ID starting with 76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9 not found: ID does not exist" containerID="76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9" Jun 05 17:54:44.471525 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.471487 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9"} err="failed to get container status \"76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9\": rpc error: code = NotFound desc = could not find container \"76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9\": container with ID starting with 76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9 not found: ID does not exist" Jun 05 17:54:44.471525 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.471501 2553 scope.go:117] "RemoveContainer" containerID="ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048" Jun 05 17:54:44.471711 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:54:44.471695 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048\": container with ID starting with ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048 not found: ID does not exist" containerID="ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048" Jun 05 17:54:44.471756 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.471713 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048"} err="failed to get container status \"ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048\": rpc error: code = NotFound desc = could not find container \"ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048\": container with ID starting with ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048 not found: ID does not exist" Jun 05 17:54:44.471756 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.471725 2553 scope.go:117] "RemoveContainer" containerID="9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464" Jun 05 17:54:44.471921 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:54:44.471907 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464\": container with ID starting with 9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464 not found: ID does not exist" containerID="9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464" Jun 05 17:54:44.471964 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.471923 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464"} err="failed to get container status \"9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464\": rpc error: code = NotFound desc = could not find container \"9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464\": container with ID starting with 9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464 not found: ID does not exist" Jun 05 17:54:44.471964 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.471935 2553 scope.go:117] "RemoveContainer" containerID="4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0" Jun 05 17:54:44.472138 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.472122 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0"} err="failed to get container status \"4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0\": rpc error: code = NotFound desc = could not find container \"4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0\": container with ID starting with 4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0 not found: ID does not exist" Jun 05 17:54:44.472180 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.472139 2553 scope.go:117] "RemoveContainer" containerID="69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb" Jun 05 17:54:44.472362 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.472345 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb"} err="failed to get container status \"69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb\": rpc error: code = NotFound desc = could not find container \"69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb\": container with ID starting with 69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb not found: ID does not exist" Jun 05 17:54:44.472362 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.472361 2553 scope.go:117] "RemoveContainer" containerID="404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd" Jun 05 17:54:44.472541 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.472527 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd"} err="failed to get container status \"404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd\": rpc error: code = NotFound desc = could not find container \"404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd\": container with ID starting with 404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd not found: ID does not exist" Jun 05 17:54:44.472541 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.472541 2553 scope.go:117] "RemoveContainer" containerID="2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364" Jun 05 17:54:44.472775 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.472756 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364"} err="failed to get container status \"2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364\": rpc error: code = NotFound desc = could not find container \"2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364\": container with ID starting with 2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364 not found: ID does not exist" Jun 05 17:54:44.472820 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.472777 2553 scope.go:117] "RemoveContainer" containerID="76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9" Jun 05 17:54:44.473028 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.473011 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9"} err="failed to get container status \"76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9\": rpc error: code = NotFound desc = could not find container \"76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9\": container with ID starting with 76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9 not found: ID does not exist" Jun 05 17:54:44.473073 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.473029 2553 scope.go:117] "RemoveContainer" containerID="ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048" Jun 05 17:54:44.473214 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.473199 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048"} err="failed to get container status \"ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048\": rpc error: code = NotFound desc = could not find container \"ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048\": container with ID starting with ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048 not found: ID does not exist" Jun 05 17:54:44.473276 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.473215 2553 scope.go:117] "RemoveContainer" containerID="9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464" Jun 05 17:54:44.473434 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.473417 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464"} err="failed to get container status \"9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464\": rpc error: code = NotFound desc = could not find container \"9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464\": container with ID starting with 9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464 not found: ID does not exist" Jun 05 17:54:44.473476 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.473433 2553 scope.go:117] "RemoveContainer" containerID="4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0" Jun 05 17:54:44.473616 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.473602 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0"} err="failed to get container status \"4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0\": rpc error: code = NotFound desc = could not find container \"4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0\": container with ID starting with 4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0 not found: ID does not exist" Jun 05 17:54:44.473658 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.473616 2553 scope.go:117] "RemoveContainer" containerID="69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb" Jun 05 17:54:44.473799 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.473785 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb"} err="failed to get container status \"69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb\": rpc error: code = NotFound desc = could not find container \"69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb\": container with ID starting with 69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb not found: ID does not exist" Jun 05 17:54:44.473844 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.473800 2553 scope.go:117] "RemoveContainer" containerID="404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd" Jun 05 17:54:44.474038 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.474020 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd"} err="failed to get container status \"404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd\": rpc error: code = NotFound desc = could not find container \"404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd\": container with ID starting with 404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd not found: ID does not exist" Jun 05 17:54:44.474090 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.474040 2553 scope.go:117] "RemoveContainer" containerID="2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364" Jun 05 17:54:44.474285 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.474266 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364"} err="failed to get container status \"2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364\": rpc error: code = NotFound desc = could not find container \"2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364\": container with ID starting with 2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364 not found: ID does not exist" Jun 05 17:54:44.474332 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.474288 2553 scope.go:117] "RemoveContainer" containerID="76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9" Jun 05 17:54:44.474499 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.474482 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9"} err="failed to get container status \"76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9\": rpc error: code = NotFound desc = could not find container \"76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9\": container with ID starting with 76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9 not found: ID does not exist" Jun 05 17:54:44.474553 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.474500 2553 scope.go:117] "RemoveContainer" containerID="ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048" Jun 05 17:54:44.474777 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.474742 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048"} err="failed to get container status \"ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048\": rpc error: code = NotFound desc = could not find container \"ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048\": container with ID starting with ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048 not found: ID does not exist" Jun 05 17:54:44.474862 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.474778 2553 scope.go:117] "RemoveContainer" containerID="9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464" Jun 05 17:54:44.475026 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.475003 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464"} err="failed to get container status \"9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464\": rpc error: code = NotFound desc = could not find container \"9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464\": container with ID starting with 9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464 not found: ID does not exist" Jun 05 17:54:44.475026 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.475026 2553 scope.go:117] "RemoveContainer" containerID="4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0" Jun 05 17:54:44.475367 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.475349 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0"} err="failed to get container status \"4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0\": rpc error: code = NotFound desc = could not find container \"4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0\": container with ID starting with 4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0 not found: ID does not exist" Jun 05 17:54:44.475367 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.475367 2553 scope.go:117] "RemoveContainer" containerID="69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb" Jun 05 17:54:44.475604 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.475587 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb"} err="failed to get container status \"69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb\": rpc error: code = NotFound desc = could not find container \"69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb\": container with ID starting with 69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb not found: ID does not exist" Jun 05 17:54:44.475604 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.475604 2553 scope.go:117] "RemoveContainer" containerID="404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd" Jun 05 17:54:44.475819 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.475803 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd"} err="failed to get container status \"404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd\": rpc error: code = NotFound desc = could not find container \"404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd\": container with ID starting with 404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd not found: ID does not exist" Jun 05 17:54:44.475860 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.475819 2553 scope.go:117] "RemoveContainer" containerID="2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364" Jun 05 17:54:44.476024 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.475996 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364"} err="failed to get container status \"2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364\": rpc error: code = NotFound desc = could not find container \"2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364\": container with ID starting with 2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364 not found: ID does not exist" Jun 05 17:54:44.476077 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.476025 2553 scope.go:117] "RemoveContainer" containerID="76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9" Jun 05 17:54:44.476215 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.476189 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9"} err="failed to get container status \"76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9\": rpc error: code = NotFound desc = could not find container \"76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9\": container with ID starting with 76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9 not found: ID does not exist" Jun 05 17:54:44.476215 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.476211 2553 scope.go:117] "RemoveContainer" containerID="ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048" Jun 05 17:54:44.476438 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.476421 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048"} err="failed to get container status \"ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048\": rpc error: code = NotFound desc = could not find container \"ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048\": container with ID starting with ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048 not found: ID does not exist" Jun 05 17:54:44.476486 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.476439 2553 scope.go:117] "RemoveContainer" containerID="9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464" Jun 05 17:54:44.476619 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.476605 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464"} err="failed to get container status \"9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464\": rpc error: code = NotFound desc = could not find container \"9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464\": container with ID starting with 9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464 not found: ID does not exist" Jun 05 17:54:44.476667 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.476619 2553 scope.go:117] "RemoveContainer" containerID="4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0" Jun 05 17:54:44.476870 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.476851 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0"} err="failed to get container status \"4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0\": rpc error: code = NotFound desc = could not find container \"4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0\": container with ID starting with 4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0 not found: ID does not exist" Jun 05 17:54:44.476917 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.476871 2553 scope.go:117] "RemoveContainer" containerID="69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb" Jun 05 17:54:44.477087 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.477071 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb"} err="failed to get container status \"69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb\": rpc error: code = NotFound desc = could not find container \"69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb\": container with ID starting with 69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb not found: ID does not exist" Jun 05 17:54:44.477131 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.477088 2553 scope.go:117] "RemoveContainer" containerID="404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd" Jun 05 17:54:44.477296 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.477278 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd"} err="failed to get container status \"404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd\": rpc error: code = NotFound desc = could not find container \"404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd\": container with ID starting with 404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd not found: ID does not exist" Jun 05 17:54:44.477350 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.477297 2553 scope.go:117] "RemoveContainer" containerID="2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364" Jun 05 17:54:44.477523 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.477505 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364"} err="failed to get container status \"2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364\": rpc error: code = NotFound desc = could not find container \"2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364\": container with ID starting with 2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364 not found: ID does not exist" Jun 05 17:54:44.477596 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.477525 2553 scope.go:117] "RemoveContainer" containerID="76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9" Jun 05 17:54:44.477734 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.477717 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9"} err="failed to get container status \"76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9\": rpc error: code = NotFound desc = could not find container \"76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9\": container with ID starting with 76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9 not found: ID does not exist" Jun 05 17:54:44.477803 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.477735 2553 scope.go:117] "RemoveContainer" containerID="ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048" Jun 05 17:54:44.477956 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.477938 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048"} err="failed to get container status \"ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048\": rpc error: code = NotFound desc = could not find container \"ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048\": container with ID starting with ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048 not found: ID does not exist" Jun 05 17:54:44.477998 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.477965 2553 scope.go:117] "RemoveContainer" containerID="9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464" Jun 05 17:54:44.478176 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.478159 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464"} err="failed to get container status \"9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464\": rpc error: code = NotFound desc = could not find container \"9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464\": container with ID starting with 9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464 not found: ID does not exist" Jun 05 17:54:44.478299 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.478176 2553 scope.go:117] "RemoveContainer" containerID="4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0" Jun 05 17:54:44.478442 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.478424 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0"} err="failed to get container status \"4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0\": rpc error: code = NotFound desc = could not find container \"4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0\": container with ID starting with 4ee41ca54080d9ca045a118d1e0f9546eaf294fefe787aa6f4454f3254c018d0 not found: ID does not exist" Jun 05 17:54:44.478490 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.478442 2553 scope.go:117] "RemoveContainer" containerID="69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb" Jun 05 17:54:44.478653 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.478636 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb"} err="failed to get container status \"69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb\": rpc error: code = NotFound desc = could not find container \"69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb\": container with ID starting with 69eca175fe4543a160e27717fe0edfdfe254bee6183c6ccca2230fbebe4f8cdb not found: ID does not exist" Jun 05 17:54:44.478700 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.478653 2553 scope.go:117] "RemoveContainer" containerID="404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd" Jun 05 17:54:44.478863 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.478846 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd"} err="failed to get container status \"404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd\": rpc error: code = NotFound desc = could not find container \"404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd\": container with ID starting with 404833be2f2665ff093e71625699f3b3c39c7ea9e7848021228bd687abb425dd not found: ID does not exist" Jun 05 17:54:44.478903 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.478863 2553 scope.go:117] "RemoveContainer" containerID="2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364" Jun 05 17:54:44.479099 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.479079 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364"} err="failed to get container status \"2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364\": rpc error: code = NotFound desc = could not find container \"2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364\": container with ID starting with 2e9d3068b07c322522c2feeb3bc237cace390ff226aa64bc5a3e3eba4edbe364 not found: ID does not exist" Jun 05 17:54:44.479166 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.479100 2553 scope.go:117] "RemoveContainer" containerID="76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9" Jun 05 17:54:44.479355 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.479337 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9"} err="failed to get container status \"76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9\": rpc error: code = NotFound desc = could not find container \"76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9\": container with ID starting with 76e322db9c021ecc9500196576b2c0aa065f739ec9bae33bbf0076b7f30d83c9 not found: ID does not exist" Jun 05 17:54:44.479501 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.479355 2553 scope.go:117] "RemoveContainer" containerID="ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048" Jun 05 17:54:44.479576 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.479559 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048"} err="failed to get container status \"ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048\": rpc error: code = NotFound desc = could not find container \"ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048\": container with ID starting with ad572ef6b30f137cb7a10924969e41371cb21a982ab495bcbd34bce3d1221048 not found: ID does not exist" Jun 05 17:54:44.479618 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.479577 2553 scope.go:117] "RemoveContainer" containerID="9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464" Jun 05 17:54:44.479796 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.479779 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464"} err="failed to get container status \"9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464\": rpc error: code = NotFound desc = could not find container \"9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464\": container with ID starting with 9101b6c33a82751a11d94f7c0a32256017d66bfe4bfd0313d80a5451b9475464 not found: ID does not exist" Jun 05 17:54:44.485005 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.484984 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 17:54:44.485268 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.485232 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="kube-rbac-proxy-thanos" Jun 05 17:54:44.485326 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.485268 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="kube-rbac-proxy-thanos" Jun 05 17:54:44.485326 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.485281 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="config-reloader" Jun 05 17:54:44.485326 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.485287 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="config-reloader" Jun 05 17:54:44.485326 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.485298 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="init-config-reloader" Jun 05 17:54:44.485326 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.485304 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="init-config-reloader" Jun 05 17:54:44.485326 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.485311 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="prometheus" Jun 05 17:54:44.485326 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.485317 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="prometheus" Jun 05 17:54:44.485326 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.485322 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="kube-rbac-proxy-web" Jun 05 17:54:44.485326 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.485328 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="kube-rbac-proxy-web" Jun 05 17:54:44.485616 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.485337 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa87a257-375d-4340-97d4-baff45f80c89" containerName="registry" Jun 05 17:54:44.485616 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.485343 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa87a257-375d-4340-97d4-baff45f80c89" containerName="registry" Jun 05 17:54:44.485616 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.485350 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="thanos-sidecar" Jun 05 17:54:44.485616 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.485355 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="thanos-sidecar" Jun 05 17:54:44.485616 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.485362 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="kube-rbac-proxy" Jun 05 17:54:44.485616 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.485367 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="kube-rbac-proxy" Jun 05 17:54:44.485616 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.485418 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="thanos-sidecar" Jun 05 17:54:44.485616 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.485427 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="kube-rbac-proxy-web" Jun 05 17:54:44.485616 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.485432 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="kube-rbac-proxy-thanos" Jun 05 17:54:44.485616 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.485440 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa87a257-375d-4340-97d4-baff45f80c89" containerName="registry" Jun 05 17:54:44.485616 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.485446 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="config-reloader" Jun 05 17:54:44.485616 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.485451 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="kube-rbac-proxy" Jun 05 17:54:44.485616 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.485457 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" containerName="prometheus" Jun 05 17:54:44.490893 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.490877 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.494158 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.494140 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 05 17:54:44.494326 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.494308 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 05 17:54:44.494483 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.494470 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 05 17:54:44.494693 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.494651 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 05 17:54:44.495547 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.495527 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-affls3gubk92q\"" Jun 05 17:54:44.495699 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.495682 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 05 17:54:44.496116 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.496095 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 05 17:54:44.496214 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.496101 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 05 17:54:44.496214 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.496121 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 05 17:54:44.496214 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.496156 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-d6z9r\"" Jun 05 17:54:44.496775 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.496758 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 05 17:54:44.496908 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.496893 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 05 17:54:44.496978 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.496969 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 05 17:54:44.497062 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.497044 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 05 17:54:44.497127 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.497055 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 05 17:54:44.501268 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.501230 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 05 17:54:44.502924 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.502900 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 05 17:54:44.518825 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.518798 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 17:54:44.553981 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.553953 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02d73e13-1e58-4c3e-80df-060bf024194a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.554132 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.553993 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/02d73e13-1e58-4c3e-80df-060bf024194a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.554132 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.554022 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r56m9\" (UniqueName: \"kubernetes.io/projected/02d73e13-1e58-4c3e-80df-060bf024194a-kube-api-access-r56m9\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.554132 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.554045 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.554132 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.554067 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.554132 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.554102 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/02d73e13-1e58-4c3e-80df-060bf024194a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.554354 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.554150 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d73e13-1e58-4c3e-80df-060bf024194a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.554354 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.554186 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.554354 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.554219 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-config\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.554354 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.554265 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d73e13-1e58-4c3e-80df-060bf024194a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.554354 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.554293 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02d73e13-1e58-4c3e-80df-060bf024194a-config-out\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.554354 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.554314 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.554354 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.554335 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-web-config\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.554592 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.554360 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/02d73e13-1e58-4c3e-80df-060bf024194a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.554592 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.554385 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.554592 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.554403 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.554592 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.554421 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.554592 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.554438 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02d73e13-1e58-4c3e-80df-060bf024194a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.554592 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.554457 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d73e13-1e58-4c3e-80df-060bf024194a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.554592 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.554479 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/02d73e13-1e58-4c3e-80df-060bf024194a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.655646 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.655606 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02d73e13-1e58-4c3e-80df-060bf024194a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.655646 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.655644 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/02d73e13-1e58-4c3e-80df-060bf024194a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.655879 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.655662 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r56m9\" (UniqueName: \"kubernetes.io/projected/02d73e13-1e58-4c3e-80df-060bf024194a-kube-api-access-r56m9\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.656015 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.655987 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.656080 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.656028 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.656130 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.656075 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/02d73e13-1e58-4c3e-80df-060bf024194a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.656130 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.656103 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d73e13-1e58-4c3e-80df-060bf024194a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.656262 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.656147 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.656262 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.656180 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-config\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.656262 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.656207 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d73e13-1e58-4c3e-80df-060bf024194a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.656262 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.656258 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02d73e13-1e58-4c3e-80df-060bf024194a-config-out\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.656471 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.656288 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.656471 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.656326 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-web-config\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.656471 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.656373 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/02d73e13-1e58-4c3e-80df-060bf024194a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.656471 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.656408 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.656471 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.656441 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.656707 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.656474 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.656707 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.656498 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02d73e13-1e58-4c3e-80df-060bf024194a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.656707 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.656499 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/02d73e13-1e58-4c3e-80df-060bf024194a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.656707 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.656521 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d73e13-1e58-4c3e-80df-060bf024194a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.656707 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.656561 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/02d73e13-1e58-4c3e-80df-060bf024194a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.656949 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.656924 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d73e13-1e58-4c3e-80df-060bf024194a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.657536 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.657178 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/02d73e13-1e58-4c3e-80df-060bf024194a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.657536 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.657495 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d73e13-1e58-4c3e-80df-060bf024194a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.658311 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.657904 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d73e13-1e58-4c3e-80df-060bf024194a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.658501 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.658434 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/02d73e13-1e58-4c3e-80df-060bf024194a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.658827 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.658778 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02d73e13-1e58-4c3e-80df-060bf024194a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.659633 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.658934 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.659633 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.658997 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.659633 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.659594 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02d73e13-1e58-4c3e-80df-060bf024194a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.659956 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.659929 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/02d73e13-1e58-4c3e-80df-060bf024194a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.660146 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.660026 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-web-config\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.660478 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.660456 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02d73e13-1e58-4c3e-80df-060bf024194a-config-out\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.660709 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.660685 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-config\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.660971 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.660950 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.661270 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.661228 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.661621 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.661597 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.661844 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.661825 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.662153 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.662136 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/02d73e13-1e58-4c3e-80df-060bf024194a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.665345 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.665327 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r56m9\" (UniqueName: \"kubernetes.io/projected/02d73e13-1e58-4c3e-80df-060bf024194a-kube-api-access-r56m9\") pod \"prometheus-k8s-0\" (UID: \"02d73e13-1e58-4c3e-80df-060bf024194a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.800297 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.800191 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:54:44.946348 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:44.946310 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 17:54:44.949064 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:54:44.949037 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02d73e13_1e58_4c3e_80df_060bf024194a.slice/crio-05298ebb22807f9de4ce72091c41ed39878497ecfbe9ec1f1f5cc2a933fa449f WatchSource:0}: Error finding container 05298ebb22807f9de4ce72091c41ed39878497ecfbe9ec1f1f5cc2a933fa449f: Status 404 returned error can't find the container with id 05298ebb22807f9de4ce72091c41ed39878497ecfbe9ec1f1f5cc2a933fa449f Jun 05 17:54:45.268923 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:45.268892 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69399686-bb25-4fa4-80c1-4ad9e2ec0064" path="/var/lib/kubelet/pods/69399686-bb25-4fa4-80c1-4ad9e2ec0064/volumes" Jun 05 17:54:45.424109 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:45.424076 2553 generic.go:356] "Generic (PLEG): container finished" podID="02d73e13-1e58-4c3e-80df-060bf024194a" containerID="9e915815280114eb6ec8fd9761229f9fce705f3bd9fdbb6ddd795147d6f69d78" exitCode=0 Jun 05 17:54:45.424313 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:45.424169 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02d73e13-1e58-4c3e-80df-060bf024194a","Type":"ContainerDied","Data":"9e915815280114eb6ec8fd9761229f9fce705f3bd9fdbb6ddd795147d6f69d78"} Jun 05 17:54:45.424313 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:45.424270 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02d73e13-1e58-4c3e-80df-060bf024194a","Type":"ContainerStarted","Data":"05298ebb22807f9de4ce72091c41ed39878497ecfbe9ec1f1f5cc2a933fa449f"} Jun 05 17:54:46.432602 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:46.432566 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02d73e13-1e58-4c3e-80df-060bf024194a","Type":"ContainerStarted","Data":"9607a6f1ea9609298434b18a59c4344c4d7111077a597ef5fc0d88f7799a3dd3"} Jun 05 17:54:46.433041 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:46.432640 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02d73e13-1e58-4c3e-80df-060bf024194a","Type":"ContainerStarted","Data":"1adb7b48a35020ae0ce6234331722cbc629ab488b8a9815a35552e7636e9c389"} Jun 05 17:54:46.433041 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:46.432682 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02d73e13-1e58-4c3e-80df-060bf024194a","Type":"ContainerStarted","Data":"4937e0851b683ec726024ce067a32728b525f6e95c29b2c326536858b8d57af9"} Jun 05 17:54:46.433041 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:46.432721 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02d73e13-1e58-4c3e-80df-060bf024194a","Type":"ContainerStarted","Data":"867e6f513c734fd0a8c1a5e5b12615010143a58065dd23e1f6c5e0a17bf80555"} Jun 05 17:54:46.433041 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:46.432763 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02d73e13-1e58-4c3e-80df-060bf024194a","Type":"ContainerStarted","Data":"549297a0f10fd869ac48cd6c08c6def0ccbc3ace582bbe9cf6fbbe67a055e560"} Jun 05 17:54:46.433041 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:46.432800 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02d73e13-1e58-4c3e-80df-060bf024194a","Type":"ContainerStarted","Data":"9d15ab13c8d840e1f3e9612d26a6cc42e036ebba4f5d575c32b90ae19ab5b895"} Jun 05 17:54:46.462945 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:46.462875 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.444380782 podStartE2EDuration="2.462858111s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.477329ms" isStatefulPod=false podCreationTimestamp="2026-06-05 17:54:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:54:46.460947277 +0000 UTC m=+335.650926481" watchObservedRunningTime="2026-06-05 17:54:46.462858111 +0000 UTC m=+335.652837279" Jun 05 17:54:49.800775 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:54:49.800698 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:55:44.800626 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:55:44.800580 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:55:44.815726 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:55:44.815701 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:55:45.681355 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:55:45.681327 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 17:57:04.735576 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:04.735537 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-58878fcd45-lmlpn"] Jun 05 17:57:04.738670 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:04.738651 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58878fcd45-lmlpn" Jun 05 17:57:04.741551 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:04.741526 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 05 17:57:04.742845 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:04.742820 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 05 17:57:04.742972 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:04.742828 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 05 17:57:04.742972 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:04.742828 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-df7cv\"" Jun 05 17:57:04.743092 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:04.743007 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 05 17:57:04.743203 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:04.743186 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 05 17:57:04.748143 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:04.748114 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58878fcd45-lmlpn"] Jun 05 17:57:04.812509 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:04.812479 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e2250813-4cc1-4fe0-9214-a5aa93051c75-manager-config\") pod \"lws-controller-manager-58878fcd45-lmlpn\" (UID: \"e2250813-4cc1-4fe0-9214-a5aa93051c75\") " pod="openshift-lws-operator/lws-controller-manager-58878fcd45-lmlpn" Jun 05 17:57:04.812673 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:04.812511 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jc66\" (UniqueName: \"kubernetes.io/projected/e2250813-4cc1-4fe0-9214-a5aa93051c75-kube-api-access-7jc66\") pod \"lws-controller-manager-58878fcd45-lmlpn\" (UID: \"e2250813-4cc1-4fe0-9214-a5aa93051c75\") " pod="openshift-lws-operator/lws-controller-manager-58878fcd45-lmlpn" Jun 05 17:57:04.812673 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:04.812553 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e2250813-4cc1-4fe0-9214-a5aa93051c75-metrics-cert\") pod \"lws-controller-manager-58878fcd45-lmlpn\" (UID: \"e2250813-4cc1-4fe0-9214-a5aa93051c75\") " pod="openshift-lws-operator/lws-controller-manager-58878fcd45-lmlpn" Jun 05 17:57:04.812755 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:04.812702 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2250813-4cc1-4fe0-9214-a5aa93051c75-cert\") pod \"lws-controller-manager-58878fcd45-lmlpn\" (UID: \"e2250813-4cc1-4fe0-9214-a5aa93051c75\") " pod="openshift-lws-operator/lws-controller-manager-58878fcd45-lmlpn" Jun 05 17:57:04.913528 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:04.913487 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e2250813-4cc1-4fe0-9214-a5aa93051c75-metrics-cert\") pod \"lws-controller-manager-58878fcd45-lmlpn\" (UID: \"e2250813-4cc1-4fe0-9214-a5aa93051c75\") " pod="openshift-lws-operator/lws-controller-manager-58878fcd45-lmlpn" Jun 05 17:57:04.913710 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:04.913595 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2250813-4cc1-4fe0-9214-a5aa93051c75-cert\") pod \"lws-controller-manager-58878fcd45-lmlpn\" (UID: \"e2250813-4cc1-4fe0-9214-a5aa93051c75\") " pod="openshift-lws-operator/lws-controller-manager-58878fcd45-lmlpn" Jun 05 17:57:04.913710 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:04.913628 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e2250813-4cc1-4fe0-9214-a5aa93051c75-manager-config\") pod \"lws-controller-manager-58878fcd45-lmlpn\" (UID: \"e2250813-4cc1-4fe0-9214-a5aa93051c75\") " pod="openshift-lws-operator/lws-controller-manager-58878fcd45-lmlpn" Jun 05 17:57:04.913710 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:04.913655 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jc66\" (UniqueName: \"kubernetes.io/projected/e2250813-4cc1-4fe0-9214-a5aa93051c75-kube-api-access-7jc66\") pod \"lws-controller-manager-58878fcd45-lmlpn\" (UID: \"e2250813-4cc1-4fe0-9214-a5aa93051c75\") " pod="openshift-lws-operator/lws-controller-manager-58878fcd45-lmlpn" Jun 05 17:57:04.914375 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:04.914350 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e2250813-4cc1-4fe0-9214-a5aa93051c75-manager-config\") pod \"lws-controller-manager-58878fcd45-lmlpn\" (UID: \"e2250813-4cc1-4fe0-9214-a5aa93051c75\") " pod="openshift-lws-operator/lws-controller-manager-58878fcd45-lmlpn" Jun 05 17:57:04.915979 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:04.915957 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2250813-4cc1-4fe0-9214-a5aa93051c75-cert\") pod \"lws-controller-manager-58878fcd45-lmlpn\" (UID: \"e2250813-4cc1-4fe0-9214-a5aa93051c75\") " pod="openshift-lws-operator/lws-controller-manager-58878fcd45-lmlpn" Jun 05 17:57:04.916078 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:04.916015 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e2250813-4cc1-4fe0-9214-a5aa93051c75-metrics-cert\") pod \"lws-controller-manager-58878fcd45-lmlpn\" (UID: \"e2250813-4cc1-4fe0-9214-a5aa93051c75\") " pod="openshift-lws-operator/lws-controller-manager-58878fcd45-lmlpn" Jun 05 17:57:04.922203 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:04.922176 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jc66\" (UniqueName: \"kubernetes.io/projected/e2250813-4cc1-4fe0-9214-a5aa93051c75-kube-api-access-7jc66\") pod \"lws-controller-manager-58878fcd45-lmlpn\" (UID: \"e2250813-4cc1-4fe0-9214-a5aa93051c75\") " pod="openshift-lws-operator/lws-controller-manager-58878fcd45-lmlpn" Jun 05 17:57:05.049190 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:05.049103 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58878fcd45-lmlpn" Jun 05 17:57:05.186988 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:05.186961 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58878fcd45-lmlpn"] Jun 05 17:57:05.189321 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:57:05.189290 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2250813_4cc1_4fe0_9214_a5aa93051c75.slice/crio-91aaa50b0f108df4ae94c95c27224ce421994c80a76c95477a91a3d2a99e478f WatchSource:0}: Error finding container 91aaa50b0f108df4ae94c95c27224ce421994c80a76c95477a91a3d2a99e478f: Status 404 returned error can't find the container with id 91aaa50b0f108df4ae94c95c27224ce421994c80a76c95477a91a3d2a99e478f Jun 05 17:57:05.191408 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:05.191390 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 17:57:05.952150 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:05.952112 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58878fcd45-lmlpn" event={"ID":"e2250813-4cc1-4fe0-9214-a5aa93051c75","Type":"ContainerStarted","Data":"91aaa50b0f108df4ae94c95c27224ce421994c80a76c95477a91a3d2a99e478f"} Jun 05 17:57:07.961608 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:07.961571 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58878fcd45-lmlpn" event={"ID":"e2250813-4cc1-4fe0-9214-a5aa93051c75","Type":"ContainerStarted","Data":"496c782053520d41ef400154e1a441d07ae8e3750135cdfd245e0ff9ef4b53f4"} Jun 05 17:57:07.962038 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:07.961676 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-58878fcd45-lmlpn" Jun 05 17:57:08.009798 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:08.009669 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-58878fcd45-lmlpn" podStartSLOduration=1.484275868 podStartE2EDuration="4.009651922s" totalImagesPullingTime="2.525376054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:57:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:57:08.009067895 +0000 UTC m=+477.199047074" watchObservedRunningTime="2026-06-05 17:57:08.009651922 +0000 UTC m=+477.199631090" Jun 05 17:57:09.198945 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.198908 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq"] Jun 05 17:57:09.202378 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.202354 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq" Jun 05 17:57:09.207927 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.207889 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dj75z\"" Jun 05 17:57:09.207927 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.207905 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 05 17:57:09.208083 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.207948 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 05 17:57:09.208610 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.208592 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 05 17:57:09.208734 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.208627 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 05 17:57:09.221101 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.221076 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq"] Jun 05 17:57:09.248763 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.248732 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5104f206-e636-4a8d-82c2-3cb51d0ead0b-tmp\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-np6pq\" (UID: \"5104f206-e636-4a8d-82c2-3cb51d0ead0b\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq" Jun 05 17:57:09.248921 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.248778 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5104f206-e636-4a8d-82c2-3cb51d0ead0b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-np6pq\" (UID: \"5104f206-e636-4a8d-82c2-3cb51d0ead0b\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq" Jun 05 17:57:09.248921 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.248822 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5104f206-e636-4a8d-82c2-3cb51d0ead0b-manifests\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-np6pq\" (UID: \"5104f206-e636-4a8d-82c2-3cb51d0ead0b\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq" Jun 05 17:57:09.248921 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.248854 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5104f206-e636-4a8d-82c2-3cb51d0ead0b-webhook-cert\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-np6pq\" (UID: \"5104f206-e636-4a8d-82c2-3cb51d0ead0b\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq" Jun 05 17:57:09.249053 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.248921 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntk6t\" (UniqueName: \"kubernetes.io/projected/5104f206-e636-4a8d-82c2-3cb51d0ead0b-kube-api-access-ntk6t\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-np6pq\" (UID: \"5104f206-e636-4a8d-82c2-3cb51d0ead0b\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq" Jun 05 17:57:09.349480 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.349450 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5104f206-e636-4a8d-82c2-3cb51d0ead0b-tmp\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-np6pq\" (UID: \"5104f206-e636-4a8d-82c2-3cb51d0ead0b\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq" Jun 05 17:57:09.349670 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.349490 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5104f206-e636-4a8d-82c2-3cb51d0ead0b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-np6pq\" (UID: \"5104f206-e636-4a8d-82c2-3cb51d0ead0b\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq" Jun 05 17:57:09.349670 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.349517 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5104f206-e636-4a8d-82c2-3cb51d0ead0b-manifests\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-np6pq\" (UID: \"5104f206-e636-4a8d-82c2-3cb51d0ead0b\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq" Jun 05 17:57:09.349670 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.349542 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5104f206-e636-4a8d-82c2-3cb51d0ead0b-webhook-cert\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-np6pq\" (UID: \"5104f206-e636-4a8d-82c2-3cb51d0ead0b\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq" Jun 05 17:57:09.349670 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.349572 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntk6t\" (UniqueName: \"kubernetes.io/projected/5104f206-e636-4a8d-82c2-3cb51d0ead0b-kube-api-access-ntk6t\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-np6pq\" (UID: \"5104f206-e636-4a8d-82c2-3cb51d0ead0b\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq" Jun 05 17:57:09.349959 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.349937 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5104f206-e636-4a8d-82c2-3cb51d0ead0b-manifests\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-np6pq\" (UID: \"5104f206-e636-4a8d-82c2-3cb51d0ead0b\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq" Jun 05 17:57:09.351719 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.351696 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5104f206-e636-4a8d-82c2-3cb51d0ead0b-tmp\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-np6pq\" (UID: \"5104f206-e636-4a8d-82c2-3cb51d0ead0b\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq" Jun 05 17:57:09.351983 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.351965 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5104f206-e636-4a8d-82c2-3cb51d0ead0b-webhook-cert\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-np6pq\" (UID: \"5104f206-e636-4a8d-82c2-3cb51d0ead0b\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq" Jun 05 17:57:09.352043 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.352023 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5104f206-e636-4a8d-82c2-3cb51d0ead0b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-np6pq\" (UID: \"5104f206-e636-4a8d-82c2-3cb51d0ead0b\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq" Jun 05 17:57:09.358499 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.358477 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntk6t\" (UniqueName: \"kubernetes.io/projected/5104f206-e636-4a8d-82c2-3cb51d0ead0b-kube-api-access-ntk6t\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-np6pq\" (UID: \"5104f206-e636-4a8d-82c2-3cb51d0ead0b\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq" Jun 05 17:57:09.512351 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.512260 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq" Jun 05 17:57:09.655571 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.655541 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq"] Jun 05 17:57:09.658231 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:57:09.658204 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5104f206_e636_4a8d_82c2_3cb51d0ead0b.slice/crio-97fde95188fab726a014f806eb225ec4163d5f0f60379bda26a851eada770070 WatchSource:0}: Error finding container 97fde95188fab726a014f806eb225ec4163d5f0f60379bda26a851eada770070: Status 404 returned error can't find the container with id 97fde95188fab726a014f806eb225ec4163d5f0f60379bda26a851eada770070 Jun 05 17:57:09.971293 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:09.971261 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq" event={"ID":"5104f206-e636-4a8d-82c2-3cb51d0ead0b","Type":"ContainerStarted","Data":"97fde95188fab726a014f806eb225ec4163d5f0f60379bda26a851eada770070"} Jun 05 17:57:12.988204 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:12.988167 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq" event={"ID":"5104f206-e636-4a8d-82c2-3cb51d0ead0b","Type":"ContainerStarted","Data":"03b588d08b9c5d04b90d38c5dc431fbd682b493ad04efd4f887e7c48caee3720"} Jun 05 17:57:13.994387 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:13.994351 2553 generic.go:356] "Generic (PLEG): container finished" podID="5104f206-e636-4a8d-82c2-3cb51d0ead0b" containerID="03b588d08b9c5d04b90d38c5dc431fbd682b493ad04efd4f887e7c48caee3720" exitCode=0 Jun 05 17:57:13.994783 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:13.994435 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq" event={"ID":"5104f206-e636-4a8d-82c2-3cb51d0ead0b","Type":"ContainerDied","Data":"03b588d08b9c5d04b90d38c5dc431fbd682b493ad04efd4f887e7c48caee3720"} Jun 05 17:57:15.001562 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:15.001527 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq" event={"ID":"5104f206-e636-4a8d-82c2-3cb51d0ead0b","Type":"ContainerStarted","Data":"91bca8c25204bd95bc746fc86dc08d8b950c73d85baba1f660e84a7a2cabc146"} Jun 05 17:57:15.002005 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:15.001615 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq" Jun 05 17:57:15.023907 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:15.023856 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq" podStartSLOduration=1.874726643 podStartE2EDuration="6.023840028s" totalImagesPullingTime="3.233873954s" totalInitContainerRuntime="915.239431ms" isStatefulPod=false podCreationTimestamp="2026-06-05 17:57:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:57:15.022782586 +0000 UTC m=+484.212761756" watchObservedRunningTime="2026-06-05 17:57:15.023840028 +0000 UTC m=+484.213819196" Jun 05 17:57:18.969179 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:18.969146 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-58878fcd45-lmlpn" Jun 05 17:57:26.010869 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:26.010836 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-np6pq" Jun 05 17:57:28.655152 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:28.655113 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-65bcf5494b-4tjlb"] Jun 05 17:57:28.667057 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:28.667027 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65bcf5494b-4tjlb" Jun 05 17:57:28.670416 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:28.670392 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-fn6qz\"" Jun 05 17:57:28.670584 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:28.670564 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 05 17:57:28.671530 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:28.671511 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 05 17:57:28.675307 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:28.675167 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65bcf5494b-4tjlb"] Jun 05 17:57:28.820580 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:28.820544 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4abbb1a4-ae43-465d-b59e-e89b59bd46f1-tmp\") pod \"kube-auth-proxy-65bcf5494b-4tjlb\" (UID: \"4abbb1a4-ae43-465d-b59e-e89b59bd46f1\") " pod="openshift-ingress/kube-auth-proxy-65bcf5494b-4tjlb" Jun 05 17:57:28.820580 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:28.820584 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqtf9\" (UniqueName: \"kubernetes.io/projected/4abbb1a4-ae43-465d-b59e-e89b59bd46f1-kube-api-access-sqtf9\") pod \"kube-auth-proxy-65bcf5494b-4tjlb\" (UID: \"4abbb1a4-ae43-465d-b59e-e89b59bd46f1\") " pod="openshift-ingress/kube-auth-proxy-65bcf5494b-4tjlb" Jun 05 17:57:28.820784 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:28.820622 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4abbb1a4-ae43-465d-b59e-e89b59bd46f1-tls-certs\") pod \"kube-auth-proxy-65bcf5494b-4tjlb\" (UID: \"4abbb1a4-ae43-465d-b59e-e89b59bd46f1\") " pod="openshift-ingress/kube-auth-proxy-65bcf5494b-4tjlb" Jun 05 17:57:28.921703 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:28.921613 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4abbb1a4-ae43-465d-b59e-e89b59bd46f1-tls-certs\") pod \"kube-auth-proxy-65bcf5494b-4tjlb\" (UID: \"4abbb1a4-ae43-465d-b59e-e89b59bd46f1\") " pod="openshift-ingress/kube-auth-proxy-65bcf5494b-4tjlb" Jun 05 17:57:28.921703 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:28.921684 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4abbb1a4-ae43-465d-b59e-e89b59bd46f1-tmp\") pod \"kube-auth-proxy-65bcf5494b-4tjlb\" (UID: \"4abbb1a4-ae43-465d-b59e-e89b59bd46f1\") " pod="openshift-ingress/kube-auth-proxy-65bcf5494b-4tjlb" Jun 05 17:57:28.921703 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:28.921706 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqtf9\" (UniqueName: \"kubernetes.io/projected/4abbb1a4-ae43-465d-b59e-e89b59bd46f1-kube-api-access-sqtf9\") pod \"kube-auth-proxy-65bcf5494b-4tjlb\" (UID: \"4abbb1a4-ae43-465d-b59e-e89b59bd46f1\") " pod="openshift-ingress/kube-auth-proxy-65bcf5494b-4tjlb" Jun 05 17:57:28.924177 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:28.924151 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4abbb1a4-ae43-465d-b59e-e89b59bd46f1-tmp\") pod \"kube-auth-proxy-65bcf5494b-4tjlb\" (UID: \"4abbb1a4-ae43-465d-b59e-e89b59bd46f1\") " pod="openshift-ingress/kube-auth-proxy-65bcf5494b-4tjlb" Jun 05 17:57:28.924326 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:28.924226 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4abbb1a4-ae43-465d-b59e-e89b59bd46f1-tls-certs\") pod \"kube-auth-proxy-65bcf5494b-4tjlb\" (UID: \"4abbb1a4-ae43-465d-b59e-e89b59bd46f1\") " pod="openshift-ingress/kube-auth-proxy-65bcf5494b-4tjlb" Jun 05 17:57:28.945016 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:28.944987 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqtf9\" (UniqueName: \"kubernetes.io/projected/4abbb1a4-ae43-465d-b59e-e89b59bd46f1-kube-api-access-sqtf9\") pod \"kube-auth-proxy-65bcf5494b-4tjlb\" (UID: \"4abbb1a4-ae43-465d-b59e-e89b59bd46f1\") " pod="openshift-ingress/kube-auth-proxy-65bcf5494b-4tjlb" Jun 05 17:57:28.978589 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:28.978555 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65bcf5494b-4tjlb" Jun 05 17:57:29.139788 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:29.139763 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65bcf5494b-4tjlb"] Jun 05 17:57:29.141693 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:57:29.141671 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4abbb1a4_ae43_465d_b59e_e89b59bd46f1.slice/crio-66b4a0897f6555c75d63d359f694000d723eff09c5e5f6808b30aba70ff2f444 WatchSource:0}: Error finding container 66b4a0897f6555c75d63d359f694000d723eff09c5e5f6808b30aba70ff2f444: Status 404 returned error can't find the container with id 66b4a0897f6555c75d63d359f694000d723eff09c5e5f6808b30aba70ff2f444 Jun 05 17:57:30.070118 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:30.069985 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65bcf5494b-4tjlb" event={"ID":"4abbb1a4-ae43-465d-b59e-e89b59bd46f1","Type":"ContainerStarted","Data":"66b4a0897f6555c75d63d359f694000d723eff09c5e5f6808b30aba70ff2f444"} Jun 05 17:57:33.088364 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:33.088321 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65bcf5494b-4tjlb" event={"ID":"4abbb1a4-ae43-465d-b59e-e89b59bd46f1","Type":"ContainerStarted","Data":"55375ea43baa897b9a1cbf4175ebb9e3491fb98de225ba0ba6355084a2104ed3"} Jun 05 17:57:33.104359 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:57:33.104304 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-65bcf5494b-4tjlb" podStartSLOduration=2.108184398 podStartE2EDuration="5.104288044s" totalImagesPullingTime="2.996103646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:57:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:57:33.103823558 +0000 UTC m=+502.293802727" watchObservedRunningTime="2026-06-05 17:57:33.104288044 +0000 UTC m=+502.294267212" Jun 05 17:59:11.245675 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:59:11.245650 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z87q_1412064f-459e-4d05-9771-f48e3fdf62b1/ovn-acl-logging/0.log" Jun 05 17:59:11.246801 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:59:11.246782 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z87q_1412064f-459e-4d05-9771-f48e3fdf62b1/ovn-acl-logging/0.log" Jun 05 17:59:13.622992 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:59:13.622955 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pv7mc"] Jun 05 17:59:13.626386 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:59:13.626369 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pv7mc" Jun 05 17:59:13.629123 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:59:13.629099 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 05 17:59:13.629271 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:59:13.629145 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 17:59:13.630284 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:59:13.630266 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j2czf\"" Jun 05 17:59:13.630380 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:59:13.630308 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 17:59:13.630380 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:59:13.630327 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 05 17:59:13.641499 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:59:13.641459 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pv7mc"] Jun 05 17:59:13.686556 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:59:13.686524 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvlmg\" (UniqueName: \"kubernetes.io/projected/6de33818-9f3f-4855-a55c-814e037e3e45-kube-api-access-wvlmg\") pod \"kuadrant-console-plugin-66b5774985-pv7mc\" (UID: \"6de33818-9f3f-4855-a55c-814e037e3e45\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pv7mc" Jun 05 17:59:13.686706 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:59:13.686617 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6de33818-9f3f-4855-a55c-814e037e3e45-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pv7mc\" (UID: \"6de33818-9f3f-4855-a55c-814e037e3e45\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pv7mc" Jun 05 17:59:13.686706 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:59:13.686645 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6de33818-9f3f-4855-a55c-814e037e3e45-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pv7mc\" (UID: \"6de33818-9f3f-4855-a55c-814e037e3e45\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pv7mc" Jun 05 17:59:13.787564 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:59:13.787528 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6de33818-9f3f-4855-a55c-814e037e3e45-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pv7mc\" (UID: \"6de33818-9f3f-4855-a55c-814e037e3e45\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pv7mc" Jun 05 17:59:13.787741 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:59:13.787574 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6de33818-9f3f-4855-a55c-814e037e3e45-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pv7mc\" (UID: \"6de33818-9f3f-4855-a55c-814e037e3e45\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pv7mc" Jun 05 17:59:13.787741 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:59:13.787614 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvlmg\" (UniqueName: \"kubernetes.io/projected/6de33818-9f3f-4855-a55c-814e037e3e45-kube-api-access-wvlmg\") pod \"kuadrant-console-plugin-66b5774985-pv7mc\" (UID: \"6de33818-9f3f-4855-a55c-814e037e3e45\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pv7mc" Jun 05 17:59:13.787741 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:59:13.787689 2553 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 05 17:59:13.787898 ip-10-0-143-199 kubenswrapper[2553]: E0605 17:59:13.787784 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de33818-9f3f-4855-a55c-814e037e3e45-plugin-serving-cert podName:6de33818-9f3f-4855-a55c-814e037e3e45 nodeName:}" failed. No retries permitted until 2026-06-05 17:59:14.287765858 +0000 UTC m=+603.477745008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/6de33818-9f3f-4855-a55c-814e037e3e45-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-pv7mc" (UID: "6de33818-9f3f-4855-a55c-814e037e3e45") : secret "plugin-serving-cert" not found Jun 05 17:59:13.788278 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:59:13.788260 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6de33818-9f3f-4855-a55c-814e037e3e45-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pv7mc\" (UID: \"6de33818-9f3f-4855-a55c-814e037e3e45\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pv7mc" Jun 05 17:59:13.798799 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:59:13.798774 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvlmg\" (UniqueName: \"kubernetes.io/projected/6de33818-9f3f-4855-a55c-814e037e3e45-kube-api-access-wvlmg\") pod \"kuadrant-console-plugin-66b5774985-pv7mc\" (UID: \"6de33818-9f3f-4855-a55c-814e037e3e45\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pv7mc" Jun 05 17:59:14.291997 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:59:14.291964 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6de33818-9f3f-4855-a55c-814e037e3e45-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pv7mc\" (UID: \"6de33818-9f3f-4855-a55c-814e037e3e45\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pv7mc" Jun 05 17:59:14.294459 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:59:14.294428 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6de33818-9f3f-4855-a55c-814e037e3e45-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pv7mc\" (UID: \"6de33818-9f3f-4855-a55c-814e037e3e45\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pv7mc" Jun 05 17:59:14.550851 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:59:14.550753 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pv7mc" Jun 05 17:59:14.675805 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:59:14.675766 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pv7mc"] Jun 05 17:59:14.679917 ip-10-0-143-199 kubenswrapper[2553]: W0605 17:59:14.679889 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6de33818_9f3f_4855_a55c_814e037e3e45.slice/crio-bf86f71ab19222a28a886550d9c14f73eb2cc71b163786c481ce34ddb66ebf35 WatchSource:0}: Error finding container bf86f71ab19222a28a886550d9c14f73eb2cc71b163786c481ce34ddb66ebf35: Status 404 returned error can't find the container with id bf86f71ab19222a28a886550d9c14f73eb2cc71b163786c481ce34ddb66ebf35 Jun 05 17:59:15.504545 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:59:15.504423 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pv7mc" event={"ID":"6de33818-9f3f-4855-a55c-814e037e3e45","Type":"ContainerStarted","Data":"bf86f71ab19222a28a886550d9c14f73eb2cc71b163786c481ce34ddb66ebf35"} Jun 05 17:59:37.618932 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:59:37.617808 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pv7mc" event={"ID":"6de33818-9f3f-4855-a55c-814e037e3e45","Type":"ContainerStarted","Data":"1625f74990d73793bf4aa8b44e9958530dedf01fa7327df583d081ef639461f0"} Jun 05 17:59:37.637376 ip-10-0-143-199 kubenswrapper[2553]: I0605 17:59:37.637322 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pv7mc" podStartSLOduration=2.180118928 podStartE2EDuration="24.637306791s" totalImagesPullingTime="22.457187863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:59:37.637095797 +0000 UTC m=+626.827074966" watchObservedRunningTime="2026-06-05 17:59:37.637306791 +0000 UTC m=+626.827285960" Jun 05 18:00:01.306338 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:01.306302 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:00:01.370507 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:01.370473 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:00:01.370507 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:01.370508 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:00:01.370707 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:01.370574 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-84pdq" Jun 05 18:00:01.373689 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:01.373667 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 05 18:00:01.505055 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:01.505024 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3b6fd8c3-6ed3-4248-9c51-cbc9d0921b3c-config-file\") pod \"limitador-limitador-54d6d988d5-84pdq\" (UID: \"3b6fd8c3-6ed3-4248-9c51-cbc9d0921b3c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-84pdq" Jun 05 18:00:01.505055 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:01.505059 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwp8t\" (UniqueName: \"kubernetes.io/projected/3b6fd8c3-6ed3-4248-9c51-cbc9d0921b3c-kube-api-access-vwp8t\") pod \"limitador-limitador-54d6d988d5-84pdq\" (UID: \"3b6fd8c3-6ed3-4248-9c51-cbc9d0921b3c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-84pdq" Jun 05 18:00:01.605518 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:01.605490 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3b6fd8c3-6ed3-4248-9c51-cbc9d0921b3c-config-file\") pod \"limitador-limitador-54d6d988d5-84pdq\" (UID: \"3b6fd8c3-6ed3-4248-9c51-cbc9d0921b3c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-84pdq" Jun 05 18:00:01.605668 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:01.605525 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwp8t\" (UniqueName: \"kubernetes.io/projected/3b6fd8c3-6ed3-4248-9c51-cbc9d0921b3c-kube-api-access-vwp8t\") pod \"limitador-limitador-54d6d988d5-84pdq\" (UID: \"3b6fd8c3-6ed3-4248-9c51-cbc9d0921b3c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-84pdq" Jun 05 18:00:01.606079 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:01.606057 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3b6fd8c3-6ed3-4248-9c51-cbc9d0921b3c-config-file\") pod \"limitador-limitador-54d6d988d5-84pdq\" (UID: \"3b6fd8c3-6ed3-4248-9c51-cbc9d0921b3c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-84pdq" Jun 05 18:00:01.614519 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:01.614497 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwp8t\" (UniqueName: \"kubernetes.io/projected/3b6fd8c3-6ed3-4248-9c51-cbc9d0921b3c-kube-api-access-vwp8t\") pod \"limitador-limitador-54d6d988d5-84pdq\" (UID: \"3b6fd8c3-6ed3-4248-9c51-cbc9d0921b3c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-84pdq" Jun 05 18:00:01.680465 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:01.680444 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-84pdq" Jun 05 18:00:01.814181 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:01.814140 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:00:01.816994 ip-10-0-143-199 kubenswrapper[2553]: W0605 18:00:01.816958 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b6fd8c3_6ed3_4248_9c51_cbc9d0921b3c.slice/crio-f3e1dac8b85c58170f83268a1953489f2b5e22ecf7c99a52a715e72d1ad46abc WatchSource:0}: Error finding container f3e1dac8b85c58170f83268a1953489f2b5e22ecf7c99a52a715e72d1ad46abc: Status 404 returned error can't find the container with id f3e1dac8b85c58170f83268a1953489f2b5e22ecf7c99a52a715e72d1ad46abc Jun 05 18:00:01.901863 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:01.901795 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-cvr9b"] Jun 05 18:00:01.906088 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:01.906071 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cvr9b" Jun 05 18:00:01.909185 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:01.909168 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-r6cks\"" Jun 05 18:00:01.915751 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:01.915731 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cvr9b"] Jun 05 18:00:02.009580 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:02.009543 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zdcj\" (UniqueName: \"kubernetes.io/projected/c8b11142-34d8-49e3-8278-81ce6061a9ce-kube-api-access-5zdcj\") pod \"authorino-75d556bd77-cvr9b\" (UID: \"c8b11142-34d8-49e3-8278-81ce6061a9ce\") " pod="kuadrant-system/authorino-75d556bd77-cvr9b" Jun 05 18:00:02.110299 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:02.110261 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zdcj\" (UniqueName: \"kubernetes.io/projected/c8b11142-34d8-49e3-8278-81ce6061a9ce-kube-api-access-5zdcj\") pod \"authorino-75d556bd77-cvr9b\" (UID: \"c8b11142-34d8-49e3-8278-81ce6061a9ce\") " pod="kuadrant-system/authorino-75d556bd77-cvr9b" Jun 05 18:00:02.120423 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:02.120394 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zdcj\" (UniqueName: \"kubernetes.io/projected/c8b11142-34d8-49e3-8278-81ce6061a9ce-kube-api-access-5zdcj\") pod \"authorino-75d556bd77-cvr9b\" (UID: \"c8b11142-34d8-49e3-8278-81ce6061a9ce\") " pod="kuadrant-system/authorino-75d556bd77-cvr9b" Jun 05 18:00:02.216632 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:02.216543 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cvr9b" Jun 05 18:00:02.341574 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:02.341530 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cvr9b"] Jun 05 18:00:02.344880 ip-10-0-143-199 kubenswrapper[2553]: W0605 18:00:02.344843 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8b11142_34d8_49e3_8278_81ce6061a9ce.slice/crio-334fa3c07c97db63b6f3fba14390922329b68e9e751cabfc0a1345fd1d6932c2 WatchSource:0}: Error finding container 334fa3c07c97db63b6f3fba14390922329b68e9e751cabfc0a1345fd1d6932c2: Status 404 returned error can't find the container with id 334fa3c07c97db63b6f3fba14390922329b68e9e751cabfc0a1345fd1d6932c2 Jun 05 18:00:02.737807 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:02.737767 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cvr9b" event={"ID":"c8b11142-34d8-49e3-8278-81ce6061a9ce","Type":"ContainerStarted","Data":"334fa3c07c97db63b6f3fba14390922329b68e9e751cabfc0a1345fd1d6932c2"} Jun 05 18:00:02.740109 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:02.740076 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-84pdq" event={"ID":"3b6fd8c3-6ed3-4248-9c51-cbc9d0921b3c","Type":"ContainerStarted","Data":"f3e1dac8b85c58170f83268a1953489f2b5e22ecf7c99a52a715e72d1ad46abc"} Jun 05 18:00:04.752699 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:04.752604 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-84pdq" event={"ID":"3b6fd8c3-6ed3-4248-9c51-cbc9d0921b3c","Type":"ContainerStarted","Data":"b170241901bec87822ddacf9cc3552a3912dbbf77d801805c442ee8d45c52126"} Jun 05 18:00:04.752699 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:04.752680 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-84pdq" Jun 05 18:00:04.770145 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:04.770085 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-84pdq" podStartSLOduration=1.16172657 podStartE2EDuration="3.770066858s" totalImagesPullingTime="2.608340288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:00:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:00:04.768872208 +0000 UTC m=+653.958851378" watchObservedRunningTime="2026-06-05 18:00:04.770066858 +0000 UTC m=+653.960046027" Jun 05 18:00:06.763511 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:06.763476 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cvr9b" event={"ID":"c8b11142-34d8-49e3-8278-81ce6061a9ce","Type":"ContainerStarted","Data":"2ebbcbf5a20cc5408924c02f65ed06b13dd004c56d4c9dad8ee8fce39d582eb1"} Jun 05 18:00:06.782446 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:06.782273 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-cvr9b" podStartSLOduration=1.440585223 podStartE2EDuration="5.782254887s" totalImagesPullingTime="4.341669664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:00:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:00:06.779825442 +0000 UTC m=+655.969804608" watchObservedRunningTime="2026-06-05 18:00:06.782254887 +0000 UTC m=+655.972234046" Jun 05 18:00:15.758891 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:00:15.758217 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-84pdq" Jun 05 18:01:28.585325 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:28.581830 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cvr9b"] Jun 05 18:01:28.585325 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:28.582071 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-cvr9b" podUID="c8b11142-34d8-49e3-8278-81ce6061a9ce" containerName="authorino" containerID="cri-o://2ebbcbf5a20cc5408924c02f65ed06b13dd004c56d4c9dad8ee8fce39d582eb1" gracePeriod=30 Jun 05 18:01:28.838412 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:28.838351 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cvr9b" Jun 05 18:01:28.941714 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:28.941681 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zdcj\" (UniqueName: \"kubernetes.io/projected/c8b11142-34d8-49e3-8278-81ce6061a9ce-kube-api-access-5zdcj\") pod \"c8b11142-34d8-49e3-8278-81ce6061a9ce\" (UID: \"c8b11142-34d8-49e3-8278-81ce6061a9ce\") " Jun 05 18:01:28.943833 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:28.943802 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8b11142-34d8-49e3-8278-81ce6061a9ce-kube-api-access-5zdcj" (OuterVolumeSpecName: "kube-api-access-5zdcj") pod "c8b11142-34d8-49e3-8278-81ce6061a9ce" (UID: "c8b11142-34d8-49e3-8278-81ce6061a9ce"). InnerVolumeSpecName "kube-api-access-5zdcj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 18:01:29.043305 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:29.043272 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zdcj\" (UniqueName: \"kubernetes.io/projected/c8b11142-34d8-49e3-8278-81ce6061a9ce-kube-api-access-5zdcj\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 18:01:29.109828 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:29.109763 2553 generic.go:356] "Generic (PLEG): container finished" podID="c8b11142-34d8-49e3-8278-81ce6061a9ce" containerID="2ebbcbf5a20cc5408924c02f65ed06b13dd004c56d4c9dad8ee8fce39d582eb1" exitCode=0 Jun 05 18:01:29.109828 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:29.109803 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cvr9b" Jun 05 18:01:29.109828 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:29.109815 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cvr9b" event={"ID":"c8b11142-34d8-49e3-8278-81ce6061a9ce","Type":"ContainerDied","Data":"2ebbcbf5a20cc5408924c02f65ed06b13dd004c56d4c9dad8ee8fce39d582eb1"} Jun 05 18:01:29.110003 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:29.109845 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cvr9b" event={"ID":"c8b11142-34d8-49e3-8278-81ce6061a9ce","Type":"ContainerDied","Data":"334fa3c07c97db63b6f3fba14390922329b68e9e751cabfc0a1345fd1d6932c2"} Jun 05 18:01:29.110003 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:29.109861 2553 scope.go:117] "RemoveContainer" containerID="2ebbcbf5a20cc5408924c02f65ed06b13dd004c56d4c9dad8ee8fce39d582eb1" Jun 05 18:01:29.118142 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:29.118124 2553 scope.go:117] "RemoveContainer" containerID="2ebbcbf5a20cc5408924c02f65ed06b13dd004c56d4c9dad8ee8fce39d582eb1" Jun 05 18:01:29.118446 ip-10-0-143-199 kubenswrapper[2553]: E0605 18:01:29.118422 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ebbcbf5a20cc5408924c02f65ed06b13dd004c56d4c9dad8ee8fce39d582eb1\": container with ID starting with 2ebbcbf5a20cc5408924c02f65ed06b13dd004c56d4c9dad8ee8fce39d582eb1 not found: ID does not exist" containerID="2ebbcbf5a20cc5408924c02f65ed06b13dd004c56d4c9dad8ee8fce39d582eb1" Jun 05 18:01:29.118531 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:29.118451 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ebbcbf5a20cc5408924c02f65ed06b13dd004c56d4c9dad8ee8fce39d582eb1"} err="failed to get container status \"2ebbcbf5a20cc5408924c02f65ed06b13dd004c56d4c9dad8ee8fce39d582eb1\": rpc error: code = NotFound desc = could not find container \"2ebbcbf5a20cc5408924c02f65ed06b13dd004c56d4c9dad8ee8fce39d582eb1\": container with ID starting with 2ebbcbf5a20cc5408924c02f65ed06b13dd004c56d4c9dad8ee8fce39d582eb1 not found: ID does not exist" Jun 05 18:01:29.132365 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:29.132342 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cvr9b"] Jun 05 18:01:29.138575 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:29.138553 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cvr9b"] Jun 05 18:01:29.271195 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:29.271163 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8b11142-34d8-49e3-8278-81ce6061a9ce" path="/var/lib/kubelet/pods/c8b11142-34d8-49e3-8278-81ce6061a9ce/volumes" Jun 05 18:01:32.041788 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.041748 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5bb4458859-v487f"] Jun 05 18:01:32.042281 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.042186 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8b11142-34d8-49e3-8278-81ce6061a9ce" containerName="authorino" Jun 05 18:01:32.042281 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.042205 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8b11142-34d8-49e3-8278-81ce6061a9ce" containerName="authorino" Jun 05 18:01:32.042409 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.042337 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8b11142-34d8-49e3-8278-81ce6061a9ce" containerName="authorino" Jun 05 18:01:32.045306 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.045284 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bb4458859-v487f" Jun 05 18:01:32.048181 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.048164 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-k9t54\"" Jun 05 18:01:32.048433 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.048420 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 05 18:01:32.049347 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.049329 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 05 18:01:32.057182 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.057160 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5bb4458859-v487f"] Jun 05 18:01:32.069928 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.069902 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23fca9a2-064b-47cb-8ca8-046faf2cca63-webhook-cert\") pod \"maas-controller-5bb4458859-v487f\" (UID: \"23fca9a2-064b-47cb-8ca8-046faf2cca63\") " pod="opendatahub/maas-controller-5bb4458859-v487f" Jun 05 18:01:32.070452 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.070150 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxsnj\" (UniqueName: \"kubernetes.io/projected/23fca9a2-064b-47cb-8ca8-046faf2cca63-kube-api-access-pxsnj\") pod \"maas-controller-5bb4458859-v487f\" (UID: \"23fca9a2-064b-47cb-8ca8-046faf2cca63\") " pod="opendatahub/maas-controller-5bb4458859-v487f" Jun 05 18:01:32.171913 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.171882 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23fca9a2-064b-47cb-8ca8-046faf2cca63-webhook-cert\") pod \"maas-controller-5bb4458859-v487f\" (UID: \"23fca9a2-064b-47cb-8ca8-046faf2cca63\") " pod="opendatahub/maas-controller-5bb4458859-v487f" Jun 05 18:01:32.172098 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.171918 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxsnj\" (UniqueName: \"kubernetes.io/projected/23fca9a2-064b-47cb-8ca8-046faf2cca63-kube-api-access-pxsnj\") pod \"maas-controller-5bb4458859-v487f\" (UID: \"23fca9a2-064b-47cb-8ca8-046faf2cca63\") " pod="opendatahub/maas-controller-5bb4458859-v487f" Jun 05 18:01:32.172098 ip-10-0-143-199 kubenswrapper[2553]: E0605 18:01:32.172028 2553 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 05 18:01:32.172098 ip-10-0-143-199 kubenswrapper[2553]: E0605 18:01:32.172095 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23fca9a2-064b-47cb-8ca8-046faf2cca63-webhook-cert podName:23fca9a2-064b-47cb-8ca8-046faf2cca63 nodeName:}" failed. No retries permitted until 2026-06-05 18:01:32.672078495 +0000 UTC m=+741.862057642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/23fca9a2-064b-47cb-8ca8-046faf2cca63-webhook-cert") pod "maas-controller-5bb4458859-v487f" (UID: "23fca9a2-064b-47cb-8ca8-046faf2cca63") : secret "maas-controller-webhook-cert" not found Jun 05 18:01:32.181614 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.181457 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxsnj\" (UniqueName: \"kubernetes.io/projected/23fca9a2-064b-47cb-8ca8-046faf2cca63-kube-api-access-pxsnj\") pod \"maas-controller-5bb4458859-v487f\" (UID: \"23fca9a2-064b-47cb-8ca8-046faf2cca63\") " pod="opendatahub/maas-controller-5bb4458859-v487f" Jun 05 18:01:32.214488 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.214458 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-575b84f768-vzbmb"] Jun 05 18:01:32.216762 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.216744 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-575b84f768-vzbmb" Jun 05 18:01:32.227832 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.227807 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-575b84f768-vzbmb"] Jun 05 18:01:32.272596 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.272559 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61048d5e-bbdb-4d48-9e54-2ff8e9261388-webhook-cert\") pod \"maas-controller-575b84f768-vzbmb\" (UID: \"61048d5e-bbdb-4d48-9e54-2ff8e9261388\") " pod="opendatahub/maas-controller-575b84f768-vzbmb" Jun 05 18:01:32.272758 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.272627 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnb5c\" (UniqueName: \"kubernetes.io/projected/61048d5e-bbdb-4d48-9e54-2ff8e9261388-kube-api-access-hnb5c\") pod \"maas-controller-575b84f768-vzbmb\" (UID: \"61048d5e-bbdb-4d48-9e54-2ff8e9261388\") " pod="opendatahub/maas-controller-575b84f768-vzbmb" Jun 05 18:01:32.373911 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.373882 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnb5c\" (UniqueName: \"kubernetes.io/projected/61048d5e-bbdb-4d48-9e54-2ff8e9261388-kube-api-access-hnb5c\") pod \"maas-controller-575b84f768-vzbmb\" (UID: \"61048d5e-bbdb-4d48-9e54-2ff8e9261388\") " pod="opendatahub/maas-controller-575b84f768-vzbmb" Jun 05 18:01:32.374062 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.373964 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61048d5e-bbdb-4d48-9e54-2ff8e9261388-webhook-cert\") pod \"maas-controller-575b84f768-vzbmb\" (UID: \"61048d5e-bbdb-4d48-9e54-2ff8e9261388\") " pod="opendatahub/maas-controller-575b84f768-vzbmb" Jun 05 18:01:32.376306 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.376279 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61048d5e-bbdb-4d48-9e54-2ff8e9261388-webhook-cert\") pod \"maas-controller-575b84f768-vzbmb\" (UID: \"61048d5e-bbdb-4d48-9e54-2ff8e9261388\") " pod="opendatahub/maas-controller-575b84f768-vzbmb" Jun 05 18:01:32.383041 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.383014 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnb5c\" (UniqueName: \"kubernetes.io/projected/61048d5e-bbdb-4d48-9e54-2ff8e9261388-kube-api-access-hnb5c\") pod \"maas-controller-575b84f768-vzbmb\" (UID: \"61048d5e-bbdb-4d48-9e54-2ff8e9261388\") " pod="opendatahub/maas-controller-575b84f768-vzbmb" Jun 05 18:01:32.527315 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.527284 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-575b84f768-vzbmb" Jun 05 18:01:32.655445 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.655419 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-575b84f768-vzbmb"] Jun 05 18:01:32.657582 ip-10-0-143-199 kubenswrapper[2553]: W0605 18:01:32.657557 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61048d5e_bbdb_4d48_9e54_2ff8e9261388.slice/crio-812c9c143838834576e09f5cadbe3878ad6ef1107514ba66a048ccf72d120a84 WatchSource:0}: Error finding container 812c9c143838834576e09f5cadbe3878ad6ef1107514ba66a048ccf72d120a84: Status 404 returned error can't find the container with id 812c9c143838834576e09f5cadbe3878ad6ef1107514ba66a048ccf72d120a84 Jun 05 18:01:32.676613 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.676586 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23fca9a2-064b-47cb-8ca8-046faf2cca63-webhook-cert\") pod \"maas-controller-5bb4458859-v487f\" (UID: \"23fca9a2-064b-47cb-8ca8-046faf2cca63\") " pod="opendatahub/maas-controller-5bb4458859-v487f" Jun 05 18:01:32.678908 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.678888 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23fca9a2-064b-47cb-8ca8-046faf2cca63-webhook-cert\") pod \"maas-controller-5bb4458859-v487f\" (UID: \"23fca9a2-064b-47cb-8ca8-046faf2cca63\") " pod="opendatahub/maas-controller-5bb4458859-v487f" Jun 05 18:01:32.956069 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:32.955965 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bb4458859-v487f" Jun 05 18:01:33.083767 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:33.083741 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5bb4458859-v487f"] Jun 05 18:01:33.086169 ip-10-0-143-199 kubenswrapper[2553]: W0605 18:01:33.086147 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23fca9a2_064b_47cb_8ca8_046faf2cca63.slice/crio-bc3464f67fb4001d658942f7597df2d8460bdc1942613591dc9971a66bc40004 WatchSource:0}: Error finding container bc3464f67fb4001d658942f7597df2d8460bdc1942613591dc9971a66bc40004: Status 404 returned error can't find the container with id bc3464f67fb4001d658942f7597df2d8460bdc1942613591dc9971a66bc40004 Jun 05 18:01:33.130515 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:33.130473 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bb4458859-v487f" event={"ID":"23fca9a2-064b-47cb-8ca8-046faf2cca63","Type":"ContainerStarted","Data":"bc3464f67fb4001d658942f7597df2d8460bdc1942613591dc9971a66bc40004"} Jun 05 18:01:33.131584 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:33.131561 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-575b84f768-vzbmb" event={"ID":"61048d5e-bbdb-4d48-9e54-2ff8e9261388","Type":"ContainerStarted","Data":"812c9c143838834576e09f5cadbe3878ad6ef1107514ba66a048ccf72d120a84"} Jun 05 18:01:36.149664 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:36.149625 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bb4458859-v487f" event={"ID":"23fca9a2-064b-47cb-8ca8-046faf2cca63","Type":"ContainerStarted","Data":"f320d6bfe3a4c03396b51e5473d03fe22681ce19741cb4add45e395a06549fb0"} Jun 05 18:01:36.150128 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:36.149740 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5bb4458859-v487f" Jun 05 18:01:36.151317 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:36.151281 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-575b84f768-vzbmb" event={"ID":"61048d5e-bbdb-4d48-9e54-2ff8e9261388","Type":"ContainerStarted","Data":"9436c45df2f379de4725d678d617cf981a1a2b30baf7169bb039f6da2a7ac90a"} Jun 05 18:01:36.151454 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:36.151373 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-575b84f768-vzbmb" Jun 05 18:01:36.173191 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:36.173139 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5bb4458859-v487f" podStartSLOduration=1.84824375 podStartE2EDuration="4.173121173s" totalImagesPullingTime="2.324877423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:01:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:01:36.172587579 +0000 UTC m=+745.362566749" watchObservedRunningTime="2026-06-05 18:01:36.173121173 +0000 UTC m=+745.363100344" Jun 05 18:01:36.197025 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:36.196982 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-575b84f768-vzbmb" podStartSLOduration=1.453434954 podStartE2EDuration="4.196969834s" totalImagesPullingTime="2.74353488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:01:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:01:36.196069747 +0000 UTC m=+745.386048915" watchObservedRunningTime="2026-06-05 18:01:36.196969834 +0000 UTC m=+745.386949004" Jun 05 18:01:47.162732 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:47.162698 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5bb4458859-v487f" Jun 05 18:01:47.163573 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:47.163553 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-575b84f768-vzbmb" Jun 05 18:01:47.231774 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:47.231741 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5bb4458859-v487f"] Jun 05 18:01:47.231945 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:47.231924 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5bb4458859-v487f" podUID="23fca9a2-064b-47cb-8ca8-046faf2cca63" containerName="manager" containerID="cri-o://f320d6bfe3a4c03396b51e5473d03fe22681ce19741cb4add45e395a06549fb0" gracePeriod=30 Jun 05 18:01:47.476799 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:47.476777 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bb4458859-v487f" Jun 05 18:01:47.614024 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:47.613988 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxsnj\" (UniqueName: \"kubernetes.io/projected/23fca9a2-064b-47cb-8ca8-046faf2cca63-kube-api-access-pxsnj\") pod \"23fca9a2-064b-47cb-8ca8-046faf2cca63\" (UID: \"23fca9a2-064b-47cb-8ca8-046faf2cca63\") " Jun 05 18:01:47.614180 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:47.614092 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23fca9a2-064b-47cb-8ca8-046faf2cca63-webhook-cert\") pod \"23fca9a2-064b-47cb-8ca8-046faf2cca63\" (UID: \"23fca9a2-064b-47cb-8ca8-046faf2cca63\") " Jun 05 18:01:47.616293 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:47.616261 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23fca9a2-064b-47cb-8ca8-046faf2cca63-kube-api-access-pxsnj" (OuterVolumeSpecName: "kube-api-access-pxsnj") pod "23fca9a2-064b-47cb-8ca8-046faf2cca63" (UID: "23fca9a2-064b-47cb-8ca8-046faf2cca63"). InnerVolumeSpecName "kube-api-access-pxsnj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 18:01:47.616413 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:47.616302 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23fca9a2-064b-47cb-8ca8-046faf2cca63-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "23fca9a2-064b-47cb-8ca8-046faf2cca63" (UID: "23fca9a2-064b-47cb-8ca8-046faf2cca63"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 18:01:47.714960 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:47.714884 2553 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23fca9a2-064b-47cb-8ca8-046faf2cca63-webhook-cert\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 18:01:47.714960 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:47.714912 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxsnj\" (UniqueName: \"kubernetes.io/projected/23fca9a2-064b-47cb-8ca8-046faf2cca63-kube-api-access-pxsnj\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 18:01:48.209116 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:48.209080 2553 generic.go:356] "Generic (PLEG): container finished" podID="23fca9a2-064b-47cb-8ca8-046faf2cca63" containerID="f320d6bfe3a4c03396b51e5473d03fe22681ce19741cb4add45e395a06549fb0" exitCode=0 Jun 05 18:01:48.209583 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:48.209123 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bb4458859-v487f" Jun 05 18:01:48.209583 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:48.209159 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bb4458859-v487f" event={"ID":"23fca9a2-064b-47cb-8ca8-046faf2cca63","Type":"ContainerDied","Data":"f320d6bfe3a4c03396b51e5473d03fe22681ce19741cb4add45e395a06549fb0"} Jun 05 18:01:48.209583 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:48.209204 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bb4458859-v487f" event={"ID":"23fca9a2-064b-47cb-8ca8-046faf2cca63","Type":"ContainerDied","Data":"bc3464f67fb4001d658942f7597df2d8460bdc1942613591dc9971a66bc40004"} Jun 05 18:01:48.209583 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:48.209228 2553 scope.go:117] "RemoveContainer" containerID="f320d6bfe3a4c03396b51e5473d03fe22681ce19741cb4add45e395a06549fb0" Jun 05 18:01:48.218083 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:48.218062 2553 scope.go:117] "RemoveContainer" containerID="f320d6bfe3a4c03396b51e5473d03fe22681ce19741cb4add45e395a06549fb0" Jun 05 18:01:48.218345 ip-10-0-143-199 kubenswrapper[2553]: E0605 18:01:48.218326 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f320d6bfe3a4c03396b51e5473d03fe22681ce19741cb4add45e395a06549fb0\": container with ID starting with f320d6bfe3a4c03396b51e5473d03fe22681ce19741cb4add45e395a06549fb0 not found: ID does not exist" containerID="f320d6bfe3a4c03396b51e5473d03fe22681ce19741cb4add45e395a06549fb0" Jun 05 18:01:48.218402 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:48.218354 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f320d6bfe3a4c03396b51e5473d03fe22681ce19741cb4add45e395a06549fb0"} err="failed to get container status \"f320d6bfe3a4c03396b51e5473d03fe22681ce19741cb4add45e395a06549fb0\": rpc error: code = NotFound desc = could not find container \"f320d6bfe3a4c03396b51e5473d03fe22681ce19741cb4add45e395a06549fb0\": container with ID starting with f320d6bfe3a4c03396b51e5473d03fe22681ce19741cb4add45e395a06549fb0 not found: ID does not exist" Jun 05 18:01:48.230850 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:48.230830 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5bb4458859-v487f"] Jun 05 18:01:48.234329 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:48.234308 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5bb4458859-v487f"] Jun 05 18:01:49.269133 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:01:49.269101 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23fca9a2-064b-47cb-8ca8-046faf2cca63" path="/var/lib/kubelet/pods/23fca9a2-064b-47cb-8ca8-046faf2cca63/volumes" Jun 05 18:02:06.223183 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.223148 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-688f6c4bb7-4j798"] Jun 05 18:02:06.223793 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.223487 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23fca9a2-064b-47cb-8ca8-046faf2cca63" containerName="manager" Jun 05 18:02:06.223793 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.223498 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="23fca9a2-064b-47cb-8ca8-046faf2cca63" containerName="manager" Jun 05 18:02:06.223793 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.223551 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="23fca9a2-064b-47cb-8ca8-046faf2cca63" containerName="manager" Jun 05 18:02:06.227127 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.227110 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-688f6c4bb7-4j798" Jun 05 18:02:06.230145 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.230124 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-h86lk\"" Jun 05 18:02:06.230266 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.230152 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 05 18:02:06.237012 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.236991 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-688f6c4bb7-4j798"] Jun 05 18:02:06.277462 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.277428 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b4qb\" (UniqueName: \"kubernetes.io/projected/006e98e9-0103-4847-b04f-2ddedd8a8c40-kube-api-access-2b4qb\") pod \"maas-api-688f6c4bb7-4j798\" (UID: \"006e98e9-0103-4847-b04f-2ddedd8a8c40\") " pod="opendatahub/maas-api-688f6c4bb7-4j798" Jun 05 18:02:06.277576 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.277504 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/006e98e9-0103-4847-b04f-2ddedd8a8c40-maas-api-tls\") pod \"maas-api-688f6c4bb7-4j798\" (UID: \"006e98e9-0103-4847-b04f-2ddedd8a8c40\") " pod="opendatahub/maas-api-688f6c4bb7-4j798" Jun 05 18:02:06.378205 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.378175 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/006e98e9-0103-4847-b04f-2ddedd8a8c40-maas-api-tls\") pod \"maas-api-688f6c4bb7-4j798\" (UID: \"006e98e9-0103-4847-b04f-2ddedd8a8c40\") " pod="opendatahub/maas-api-688f6c4bb7-4j798" Jun 05 18:02:06.378345 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.378227 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b4qb\" (UniqueName: \"kubernetes.io/projected/006e98e9-0103-4847-b04f-2ddedd8a8c40-kube-api-access-2b4qb\") pod \"maas-api-688f6c4bb7-4j798\" (UID: \"006e98e9-0103-4847-b04f-2ddedd8a8c40\") " pod="opendatahub/maas-api-688f6c4bb7-4j798" Jun 05 18:02:06.378388 ip-10-0-143-199 kubenswrapper[2553]: E0605 18:02:06.378356 2553 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 05 18:02:06.378445 ip-10-0-143-199 kubenswrapper[2553]: E0605 18:02:06.378434 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/006e98e9-0103-4847-b04f-2ddedd8a8c40-maas-api-tls podName:006e98e9-0103-4847-b04f-2ddedd8a8c40 nodeName:}" failed. No retries permitted until 2026-06-05 18:02:06.878412214 +0000 UTC m=+776.068391367 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/006e98e9-0103-4847-b04f-2ddedd8a8c40-maas-api-tls") pod "maas-api-688f6c4bb7-4j798" (UID: "006e98e9-0103-4847-b04f-2ddedd8a8c40") : secret "maas-api-serving-cert" not found Jun 05 18:02:06.387661 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.387638 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b4qb\" (UniqueName: \"kubernetes.io/projected/006e98e9-0103-4847-b04f-2ddedd8a8c40-kube-api-access-2b4qb\") pod \"maas-api-688f6c4bb7-4j798\" (UID: \"006e98e9-0103-4847-b04f-2ddedd8a8c40\") " pod="opendatahub/maas-api-688f6c4bb7-4j798" Jun 05 18:02:06.755993 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.755957 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-wl4xk"] Jun 05 18:02:06.758461 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.758438 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-wl4xk" Jun 05 18:02:06.763716 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.763692 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-cljkr"] Jun 05 18:02:06.763880 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.763863 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 05 18:02:06.766495 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.766437 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-cljkr" Jun 05 18:02:06.769272 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.769252 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-rkpcm\"" Jun 05 18:02:06.777498 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.777472 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-wl4xk"] Jun 05 18:02:06.781843 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.781818 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dvxx\" (UniqueName: \"kubernetes.io/projected/8d4a3f94-d261-4d64-ae6e-1cc0fc4f1559-kube-api-access-6dvxx\") pod \"payload-processing-7c6c859784-cljkr\" (UID: \"8d4a3f94-d261-4d64-ae6e-1cc0fc4f1559\") " pod="openshift-ingress/payload-processing-7c6c859784-cljkr" Jun 05 18:02:06.781970 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.781945 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jz9z\" (UniqueName: \"kubernetes.io/projected/0ffcaa26-4f9e-46ed-bcf1-20cf67fb8169-kube-api-access-9jz9z\") pod \"payload-pre-processing-67d7689b65-wl4xk\" (UID: \"0ffcaa26-4f9e-46ed-bcf1-20cf67fb8169\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-wl4xk" Jun 05 18:02:06.790981 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.790947 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-cljkr"] Jun 05 18:02:06.882550 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.882518 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dvxx\" (UniqueName: \"kubernetes.io/projected/8d4a3f94-d261-4d64-ae6e-1cc0fc4f1559-kube-api-access-6dvxx\") pod \"payload-processing-7c6c859784-cljkr\" (UID: \"8d4a3f94-d261-4d64-ae6e-1cc0fc4f1559\") " pod="openshift-ingress/payload-processing-7c6c859784-cljkr" Jun 05 18:02:06.882706 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.882581 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jz9z\" (UniqueName: \"kubernetes.io/projected/0ffcaa26-4f9e-46ed-bcf1-20cf67fb8169-kube-api-access-9jz9z\") pod \"payload-pre-processing-67d7689b65-wl4xk\" (UID: \"0ffcaa26-4f9e-46ed-bcf1-20cf67fb8169\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-wl4xk" Jun 05 18:02:06.882706 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.882620 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/006e98e9-0103-4847-b04f-2ddedd8a8c40-maas-api-tls\") pod \"maas-api-688f6c4bb7-4j798\" (UID: \"006e98e9-0103-4847-b04f-2ddedd8a8c40\") " pod="opendatahub/maas-api-688f6c4bb7-4j798" Jun 05 18:02:06.882793 ip-10-0-143-199 kubenswrapper[2553]: E0605 18:02:06.882733 2553 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 05 18:02:06.882843 ip-10-0-143-199 kubenswrapper[2553]: E0605 18:02:06.882807 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/006e98e9-0103-4847-b04f-2ddedd8a8c40-maas-api-tls podName:006e98e9-0103-4847-b04f-2ddedd8a8c40 nodeName:}" failed. No retries permitted until 2026-06-05 18:02:07.882786715 +0000 UTC m=+777.072765880 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/006e98e9-0103-4847-b04f-2ddedd8a8c40-maas-api-tls") pod "maas-api-688f6c4bb7-4j798" (UID: "006e98e9-0103-4847-b04f-2ddedd8a8c40") : secret "maas-api-serving-cert" not found Jun 05 18:02:06.894553 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.894486 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jz9z\" (UniqueName: \"kubernetes.io/projected/0ffcaa26-4f9e-46ed-bcf1-20cf67fb8169-kube-api-access-9jz9z\") pod \"payload-pre-processing-67d7689b65-wl4xk\" (UID: \"0ffcaa26-4f9e-46ed-bcf1-20cf67fb8169\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-wl4xk" Jun 05 18:02:06.899427 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.899402 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dvxx\" (UniqueName: \"kubernetes.io/projected/8d4a3f94-d261-4d64-ae6e-1cc0fc4f1559-kube-api-access-6dvxx\") pod \"payload-processing-7c6c859784-cljkr\" (UID: \"8d4a3f94-d261-4d64-ae6e-1cc0fc4f1559\") " pod="openshift-ingress/payload-processing-7c6c859784-cljkr" Jun 05 18:02:06.944857 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:06.944823 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:02:07.069795 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:07.069715 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-wl4xk" Jun 05 18:02:07.079193 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:07.079168 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-cljkr" Jun 05 18:02:07.216020 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:07.215989 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-wl4xk"] Jun 05 18:02:07.220313 ip-10-0-143-199 kubenswrapper[2553]: W0605 18:02:07.220285 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ffcaa26_4f9e_46ed_bcf1_20cf67fb8169.slice/crio-55ee5634e078a162b34866331db60c10cf5091ef9a505f40b173f9a39101cc8c WatchSource:0}: Error finding container 55ee5634e078a162b34866331db60c10cf5091ef9a505f40b173f9a39101cc8c: Status 404 returned error can't find the container with id 55ee5634e078a162b34866331db60c10cf5091ef9a505f40b173f9a39101cc8c Jun 05 18:02:07.222569 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:07.222555 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 18:02:07.237173 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:07.237153 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-cljkr"] Jun 05 18:02:07.239368 ip-10-0-143-199 kubenswrapper[2553]: W0605 18:02:07.239347 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d4a3f94_d261_4d64_ae6e_1cc0fc4f1559.slice/crio-67e815f44b0e0a9d48fb2311cf33cdd988e2f7fdd1581dfcff2ff4c78667b96c WatchSource:0}: Error finding container 67e815f44b0e0a9d48fb2311cf33cdd988e2f7fdd1581dfcff2ff4c78667b96c: Status 404 returned error can't find the container with id 67e815f44b0e0a9d48fb2311cf33cdd988e2f7fdd1581dfcff2ff4c78667b96c Jun 05 18:02:07.293255 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:07.293202 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-cljkr" event={"ID":"8d4a3f94-d261-4d64-ae6e-1cc0fc4f1559","Type":"ContainerStarted","Data":"67e815f44b0e0a9d48fb2311cf33cdd988e2f7fdd1581dfcff2ff4c78667b96c"} Jun 05 18:02:07.294413 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:07.294388 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-wl4xk" event={"ID":"0ffcaa26-4f9e-46ed-bcf1-20cf67fb8169","Type":"ContainerStarted","Data":"55ee5634e078a162b34866331db60c10cf5091ef9a505f40b173f9a39101cc8c"} Jun 05 18:02:07.894566 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:07.894464 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/006e98e9-0103-4847-b04f-2ddedd8a8c40-maas-api-tls\") pod \"maas-api-688f6c4bb7-4j798\" (UID: \"006e98e9-0103-4847-b04f-2ddedd8a8c40\") " pod="opendatahub/maas-api-688f6c4bb7-4j798" Jun 05 18:02:07.900425 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:07.900397 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/006e98e9-0103-4847-b04f-2ddedd8a8c40-maas-api-tls\") pod \"maas-api-688f6c4bb7-4j798\" (UID: \"006e98e9-0103-4847-b04f-2ddedd8a8c40\") " pod="opendatahub/maas-api-688f6c4bb7-4j798" Jun 05 18:02:08.038612 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:08.038312 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-688f6c4bb7-4j798" Jun 05 18:02:08.229626 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:08.229589 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-688f6c4bb7-4j798"] Jun 05 18:02:08.236262 ip-10-0-143-199 kubenswrapper[2553]: W0605 18:02:08.236210 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod006e98e9_0103_4847_b04f_2ddedd8a8c40.slice/crio-1010f31336785df2ce0ebd74b769dcc55eb4f1de429e10eb121f5ffa5b617e66 WatchSource:0}: Error finding container 1010f31336785df2ce0ebd74b769dcc55eb4f1de429e10eb121f5ffa5b617e66: Status 404 returned error can't find the container with id 1010f31336785df2ce0ebd74b769dcc55eb4f1de429e10eb121f5ffa5b617e66 Jun 05 18:02:08.304760 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:08.304714 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-688f6c4bb7-4j798" event={"ID":"006e98e9-0103-4847-b04f-2ddedd8a8c40","Type":"ContainerStarted","Data":"1010f31336785df2ce0ebd74b769dcc55eb4f1de429e10eb121f5ffa5b617e66"} Jun 05 18:02:10.316094 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:10.316050 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-cljkr" event={"ID":"8d4a3f94-d261-4d64-ae6e-1cc0fc4f1559","Type":"ContainerStarted","Data":"f526ab7bfe45eddff9b71e84e80b5a0ef788260ee2528b0f03f416838705ea80"} Jun 05 18:02:10.316570 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:10.316157 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-cljkr" Jun 05 18:02:10.317915 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:10.317879 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-wl4xk" event={"ID":"0ffcaa26-4f9e-46ed-bcf1-20cf67fb8169","Type":"ContainerStarted","Data":"6e70fbc80de839ef019d2bdb5d511f5e3e88b4baecccaf767633e75aef65ea3c"} Jun 05 18:02:10.318047 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:10.318026 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-wl4xk" Jun 05 18:02:10.363447 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:10.362955 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-cljkr" podStartSLOduration=1.926774205 podStartE2EDuration="4.36293634s" totalImagesPullingTime="2.436162135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:02:10.33963567 +0000 UTC m=+779.529614839" watchObservedRunningTime="2026-06-05 18:02:10.36293634 +0000 UTC m=+779.552915512" Jun 05 18:02:10.365054 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:10.365006 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-wl4xk" podStartSLOduration=1.917582777 podStartE2EDuration="4.364989276s" totalImagesPullingTime="2.447406499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:02:10.362906373 +0000 UTC m=+779.552885543" watchObservedRunningTime="2026-06-05 18:02:10.364989276 +0000 UTC m=+779.554968448" Jun 05 18:02:11.323328 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:11.323285 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-688f6c4bb7-4j798" event={"ID":"006e98e9-0103-4847-b04f-2ddedd8a8c40","Type":"ContainerStarted","Data":"bdf0a694c2f1ae1154d863026885ad77c502694928172c7487de5d9d5075db79"} Jun 05 18:02:11.323697 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:11.323676 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-688f6c4bb7-4j798" Jun 05 18:02:11.342714 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:11.342673 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-688f6c4bb7-4j798" podStartSLOduration=2.378225833 podStartE2EDuration="5.342660845s" totalImagesPullingTime="2.964435012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:02:11.341282726 +0000 UTC m=+780.531261896" watchObservedRunningTime="2026-06-05 18:02:11.342660845 +0000 UTC m=+780.532640013" Jun 05 18:02:18.336667 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:18.336639 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-688f6c4bb7-4j798" Jun 05 18:02:21.325779 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:21.325743 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-cljkr" Jun 05 18:02:21.326171 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:02:21.325960 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-wl4xk" Jun 05 18:03:07.519139 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:03:07.519104 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6799984c44-gz2pj"] Jun 05 18:03:07.522071 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:03:07.522047 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6799984c44-gz2pj" Jun 05 18:03:07.526085 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:03:07.526056 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 05 18:03:07.526203 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:03:07.526109 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 05 18:03:07.526203 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:03:07.526059 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-r6cks\"" Jun 05 18:03:07.533384 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:03:07.533365 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6799984c44-gz2pj"] Jun 05 18:03:07.597740 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:03:07.597713 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f0a13dc8-e8cf-4534-82bd-5215761d16ca-tls-cert\") pod \"authorino-6799984c44-gz2pj\" (UID: \"f0a13dc8-e8cf-4534-82bd-5215761d16ca\") " pod="kuadrant-system/authorino-6799984c44-gz2pj" Jun 05 18:03:07.597894 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:03:07.597787 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f0a13dc8-e8cf-4534-82bd-5215761d16ca-oidc-ca\") pod \"authorino-6799984c44-gz2pj\" (UID: \"f0a13dc8-e8cf-4534-82bd-5215761d16ca\") " pod="kuadrant-system/authorino-6799984c44-gz2pj" Jun 05 18:03:07.597894 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:03:07.597814 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f7m7\" (UniqueName: \"kubernetes.io/projected/f0a13dc8-e8cf-4534-82bd-5215761d16ca-kube-api-access-7f7m7\") pod \"authorino-6799984c44-gz2pj\" (UID: \"f0a13dc8-e8cf-4534-82bd-5215761d16ca\") " pod="kuadrant-system/authorino-6799984c44-gz2pj" Jun 05 18:03:07.698322 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:03:07.698285 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f0a13dc8-e8cf-4534-82bd-5215761d16ca-oidc-ca\") pod \"authorino-6799984c44-gz2pj\" (UID: \"f0a13dc8-e8cf-4534-82bd-5215761d16ca\") " pod="kuadrant-system/authorino-6799984c44-gz2pj" Jun 05 18:03:07.698322 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:03:07.698324 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f7m7\" (UniqueName: \"kubernetes.io/projected/f0a13dc8-e8cf-4534-82bd-5215761d16ca-kube-api-access-7f7m7\") pod \"authorino-6799984c44-gz2pj\" (UID: \"f0a13dc8-e8cf-4534-82bd-5215761d16ca\") " pod="kuadrant-system/authorino-6799984c44-gz2pj" Jun 05 18:03:07.698543 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:03:07.698357 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f0a13dc8-e8cf-4534-82bd-5215761d16ca-tls-cert\") pod \"authorino-6799984c44-gz2pj\" (UID: \"f0a13dc8-e8cf-4534-82bd-5215761d16ca\") " pod="kuadrant-system/authorino-6799984c44-gz2pj" Jun 05 18:03:07.698901 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:03:07.698877 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f0a13dc8-e8cf-4534-82bd-5215761d16ca-oidc-ca\") pod \"authorino-6799984c44-gz2pj\" (UID: \"f0a13dc8-e8cf-4534-82bd-5215761d16ca\") " pod="kuadrant-system/authorino-6799984c44-gz2pj" Jun 05 18:03:07.700568 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:03:07.700546 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f0a13dc8-e8cf-4534-82bd-5215761d16ca-tls-cert\") pod \"authorino-6799984c44-gz2pj\" (UID: \"f0a13dc8-e8cf-4534-82bd-5215761d16ca\") " pod="kuadrant-system/authorino-6799984c44-gz2pj" Jun 05 18:03:07.706955 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:03:07.706934 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f7m7\" (UniqueName: \"kubernetes.io/projected/f0a13dc8-e8cf-4534-82bd-5215761d16ca-kube-api-access-7f7m7\") pod \"authorino-6799984c44-gz2pj\" (UID: \"f0a13dc8-e8cf-4534-82bd-5215761d16ca\") " pod="kuadrant-system/authorino-6799984c44-gz2pj" Jun 05 18:03:07.830984 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:03:07.830926 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6799984c44-gz2pj" Jun 05 18:03:07.959536 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:03:07.959505 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6799984c44-gz2pj"] Jun 05 18:03:07.962097 ip-10-0-143-199 kubenswrapper[2553]: W0605 18:03:07.962059 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0a13dc8_e8cf_4534_82bd_5215761d16ca.slice/crio-ae89b799d33682ccab8b6172335a71835ad30f40e0bd2d600b975567b7f07038 WatchSource:0}: Error finding container ae89b799d33682ccab8b6172335a71835ad30f40e0bd2d600b975567b7f07038: Status 404 returned error can't find the container with id ae89b799d33682ccab8b6172335a71835ad30f40e0bd2d600b975567b7f07038 Jun 05 18:03:08.569163 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:03:08.569128 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6799984c44-gz2pj" event={"ID":"f0a13dc8-e8cf-4534-82bd-5215761d16ca","Type":"ContainerStarted","Data":"8e2bdcd29117c1bf7a1e124c5ecab3a6182ccdd98edeee060b2b7f9d108b5be9"} Jun 05 18:03:08.569551 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:03:08.569174 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6799984c44-gz2pj" event={"ID":"f0a13dc8-e8cf-4534-82bd-5215761d16ca","Type":"ContainerStarted","Data":"ae89b799d33682ccab8b6172335a71835ad30f40e0bd2d600b975567b7f07038"} Jun 05 18:03:08.584528 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:03:08.584478 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6799984c44-gz2pj" podStartSLOduration=1.167355365 podStartE2EDuration="1.584463049s" totalImagesPullingTime="417.107684ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:03:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:03:08.583663103 +0000 UTC m=+837.773642273" watchObservedRunningTime="2026-06-05 18:03:08.584463049 +0000 UTC m=+837.774442263" Jun 05 18:03:16.205662 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:03:16.205626 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:03:23.586538 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:03:23.586506 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:03:45.583535 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:03:45.583499 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:03:55.685621 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:03:55.685588 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:03:58.190973 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:03:58.190929 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:04:11.279539 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:04:11.279508 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z87q_1412064f-459e-4d05-9771-f48e3fdf62b1/ovn-acl-logging/0.log" Jun 05 18:04:11.279941 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:04:11.279508 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z87q_1412064f-459e-4d05-9771-f48e3fdf62b1/ovn-acl-logging/0.log" Jun 05 18:04:14.979630 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:04:14.979600 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:05:18.674322 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:18.674286 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7cc9b49d5-54m2n"] Jun 05 18:05:18.676611 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:18.676590 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cc9b49d5-54m2n" Jun 05 18:05:18.686014 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:18.685986 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cc9b49d5-54m2n"] Jun 05 18:05:18.810611 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:18.810579 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6c4ff1a2-d69e-4791-9908-6d84b314a008-tls-cert\") pod \"authorino-7cc9b49d5-54m2n\" (UID: \"6c4ff1a2-d69e-4791-9908-6d84b314a008\") " pod="kuadrant-system/authorino-7cc9b49d5-54m2n" Jun 05 18:05:18.810753 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:18.810622 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6c4ff1a2-d69e-4791-9908-6d84b314a008-oidc-ca\") pod \"authorino-7cc9b49d5-54m2n\" (UID: \"6c4ff1a2-d69e-4791-9908-6d84b314a008\") " pod="kuadrant-system/authorino-7cc9b49d5-54m2n" Jun 05 18:05:18.810753 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:18.810710 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f49sc\" (UniqueName: \"kubernetes.io/projected/6c4ff1a2-d69e-4791-9908-6d84b314a008-kube-api-access-f49sc\") pod \"authorino-7cc9b49d5-54m2n\" (UID: \"6c4ff1a2-d69e-4791-9908-6d84b314a008\") " pod="kuadrant-system/authorino-7cc9b49d5-54m2n" Jun 05 18:05:18.911891 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:18.911858 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f49sc\" (UniqueName: \"kubernetes.io/projected/6c4ff1a2-d69e-4791-9908-6d84b314a008-kube-api-access-f49sc\") pod \"authorino-7cc9b49d5-54m2n\" (UID: \"6c4ff1a2-d69e-4791-9908-6d84b314a008\") " pod="kuadrant-system/authorino-7cc9b49d5-54m2n" Jun 05 18:05:18.912040 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:18.911903 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6c4ff1a2-d69e-4791-9908-6d84b314a008-tls-cert\") pod \"authorino-7cc9b49d5-54m2n\" (UID: \"6c4ff1a2-d69e-4791-9908-6d84b314a008\") " pod="kuadrant-system/authorino-7cc9b49d5-54m2n" Jun 05 18:05:18.912040 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:18.911930 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6c4ff1a2-d69e-4791-9908-6d84b314a008-oidc-ca\") pod \"authorino-7cc9b49d5-54m2n\" (UID: \"6c4ff1a2-d69e-4791-9908-6d84b314a008\") " pod="kuadrant-system/authorino-7cc9b49d5-54m2n" Jun 05 18:05:18.912510 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:18.912489 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6c4ff1a2-d69e-4791-9908-6d84b314a008-oidc-ca\") pod \"authorino-7cc9b49d5-54m2n\" (UID: \"6c4ff1a2-d69e-4791-9908-6d84b314a008\") " pod="kuadrant-system/authorino-7cc9b49d5-54m2n" Jun 05 18:05:18.914321 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:18.914301 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6c4ff1a2-d69e-4791-9908-6d84b314a008-tls-cert\") pod \"authorino-7cc9b49d5-54m2n\" (UID: \"6c4ff1a2-d69e-4791-9908-6d84b314a008\") " pod="kuadrant-system/authorino-7cc9b49d5-54m2n" Jun 05 18:05:18.919953 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:18.919928 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f49sc\" (UniqueName: \"kubernetes.io/projected/6c4ff1a2-d69e-4791-9908-6d84b314a008-kube-api-access-f49sc\") pod \"authorino-7cc9b49d5-54m2n\" (UID: \"6c4ff1a2-d69e-4791-9908-6d84b314a008\") " pod="kuadrant-system/authorino-7cc9b49d5-54m2n" Jun 05 18:05:18.986491 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:18.986436 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cc9b49d5-54m2n" Jun 05 18:05:19.117053 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:19.117020 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cc9b49d5-54m2n"] Jun 05 18:05:19.119948 ip-10-0-143-199 kubenswrapper[2553]: W0605 18:05:19.119913 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c4ff1a2_d69e_4791_9908_6d84b314a008.slice/crio-ea2fdcd8e03b87d4f2079ad4b4a458254be9eee25e3f2be4e71d6848860bfdb6 WatchSource:0}: Error finding container ea2fdcd8e03b87d4f2079ad4b4a458254be9eee25e3f2be4e71d6848860bfdb6: Status 404 returned error can't find the container with id ea2fdcd8e03b87d4f2079ad4b4a458254be9eee25e3f2be4e71d6848860bfdb6 Jun 05 18:05:19.148174 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:19.148144 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cc9b49d5-54m2n" event={"ID":"6c4ff1a2-d69e-4791-9908-6d84b314a008","Type":"ContainerStarted","Data":"ea2fdcd8e03b87d4f2079ad4b4a458254be9eee25e3f2be4e71d6848860bfdb6"} Jun 05 18:05:20.155221 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:20.155172 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cc9b49d5-54m2n" event={"ID":"6c4ff1a2-d69e-4791-9908-6d84b314a008","Type":"ContainerStarted","Data":"92476f6a13928d89fc1b52db08cad405b32f7fd7cb60f2aab1cfdfe77e76bbd2"} Jun 05 18:05:20.169988 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:20.169935 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7cc9b49d5-54m2n" podStartSLOduration=1.818421455 podStartE2EDuration="2.169915207s" totalImagesPullingTime="351.493752ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:05:20.169629302 +0000 UTC m=+969.359608470" watchObservedRunningTime="2026-06-05 18:05:20.169915207 +0000 UTC m=+969.359894376" Jun 05 18:05:20.199173 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:20.198198 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6799984c44-gz2pj"] Jun 05 18:05:20.199173 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:20.198428 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6799984c44-gz2pj" podUID="f0a13dc8-e8cf-4534-82bd-5215761d16ca" containerName="authorino" containerID="cri-o://8e2bdcd29117c1bf7a1e124c5ecab3a6182ccdd98edeee060b2b7f9d108b5be9" gracePeriod=30 Jun 05 18:05:20.455125 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:20.455101 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6799984c44-gz2pj" Jun 05 18:05:20.628593 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:20.628560 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f0a13dc8-e8cf-4534-82bd-5215761d16ca-oidc-ca\") pod \"f0a13dc8-e8cf-4534-82bd-5215761d16ca\" (UID: \"f0a13dc8-e8cf-4534-82bd-5215761d16ca\") " Jun 05 18:05:20.628755 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:20.628605 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f0a13dc8-e8cf-4534-82bd-5215761d16ca-tls-cert\") pod \"f0a13dc8-e8cf-4534-82bd-5215761d16ca\" (UID: \"f0a13dc8-e8cf-4534-82bd-5215761d16ca\") " Jun 05 18:05:20.628755 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:20.628671 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7f7m7\" (UniqueName: \"kubernetes.io/projected/f0a13dc8-e8cf-4534-82bd-5215761d16ca-kube-api-access-7f7m7\") pod \"f0a13dc8-e8cf-4534-82bd-5215761d16ca\" (UID: \"f0a13dc8-e8cf-4534-82bd-5215761d16ca\") " Jun 05 18:05:20.630594 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:20.630556 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0a13dc8-e8cf-4534-82bd-5215761d16ca-kube-api-access-7f7m7" (OuterVolumeSpecName: "kube-api-access-7f7m7") pod "f0a13dc8-e8cf-4534-82bd-5215761d16ca" (UID: "f0a13dc8-e8cf-4534-82bd-5215761d16ca"). InnerVolumeSpecName "kube-api-access-7f7m7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 18:05:20.633346 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:20.633320 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0a13dc8-e8cf-4534-82bd-5215761d16ca-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "f0a13dc8-e8cf-4534-82bd-5215761d16ca" (UID: "f0a13dc8-e8cf-4534-82bd-5215761d16ca"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 18:05:20.638087 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:20.638066 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0a13dc8-e8cf-4534-82bd-5215761d16ca-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "f0a13dc8-e8cf-4534-82bd-5215761d16ca" (UID: "f0a13dc8-e8cf-4534-82bd-5215761d16ca"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 18:05:20.730044 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:20.729959 2553 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f0a13dc8-e8cf-4534-82bd-5215761d16ca-oidc-ca\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 18:05:20.730044 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:20.729990 2553 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f0a13dc8-e8cf-4534-82bd-5215761d16ca-tls-cert\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 18:05:20.730044 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:20.729999 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7f7m7\" (UniqueName: \"kubernetes.io/projected/f0a13dc8-e8cf-4534-82bd-5215761d16ca-kube-api-access-7f7m7\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 18:05:21.160546 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:21.160510 2553 generic.go:356] "Generic (PLEG): container finished" podID="f0a13dc8-e8cf-4534-82bd-5215761d16ca" containerID="8e2bdcd29117c1bf7a1e124c5ecab3a6182ccdd98edeee060b2b7f9d108b5be9" exitCode=0 Jun 05 18:05:21.160993 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:21.160550 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6799984c44-gz2pj" Jun 05 18:05:21.160993 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:21.160601 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6799984c44-gz2pj" event={"ID":"f0a13dc8-e8cf-4534-82bd-5215761d16ca","Type":"ContainerDied","Data":"8e2bdcd29117c1bf7a1e124c5ecab3a6182ccdd98edeee060b2b7f9d108b5be9"} Jun 05 18:05:21.160993 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:21.160640 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6799984c44-gz2pj" event={"ID":"f0a13dc8-e8cf-4534-82bd-5215761d16ca","Type":"ContainerDied","Data":"ae89b799d33682ccab8b6172335a71835ad30f40e0bd2d600b975567b7f07038"} Jun 05 18:05:21.160993 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:21.160659 2553 scope.go:117] "RemoveContainer" containerID="8e2bdcd29117c1bf7a1e124c5ecab3a6182ccdd98edeee060b2b7f9d108b5be9" Jun 05 18:05:21.169518 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:21.169501 2553 scope.go:117] "RemoveContainer" containerID="8e2bdcd29117c1bf7a1e124c5ecab3a6182ccdd98edeee060b2b7f9d108b5be9" Jun 05 18:05:21.169791 ip-10-0-143-199 kubenswrapper[2553]: E0605 18:05:21.169775 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e2bdcd29117c1bf7a1e124c5ecab3a6182ccdd98edeee060b2b7f9d108b5be9\": container with ID starting with 8e2bdcd29117c1bf7a1e124c5ecab3a6182ccdd98edeee060b2b7f9d108b5be9 not found: ID does not exist" containerID="8e2bdcd29117c1bf7a1e124c5ecab3a6182ccdd98edeee060b2b7f9d108b5be9" Jun 05 18:05:21.169829 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:21.169807 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e2bdcd29117c1bf7a1e124c5ecab3a6182ccdd98edeee060b2b7f9d108b5be9"} err="failed to get container status \"8e2bdcd29117c1bf7a1e124c5ecab3a6182ccdd98edeee060b2b7f9d108b5be9\": rpc error: code = NotFound desc = could not find container \"8e2bdcd29117c1bf7a1e124c5ecab3a6182ccdd98edeee060b2b7f9d108b5be9\": container with ID starting with 8e2bdcd29117c1bf7a1e124c5ecab3a6182ccdd98edeee060b2b7f9d108b5be9 not found: ID does not exist" Jun 05 18:05:21.181599 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:21.181573 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6799984c44-gz2pj"] Jun 05 18:05:21.188257 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:21.188221 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6799984c44-gz2pj"] Jun 05 18:05:21.269477 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:21.269450 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0a13dc8-e8cf-4534-82bd-5215761d16ca" path="/var/lib/kubelet/pods/f0a13dc8-e8cf-4534-82bd-5215761d16ca/volumes" Jun 05 18:05:41.987695 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:41.987661 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:05:45.891748 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:45.891712 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:05:52.984262 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:05:52.984205 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:06:03.294617 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:03.294570 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:06:11.583367 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:11.583281 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:06:22.390632 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:22.390593 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:06:31.584509 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:31.584471 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:06:40.892421 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:40.892381 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:06:49.384537 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:49.384505 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-575b84f768-vzbmb"] Jun 05 18:06:49.385032 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:49.384693 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-575b84f768-vzbmb" podUID="61048d5e-bbdb-4d48-9e54-2ff8e9261388" containerName="manager" containerID="cri-o://9436c45df2f379de4725d678d617cf981a1a2b30baf7169bb039f6da2a7ac90a" gracePeriod=30 Jun 05 18:06:49.555910 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:49.555881 2553 generic.go:356] "Generic (PLEG): container finished" podID="61048d5e-bbdb-4d48-9e54-2ff8e9261388" containerID="9436c45df2f379de4725d678d617cf981a1a2b30baf7169bb039f6da2a7ac90a" exitCode=0 Jun 05 18:06:49.556062 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:49.555947 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-575b84f768-vzbmb" event={"ID":"61048d5e-bbdb-4d48-9e54-2ff8e9261388","Type":"ContainerDied","Data":"9436c45df2f379de4725d678d617cf981a1a2b30baf7169bb039f6da2a7ac90a"} Jun 05 18:06:49.633926 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:49.633902 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-575b84f768-vzbmb" Jun 05 18:06:49.796177 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:49.796093 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnb5c\" (UniqueName: \"kubernetes.io/projected/61048d5e-bbdb-4d48-9e54-2ff8e9261388-kube-api-access-hnb5c\") pod \"61048d5e-bbdb-4d48-9e54-2ff8e9261388\" (UID: \"61048d5e-bbdb-4d48-9e54-2ff8e9261388\") " Jun 05 18:06:49.796177 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:49.796157 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61048d5e-bbdb-4d48-9e54-2ff8e9261388-webhook-cert\") pod \"61048d5e-bbdb-4d48-9e54-2ff8e9261388\" (UID: \"61048d5e-bbdb-4d48-9e54-2ff8e9261388\") " Jun 05 18:06:49.798097 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:49.798071 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61048d5e-bbdb-4d48-9e54-2ff8e9261388-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "61048d5e-bbdb-4d48-9e54-2ff8e9261388" (UID: "61048d5e-bbdb-4d48-9e54-2ff8e9261388"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 18:06:49.798208 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:49.798113 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61048d5e-bbdb-4d48-9e54-2ff8e9261388-kube-api-access-hnb5c" (OuterVolumeSpecName: "kube-api-access-hnb5c") pod "61048d5e-bbdb-4d48-9e54-2ff8e9261388" (UID: "61048d5e-bbdb-4d48-9e54-2ff8e9261388"). InnerVolumeSpecName "kube-api-access-hnb5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 18:06:49.897179 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:49.897155 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnb5c\" (UniqueName: \"kubernetes.io/projected/61048d5e-bbdb-4d48-9e54-2ff8e9261388-kube-api-access-hnb5c\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 18:06:49.897179 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:49.897181 2553 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61048d5e-bbdb-4d48-9e54-2ff8e9261388-webhook-cert\") on node \"ip-10-0-143-199.ec2.internal\" DevicePath \"\"" Jun 05 18:06:50.561711 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:50.561680 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-575b84f768-vzbmb" Jun 05 18:06:50.561711 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:50.561704 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-575b84f768-vzbmb" event={"ID":"61048d5e-bbdb-4d48-9e54-2ff8e9261388","Type":"ContainerDied","Data":"812c9c143838834576e09f5cadbe3878ad6ef1107514ba66a048ccf72d120a84"} Jun 05 18:06:50.562153 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:50.561755 2553 scope.go:117] "RemoveContainer" containerID="9436c45df2f379de4725d678d617cf981a1a2b30baf7169bb039f6da2a7ac90a" Jun 05 18:06:50.583604 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:50.583575 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-575b84f768-vzbmb"] Jun 05 18:06:50.585935 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:50.585910 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-575b84f768-vzbmb"] Jun 05 18:06:51.269890 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:51.269858 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61048d5e-bbdb-4d48-9e54-2ff8e9261388" path="/var/lib/kubelet/pods/61048d5e-bbdb-4d48-9e54-2ff8e9261388/volumes" Jun 05 18:06:51.350647 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:51.350615 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-575b84f768-wxsf6"] Jun 05 18:06:51.350949 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:51.350937 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61048d5e-bbdb-4d48-9e54-2ff8e9261388" containerName="manager" Jun 05 18:06:51.351019 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:51.350951 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="61048d5e-bbdb-4d48-9e54-2ff8e9261388" containerName="manager" Jun 05 18:06:51.351019 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:51.350971 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0a13dc8-e8cf-4534-82bd-5215761d16ca" containerName="authorino" Jun 05 18:06:51.351019 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:51.350977 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0a13dc8-e8cf-4534-82bd-5215761d16ca" containerName="authorino" Jun 05 18:06:51.351111 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:51.351031 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="61048d5e-bbdb-4d48-9e54-2ff8e9261388" containerName="manager" Jun 05 18:06:51.351111 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:51.351038 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0a13dc8-e8cf-4534-82bd-5215761d16ca" containerName="authorino" Jun 05 18:06:51.353587 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:51.353572 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-575b84f768-wxsf6" Jun 05 18:06:51.357231 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:51.357208 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-k9t54\"" Jun 05 18:06:51.357369 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:51.357212 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 05 18:06:51.357369 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:51.357276 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 05 18:06:51.364334 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:51.364310 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-575b84f768-wxsf6"] Jun 05 18:06:51.514165 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:51.514129 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6405a924-25ba-450a-a09e-fd5919047770-webhook-cert\") pod \"maas-controller-575b84f768-wxsf6\" (UID: \"6405a924-25ba-450a-a09e-fd5919047770\") " pod="opendatahub/maas-controller-575b84f768-wxsf6" Jun 05 18:06:51.514370 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:51.514228 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7hcn\" (UniqueName: \"kubernetes.io/projected/6405a924-25ba-450a-a09e-fd5919047770-kube-api-access-x7hcn\") pod \"maas-controller-575b84f768-wxsf6\" (UID: \"6405a924-25ba-450a-a09e-fd5919047770\") " pod="opendatahub/maas-controller-575b84f768-wxsf6" Jun 05 18:06:51.615505 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:51.615470 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6405a924-25ba-450a-a09e-fd5919047770-webhook-cert\") pod \"maas-controller-575b84f768-wxsf6\" (UID: \"6405a924-25ba-450a-a09e-fd5919047770\") " pod="opendatahub/maas-controller-575b84f768-wxsf6" Jun 05 18:06:51.615943 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:51.615530 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7hcn\" (UniqueName: \"kubernetes.io/projected/6405a924-25ba-450a-a09e-fd5919047770-kube-api-access-x7hcn\") pod \"maas-controller-575b84f768-wxsf6\" (UID: \"6405a924-25ba-450a-a09e-fd5919047770\") " pod="opendatahub/maas-controller-575b84f768-wxsf6" Jun 05 18:06:51.617875 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:51.617851 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6405a924-25ba-450a-a09e-fd5919047770-webhook-cert\") pod \"maas-controller-575b84f768-wxsf6\" (UID: \"6405a924-25ba-450a-a09e-fd5919047770\") " pod="opendatahub/maas-controller-575b84f768-wxsf6" Jun 05 18:06:51.624701 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:51.624676 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7hcn\" (UniqueName: \"kubernetes.io/projected/6405a924-25ba-450a-a09e-fd5919047770-kube-api-access-x7hcn\") pod \"maas-controller-575b84f768-wxsf6\" (UID: \"6405a924-25ba-450a-a09e-fd5919047770\") " pod="opendatahub/maas-controller-575b84f768-wxsf6" Jun 05 18:06:51.663467 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:51.663441 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-575b84f768-wxsf6" Jun 05 18:06:51.799409 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:51.799383 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-575b84f768-wxsf6"] Jun 05 18:06:51.801440 ip-10-0-143-199 kubenswrapper[2553]: W0605 18:06:51.801408 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6405a924_25ba_450a_a09e_fd5919047770.slice/crio-68c9fa8d1920434106957cbc255a4e0d78893b43eb4a959ab62b7d47d6e9131a WatchSource:0}: Error finding container 68c9fa8d1920434106957cbc255a4e0d78893b43eb4a959ab62b7d47d6e9131a: Status 404 returned error can't find the container with id 68c9fa8d1920434106957cbc255a4e0d78893b43eb4a959ab62b7d47d6e9131a Jun 05 18:06:52.572577 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:52.572535 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-575b84f768-wxsf6" event={"ID":"6405a924-25ba-450a-a09e-fd5919047770","Type":"ContainerStarted","Data":"0d393f6de333df3854f3c33678dace09142136a84b23abff869ac7c262a77fac"} Jun 05 18:06:52.572577 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:52.572585 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-575b84f768-wxsf6" event={"ID":"6405a924-25ba-450a-a09e-fd5919047770","Type":"ContainerStarted","Data":"68c9fa8d1920434106957cbc255a4e0d78893b43eb4a959ab62b7d47d6e9131a"} Jun 05 18:06:52.572787 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:52.572678 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-575b84f768-wxsf6" Jun 05 18:06:52.591728 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:06:52.591589 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-575b84f768-wxsf6" podStartSLOduration=1.053789424 podStartE2EDuration="1.591574587s" totalImagesPullingTime="537.785163ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:06:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:06:52.591323596 +0000 UTC m=+1061.781302765" watchObservedRunningTime="2026-06-05 18:06:52.591574587 +0000 UTC m=+1061.781553756" Jun 05 18:07:03.583282 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:07:03.583183 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-575b84f768-wxsf6" Jun 05 18:07:14.139902 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:07:14.139866 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:07:18.587151 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:07:18.587113 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:07:23.318778 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:07:23.318738 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:07:26.035536 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:07:26.035498 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:07:55.517396 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:07:55.517355 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:08:11.697845 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:08:11.697809 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:08:50.698167 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:08:50.698135 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:09:07.882019 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:09:07.881981 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:09:11.305661 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:09:11.305633 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z87q_1412064f-459e-4d05-9771-f48e3fdf62b1/ovn-acl-logging/0.log" Jun 05 18:09:11.307078 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:09:11.307055 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z87q_1412064f-459e-4d05-9771-f48e3fdf62b1/ovn-acl-logging/0.log" Jun 05 18:09:22.188824 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:09:22.188787 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:09:38.290081 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:09:38.290044 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:10:16.886428 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:10:16.886389 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:10:19.986713 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:10:19.986681 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:10:42.093358 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:10:42.093320 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:10:51.382225 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:10:51.382192 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:11:07.886353 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:11:07.886317 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:11:16.194492 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:11:16.194447 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:11:33.784081 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:11:33.783994 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:11:42.288796 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:11:42.288749 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:12:14.489015 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:12:14.488982 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:12:22.484355 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:12:22.484318 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:12:25.090857 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:12:25.090820 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:12:31.694473 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:12:31.694439 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:12:39.798492 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:12:39.798454 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:12:48.090321 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:12:48.090280 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:12:56.791012 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:12:56.790973 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:13:00.086635 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:13:00.086597 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:13:05.191488 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:13:05.191403 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:13:16.402356 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:13:16.402311 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:13:54.987092 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:13:54.987057 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:13:56.289944 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:13:56.289913 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:14:04.585360 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:14:04.585324 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:14:07.991941 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:14:07.991903 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:14:11.331174 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:14:11.331142 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z87q_1412064f-459e-4d05-9771-f48e3fdf62b1/ovn-acl-logging/0.log" Jun 05 18:14:11.334395 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:14:11.334374 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z87q_1412064f-459e-4d05-9771-f48e3fdf62b1/ovn-acl-logging/0.log" Jun 05 18:14:16.105827 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:14:16.105791 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:14:24.505701 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:14:24.505658 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:14:34.397809 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:14:34.397725 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:14:42.028797 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:14:42.028763 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:14:51.403094 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:14:51.403061 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:14:54.798685 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:14:54.798644 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:14:59.906632 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:14:59.906595 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:15:08.698926 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:15:08.698892 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:15:17.109499 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:15:17.109461 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:15:26.332902 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:15:26.332865 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:15:35.394104 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:15:35.394065 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:15:43.997991 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:15:43.997951 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:15:52.692256 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:15:52.692197 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:16:01.088367 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:16:01.088288 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:16:09.404710 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:16:09.404669 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:16:19.201872 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:16:19.201838 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:16:27.587759 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:16:27.587724 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:18:46.822256 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:18:46.822205 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:18:50.791059 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:18:50.791024 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:19:11.357064 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:19:11.357035 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z87q_1412064f-459e-4d05-9771-f48e3fdf62b1/ovn-acl-logging/0.log" Jun 05 18:19:11.360671 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:19:11.360650 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z87q_1412064f-459e-4d05-9771-f48e3fdf62b1/ovn-acl-logging/0.log" Jun 05 18:19:16.692999 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:19:16.692959 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:19:21.081207 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:19:21.081165 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:19:30.079960 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:19:30.079918 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:19:40.686537 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:19:40.686503 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:19:49.386748 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:19:49.386714 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:20:00.274561 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:20:00.274526 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:20:08.882020 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:20:08.881984 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:20:19.092569 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:20:19.092528 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:20:28.086188 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:20:28.086149 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:20:38.086723 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:20:38.086622 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:20:48.084151 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:20:48.084106 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:20:52.405269 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:20:52.405219 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:21:20.481493 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:21:20.481461 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:22:04.486117 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:22:04.486036 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:22:11.588632 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:22:11.588595 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:22:21.491082 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:22:21.491041 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:22:29.189642 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:22:29.189596 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:22:39.574829 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:22:39.574792 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:22:50.977071 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:22:50.977038 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:22:59.995211 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:22:59.995173 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:23:07.187313 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:23:07.187279 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:23:17.283605 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:23:17.283574 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:23:24.893132 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:23:24.893095 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:23:32.689648 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:23:32.689566 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:23:43.084162 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:23:43.084124 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:24:01.492160 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:24:01.492123 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:24:09.490157 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:24:09.490120 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:24:11.383000 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:24:11.382965 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z87q_1412064f-459e-4d05-9771-f48e3fdf62b1/ovn-acl-logging/0.log" Jun 05 18:24:11.386824 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:24:11.386804 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z87q_1412064f-459e-4d05-9771-f48e3fdf62b1/ovn-acl-logging/0.log" Jun 05 18:24:18.187472 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:24:18.187436 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:24:26.083563 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:24:26.083525 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:24:44.381607 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:24:44.381571 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:24:52.682212 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:24:52.682175 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:25:00.681143 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:25:00.681051 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:25:09.594284 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:25:09.594229 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:25:17.978188 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:25:17.978145 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:25:26.784697 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:25:26.784656 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:25:35.503026 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:25:35.502990 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:25:46.491593 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:25:46.491556 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:25:55.683324 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:25:55.683288 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:26:06.889079 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:26:06.889041 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:26:16.986799 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:26:16.986756 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:26:23.478886 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:26:23.478849 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:26:32.286521 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:26:32.286440 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:26:38.377997 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:26:38.377955 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:26:54.377024 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:26:54.376986 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:27:03.095210 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:27:03.095174 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:27:12.184301 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:27:12.184268 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:27:17.972383 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:27:17.972349 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:27:41.582387 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:27:41.582356 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:27:54.509036 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:27:54.509001 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:27:59.082630 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:27:59.082547 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-84pdq"] Jun 05 18:28:28.427553 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:28.427519 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7cc9b49d5-54m2n_6c4ff1a2-d69e-4791-9908-6d84b314a008/authorino/0.log" Jun 05 18:28:33.313279 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:33.313228 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-688f6c4bb7-4j798_006e98e9-0103-4847-b04f-2ddedd8a8c40/maas-api/0.log" Jun 05 18:28:33.547337 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:33.547305 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-575b84f768-wxsf6_6405a924-25ba-450a-a09e-fd5919047770/manager/0.log" Jun 05 18:28:34.120748 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:34.120717 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54f5f4b6cb-np6pq_5104f206-e636-4a8d-82c2-3cb51d0ead0b/copy-manifests/0.log" Jun 05 18:28:34.133196 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:34.133172 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54f5f4b6cb-np6pq_5104f206-e636-4a8d-82c2-3cb51d0ead0b/manager/0.log" Jun 05 18:28:35.460041 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:35.460008 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7cc9b49d5-54m2n_6c4ff1a2-d69e-4791-9908-6d84b314a008/authorino/0.log" Jun 05 18:28:35.787688 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:35.787611 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-pv7mc_6de33818-9f3f-4855-a55c-814e037e3e45/kuadrant-console-plugin/0.log" Jun 05 18:28:36.119543 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:36.119514 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-84pdq_3b6fd8c3-6ed3-4248-9c51-cbc9d0921b3c/limitador/0.log" Jun 05 18:28:36.794940 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:36.794904 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65bcf5494b-4tjlb_4abbb1a4-ae43-465d-b59e-e89b59bd46f1/kube-auth-proxy/0.log" Jun 05 18:28:37.146444 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:37.146414 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-wl4xk_0ffcaa26-4f9e-46ed-bcf1-20cf67fb8169/payload-pre-processing/0.log" Jun 05 18:28:37.261638 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:37.261607 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-cljkr_8d4a3f94-d261-4d64-ae6e-1cc0fc4f1559/payload-processing/0.log" Jun 05 18:28:37.373314 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:37.373286 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cb4fdffb5-hq64f_1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3/router/0.log" Jun 05 18:28:41.942990 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:41.942947 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hm5wr/must-gather-zdx7s"] Jun 05 18:28:41.946725 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:41.946703 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hm5wr/must-gather-zdx7s" Jun 05 18:28:41.949541 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:41.949520 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hm5wr\"/\"openshift-service-ca.crt\"" Jun 05 18:28:41.949652 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:41.949549 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hm5wr\"/\"kube-root-ca.crt\"" Jun 05 18:28:41.949652 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:41.949643 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hm5wr\"/\"default-dockercfg-b572z\"" Jun 05 18:28:41.955812 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:41.955789 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hm5wr/must-gather-zdx7s"] Jun 05 18:28:42.021622 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:42.021584 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wdp6\" (UniqueName: \"kubernetes.io/projected/a59a4c2d-f364-4d12-a67e-bba9d77a039d-kube-api-access-6wdp6\") pod \"must-gather-zdx7s\" (UID: \"a59a4c2d-f364-4d12-a67e-bba9d77a039d\") " pod="openshift-must-gather-hm5wr/must-gather-zdx7s" Jun 05 18:28:42.021783 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:42.021696 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a59a4c2d-f364-4d12-a67e-bba9d77a039d-must-gather-output\") pod \"must-gather-zdx7s\" (UID: \"a59a4c2d-f364-4d12-a67e-bba9d77a039d\") " pod="openshift-must-gather-hm5wr/must-gather-zdx7s" Jun 05 18:28:42.122514 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:42.122485 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a59a4c2d-f364-4d12-a67e-bba9d77a039d-must-gather-output\") pod \"must-gather-zdx7s\" (UID: \"a59a4c2d-f364-4d12-a67e-bba9d77a039d\") " pod="openshift-must-gather-hm5wr/must-gather-zdx7s" Jun 05 18:28:42.122673 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:42.122524 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wdp6\" (UniqueName: \"kubernetes.io/projected/a59a4c2d-f364-4d12-a67e-bba9d77a039d-kube-api-access-6wdp6\") pod \"must-gather-zdx7s\" (UID: \"a59a4c2d-f364-4d12-a67e-bba9d77a039d\") " pod="openshift-must-gather-hm5wr/must-gather-zdx7s" Jun 05 18:28:42.122857 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:42.122836 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a59a4c2d-f364-4d12-a67e-bba9d77a039d-must-gather-output\") pod \"must-gather-zdx7s\" (UID: \"a59a4c2d-f364-4d12-a67e-bba9d77a039d\") " pod="openshift-must-gather-hm5wr/must-gather-zdx7s" Jun 05 18:28:42.130617 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:42.130590 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wdp6\" (UniqueName: \"kubernetes.io/projected/a59a4c2d-f364-4d12-a67e-bba9d77a039d-kube-api-access-6wdp6\") pod \"must-gather-zdx7s\" (UID: \"a59a4c2d-f364-4d12-a67e-bba9d77a039d\") " pod="openshift-must-gather-hm5wr/must-gather-zdx7s" Jun 05 18:28:42.256319 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:42.256225 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hm5wr/must-gather-zdx7s" Jun 05 18:28:42.384820 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:42.384705 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hm5wr/must-gather-zdx7s"] Jun 05 18:28:42.387503 ip-10-0-143-199 kubenswrapper[2553]: W0605 18:28:42.387474 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda59a4c2d_f364_4d12_a67e_bba9d77a039d.slice/crio-17e338bf86b25db023459801bf258d409d7aeb6d92c7b8b1711e660cc1b4caa8 WatchSource:0}: Error finding container 17e338bf86b25db023459801bf258d409d7aeb6d92c7b8b1711e660cc1b4caa8: Status 404 returned error can't find the container with id 17e338bf86b25db023459801bf258d409d7aeb6d92c7b8b1711e660cc1b4caa8 Jun 05 18:28:42.389221 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:42.389204 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 18:28:43.375406 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:43.375374 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hm5wr/must-gather-zdx7s" event={"ID":"a59a4c2d-f364-4d12-a67e-bba9d77a039d","Type":"ContainerStarted","Data":"f0adbbd9b1ace6e35d0fc78152d9dbbfdd9657510251c917e4e61f496a82b67a"} Jun 05 18:28:43.375721 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:43.375416 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hm5wr/must-gather-zdx7s" event={"ID":"a59a4c2d-f364-4d12-a67e-bba9d77a039d","Type":"ContainerStarted","Data":"17e338bf86b25db023459801bf258d409d7aeb6d92c7b8b1711e660cc1b4caa8"} Jun 05 18:28:44.385813 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:44.385766 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hm5wr/must-gather-zdx7s" event={"ID":"a59a4c2d-f364-4d12-a67e-bba9d77a039d","Type":"ContainerStarted","Data":"7e56cdde4139f0eb7a482caa241582f8ef79b4a2289471caf46b36c2121ba010"} Jun 05 18:28:44.410581 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:44.410509 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hm5wr/must-gather-zdx7s" podStartSLOduration=2.6059893069999998 podStartE2EDuration="3.410484283s" totalImagesPullingTime="804.494976ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:28:44.407417572 +0000 UTC m=+2373.597396742" watchObservedRunningTime="2026-06-05 18:28:44.410484283 +0000 UTC m=+2373.600463454" Jun 05 18:28:44.965304 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:44.965274 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cd8cb_ceaba4c9-2e0e-45d6-a060-9033db497249/global-pull-secret-syncer/0.log" Jun 05 18:28:45.152965 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:45.152936 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-v67cc_823d3bd4-667c-4582-a9c6-d54db925edf4/konnectivity-agent/0.log" Jun 05 18:28:45.220741 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:45.220666 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-199.ec2.internal_2da0c469e1f6c43dd080495b19164f17/haproxy/0.log" Jun 05 18:28:50.335122 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:50.334987 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7cc9b49d5-54m2n_6c4ff1a2-d69e-4791-9908-6d84b314a008/authorino/0.log" Jun 05 18:28:50.435271 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:50.435224 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-pv7mc_6de33818-9f3f-4855-a55c-814e037e3e45/kuadrant-console-plugin/0.log" Jun 05 18:28:50.556854 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:50.556824 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-84pdq_3b6fd8c3-6ed3-4248-9c51-cbc9d0921b3c/limitador/0.log" Jun 05 18:28:52.308702 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:52.308619 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-xbt54_8e0ba5fe-8bc9-4b38-beda-f77a42e673cd/cluster-monitoring-operator/0.log" Jun 05 18:28:52.540473 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:52.540390 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p7bb8_0465ba43-6326-4314-a1bf-4b1bef2a001d/node-exporter/0.log" Jun 05 18:28:52.570004 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:52.569973 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p7bb8_0465ba43-6326-4314-a1bf-4b1bef2a001d/kube-rbac-proxy/0.log" Jun 05 18:28:52.594597 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:52.594567 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p7bb8_0465ba43-6326-4314-a1bf-4b1bef2a001d/init-textfile/0.log" Jun 05 18:28:52.782903 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:52.782844 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_02d73e13-1e58-4c3e-80df-060bf024194a/prometheus/0.log" Jun 05 18:28:52.814339 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:52.814272 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_02d73e13-1e58-4c3e-80df-060bf024194a/config-reloader/0.log" Jun 05 18:28:52.836246 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:52.836192 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_02d73e13-1e58-4c3e-80df-060bf024194a/thanos-sidecar/0.log" Jun 05 18:28:52.856960 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:52.856902 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_02d73e13-1e58-4c3e-80df-060bf024194a/kube-rbac-proxy-web/0.log" Jun 05 18:28:52.881391 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:52.881354 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_02d73e13-1e58-4c3e-80df-060bf024194a/kube-rbac-proxy/0.log" Jun 05 18:28:52.910785 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:52.910757 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_02d73e13-1e58-4c3e-80df-060bf024194a/kube-rbac-proxy-thanos/0.log" Jun 05 18:28:52.935425 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:52.935400 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_02d73e13-1e58-4c3e-80df-060bf024194a/init-config-reloader/0.log" Jun 05 18:28:53.057052 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:53.057025 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-dcbf484f7-w6wfj_b2262c61-9780-4c31-a5cd-479d5305786a/telemeter-client/0.log" Jun 05 18:28:53.085023 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:53.084926 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-dcbf484f7-w6wfj_b2262c61-9780-4c31-a5cd-479d5305786a/reload/0.log" Jun 05 18:28:53.113974 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:53.113936 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-dcbf484f7-w6wfj_b2262c61-9780-4c31-a5cd-479d5305786a/kube-rbac-proxy/0.log" Jun 05 18:28:56.670363 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:56.670327 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-wb9nd_abf1ee15-6a4e-4850-a9f3-54ee56fa6bd3/volume-data-source-validator/0.log" Jun 05 18:28:57.065801 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:57.065717 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hm5wr/perf-node-gather-daemonset-hb2tx"] Jun 05 18:28:57.071314 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:57.071284 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-hb2tx" Jun 05 18:28:57.078608 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:57.078570 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hm5wr/perf-node-gather-daemonset-hb2tx"] Jun 05 18:28:57.171917 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:57.171885 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fbc2a2a-361a-449d-ac37-7404a1ea7dce-sys\") pod \"perf-node-gather-daemonset-hb2tx\" (UID: \"4fbc2a2a-361a-449d-ac37-7404a1ea7dce\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-hb2tx" Jun 05 18:28:57.172124 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:57.172107 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fbc2a2a-361a-449d-ac37-7404a1ea7dce-lib-modules\") pod \"perf-node-gather-daemonset-hb2tx\" (UID: \"4fbc2a2a-361a-449d-ac37-7404a1ea7dce\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-hb2tx" Jun 05 18:28:57.172204 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:57.172194 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4fbc2a2a-361a-449d-ac37-7404a1ea7dce-proc\") pod \"perf-node-gather-daemonset-hb2tx\" (UID: \"4fbc2a2a-361a-449d-ac37-7404a1ea7dce\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-hb2tx" Jun 05 18:28:57.172352 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:57.172326 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4fbc2a2a-361a-449d-ac37-7404a1ea7dce-podres\") pod \"perf-node-gather-daemonset-hb2tx\" (UID: \"4fbc2a2a-361a-449d-ac37-7404a1ea7dce\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-hb2tx" Jun 05 18:28:57.172417 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:57.172359 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chbxq\" (UniqueName: \"kubernetes.io/projected/4fbc2a2a-361a-449d-ac37-7404a1ea7dce-kube-api-access-chbxq\") pod \"perf-node-gather-daemonset-hb2tx\" (UID: \"4fbc2a2a-361a-449d-ac37-7404a1ea7dce\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-hb2tx" Jun 05 18:28:57.273994 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:57.273955 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4fbc2a2a-361a-449d-ac37-7404a1ea7dce-podres\") pod \"perf-node-gather-daemonset-hb2tx\" (UID: \"4fbc2a2a-361a-449d-ac37-7404a1ea7dce\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-hb2tx" Jun 05 18:28:57.274178 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:57.274004 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chbxq\" (UniqueName: \"kubernetes.io/projected/4fbc2a2a-361a-449d-ac37-7404a1ea7dce-kube-api-access-chbxq\") pod \"perf-node-gather-daemonset-hb2tx\" (UID: \"4fbc2a2a-361a-449d-ac37-7404a1ea7dce\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-hb2tx" Jun 05 18:28:57.274178 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:57.274150 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fbc2a2a-361a-449d-ac37-7404a1ea7dce-sys\") pod \"perf-node-gather-daemonset-hb2tx\" (UID: \"4fbc2a2a-361a-449d-ac37-7404a1ea7dce\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-hb2tx" Jun 05 18:28:57.274178 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:57.274157 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4fbc2a2a-361a-449d-ac37-7404a1ea7dce-podres\") pod \"perf-node-gather-daemonset-hb2tx\" (UID: \"4fbc2a2a-361a-449d-ac37-7404a1ea7dce\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-hb2tx" Jun 05 18:28:57.274368 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:57.274176 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fbc2a2a-361a-449d-ac37-7404a1ea7dce-lib-modules\") pod \"perf-node-gather-daemonset-hb2tx\" (UID: \"4fbc2a2a-361a-449d-ac37-7404a1ea7dce\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-hb2tx" Jun 05 18:28:57.274368 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:57.274211 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4fbc2a2a-361a-449d-ac37-7404a1ea7dce-proc\") pod \"perf-node-gather-daemonset-hb2tx\" (UID: \"4fbc2a2a-361a-449d-ac37-7404a1ea7dce\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-hb2tx" Jun 05 18:28:57.274368 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:57.274319 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4fbc2a2a-361a-449d-ac37-7404a1ea7dce-proc\") pod \"perf-node-gather-daemonset-hb2tx\" (UID: \"4fbc2a2a-361a-449d-ac37-7404a1ea7dce\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-hb2tx" Jun 05 18:28:57.274527 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:57.274378 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fbc2a2a-361a-449d-ac37-7404a1ea7dce-sys\") pod \"perf-node-gather-daemonset-hb2tx\" (UID: \"4fbc2a2a-361a-449d-ac37-7404a1ea7dce\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-hb2tx" Jun 05 18:28:57.274527 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:57.274489 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fbc2a2a-361a-449d-ac37-7404a1ea7dce-lib-modules\") pod \"perf-node-gather-daemonset-hb2tx\" (UID: \"4fbc2a2a-361a-449d-ac37-7404a1ea7dce\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-hb2tx" Jun 05 18:28:57.283509 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:57.283479 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chbxq\" (UniqueName: \"kubernetes.io/projected/4fbc2a2a-361a-449d-ac37-7404a1ea7dce-kube-api-access-chbxq\") pod \"perf-node-gather-daemonset-hb2tx\" (UID: \"4fbc2a2a-361a-449d-ac37-7404a1ea7dce\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-hb2tx" Jun 05 18:28:57.387458 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:57.387403 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-hb2tx" Jun 05 18:28:57.586614 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:57.585527 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hm5wr/perf-node-gather-daemonset-hb2tx"] Jun 05 18:28:58.030397 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:58.030316 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z7h9r_0b586fdc-e65a-4afc-91c4-2f6307527422/dns/0.log" Jun 05 18:28:58.051919 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:58.051891 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z7h9r_0b586fdc-e65a-4afc-91c4-2f6307527422/kube-rbac-proxy/0.log" Jun 05 18:28:58.121783 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:58.121758 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t7jhz_7f32c561-c9cd-4f88-8f31-303673c53503/dns-node-resolver/0.log" Jun 05 18:28:58.484198 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:58.484164 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-hb2tx" event={"ID":"4fbc2a2a-361a-449d-ac37-7404a1ea7dce","Type":"ContainerStarted","Data":"5497b5a074b60b31e84bf6d7cc29997618561fe51c3979389d99bcc54608258e"} Jun 05 18:28:58.484397 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:58.484219 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-hb2tx" event={"ID":"4fbc2a2a-361a-449d-ac37-7404a1ea7dce","Type":"ContainerStarted","Data":"9cd2a687f4964b54c42a2bbf2c7217425c78a5cfaf296138e32e37b52c630902"} Jun 05 18:28:58.484454 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:58.484406 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-hb2tx" Jun 05 18:28:58.501971 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:58.501859 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-hb2tx" podStartSLOduration=1.501838705 podStartE2EDuration="1.501838705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 18:28:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:28:58.501727156 +0000 UTC m=+2387.691706332" watchObservedRunningTime="2026-06-05 18:28:58.501838705 +0000 UTC m=+2387.691817872" Jun 05 18:28:58.633091 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:58.633054 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6dfb6cdb54-kjnhs_48a91cf5-c282-4fa5-bf5c-8f3f224c2f65/registry/0.log" Jun 05 18:28:58.645074 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:58.645042 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6dfb6cdb54-kjnhs_48a91cf5-c282-4fa5-bf5c-8f3f224c2f65/registry/1.log" Jun 05 18:28:58.711745 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:58.711715 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wlsj8_9f55e627-03d9-48da-ba1a-0c0fb6b40398/node-ca/0.log" Jun 05 18:28:59.744082 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:59.744053 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65bcf5494b-4tjlb_4abbb1a4-ae43-465d-b59e-e89b59bd46f1/kube-auth-proxy/0.log" Jun 05 18:28:59.867990 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:59.867960 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-wl4xk_0ffcaa26-4f9e-46ed-bcf1-20cf67fb8169/payload-pre-processing/0.log" Jun 05 18:28:59.938503 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:59.938470 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-cljkr_8d4a3f94-d261-4d64-ae6e-1cc0fc4f1559/payload-processing/0.log" Jun 05 18:28:59.961686 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:28:59.961659 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cb4fdffb5-hq64f_1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3/router/0.log" Jun 05 18:29:00.614868 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:00.614842 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x2wwq_3d366d70-6cb1-4172-9b93-9606ed9c66ba/serve-healthcheck-canary/0.log" Jun 05 18:29:01.293850 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:01.293823 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pqxrg_bebd4bc2-e6ce-4b74-a711-f33ac12486e9/kube-rbac-proxy/0.log" Jun 05 18:29:01.314859 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:01.314837 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pqxrg_bebd4bc2-e6ce-4b74-a711-f33ac12486e9/exporter/0.log" Jun 05 18:29:01.334602 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:01.334576 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pqxrg_bebd4bc2-e6ce-4b74-a711-f33ac12486e9/extractor/0.log" Jun 05 18:29:03.758206 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:03.758179 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-688f6c4bb7-4j798_006e98e9-0103-4847-b04f-2ddedd8a8c40/maas-api/0.log" Jun 05 18:29:03.877230 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:03.877196 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-575b84f768-wxsf6_6405a924-25ba-450a-a09e-fd5919047770/manager/0.log" Jun 05 18:29:04.178133 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:04.178101 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54f5f4b6cb-np6pq_5104f206-e636-4a8d-82c2-3cb51d0ead0b/manager/0.log" Jun 05 18:29:04.195679 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:04.195655 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54f5f4b6cb-np6pq_5104f206-e636-4a8d-82c2-3cb51d0ead0b/copy-manifests/0.log" Jun 05 18:29:04.501467 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:04.501389 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-hb2tx" Jun 05 18:29:05.765610 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:05.765577 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-58878fcd45-lmlpn_e2250813-4cc1-4fe0-9214-a5aa93051c75/manager/0.log" Jun 05 18:29:10.182514 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:10.182485 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65bcf5494b-4tjlb_4abbb1a4-ae43-465d-b59e-e89b59bd46f1/kube-auth-proxy/0.log" Jun 05 18:29:10.294321 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:10.294294 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-wl4xk_0ffcaa26-4f9e-46ed-bcf1-20cf67fb8169/payload-pre-processing/0.log" Jun 05 18:29:10.363394 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:10.362624 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-cljkr_8d4a3f94-d261-4d64-ae6e-1cc0fc4f1559/payload-processing/0.log" Jun 05 18:29:10.375667 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:10.375618 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cb4fdffb5-hq64f_1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3/router/0.log" Jun 05 18:29:11.420342 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:11.420309 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z87q_1412064f-459e-4d05-9771-f48e3fdf62b1/ovn-acl-logging/0.log" Jun 05 18:29:11.428967 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:11.428937 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z87q_1412064f-459e-4d05-9771-f48e3fdf62b1/ovn-acl-logging/0.log" Jun 05 18:29:11.610338 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:11.610287 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65bcf5494b-4tjlb_4abbb1a4-ae43-465d-b59e-e89b59bd46f1/kube-auth-proxy/0.log" Jun 05 18:29:11.727893 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:11.727812 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-wl4xk_0ffcaa26-4f9e-46ed-bcf1-20cf67fb8169/payload-pre-processing/0.log" Jun 05 18:29:11.795771 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:11.795743 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-cljkr_8d4a3f94-d261-4d64-ae6e-1cc0fc4f1559/payload-processing/0.log" Jun 05 18:29:11.812399 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:11.812371 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cb4fdffb5-hq64f_1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3/router/0.log" Jun 05 18:29:13.170402 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:13.170373 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sbdm2_8121e0ee-fe1b-414e-9a15-c073dbddb81f/kube-multus-additional-cni-plugins/0.log" Jun 05 18:29:13.197083 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:13.197051 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sbdm2_8121e0ee-fe1b-414e-9a15-c073dbddb81f/egress-router-binary-copy/0.log" Jun 05 18:29:13.222847 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:13.222822 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sbdm2_8121e0ee-fe1b-414e-9a15-c073dbddb81f/cni-plugins/0.log" Jun 05 18:29:13.243106 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:13.243079 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sbdm2_8121e0ee-fe1b-414e-9a15-c073dbddb81f/bond-cni-plugin/0.log" Jun 05 18:29:13.265580 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:13.265548 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sbdm2_8121e0ee-fe1b-414e-9a15-c073dbddb81f/routeoverride-cni/0.log" Jun 05 18:29:13.285901 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:13.285875 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sbdm2_8121e0ee-fe1b-414e-9a15-c073dbddb81f/whereabouts-cni-bincopy/0.log" Jun 05 18:29:13.306743 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:13.306717 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sbdm2_8121e0ee-fe1b-414e-9a15-c073dbddb81f/whereabouts-cni/0.log" Jun 05 18:29:13.465055 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:13.464983 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65bcf5494b-4tjlb_4abbb1a4-ae43-465d-b59e-e89b59bd46f1/kube-auth-proxy/0.log" Jun 05 18:29:13.527220 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:13.527046 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-svjbf_939d3ed8-32b9-48f4-85e8-4ca3bfb226ec/kube-multus/0.log" Jun 05 18:29:13.568686 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:13.568655 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-wl4xk_0ffcaa26-4f9e-46ed-bcf1-20cf67fb8169/payload-pre-processing/0.log" Jun 05 18:29:13.634388 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:13.634363 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-cljkr_8d4a3f94-d261-4d64-ae6e-1cc0fc4f1559/payload-processing/0.log" Jun 05 18:29:13.641213 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:13.641186 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nbsjk_0e0bcb41-a6ca-4334-b790-165d44925258/network-metrics-daemon/0.log" Jun 05 18:29:13.646844 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:13.646821 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cb4fdffb5-hq64f_1f4b3896-4dff-4c8c-92bb-a75d2c5dd1c3/router/0.log" Jun 05 18:29:13.659040 ip-10-0-143-199 kubenswrapper[2553]: I0605 18:29:13.659000 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nbsjk_0e0bcb41-a6ca-4334-b790-165d44925258/kube-rbac-proxy/0.log"