Jun 11 13:26:24.327345 ip-10-0-140-186 systemd[1]: Starting Kubernetes Kubelet... Jun 11 13:26:24.673320 ip-10-0-140-186 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 13:26:24.673320 ip-10-0-140-186 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 13:26:24.673320 ip-10-0-140-186 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 13:26:24.673320 ip-10-0-140-186 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 13:26:24.673320 ip-10-0-140-186 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 13:26:24.675602 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.675534 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 13:26:24.679734 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679720 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 13:26:24.679734 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679734 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 13:26:24.679796 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679738 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 13:26:24.679796 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679743 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 13:26:24.679796 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679747 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 13:26:24.679796 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679750 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 13:26:24.679796 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679753 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 13:26:24.679796 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679756 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 13:26:24.679796 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679759 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 13:26:24.679796 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679762 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 13:26:24.679796 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679764 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 13:26:24.679796 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679767 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 13:26:24.679796 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679769 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 13:26:24.679796 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679772 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 13:26:24.679796 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679775 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 13:26:24.679796 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679782 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 13:26:24.679796 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679785 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 13:26:24.679796 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679787 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 13:26:24.679796 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679791 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 13:26:24.679796 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679794 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 13:26:24.679796 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679796 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 13:26:24.680254 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679799 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 13:26:24.680254 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679802 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 13:26:24.680254 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679805 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 13:26:24.680254 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679807 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 13:26:24.680254 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679811 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 13:26:24.680254 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679813 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 13:26:24.680254 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679816 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 13:26:24.680254 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679818 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 13:26:24.680254 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679821 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 13:26:24.680254 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679823 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 13:26:24.680254 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679826 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 11 13:26:24.680254 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679828 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 13:26:24.680254 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679830 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 13:26:24.680254 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679833 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 13:26:24.680254 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679836 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 13:26:24.680254 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679838 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 13:26:24.680254 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679840 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 13:26:24.680254 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679842 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 13:26:24.680254 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679845 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 13:26:24.680254 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679853 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 13:26:24.680722 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679855 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 13:26:24.680722 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679857 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 13:26:24.680722 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679860 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 13:26:24.680722 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679862 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 13:26:24.680722 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679864 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 13:26:24.680722 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679867 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 13:26:24.680722 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679869 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 13:26:24.680722 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679871 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 13:26:24.680722 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679874 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 13:26:24.680722 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679876 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 13:26:24.680722 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679878 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 13:26:24.680722 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679881 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 13:26:24.680722 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679883 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 13:26:24.680722 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679887 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 13:26:24.680722 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679890 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 13:26:24.680722 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679892 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 13:26:24.680722 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679895 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 13:26:24.680722 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679897 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 13:26:24.680722 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679900 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 13:26:24.680722 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679902 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 13:26:24.681204 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679904 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 13:26:24.681204 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679907 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 13:26:24.681204 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679909 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 13:26:24.681204 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679912 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 13:26:24.681204 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679915 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 13:26:24.681204 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679917 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 13:26:24.681204 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679920 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 13:26:24.681204 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679923 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 13:26:24.681204 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679925 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 13:26:24.681204 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679928 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 13:26:24.681204 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679930 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 13:26:24.681204 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679932 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 13:26:24.681204 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679935 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 13:26:24.681204 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679937 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 13:26:24.681204 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679940 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 13:26:24.681204 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679942 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 13:26:24.681204 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679945 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 13:26:24.681204 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679947 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 13:26:24.681204 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679949 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 13:26:24.681204 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679953 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 13:26:24.681664 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679955 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 13:26:24.681664 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679958 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 13:26:24.681664 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679960 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 13:26:24.681664 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679962 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 13:26:24.681664 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679965 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 13:26:24.681664 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679968 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 13:26:24.681664 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679970 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 13:26:24.681664 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679973 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 13:26:24.681664 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679977 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 13:26:24.681664 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679980 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 13:26:24.681664 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679982 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 13:26:24.681664 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679985 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 13:26:24.681664 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679987 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 13:26:24.681664 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679990 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 13:26:24.681664 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679993 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 13:26:24.681664 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.679997 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 13:26:24.681664 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680000 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 13:26:24.681664 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680003 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 13:26:24.681664 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680703 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 13:26:24.682130 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680710 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 13:26:24.682130 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680713 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 13:26:24.682130 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680716 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 13:26:24.682130 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680719 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 13:26:24.682130 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680721 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 13:26:24.682130 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680724 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 13:26:24.682130 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680727 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 13:26:24.682130 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680729 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 13:26:24.682130 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680732 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 13:26:24.682130 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680735 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 13:26:24.682130 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680738 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 13:26:24.682130 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680740 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 13:26:24.682130 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680743 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 13:26:24.682130 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680753 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 13:26:24.682130 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680756 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 13:26:24.682130 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680759 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 13:26:24.682130 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680762 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 13:26:24.682130 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680764 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 13:26:24.682130 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680767 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 13:26:24.682130 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680769 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 13:26:24.682609 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680772 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 13:26:24.682609 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680774 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 13:26:24.682609 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680777 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 13:26:24.682609 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680780 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 13:26:24.682609 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680783 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 13:26:24.682609 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680785 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 13:26:24.682609 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680788 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 13:26:24.682609 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680790 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 13:26:24.682609 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680792 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 13:26:24.682609 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680795 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 13:26:24.682609 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680798 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 13:26:24.682609 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680800 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 13:26:24.682609 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680803 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 13:26:24.682609 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680805 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 13:26:24.682609 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680808 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 13:26:24.682609 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680810 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 13:26:24.682609 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680813 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 13:26:24.682609 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680815 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 13:26:24.682609 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680818 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 13:26:24.682609 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680820 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 13:26:24.683100 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680822 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 13:26:24.683100 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680825 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 13:26:24.683100 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680828 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 13:26:24.683100 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680830 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 13:26:24.683100 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680833 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 13:26:24.683100 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680835 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 13:26:24.683100 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680838 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 13:26:24.683100 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680840 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 13:26:24.683100 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680843 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 13:26:24.683100 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680845 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 13:26:24.683100 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680849 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 13:26:24.683100 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680851 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 13:26:24.683100 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680854 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 13:26:24.683100 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680856 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 11 13:26:24.683100 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680859 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 13:26:24.683100 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680861 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 13:26:24.683100 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680864 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 13:26:24.683100 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680866 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 13:26:24.683100 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680868 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 13:26:24.683100 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680870 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 13:26:24.683571 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680873 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 13:26:24.683571 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680875 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 13:26:24.683571 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680877 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 13:26:24.683571 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680880 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 13:26:24.683571 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680883 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 13:26:24.683571 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680885 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 13:26:24.683571 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680887 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 13:26:24.683571 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680890 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 13:26:24.683571 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680892 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 13:26:24.683571 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680896 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 13:26:24.683571 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680899 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 13:26:24.683571 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680904 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 13:26:24.683571 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680908 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 13:26:24.683571 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680912 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 13:26:24.683571 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680915 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 13:26:24.683571 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680918 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 13:26:24.683571 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680920 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 13:26:24.683571 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680923 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 13:26:24.683571 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680926 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 13:26:24.684039 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680929 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 13:26:24.684039 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680931 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 13:26:24.684039 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680933 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 13:26:24.684039 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680936 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 13:26:24.684039 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680939 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 13:26:24.684039 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680941 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 13:26:24.684039 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680944 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 13:26:24.684039 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680946 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 13:26:24.684039 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680949 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 13:26:24.684039 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680951 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 13:26:24.684039 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680954 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 13:26:24.684039 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680958 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 13:26:24.684039 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680961 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 13:26:24.684039 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680964 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 13:26:24.684039 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680967 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 13:26:24.684039 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680969 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 13:26:24.684039 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680972 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 13:26:24.684039 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680975 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 13:26:24.684039 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.680978 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 13:26:24.684517 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681359 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 13:26:24.684517 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681365 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 13:26:24.684517 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681368 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 11 13:26:24.684517 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681372 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 13:26:24.684517 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681374 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 13:26:24.684517 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681377 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 13:26:24.684517 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681379 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 13:26:24.684517 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681385 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 13:26:24.684517 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681388 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 13:26:24.684517 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681391 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 13:26:24.684517 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681393 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 13:26:24.684517 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681396 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 13:26:24.684517 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681399 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 13:26:24.684517 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681401 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 13:26:24.684517 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681404 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 13:26:24.684517 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681406 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 13:26:24.684517 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681409 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 13:26:24.684517 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681411 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 13:26:24.684517 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681414 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 13:26:24.684517 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681416 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 13:26:24.685007 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681419 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 13:26:24.685007 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681421 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 13:26:24.685007 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681424 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 13:26:24.685007 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681427 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 13:26:24.685007 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681431 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 13:26:24.685007 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681433 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 13:26:24.685007 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681436 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 13:26:24.685007 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681439 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 13:26:24.685007 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681441 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 13:26:24.685007 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681444 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 13:26:24.685007 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681448 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 13:26:24.685007 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681451 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 13:26:24.685007 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681454 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 13:26:24.685007 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681456 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 13:26:24.685007 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681459 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 13:26:24.685007 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681461 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 13:26:24.685007 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681463 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 13:26:24.685007 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681466 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 13:26:24.685007 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681468 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 13:26:24.685007 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681473 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 13:26:24.685499 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681475 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 13:26:24.685499 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681478 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 13:26:24.685499 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681480 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 13:26:24.685499 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681482 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 13:26:24.685499 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681485 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 13:26:24.685499 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681487 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 13:26:24.685499 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681490 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 13:26:24.685499 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681492 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 13:26:24.685499 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681495 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 13:26:24.685499 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681498 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 13:26:24.685499 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681500 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 13:26:24.685499 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681502 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 13:26:24.685499 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681505 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 13:26:24.685499 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681507 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 13:26:24.685499 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681509 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 13:26:24.685499 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681512 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 13:26:24.685499 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681514 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 13:26:24.685499 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681518 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 13:26:24.685499 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681521 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 13:26:24.685951 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681524 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 13:26:24.685951 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681527 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 13:26:24.685951 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681530 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 13:26:24.685951 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681532 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 13:26:24.685951 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681535 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 13:26:24.685951 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681538 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 13:26:24.685951 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681540 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 13:26:24.685951 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681543 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 13:26:24.685951 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681560 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 13:26:24.685951 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681563 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 13:26:24.685951 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681566 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 13:26:24.685951 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681569 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 13:26:24.685951 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681573 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 13:26:24.685951 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681575 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 13:26:24.685951 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681578 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 13:26:24.685951 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681581 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 13:26:24.685951 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681583 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 13:26:24.685951 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681585 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 13:26:24.685951 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681588 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 13:26:24.686434 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681590 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 13:26:24.686434 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681592 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 13:26:24.686434 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681597 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 13:26:24.686434 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681600 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 13:26:24.686434 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681602 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 13:26:24.686434 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681605 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 13:26:24.686434 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681607 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 13:26:24.686434 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681609 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 13:26:24.686434 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681612 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 13:26:24.686434 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681614 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 13:26:24.686434 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681616 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 13:26:24.686434 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681619 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 13:26:24.686434 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681621 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 13:26:24.686434 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681624 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 13:26:24.686434 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681626 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 13:26:24.686434 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681628 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 13:26:24.686434 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681632 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 13:26:24.686434 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681636 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 13:26:24.686434 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681639 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 13:26:24.686434 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681642 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 13:26:24.686966 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.681644 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 13:26:24.686966 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681715 2563 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 13:26:24.686966 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681723 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 13:26:24.686966 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681733 2563 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 13:26:24.686966 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681739 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 13:26:24.686966 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681746 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 13:26:24.686966 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681751 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 13:26:24.686966 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681755 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 13:26:24.686966 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681759 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 13:26:24.686966 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681762 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 13:26:24.686966 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681764 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 13:26:24.686966 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681768 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 13:26:24.686966 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681771 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 13:26:24.686966 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681774 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 13:26:24.686966 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681778 2563 flags.go:64] FLAG: --cgroup-root="" Jun 11 13:26:24.686966 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681781 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 13:26:24.686966 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681784 2563 flags.go:64] FLAG: --client-ca-file="" Jun 11 13:26:24.686966 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681786 2563 flags.go:64] FLAG: --cloud-provider="external" Jun 11 13:26:24.686966 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681789 2563 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 13:26:24.686966 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681793 2563 flags.go:64] FLAG: --cluster-domain="" Jun 11 13:26:24.686966 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681796 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 13:26:24.686966 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681798 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 13:26:24.686966 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681801 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 13:26:24.686966 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681805 2563 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 13:26:24.687540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681808 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 13:26:24.687540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681811 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 13:26:24.687540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681814 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 13:26:24.687540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681817 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 13:26:24.687540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681819 2563 flags.go:64] FLAG: --contention-profiling="false" Jun 11 13:26:24.687540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681822 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 13:26:24.687540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681825 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 13:26:24.687540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681828 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 13:26:24.687540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681831 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 13:26:24.687540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681834 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 13:26:24.687540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681837 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 13:26:24.687540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681840 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 13:26:24.687540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681842 2563 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 13:26:24.687540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681845 2563 flags.go:64] FLAG: --enable-server="true" Jun 11 13:26:24.687540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681848 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 13:26:24.687540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681852 2563 flags.go:64] FLAG: --event-burst="100" Jun 11 13:26:24.687540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681855 2563 flags.go:64] FLAG: --event-qps="50" Jun 11 13:26:24.687540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681858 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 13:26:24.687540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681861 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 13:26:24.687540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681864 2563 flags.go:64] FLAG: --eviction-hard="" Jun 11 13:26:24.687540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681867 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 13:26:24.687540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681870 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 13:26:24.687540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681874 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 13:26:24.687540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681876 2563 flags.go:64] FLAG: --eviction-soft="" Jun 11 13:26:24.687540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681879 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 13:26:24.688128 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681882 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 13:26:24.688128 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681885 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 13:26:24.688128 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681887 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 13:26:24.688128 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681890 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 13:26:24.688128 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681892 2563 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 13:26:24.688128 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681895 2563 flags.go:64] FLAG: --feature-gates="" Jun 11 13:26:24.688128 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681898 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 13:26:24.688128 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681901 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 13:26:24.688128 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681904 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 13:26:24.688128 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681906 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 13:26:24.688128 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681909 2563 flags.go:64] FLAG: --healthz-port="10248" Jun 11 13:26:24.688128 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681912 2563 flags.go:64] FLAG: --help="false" Jun 11 13:26:24.688128 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681915 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-140-186.ec2.internal" Jun 11 13:26:24.688128 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681918 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 13:26:24.688128 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681920 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 13:26:24.688128 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681926 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 13:26:24.688128 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681929 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 13:26:24.688128 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681932 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 13:26:24.688128 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681935 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 13:26:24.688128 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681937 2563 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 13:26:24.688128 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681940 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 13:26:24.688128 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681943 2563 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 13:26:24.688128 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681946 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 13:26:24.688710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681949 2563 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 13:26:24.688710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681952 2563 flags.go:64] FLAG: --kube-reserved="" Jun 11 13:26:24.688710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681954 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 13:26:24.688710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681957 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 13:26:24.688710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681960 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 13:26:24.688710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681962 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 13:26:24.688710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681966 2563 flags.go:64] FLAG: --lock-file="" Jun 11 13:26:24.688710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681969 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 13:26:24.688710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681972 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 13:26:24.688710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681975 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 13:26:24.688710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681979 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 13:26:24.688710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681982 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 13:26:24.688710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681985 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 13:26:24.688710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681988 2563 flags.go:64] FLAG: --logging-format="text" Jun 11 13:26:24.688710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681990 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 13:26:24.688710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681994 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 13:26:24.688710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681996 2563 flags.go:64] FLAG: --manifest-url="" Jun 11 13:26:24.688710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.681999 2563 flags.go:64] FLAG: --manifest-url-header="" Jun 11 13:26:24.688710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682003 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 13:26:24.688710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682006 2563 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 13:26:24.688710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682009 2563 flags.go:64] FLAG: --max-pods="110" Jun 11 13:26:24.688710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682012 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 13:26:24.688710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682015 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 13:26:24.688710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682018 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 13:26:24.688710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682021 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 13:26:24.689354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682024 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 13:26:24.689354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682027 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 13:26:24.689354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682029 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 13:26:24.689354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682036 2563 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 13:26:24.689354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682039 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 13:26:24.689354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682057 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 13:26:24.689354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682060 2563 flags.go:64] FLAG: --pod-cidr="" Jun 11 13:26:24.689354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682062 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 13:26:24.689354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682068 2563 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 13:26:24.689354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682070 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 13:26:24.689354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682073 2563 flags.go:64] FLAG: --pods-per-core="0" Jun 11 13:26:24.689354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682076 2563 flags.go:64] FLAG: --port="10250" Jun 11 13:26:24.689354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682079 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 13:26:24.689354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682083 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05de85643d8bfe0a6" Jun 11 13:26:24.689354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682086 2563 flags.go:64] FLAG: --qos-reserved="" Jun 11 13:26:24.689354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682089 2563 flags.go:64] FLAG: --read-only-port="10255" Jun 11 13:26:24.689354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682091 2563 flags.go:64] FLAG: --register-node="true" Jun 11 13:26:24.689354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682094 2563 flags.go:64] FLAG: --register-with-taints="" Jun 11 13:26:24.689354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682097 2563 flags.go:64] FLAG: --registry-burst="10" Jun 11 13:26:24.689354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682100 2563 flags.go:64] FLAG: --registry-qps="5" Jun 11 13:26:24.689354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682102 2563 flags.go:64] FLAG: --reserved-cpus="" Jun 11 13:26:24.689354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682105 2563 flags.go:64] FLAG: --reserved-memory="" Jun 11 13:26:24.689354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682108 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 13:26:24.689354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682111 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 13:26:24.689354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682113 2563 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 13:26:24.690378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682116 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 13:26:24.690378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682118 2563 flags.go:64] FLAG: --runonce="false" Jun 11 13:26:24.690378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682121 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 13:26:24.690378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682124 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 13:26:24.690378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682127 2563 flags.go:64] FLAG: --seccomp-default="false" Jun 11 13:26:24.690378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682129 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 13:26:24.690378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682132 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 13:26:24.690378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682135 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 13:26:24.690378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682139 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 13:26:24.690378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682141 2563 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 13:26:24.690378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682144 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 13:26:24.690378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682148 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 13:26:24.690378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682151 2563 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 13:26:24.690378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682154 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 13:26:24.690378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682157 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 13:26:24.690378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682159 2563 flags.go:64] FLAG: --system-cgroups="" Jun 11 13:26:24.690378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682162 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 13:26:24.690378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682167 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 13:26:24.690378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682170 2563 flags.go:64] FLAG: --tls-cert-file="" Jun 11 13:26:24.690378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682172 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 13:26:24.690378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682176 2563 flags.go:64] FLAG: --tls-min-version="" Jun 11 13:26:24.690378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682179 2563 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 13:26:24.690378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682182 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 13:26:24.690378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682185 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 13:26:24.690378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682187 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 13:26:24.691031 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682190 2563 flags.go:64] FLAG: --v="2" Jun 11 13:26:24.691031 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682194 2563 flags.go:64] FLAG: --version="false" Jun 11 13:26:24.691031 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682198 2563 flags.go:64] FLAG: --vmodule="" Jun 11 13:26:24.691031 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682201 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 13:26:24.691031 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.682204 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 13:26:24.691031 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682333 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 13:26:24.691031 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682337 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 13:26:24.691031 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682340 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 13:26:24.691031 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682343 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 13:26:24.691031 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682345 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 13:26:24.691031 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682349 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 13:26:24.691031 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682353 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 13:26:24.691031 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682356 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 13:26:24.691031 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682358 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 13:26:24.691031 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682361 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 13:26:24.691031 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682363 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 13:26:24.691031 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682367 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 13:26:24.691031 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682369 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 13:26:24.691031 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682374 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 13:26:24.691031 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682377 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 13:26:24.691557 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682379 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 13:26:24.691557 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682382 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 13:26:24.691557 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682384 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 13:26:24.691557 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682386 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 13:26:24.691557 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682389 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 13:26:24.691557 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682391 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 13:26:24.691557 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682394 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 13:26:24.691557 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682397 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 13:26:24.691557 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682400 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 13:26:24.691557 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682402 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 13:26:24.691557 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682405 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 13:26:24.691557 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682407 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 13:26:24.691557 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682410 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 13:26:24.691557 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682412 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 13:26:24.691557 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682415 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 13:26:24.691557 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682417 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 13:26:24.691557 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682420 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 13:26:24.691557 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682422 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 13:26:24.691557 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682424 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 13:26:24.691557 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682427 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 13:26:24.692027 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682429 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 13:26:24.692027 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682432 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 13:26:24.692027 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682434 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 13:26:24.692027 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682436 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 13:26:24.692027 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682439 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 13:26:24.692027 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682441 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 13:26:24.692027 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682443 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 13:26:24.692027 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682446 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 13:26:24.692027 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682448 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 13:26:24.692027 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682451 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 13:26:24.692027 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682455 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 13:26:24.692027 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682457 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 13:26:24.692027 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682460 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 13:26:24.692027 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682462 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 13:26:24.692027 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682464 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 13:26:24.692027 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682468 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 13:26:24.692027 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682472 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 13:26:24.692027 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682475 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 13:26:24.692027 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682477 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 13:26:24.692027 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682480 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 13:26:24.692529 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682482 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 13:26:24.692529 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682485 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 13:26:24.692529 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682487 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 13:26:24.692529 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682489 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 13:26:24.692529 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682492 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 13:26:24.692529 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682496 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 13:26:24.692529 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682499 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 13:26:24.692529 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682501 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 13:26:24.692529 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682504 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 13:26:24.692529 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682507 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 13:26:24.692529 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682509 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 13:26:24.692529 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682512 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 13:26:24.692529 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682514 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 13:26:24.692529 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682516 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 13:26:24.692529 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682519 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 13:26:24.692529 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682521 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 13:26:24.692529 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682524 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 13:26:24.692529 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682526 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 13:26:24.692529 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682529 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 13:26:24.692974 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682531 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 13:26:24.692974 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682533 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 13:26:24.692974 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682536 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 13:26:24.692974 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682540 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 13:26:24.692974 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682543 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 13:26:24.692974 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682546 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 11 13:26:24.692974 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682548 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 13:26:24.692974 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682550 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 13:26:24.692974 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682553 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 13:26:24.692974 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682555 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 13:26:24.692974 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682558 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 13:26:24.692974 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682561 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 13:26:24.692974 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682563 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 13:26:24.692974 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682566 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 13:26:24.692974 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682568 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 13:26:24.692974 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682570 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 13:26:24.692974 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682573 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 13:26:24.692974 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682575 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 13:26:24.692974 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682578 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 13:26:24.692974 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682580 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 13:26:24.693473 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682583 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 13:26:24.693473 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682585 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 13:26:24.693473 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682587 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 13:26:24.693473 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682590 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 13:26:24.693473 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.682592 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 13:26:24.693473 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.683245 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 13:26:24.693473 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.690607 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 13:26:24.693473 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.690691 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 13:26:24.693473 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.690710 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 13:26:24.693473 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.690716 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 13:26:24.693473 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690771 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 13:26:24.693473 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690776 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 13:26:24.693473 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690779 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 13:26:24.693473 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690782 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 13:26:24.693473 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690785 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 13:26:24.693832 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690787 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 13:26:24.693832 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690790 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 13:26:24.693832 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690792 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 13:26:24.693832 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690795 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 13:26:24.693832 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690797 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 13:26:24.693832 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690800 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 13:26:24.693832 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690802 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 13:26:24.693832 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690805 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 13:26:24.693832 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690807 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 13:26:24.693832 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690810 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 13:26:24.693832 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690812 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 13:26:24.693832 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690815 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 13:26:24.693832 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690817 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 13:26:24.693832 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690820 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 13:26:24.693832 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690822 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 13:26:24.693832 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690825 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 13:26:24.693832 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690829 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 13:26:24.693832 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690832 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 13:26:24.693832 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690835 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 13:26:24.693832 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690837 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 13:26:24.694332 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690840 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 13:26:24.694332 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690843 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 13:26:24.694332 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690845 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 13:26:24.694332 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690856 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 13:26:24.694332 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690859 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 13:26:24.694332 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690862 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 13:26:24.694332 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690864 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 13:26:24.694332 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690867 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 13:26:24.694332 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690869 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 13:26:24.694332 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690872 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 13:26:24.694332 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690874 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 13:26:24.694332 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690877 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 13:26:24.694332 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690879 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 13:26:24.694332 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690881 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 13:26:24.694332 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690884 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 13:26:24.694332 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690886 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 13:26:24.694332 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690889 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 13:26:24.694332 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690891 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 13:26:24.694332 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690894 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 13:26:24.694759 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690896 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 13:26:24.694759 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690898 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 13:26:24.694759 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690901 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 13:26:24.694759 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690904 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 13:26:24.694759 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690906 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 13:26:24.694759 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690909 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 13:26:24.694759 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690912 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 13:26:24.694759 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690915 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 13:26:24.694759 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690917 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 13:26:24.694759 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690920 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 13:26:24.694759 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690922 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 13:26:24.694759 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690925 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 13:26:24.694759 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690928 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 13:26:24.694759 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690930 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 13:26:24.694759 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690932 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 13:26:24.694759 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690935 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 13:26:24.694759 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690937 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 13:26:24.694759 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690940 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 13:26:24.694759 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690942 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 13:26:24.694759 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690945 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 13:26:24.695340 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690947 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 13:26:24.695340 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690950 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 13:26:24.695340 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690952 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 11 13:26:24.695340 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690955 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 13:26:24.695340 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690957 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 13:26:24.695340 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690960 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 13:26:24.695340 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690962 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 13:26:24.695340 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690965 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 13:26:24.695340 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690967 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 13:26:24.695340 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690970 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 13:26:24.695340 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690972 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 13:26:24.695340 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690975 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 13:26:24.695340 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690977 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 13:26:24.695340 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690980 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 13:26:24.695340 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690984 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 13:26:24.695340 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690988 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 13:26:24.695340 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690991 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 13:26:24.695340 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690994 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 13:26:24.695340 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690997 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 13:26:24.695340 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.690999 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 13:26:24.695815 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691002 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 13:26:24.695815 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691005 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 13:26:24.695815 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691007 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 13:26:24.695815 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691009 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 13:26:24.695815 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691012 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 13:26:24.695815 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691014 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 13:26:24.695815 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691018 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 13:26:24.695815 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691022 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 13:26:24.695815 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691024 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 13:26:24.695815 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691027 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 13:26:24.695815 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691030 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 13:26:24.695815 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691033 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 13:26:24.695815 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691036 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 13:26:24.695815 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691039 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 13:26:24.695815 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691059 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 13:26:24.696190 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.691065 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 13:26:24.696190 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691184 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 13:26:24.696190 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691189 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 13:26:24.696190 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691193 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 13:26:24.696190 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691196 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 13:26:24.696190 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691199 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 13:26:24.696190 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691201 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 13:26:24.696190 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691204 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 13:26:24.696190 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691207 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 13:26:24.696190 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691209 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 13:26:24.696190 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691213 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 13:26:24.696190 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691217 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 13:26:24.696190 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691220 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 13:26:24.696190 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691223 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 13:26:24.696190 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691226 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 13:26:24.696581 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691229 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 13:26:24.696581 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691232 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 13:26:24.696581 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691234 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 13:26:24.696581 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691237 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 13:26:24.696581 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691239 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 13:26:24.696581 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691241 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 13:26:24.696581 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691244 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 13:26:24.696581 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691246 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 13:26:24.696581 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691249 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 13:26:24.696581 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691251 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 13:26:24.696581 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691254 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 13:26:24.696581 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691257 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 13:26:24.696581 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691259 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 13:26:24.696581 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691262 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 13:26:24.696581 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691264 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 13:26:24.696581 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691267 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 13:26:24.696581 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691270 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 13:26:24.696581 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691272 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 13:26:24.696581 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691274 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 13:26:24.697028 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691277 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 13:26:24.697028 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691279 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 13:26:24.697028 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691281 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 13:26:24.697028 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691284 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 13:26:24.697028 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691286 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 13:26:24.697028 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691288 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 13:26:24.697028 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691291 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 13:26:24.697028 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691293 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 13:26:24.697028 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691296 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 13:26:24.697028 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691298 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 13:26:24.697028 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691302 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 13:26:24.697028 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691305 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 13:26:24.697028 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691308 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 13:26:24.697028 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691311 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 13:26:24.697028 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691314 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 13:26:24.697028 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691316 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 13:26:24.697028 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691319 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 13:26:24.697028 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691322 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 13:26:24.697028 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691324 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 13:26:24.697510 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691327 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 13:26:24.697510 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691329 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 13:26:24.697510 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691331 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 13:26:24.697510 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691334 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 13:26:24.697510 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691337 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 13:26:24.697510 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691339 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 13:26:24.697510 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691341 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 13:26:24.697510 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691344 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 13:26:24.697510 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691346 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 13:26:24.697510 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691348 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 13:26:24.697510 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691351 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 13:26:24.697510 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691353 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 13:26:24.697510 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691355 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 13:26:24.697510 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691358 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 13:26:24.697510 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691360 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 13:26:24.697510 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691362 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 13:26:24.697510 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691364 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 13:26:24.697510 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691367 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 13:26:24.697510 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691369 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 11 13:26:24.697510 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691371 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 13:26:24.697990 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691374 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 13:26:24.697990 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691376 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 13:26:24.697990 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691379 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 13:26:24.697990 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691381 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 13:26:24.697990 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691384 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 13:26:24.697990 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691386 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 13:26:24.697990 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691389 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 13:26:24.697990 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691391 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 13:26:24.697990 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691394 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 13:26:24.697990 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691396 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 13:26:24.697990 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691398 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 13:26:24.697990 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691401 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 13:26:24.697990 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691403 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 13:26:24.697990 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691405 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 13:26:24.697990 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691408 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 13:26:24.697990 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691410 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 13:26:24.697990 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691413 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 13:26:24.697990 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691415 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 13:26:24.697990 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691419 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 13:26:24.700719 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691422 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 13:26:24.700719 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691424 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 13:26:24.700719 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691427 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 13:26:24.700719 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691429 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 13:26:24.700719 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691431 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 13:26:24.700719 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691434 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 13:26:24.700719 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691436 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 13:26:24.700719 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:24.691438 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 13:26:24.700719 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.691443 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 13:26:24.700719 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.691533 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 13:26:24.700719 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.693641 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 13:26:24.700719 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.694943 2563 server.go:1019] "Starting client certificate rotation" Jun 11 13:26:24.700719 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.695056 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 13:26:24.700719 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.695085 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 13:26:24.701066 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.697342 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 13:26:24.701066 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.699806 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 13:26:24.707395 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.707382 2563 log.go:25] "Validated CRI v1 runtime API" Jun 11 13:26:24.718973 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.718948 2563 log.go:25] "Validated CRI v1 image API" Jun 11 13:26:24.722663 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.722632 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 13:26:24.724867 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.724840 2563 fs.go:135] Filesystem UUIDs: map[277fd80b-3c0a-43df-9065-02971c161157:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a1b6f957-416d-4651-b77a-1a5443894798:/dev/nvme0n1p3] Jun 11 13:26:24.724922 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.724867 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 13:26:24.731007 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.730909 2563 manager.go:216] Machine: {Timestamp:2026-06-11 13:26:24.728953613 +0000 UTC m=+0.297371934 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3202449 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f59f2822d8bf508bbfbccff68baf5 SystemUUID:ec2f59f2-822d-8bf5-08bb-fbccff68baf5 BootID:a4ebd8fc-cc18-480d-a2c3-b2d960199b33 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:52:ef:b0:7a:b7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:52:ef:b0:7a:b7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:43:69:46:7d:49 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 13:26:24.731007 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.731005 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 13:26:24.731127 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.731084 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 13:26:24.734454 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.734433 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 13:26:24.734569 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.734457 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-186.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 13:26:24.734984 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.734965 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 13:26:24.735286 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.735274 2563 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 13:26:24.735328 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.735288 2563 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 13:26:24.735328 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.735296 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 13:26:24.735882 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.735873 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 13:26:24.737034 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.737023 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 13:26:24.740291 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.740280 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 11 13:26:24.740406 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.740397 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 13:26:24.740441 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.740429 2563 kubelet.go:486] "Attempting to sync node with API server" Jun 11 13:26:24.740470 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.740441 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 13:26:24.740470 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.740465 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 13:26:24.740519 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.740478 2563 kubelet.go:398] "Adding apiserver pod source" Jun 11 13:26:24.740519 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.740489 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 13:26:24.745343 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.745319 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 13:26:24.745419 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.745363 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 13:26:24.747773 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.747752 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 13:26:24.749879 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.749865 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 13:26:24.749945 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.749893 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 13:26:24.750585 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.750575 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 13:26:24.750618 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.750594 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 13:26:24.750618 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.750602 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 13:26:24.750618 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.750608 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 13:26:24.750618 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.750616 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 13:26:24.750724 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.750622 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 13:26:24.750814 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.750801 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 13:26:24.750842 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.750815 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 13:26:24.750842 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.750823 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 13:26:24.750842 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.750829 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 13:26:24.750842 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.750837 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 13:26:24.750941 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.750846 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 13:26:24.752302 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.752290 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 13:26:24.752336 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.752303 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 13:26:24.755278 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.755261 2563 server.go:1268] "Started kubelet" Jun 11 13:26:24.755376 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.755336 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 13:26:24.755421 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.755392 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 13:26:24.755498 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.755470 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 13:26:24.756068 ip-10-0-140-186 systemd[1]: Started Kubernetes Kubelet. Jun 11 13:26:24.756705 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.756673 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-186.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 13:26:24.756705 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:24.756675 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 13:26:24.756925 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:24.756833 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-186.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 13:26:24.757650 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.757635 2563 server.go:310] "Adding debug handlers to kubelet server" Jun 11 13:26:24.757729 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.757697 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 13:26:24.762660 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:24.762633 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 13:26:24.763506 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:24.762624 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-186.ec2.internal.18b809c2c4cefd7d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-186.ec2.internal,UID:ip-10-0-140-186.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-186.ec2.internal,},FirstTimestamp:2026-06-11 13:26:24.755236221 +0000 UTC m=+0.323654543,LastTimestamp:2026-06-11 13:26:24.755236221 +0000 UTC m=+0.323654543,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-186.ec2.internal,}" Jun 11 13:26:24.766693 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.766679 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 13:26:24.766775 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.766694 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 13:26:24.766775 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:24.766756 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-186.ec2.internal\" not found" Jun 11 13:26:24.767318 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.767302 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 13:26:24.767318 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.767305 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 13:26:24.767318 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.767328 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 13:26:24.767477 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.767402 2563 reconstruct.go:97] "Volume reconstruction finished" Jun 11 13:26:24.767477 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.767412 2563 reconciler.go:29] "Reconciler: start to sync state" Jun 11 13:26:24.768123 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.768106 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 13:26:24.768217 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.768124 2563 factory.go:55] Registering systemd factory Jun 11 13:26:24.768217 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.768135 2563 factory.go:223] Registration of the systemd container factory successfully Jun 11 13:26:24.768449 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.768360 2563 factory.go:153] Registering CRI-O factory Jun 11 13:26:24.768449 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.768376 2563 factory.go:223] Registration of the crio container factory successfully Jun 11 13:26:24.768449 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.768397 2563 factory.go:103] Registering Raw factory Jun 11 13:26:24.768449 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.768410 2563 manager.go:1196] Started watching for new ooms in manager Jun 11 13:26:24.768746 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:24.768715 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-186.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 13:26:24.768934 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:24.768895 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 13:26:24.769260 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.769248 2563 manager.go:349] Starting recovery of all containers Jun 11 13:26:24.778788 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.778770 2563 manager.go:354] Recovery completed Jun 11 13:26:24.783104 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.783092 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 13:26:24.784801 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.784783 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientMemory" Jun 11 13:26:24.784860 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.784811 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 13:26:24.784860 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.784821 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientPID" Jun 11 13:26:24.785355 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.785338 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 13:26:24.785416 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.785358 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 13:26:24.785416 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.785361 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 13:26:24.785416 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.785377 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 11 13:26:24.785955 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.785942 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientMemory" Jun 11 13:26:24.786004 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.785966 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 13:26:24.786004 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.785975 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientPID" Jun 11 13:26:24.786526 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.786515 2563 policy_none.go:49] "None policy: Start" Jun 11 13:26:24.786559 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.786530 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 13:26:24.786559 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.786539 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 13:26:24.787350 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.787341 2563 policy_none.go:47] "Start" Jun 11 13:26:24.787751 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.787736 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cwrhb" Jun 11 13:26:24.795417 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.795397 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cwrhb" Jun 11 13:26:24.795486 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:24.795399 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-186.ec2.internal.18b809c2c6921826 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-186.ec2.internal,UID:ip-10-0-140-186.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-186.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-186.ec2.internal,},FirstTimestamp:2026-06-11 13:26:24.784799782 +0000 UTC m=+0.353218102,LastTimestamp:2026-06-11 13:26:24.784799782 +0000 UTC m=+0.353218102,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-186.ec2.internal,}" Jun 11 13:26:24.816609 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.816596 2563 manager.go:337] "Starting Device Plugin manager" Jun 11 13:26:24.816677 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:24.816637 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 13:26:24.816677 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.816647 2563 server.go:87] "Starting device plugin registration server" Jun 11 13:26:24.816885 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.816873 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 13:26:24.816932 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.816889 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 13:26:24.817037 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.817019 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 13:26:24.817142 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.817119 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 13:26:24.817142 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.817128 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 13:26:24.817462 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:24.817437 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 13:26:24.817537 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:24.817488 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-186.ec2.internal\" not found" Jun 11 13:26:24.838898 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.838877 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 13:26:24.840121 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.840105 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 13:26:24.840195 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.840150 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 13:26:24.840195 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.840172 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 13:26:24.840270 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:24.840208 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 13:26:24.842404 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.842388 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 13:26:24.917599 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.917571 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 13:26:24.918264 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.918251 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientMemory" Jun 11 13:26:24.918321 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.918278 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 13:26:24.918321 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.918294 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientPID" Jun 11 13:26:24.918321 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.918313 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-186.ec2.internal" Jun 11 13:26:24.927824 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.927785 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-186.ec2.internal" Jun 11 13:26:24.927824 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:24.927804 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-186.ec2.internal\": node \"ip-10-0-140-186.ec2.internal\" not found" Jun 11 13:26:24.940586 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.940567 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-186.ec2.internal"] Jun 11 13:26:24.940658 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.940615 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 13:26:24.941650 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.941633 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientMemory" Jun 11 13:26:24.941735 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.941662 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 13:26:24.941735 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.941675 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientPID" Jun 11 13:26:24.942701 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.942686 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 13:26:24.942779 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.942758 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal" Jun 11 13:26:24.942823 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.942786 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 13:26:24.943331 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.943318 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientMemory" Jun 11 13:26:24.943401 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.943340 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientMemory" Jun 11 13:26:24.943401 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.943364 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 13:26:24.943401 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.943374 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientPID" Jun 11 13:26:24.943539 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.943344 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 13:26:24.943539 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.943444 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientPID" Jun 11 13:26:24.944524 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.944509 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-186.ec2.internal" Jun 11 13:26:24.944601 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.944537 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 13:26:24.945467 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.945451 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientMemory" Jun 11 13:26:24.945536 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.945477 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 13:26:24.945536 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.945486 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientPID" Jun 11 13:26:24.964105 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:24.964084 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-186.ec2.internal\" not found" Jun 11 13:26:24.969384 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.969367 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce578246f2dac87eebf5b94bf718ad67-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal\" (UID: \"ce578246f2dac87eebf5b94bf718ad67\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal" Jun 11 13:26:24.969458 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.969398 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/98f8e857b61fd5c153132da526b56dd7-config\") pod \"kube-apiserver-proxy-ip-10-0-140-186.ec2.internal\" (UID: \"98f8e857b61fd5c153132da526b56dd7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-186.ec2.internal" Jun 11 13:26:24.969458 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:24.969425 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ce578246f2dac87eebf5b94bf718ad67-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal\" (UID: \"ce578246f2dac87eebf5b94bf718ad67\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal" Jun 11 13:26:24.970662 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:24.970632 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-186.ec2.internal\" not found" node="ip-10-0-140-186.ec2.internal" Jun 11 13:26:24.974860 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:24.974844 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-186.ec2.internal\" not found" node="ip-10-0-140-186.ec2.internal" Jun 11 13:26:25.064640 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:25.064625 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-186.ec2.internal\" not found" Jun 11 13:26:25.069931 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:25.069917 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce578246f2dac87eebf5b94bf718ad67-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal\" (UID: \"ce578246f2dac87eebf5b94bf718ad67\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal" Jun 11 13:26:25.069993 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:25.069943 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/98f8e857b61fd5c153132da526b56dd7-config\") pod \"kube-apiserver-proxy-ip-10-0-140-186.ec2.internal\" (UID: \"98f8e857b61fd5c153132da526b56dd7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-186.ec2.internal" Jun 11 13:26:25.069993 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:25.069958 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ce578246f2dac87eebf5b94bf718ad67-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal\" (UID: \"ce578246f2dac87eebf5b94bf718ad67\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal" Jun 11 13:26:25.069993 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:25.069981 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ce578246f2dac87eebf5b94bf718ad67-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal\" (UID: \"ce578246f2dac87eebf5b94bf718ad67\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal" Jun 11 13:26:25.070122 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:25.070010 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce578246f2dac87eebf5b94bf718ad67-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal\" (UID: \"ce578246f2dac87eebf5b94bf718ad67\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal" Jun 11 13:26:25.070122 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:25.070015 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/98f8e857b61fd5c153132da526b56dd7-config\") pod \"kube-apiserver-proxy-ip-10-0-140-186.ec2.internal\" (UID: \"98f8e857b61fd5c153132da526b56dd7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-186.ec2.internal" Jun 11 13:26:25.165259 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:25.165232 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-186.ec2.internal\" not found" Jun 11 13:26:25.265942 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:25.265919 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-186.ec2.internal\" not found" Jun 11 13:26:25.276362 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:25.276345 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal" Jun 11 13:26:25.279533 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:25.279519 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-186.ec2.internal" Jun 11 13:26:25.366333 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:25.366300 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-186.ec2.internal\" not found" Jun 11 13:26:25.466750 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:25.466717 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-186.ec2.internal\" not found" Jun 11 13:26:25.567183 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:25.567111 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-186.ec2.internal\" not found" Jun 11 13:26:25.667650 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:25.667628 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-186.ec2.internal\" not found" Jun 11 13:26:25.694972 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:25.694946 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 13:26:25.695517 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:25.695095 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 13:26:25.768721 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:25.768692 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-186.ec2.internal\" not found" Jun 11 13:26:25.797383 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:25.797354 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 13:21:24 +0000 UTC" deadline="2027-11-04 18:11:52.416527863 +0000 UTC" Jun 11 13:26:25.797383 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:25.797380 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12268h45m26.619150714s" Jun 11 13:26:25.836246 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:25.836211 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce578246f2dac87eebf5b94bf718ad67.slice/crio-df570b57684fcca773a208ce149ee8b1f8c61a5ae853b87ea73cc8a54b3627ed WatchSource:0}: Error finding container df570b57684fcca773a208ce149ee8b1f8c61a5ae853b87ea73cc8a54b3627ed: Status 404 returned error can't find the container with id df570b57684fcca773a208ce149ee8b1f8c61a5ae853b87ea73cc8a54b3627ed Jun 11 13:26:25.836427 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:25.836416 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98f8e857b61fd5c153132da526b56dd7.slice/crio-43115eb492617feeb8430502fb89ba0315a442451b0e41c2900972d44fd0118e WatchSource:0}: Error finding container 43115eb492617feeb8430502fb89ba0315a442451b0e41c2900972d44fd0118e: Status 404 returned error can't find the container with id 43115eb492617feeb8430502fb89ba0315a442451b0e41c2900972d44fd0118e Jun 11 13:26:25.839634 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:25.839618 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 13:26:25.843435 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:25.843399 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-186.ec2.internal" event={"ID":"98f8e857b61fd5c153132da526b56dd7","Type":"ContainerStarted","Data":"43115eb492617feeb8430502fb89ba0315a442451b0e41c2900972d44fd0118e"} Jun 11 13:26:25.844419 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:25.844400 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal" event={"ID":"ce578246f2dac87eebf5b94bf718ad67","Type":"ContainerStarted","Data":"df570b57684fcca773a208ce149ee8b1f8c61a5ae853b87ea73cc8a54b3627ed"} Jun 11 13:26:25.869561 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:25.869538 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-186.ec2.internal\" not found" Jun 11 13:26:25.905765 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:25.905747 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 13:26:25.906509 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:25.906496 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientMemory" Jun 11 13:26:25.906573 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:25.906522 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 13:26:25.906573 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:25.906536 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeHasSufficientPID" Jun 11 13:26:25.970479 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:25.970459 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-186.ec2.internal\" not found" Jun 11 13:26:25.980764 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:25.980742 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 13:26:26.064071 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.064038 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 13:26:26.071306 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:26.071289 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-186.ec2.internal\" not found" Jun 11 13:26:26.095008 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.094970 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 13:26:26.167576 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.167552 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal" Jun 11 13:26:26.183819 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.183799 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 13:26:26.184820 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.184806 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-186.ec2.internal" Jun 11 13:26:26.191843 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.191829 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 13:26:26.742302 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.742273 2563 apiserver.go:52] "Watching apiserver" Jun 11 13:26:26.748399 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.748376 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 13:26:26.748800 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.748769 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-9dk9k","openshift-multus/multus-additional-cni-plugins-5wltr","openshift-multus/multus-qh4rj","openshift-network-diagnostics/network-check-target-svdx4","openshift-network-operator/iptables-alerter-j9vjz","kube-system/global-pull-secret-syncer-kjtlg","kube-system/kube-apiserver-proxy-ip-10-0-140-186.ec2.internal","openshift-dns/node-resolver-swccc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal","openshift-multus/network-metrics-daemon-698v8","openshift-ovn-kubernetes/ovnkube-node-87tcg","kube-system/konnectivity-agent-f4sfh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt","openshift-cluster-node-tuning-operator/tuned-phwdp"] Jun 11 13:26:26.750368 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.750349 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:26:26.750509 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:26.750423 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svdx4" podUID="12885b90-19b5-4c6f-838e-22cc394e21db" Jun 11 13:26:26.751147 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.751124 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f4sfh" Jun 11 13:26:26.752230 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.752207 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j9vjz" Jun 11 13:26:26.753332 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.753312 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:26.753422 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:26.753379 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698v8" podUID="dbcbad68-5014-4dbd-99f2-087716f10a31" Jun 11 13:26:26.753970 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.753950 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pzgc9\"" Jun 11 13:26:26.754095 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.754075 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 13:26:26.754486 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.754470 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.756127 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.756108 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:26.756284 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:26.756173 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtlg" podUID="7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6" Jun 11 13:26:26.757038 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.756721 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-swccc" Jun 11 13:26:26.757434 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.757282 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 13:26:26.757434 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.757366 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 13:26:26.759208 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.758505 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9dk9k" Jun 11 13:26:26.759208 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.759008 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 13:26:26.760109 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.759865 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 13:26:26.760244 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.760191 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 13:26:26.763777 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.761868 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 13:26:26.763777 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.761920 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ppqj2\"" Jun 11 13:26:26.763777 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.762116 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 13:26:26.763777 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.762153 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 13:26:26.763777 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.762426 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 13:26:26.763777 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.762494 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 13:26:26.763777 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.762617 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sm767\"" Jun 11 13:26:26.763777 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.762712 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z68sh\"" Jun 11 13:26:26.763777 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.762933 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.763777 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.762970 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 13:26:26.763777 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.762933 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:26.763777 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.763678 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hv4sn\"" Jun 11 13:26:26.764573 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.764553 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" Jun 11 13:26:26.766170 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.766152 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.767681 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.767665 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 13:26:26.768271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.768122 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 13:26:26.769393 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.769376 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 13:26:26.774620 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.774600 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 13:26:26.775306 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.775287 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 13:26:26.785248 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.785227 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-tmp\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.785364 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.785269 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-multus-conf-dir\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.785364 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.785295 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-etc-kubernetes\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.785364 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.785322 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-host-run-netns\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.785364 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.785356 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/888b6b6d-8d77-4bb0-b0a7-b39b44262482-multus-daemon-config\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.785545 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.785384 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-dbus\") pod \"global-pull-secret-syncer-kjtlg\" (UID: \"7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6\") " pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:26.785545 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.785391 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bjjsn\"" Jun 11 13:26:26.785545 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.785408 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 13:26:26.785545 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.785410 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-run-systemd\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.785545 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.785443 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-node-log\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.785545 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.785475 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz9kq\" (UniqueName: \"kubernetes.io/projected/28b20342-2058-4e26-8ccd-16757e486809-kube-api-access-nz9kq\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.785545 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.785504 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-sys\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.785545 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.785532 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c6ad6978-e1a9-4aa8-8aaa-48b7d29f1ab1-host-slash\") pod \"iptables-alerter-j9vjz\" (UID: \"c6ad6978-e1a9-4aa8-8aaa-48b7d29f1ab1\") " pod="openshift-network-operator/iptables-alerter-j9vjz" Jun 11 13:26:26.785891 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.785561 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-log-socket\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.785891 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.785586 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-host-cni-netd\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.785891 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.785617 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/28b20342-2058-4e26-8ccd-16757e486809-ovnkube-script-lib\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.785891 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.785646 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b28aec9e-b169-4afe-922d-11bb294e0e33-socket-dir\") pod \"aws-ebs-csi-driver-node-jmtbt\" (UID: \"b28aec9e-b169-4afe-922d-11bb294e0e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" Jun 11 13:26:26.785891 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.785676 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b28aec9e-b169-4afe-922d-11bb294e0e33-etc-selinux\") pod \"aws-ebs-csi-driver-node-jmtbt\" (UID: \"b28aec9e-b169-4afe-922d-11bb294e0e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" Jun 11 13:26:26.785891 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.785681 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 13:26:26.785891 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.785701 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/50d20acf-e30a-41ef-871b-b8adc1ff8a0a-serviceca\") pod \"node-ca-9dk9k\" (UID: \"50d20acf-e30a-41ef-871b-b8adc1ff8a0a\") " pod="openshift-image-registry/node-ca-9dk9k" Jun 11 13:26:26.785891 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.785737 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-etc-modprobe-d\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.786322 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.785899 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/888b6b6d-8d77-4bb0-b0a7-b39b44262482-cni-binary-copy\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.786322 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.785934 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 13:26:26.786322 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.785961 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-original-pull-secret\") pod \"global-pull-secret-syncer-kjtlg\" (UID: \"7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6\") " pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:26.786322 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.785966 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 13:26:26.786322 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.786012 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b28aec9e-b169-4afe-922d-11bb294e0e33-device-dir\") pod \"aws-ebs-csi-driver-node-jmtbt\" (UID: \"b28aec9e-b169-4afe-922d-11bb294e0e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" Jun 11 13:26:26.786322 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.786084 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3070766-1adb-409f-843f-8867c2861723-cni-binary-copy\") pod \"multus-additional-cni-plugins-5wltr\" (UID: \"e3070766-1adb-409f-843f-8867c2861723\") " pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:26.786322 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.786120 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/62ccca45-38fd-48eb-85b9-563e624328b5-konnectivity-ca\") pod \"konnectivity-agent-f4sfh\" (UID: \"62ccca45-38fd-48eb-85b9-563e624328b5\") " pod="kube-system/konnectivity-agent-f4sfh" Jun 11 13:26:26.786322 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.786165 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-host-kubelet\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.786322 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.786195 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/28b20342-2058-4e26-8ccd-16757e486809-ovnkube-config\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.786322 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.786227 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50d20acf-e30a-41ef-871b-b8adc1ff8a0a-host\") pod \"node-ca-9dk9k\" (UID: \"50d20acf-e30a-41ef-871b-b8adc1ff8a0a\") " pod="openshift-image-registry/node-ca-9dk9k" Jun 11 13:26:26.786322 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.786253 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-run\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.786322 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.786302 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-host-run-k8s-cni-cncf-io\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.786863 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.786352 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-host-var-lib-cni-bin\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.786863 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.786384 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-etc-openvswitch\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.786863 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.786408 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b28aec9e-b169-4afe-922d-11bb294e0e33-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jmtbt\" (UID: \"b28aec9e-b169-4afe-922d-11bb294e0e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" Jun 11 13:26:26.786863 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.786446 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-etc-tuned\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.786863 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.786498 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b28aec9e-b169-4afe-922d-11bb294e0e33-sys-fs\") pod \"aws-ebs-csi-driver-node-jmtbt\" (UID: \"b28aec9e-b169-4afe-922d-11bb294e0e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" Jun 11 13:26:26.786863 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.786557 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-etc-kubernetes\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.786863 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.786602 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-os-release\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.786863 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.786690 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-host-run-netns\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.786863 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.786730 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-host-var-lib-cni-multus\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.786863 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.786779 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-host-var-lib-kubelet\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.786863 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.786809 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e3070766-1adb-409f-843f-8867c2861723-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5wltr\" (UID: \"e3070766-1adb-409f-843f-8867c2861723\") " pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:26.786863 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.786845 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzf5q\" (UniqueName: \"kubernetes.io/projected/c6ad6978-e1a9-4aa8-8aaa-48b7d29f1ab1-kube-api-access-kzf5q\") pod \"iptables-alerter-j9vjz\" (UID: \"c6ad6978-e1a9-4aa8-8aaa-48b7d29f1ab1\") " pod="openshift-network-operator/iptables-alerter-j9vjz" Jun 11 13:26:26.787413 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.786884 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs\") pod \"network-metrics-daemon-698v8\" (UID: \"dbcbad68-5014-4dbd-99f2-087716f10a31\") " pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:26.787413 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.786921 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c6ad6978-e1a9-4aa8-8aaa-48b7d29f1ab1-iptables-alerter-script\") pod \"iptables-alerter-j9vjz\" (UID: \"c6ad6978-e1a9-4aa8-8aaa-48b7d29f1ab1\") " pod="openshift-network-operator/iptables-alerter-j9vjz" Jun 11 13:26:26.787413 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.786955 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-hostroot\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.787413 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.786983 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-host-run-multus-certs\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.787413 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787007 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-var-lib-openvswitch\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.787413 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787061 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-host-run-ovn-kubernetes\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.787413 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787092 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f047a728-0ff9-4b65-ba9d-7dfcacb808f4-tmp-dir\") pod \"node-resolver-swccc\" (UID: \"f047a728-0ff9-4b65-ba9d-7dfcacb808f4\") " pod="openshift-dns/node-resolver-swccc" Jun 11 13:26:26.787413 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787121 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e3070766-1adb-409f-843f-8867c2861723-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5wltr\" (UID: \"e3070766-1adb-409f-843f-8867c2861723\") " pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:26.787413 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787151 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-lib-modules\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.787413 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787173 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-host\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.787413 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787222 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/62ccca45-38fd-48eb-85b9-563e624328b5-agent-certs\") pod \"konnectivity-agent-f4sfh\" (UID: \"62ccca45-38fd-48eb-85b9-563e624328b5\") " pod="kube-system/konnectivity-agent-f4sfh" Jun 11 13:26:26.787413 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787250 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-run-openvswitch\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.787413 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787280 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3070766-1adb-409f-843f-8867c2861723-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5wltr\" (UID: \"e3070766-1adb-409f-843f-8867c2861723\") " pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:26.787413 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787314 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6pml\" (UniqueName: \"kubernetes.io/projected/50d20acf-e30a-41ef-871b-b8adc1ff8a0a-kube-api-access-c6pml\") pod \"node-ca-9dk9k\" (UID: \"50d20acf-e30a-41ef-871b-b8adc1ff8a0a\") " pod="openshift-image-registry/node-ca-9dk9k" Jun 11 13:26:26.787413 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787389 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-system-cni-dir\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.787413 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787402 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 13:26:26.787413 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787420 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pzqv\" (UniqueName: \"kubernetes.io/projected/888b6b6d-8d77-4bb0-b0a7-b39b44262482-kube-api-access-7pzqv\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.788271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787463 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-kubelet-config\") pod \"global-pull-secret-syncer-kjtlg\" (UID: \"7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6\") " pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:26.788271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787500 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-systemd-units\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.788271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787528 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-run-ovn\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.788271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787554 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/28b20342-2058-4e26-8ccd-16757e486809-ovn-node-metrics-cert\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.788271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787610 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-etc-sysconfig\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.788271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787641 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-cnibin\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.788271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787671 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/28b20342-2058-4e26-8ccd-16757e486809-env-overrides\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.788271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787706 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8prwj\" (UniqueName: \"kubernetes.io/projected/dbcbad68-5014-4dbd-99f2-087716f10a31-kube-api-access-8prwj\") pod \"network-metrics-daemon-698v8\" (UID: \"dbcbad68-5014-4dbd-99f2-087716f10a31\") " pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:26.788271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787753 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8zxb\" (UniqueName: \"kubernetes.io/projected/f047a728-0ff9-4b65-ba9d-7dfcacb808f4-kube-api-access-q8zxb\") pod \"node-resolver-swccc\" (UID: \"f047a728-0ff9-4b65-ba9d-7dfcacb808f4\") " pod="openshift-dns/node-resolver-swccc" Jun 11 13:26:26.788271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787765 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 13:26:26.788271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787772 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3070766-1adb-409f-843f-8867c2861723-os-release\") pod \"multus-additional-cni-plugins-5wltr\" (UID: \"e3070766-1adb-409f-843f-8867c2861723\") " pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:26.788271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787791 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-etc-systemd\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.788271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787811 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-host-cni-bin\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.788271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787834 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 13:26:26.788271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787839 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttkvm\" (UniqueName: \"kubernetes.io/projected/12885b90-19b5-4c6f-838e-22cc394e21db-kube-api-access-ttkvm\") pod \"network-check-target-svdx4\" (UID: \"12885b90-19b5-4c6f-838e-22cc394e21db\") " pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:26:26.788271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787857 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4bss\" (UniqueName: \"kubernetes.io/projected/e3070766-1adb-409f-843f-8867c2861723-kube-api-access-q4bss\") pod \"multus-additional-cni-plugins-5wltr\" (UID: \"e3070766-1adb-409f-843f-8867c2861723\") " pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:26.788271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787876 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-etc-sysctl-conf\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.788862 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787894 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-multus-socket-dir-parent\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.788862 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787913 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.788862 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.787950 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg9zs\" (UniqueName: \"kubernetes.io/projected/b28aec9e-b169-4afe-922d-11bb294e0e33-kube-api-access-tg9zs\") pod \"aws-ebs-csi-driver-node-jmtbt\" (UID: \"b28aec9e-b169-4afe-922d-11bb294e0e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" Jun 11 13:26:26.788862 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.788007 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f047a728-0ff9-4b65-ba9d-7dfcacb808f4-hosts-file\") pod \"node-resolver-swccc\" (UID: \"f047a728-0ff9-4b65-ba9d-7dfcacb808f4\") " pod="openshift-dns/node-resolver-swccc" Jun 11 13:26:26.788862 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.788081 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3070766-1adb-409f-843f-8867c2861723-cnibin\") pod \"multus-additional-cni-plugins-5wltr\" (UID: \"e3070766-1adb-409f-843f-8867c2861723\") " pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:26.788862 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.788156 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj98v\" (UniqueName: \"kubernetes.io/projected/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-kube-api-access-vj98v\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.788862 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.788192 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-multus-cni-dir\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.788862 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.788222 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-host-slash\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.788862 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.788246 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b28aec9e-b169-4afe-922d-11bb294e0e33-registration-dir\") pod \"aws-ebs-csi-driver-node-jmtbt\" (UID: \"b28aec9e-b169-4afe-922d-11bb294e0e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" Jun 11 13:26:26.788862 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.788282 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3070766-1adb-409f-843f-8867c2861723-system-cni-dir\") pod \"multus-additional-cni-plugins-5wltr\" (UID: \"e3070766-1adb-409f-843f-8867c2861723\") " pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:26.788862 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.788303 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-etc-sysctl-d\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.788862 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.788319 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-var-lib-kubelet\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.790444 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.789873 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 13:26:26.793509 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.791844 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 13:26:26.793509 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.792002 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wd5mc\"" Jun 11 13:26:26.793509 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.792429 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wjhb8\"" Jun 11 13:26:26.793509 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.792625 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-25l8t\"" Jun 11 13:26:26.793509 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.792778 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 13:26:26.793509 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.792957 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 13:26:26.793509 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.793201 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 13:26:26.822653 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.822407 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 13:26:26.827483 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.827228 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 13:26:26.883630 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.883607 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xksb5" Jun 11 13:26:26.888535 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888511 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-multus-cni-dir\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.888639 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888542 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-host-slash\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.888639 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888566 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b28aec9e-b169-4afe-922d-11bb294e0e33-registration-dir\") pod \"aws-ebs-csi-driver-node-jmtbt\" (UID: \"b28aec9e-b169-4afe-922d-11bb294e0e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" Jun 11 13:26:26.888639 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888582 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-multus-cni-dir\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.888639 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888589 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3070766-1adb-409f-843f-8867c2861723-system-cni-dir\") pod \"multus-additional-cni-plugins-5wltr\" (UID: \"e3070766-1adb-409f-843f-8867c2861723\") " pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:26.888639 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888610 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-etc-sysctl-d\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.888639 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888625 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-host-slash\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.888639 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888634 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-var-lib-kubelet\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.888933 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888644 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b28aec9e-b169-4afe-922d-11bb294e0e33-registration-dir\") pod \"aws-ebs-csi-driver-node-jmtbt\" (UID: \"b28aec9e-b169-4afe-922d-11bb294e0e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" Jun 11 13:26:26.888933 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888656 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-tmp\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.888933 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888671 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3070766-1adb-409f-843f-8867c2861723-system-cni-dir\") pod \"multus-additional-cni-plugins-5wltr\" (UID: \"e3070766-1adb-409f-843f-8867c2861723\") " pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:26.888933 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888679 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-multus-conf-dir\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.888933 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888698 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-etc-kubernetes\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.888933 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888709 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-var-lib-kubelet\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.888933 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888720 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-host-run-netns\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.888933 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888753 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-multus-conf-dir\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.888933 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888760 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-etc-sysctl-d\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.888933 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888761 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-host-run-netns\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.888933 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888774 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/888b6b6d-8d77-4bb0-b0a7-b39b44262482-multus-daemon-config\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.888933 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888791 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-dbus\") pod \"global-pull-secret-syncer-kjtlg\" (UID: \"7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6\") " pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:26.888933 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888792 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-etc-kubernetes\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.888933 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888806 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-run-systemd\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.888933 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888819 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-node-log\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.888933 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888835 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz9kq\" (UniqueName: \"kubernetes.io/projected/28b20342-2058-4e26-8ccd-16757e486809-kube-api-access-nz9kq\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.888933 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888850 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-sys\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.888933 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888879 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-node-log\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.889747 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888919 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-run-systemd\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.889747 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.888976 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-sys\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.889747 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889076 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 13:26:26.889747 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889125 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-dbus\") pod \"global-pull-secret-syncer-kjtlg\" (UID: \"7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6\") " pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:26.889747 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889159 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c6ad6978-e1a9-4aa8-8aaa-48b7d29f1ab1-host-slash\") pod \"iptables-alerter-j9vjz\" (UID: \"c6ad6978-e1a9-4aa8-8aaa-48b7d29f1ab1\") " pod="openshift-network-operator/iptables-alerter-j9vjz" Jun 11 13:26:26.889747 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889188 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-log-socket\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.889747 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889212 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-host-cni-netd\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.889747 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889235 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/28b20342-2058-4e26-8ccd-16757e486809-ovnkube-script-lib\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.889747 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889267 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b28aec9e-b169-4afe-922d-11bb294e0e33-socket-dir\") pod \"aws-ebs-csi-driver-node-jmtbt\" (UID: \"b28aec9e-b169-4afe-922d-11bb294e0e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" Jun 11 13:26:26.889747 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889290 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b28aec9e-b169-4afe-922d-11bb294e0e33-etc-selinux\") pod \"aws-ebs-csi-driver-node-jmtbt\" (UID: \"b28aec9e-b169-4afe-922d-11bb294e0e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" Jun 11 13:26:26.889747 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889331 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/50d20acf-e30a-41ef-871b-b8adc1ff8a0a-serviceca\") pod \"node-ca-9dk9k\" (UID: \"50d20acf-e30a-41ef-871b-b8adc1ff8a0a\") " pod="openshift-image-registry/node-ca-9dk9k" Jun 11 13:26:26.889747 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889353 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/888b6b6d-8d77-4bb0-b0a7-b39b44262482-multus-daemon-config\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.889747 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889373 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-etc-modprobe-d\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.889747 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889373 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-host-cni-netd\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.889747 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889399 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/888b6b6d-8d77-4bb0-b0a7-b39b44262482-cni-binary-copy\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.889747 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889414 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c6ad6978-e1a9-4aa8-8aaa-48b7d29f1ab1-host-slash\") pod \"iptables-alerter-j9vjz\" (UID: \"c6ad6978-e1a9-4aa8-8aaa-48b7d29f1ab1\") " pod="openshift-network-operator/iptables-alerter-j9vjz" Jun 11 13:26:26.889747 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889425 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-original-pull-secret\") pod \"global-pull-secret-syncer-kjtlg\" (UID: \"7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6\") " pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:26.889747 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889440 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b28aec9e-b169-4afe-922d-11bb294e0e33-socket-dir\") pod \"aws-ebs-csi-driver-node-jmtbt\" (UID: \"b28aec9e-b169-4afe-922d-11bb294e0e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" Jun 11 13:26:26.890553 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889453 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-log-socket\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.890553 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889465 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b28aec9e-b169-4afe-922d-11bb294e0e33-device-dir\") pod \"aws-ebs-csi-driver-node-jmtbt\" (UID: \"b28aec9e-b169-4afe-922d-11bb294e0e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" Jun 11 13:26:26.890553 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889491 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3070766-1adb-409f-843f-8867c2861723-cni-binary-copy\") pod \"multus-additional-cni-plugins-5wltr\" (UID: \"e3070766-1adb-409f-843f-8867c2861723\") " pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:26.890553 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889517 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/62ccca45-38fd-48eb-85b9-563e624328b5-konnectivity-ca\") pod \"konnectivity-agent-f4sfh\" (UID: \"62ccca45-38fd-48eb-85b9-563e624328b5\") " pod="kube-system/konnectivity-agent-f4sfh" Jun 11 13:26:26.890553 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889540 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-etc-modprobe-d\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.890553 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889576 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-host-kubelet\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.890553 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889584 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b28aec9e-b169-4afe-922d-11bb294e0e33-device-dir\") pod \"aws-ebs-csi-driver-node-jmtbt\" (UID: \"b28aec9e-b169-4afe-922d-11bb294e0e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" Jun 11 13:26:26.890553 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:26.889589 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 13:26:26.890553 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889621 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b28aec9e-b169-4afe-922d-11bb294e0e33-etc-selinux\") pod \"aws-ebs-csi-driver-node-jmtbt\" (UID: \"b28aec9e-b169-4afe-922d-11bb294e0e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" Jun 11 13:26:26.890553 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889540 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-host-kubelet\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.890553 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:26.889691 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-original-pull-secret podName:7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6 nodeName:}" failed. No retries permitted until 2026-06-11 13:26:27.389638186 +0000 UTC m=+2.958056505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-original-pull-secret") pod "global-pull-secret-syncer-kjtlg" (UID: "7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6") : object "kube-system"/"original-pull-secret" not registered Jun 11 13:26:26.890553 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889712 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/28b20342-2058-4e26-8ccd-16757e486809-ovnkube-config\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.890553 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889737 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50d20acf-e30a-41ef-871b-b8adc1ff8a0a-host\") pod \"node-ca-9dk9k\" (UID: \"50d20acf-e30a-41ef-871b-b8adc1ff8a0a\") " pod="openshift-image-registry/node-ca-9dk9k" Jun 11 13:26:26.890553 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889759 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-run\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.890553 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889776 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/28b20342-2058-4e26-8ccd-16757e486809-ovnkube-script-lib\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.890553 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889786 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-host-run-k8s-cni-cncf-io\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.890553 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.889831 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-host-run-k8s-cni-cncf-io\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.891298 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890141 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/62ccca45-38fd-48eb-85b9-563e624328b5-konnectivity-ca\") pod \"konnectivity-agent-f4sfh\" (UID: \"62ccca45-38fd-48eb-85b9-563e624328b5\") " pod="kube-system/konnectivity-agent-f4sfh" Jun 11 13:26:26.891298 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890178 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3070766-1adb-409f-843f-8867c2861723-cni-binary-copy\") pod \"multus-additional-cni-plugins-5wltr\" (UID: \"e3070766-1adb-409f-843f-8867c2861723\") " pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:26.891298 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890205 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-host-var-lib-cni-bin\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.891298 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890183 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-host-var-lib-cni-bin\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.891298 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890229 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-etc-openvswitch\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.891298 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890254 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-etc-openvswitch\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.891298 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890282 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/50d20acf-e30a-41ef-871b-b8adc1ff8a0a-serviceca\") pod \"node-ca-9dk9k\" (UID: \"50d20acf-e30a-41ef-871b-b8adc1ff8a0a\") " pod="openshift-image-registry/node-ca-9dk9k" Jun 11 13:26:26.891298 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890343 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50d20acf-e30a-41ef-871b-b8adc1ff8a0a-host\") pod \"node-ca-9dk9k\" (UID: \"50d20acf-e30a-41ef-871b-b8adc1ff8a0a\") " pod="openshift-image-registry/node-ca-9dk9k" Jun 11 13:26:26.891298 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890398 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-run\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.891298 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890400 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b28aec9e-b169-4afe-922d-11bb294e0e33-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jmtbt\" (UID: \"b28aec9e-b169-4afe-922d-11bb294e0e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" Jun 11 13:26:26.891298 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890450 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b28aec9e-b169-4afe-922d-11bb294e0e33-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jmtbt\" (UID: \"b28aec9e-b169-4afe-922d-11bb294e0e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" Jun 11 13:26:26.891298 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890487 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-etc-tuned\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.891298 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890515 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b28aec9e-b169-4afe-922d-11bb294e0e33-sys-fs\") pod \"aws-ebs-csi-driver-node-jmtbt\" (UID: \"b28aec9e-b169-4afe-922d-11bb294e0e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" Jun 11 13:26:26.891298 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890535 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/28b20342-2058-4e26-8ccd-16757e486809-ovnkube-config\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.891298 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890538 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-etc-kubernetes\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.891298 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890578 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/888b6b6d-8d77-4bb0-b0a7-b39b44262482-cni-binary-copy\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.891298 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890573 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-etc-kubernetes\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.891298 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890582 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-os-release\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.892353 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890631 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-host-run-netns\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.892353 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890633 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-os-release\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.892353 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890636 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b28aec9e-b169-4afe-922d-11bb294e0e33-sys-fs\") pod \"aws-ebs-csi-driver-node-jmtbt\" (UID: \"b28aec9e-b169-4afe-922d-11bb294e0e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" Jun 11 13:26:26.892353 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890665 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-host-var-lib-cni-multus\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.892353 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890677 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-host-run-netns\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.892353 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890689 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-host-var-lib-kubelet\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.892353 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890714 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e3070766-1adb-409f-843f-8867c2861723-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5wltr\" (UID: \"e3070766-1adb-409f-843f-8867c2861723\") " pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:26.892353 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890737 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-host-var-lib-kubelet\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.892353 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890742 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzf5q\" (UniqueName: \"kubernetes.io/projected/c6ad6978-e1a9-4aa8-8aaa-48b7d29f1ab1-kube-api-access-kzf5q\") pod \"iptables-alerter-j9vjz\" (UID: \"c6ad6978-e1a9-4aa8-8aaa-48b7d29f1ab1\") " pod="openshift-network-operator/iptables-alerter-j9vjz" Jun 11 13:26:26.892353 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890716 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-host-var-lib-cni-multus\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.892353 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890776 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs\") pod \"network-metrics-daemon-698v8\" (UID: \"dbcbad68-5014-4dbd-99f2-087716f10a31\") " pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:26.892353 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890801 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c6ad6978-e1a9-4aa8-8aaa-48b7d29f1ab1-iptables-alerter-script\") pod \"iptables-alerter-j9vjz\" (UID: \"c6ad6978-e1a9-4aa8-8aaa-48b7d29f1ab1\") " pod="openshift-network-operator/iptables-alerter-j9vjz" Jun 11 13:26:26.892353 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890824 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-hostroot\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.892353 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890845 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-host-run-multus-certs\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.892353 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:26.890852 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:26:26.892353 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890866 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-var-lib-openvswitch\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.892353 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:26.890896 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs podName:dbcbad68-5014-4dbd-99f2-087716f10a31 nodeName:}" failed. No retries permitted until 2026-06-11 13:26:27.39088036 +0000 UTC m=+2.959298668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs") pod "network-metrics-daemon-698v8" (UID: "dbcbad68-5014-4dbd-99f2-087716f10a31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:26:26.893215 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890917 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-host-run-ovn-kubernetes\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.893215 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890947 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f047a728-0ff9-4b65-ba9d-7dfcacb808f4-tmp-dir\") pod \"node-resolver-swccc\" (UID: \"f047a728-0ff9-4b65-ba9d-7dfcacb808f4\") " pod="openshift-dns/node-resolver-swccc" Jun 11 13:26:26.893215 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890985 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e3070766-1adb-409f-843f-8867c2861723-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5wltr\" (UID: \"e3070766-1adb-409f-843f-8867c2861723\") " pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:26.893215 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891006 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-host-run-ovn-kubernetes\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.893215 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891010 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-lib-modules\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.893215 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891072 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-host\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.893215 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891039 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-hostroot\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.893215 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891099 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/62ccca45-38fd-48eb-85b9-563e624328b5-agent-certs\") pod \"konnectivity-agent-f4sfh\" (UID: \"62ccca45-38fd-48eb-85b9-563e624328b5\") " pod="kube-system/konnectivity-agent-f4sfh" Jun 11 13:26:26.893215 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891157 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e3070766-1adb-409f-843f-8867c2861723-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5wltr\" (UID: \"e3070766-1adb-409f-843f-8867c2861723\") " pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:26.893215 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.890920 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-var-lib-openvswitch\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.893215 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891159 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-run-openvswitch\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.893215 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891188 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-run-openvswitch\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.893215 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891212 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3070766-1adb-409f-843f-8867c2861723-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5wltr\" (UID: \"e3070766-1adb-409f-843f-8867c2861723\") " pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:26.893215 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891232 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-host-run-multus-certs\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.893215 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891235 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6pml\" (UniqueName: \"kubernetes.io/projected/50d20acf-e30a-41ef-871b-b8adc1ff8a0a-kube-api-access-c6pml\") pod \"node-ca-9dk9k\" (UID: \"50d20acf-e30a-41ef-871b-b8adc1ff8a0a\") " pod="openshift-image-registry/node-ca-9dk9k" Jun 11 13:26:26.893215 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891262 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-system-cni-dir\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.893215 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891289 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pzqv\" (UniqueName: \"kubernetes.io/projected/888b6b6d-8d77-4bb0-b0a7-b39b44262482-kube-api-access-7pzqv\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.893816 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891314 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-kubelet-config\") pod \"global-pull-secret-syncer-kjtlg\" (UID: \"7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6\") " pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:26.893816 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891337 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-systemd-units\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.893816 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891362 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-run-ovn\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.893816 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891387 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/28b20342-2058-4e26-8ccd-16757e486809-ovn-node-metrics-cert\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.893816 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891407 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c6ad6978-e1a9-4aa8-8aaa-48b7d29f1ab1-iptables-alerter-script\") pod \"iptables-alerter-j9vjz\" (UID: \"c6ad6978-e1a9-4aa8-8aaa-48b7d29f1ab1\") " pod="openshift-network-operator/iptables-alerter-j9vjz" Jun 11 13:26:26.893816 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891417 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f047a728-0ff9-4b65-ba9d-7dfcacb808f4-tmp-dir\") pod \"node-resolver-swccc\" (UID: \"f047a728-0ff9-4b65-ba9d-7dfcacb808f4\") " pod="openshift-dns/node-resolver-swccc" Jun 11 13:26:26.893816 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891515 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-host\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.893816 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891515 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3070766-1adb-409f-843f-8867c2861723-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5wltr\" (UID: \"e3070766-1adb-409f-843f-8867c2861723\") " pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:26.893816 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891536 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-etc-sysconfig\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.893816 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891119 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-lib-modules\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.893816 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891562 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-cnibin\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.893816 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891585 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/28b20342-2058-4e26-8ccd-16757e486809-env-overrides\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.893816 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891599 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-system-cni-dir\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.893816 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891609 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8prwj\" (UniqueName: \"kubernetes.io/projected/dbcbad68-5014-4dbd-99f2-087716f10a31-kube-api-access-8prwj\") pod \"network-metrics-daemon-698v8\" (UID: \"dbcbad68-5014-4dbd-99f2-087716f10a31\") " pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:26.893816 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891636 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8zxb\" (UniqueName: \"kubernetes.io/projected/f047a728-0ff9-4b65-ba9d-7dfcacb808f4-kube-api-access-q8zxb\") pod \"node-resolver-swccc\" (UID: \"f047a728-0ff9-4b65-ba9d-7dfcacb808f4\") " pod="openshift-dns/node-resolver-swccc" Jun 11 13:26:26.893816 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891660 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3070766-1adb-409f-843f-8867c2861723-os-release\") pod \"multus-additional-cni-plugins-5wltr\" (UID: \"e3070766-1adb-409f-843f-8867c2861723\") " pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:26.893816 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891682 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-etc-systemd\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.894442 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891703 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-host-cni-bin\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.894442 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891726 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttkvm\" (UniqueName: \"kubernetes.io/projected/12885b90-19b5-4c6f-838e-22cc394e21db-kube-api-access-ttkvm\") pod \"network-check-target-svdx4\" (UID: \"12885b90-19b5-4c6f-838e-22cc394e21db\") " pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:26:26.894442 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891751 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4bss\" (UniqueName: \"kubernetes.io/projected/e3070766-1adb-409f-843f-8867c2861723-kube-api-access-q4bss\") pod \"multus-additional-cni-plugins-5wltr\" (UID: \"e3070766-1adb-409f-843f-8867c2861723\") " pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:26.894442 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891777 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-etc-sysctl-conf\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.894442 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891810 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-multus-socket-dir-parent\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.894442 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891820 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-etc-sysconfig\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.894442 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891824 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e3070766-1adb-409f-843f-8867c2861723-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5wltr\" (UID: \"e3070766-1adb-409f-843f-8867c2861723\") " pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:26.894442 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891836 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.894442 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891889 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-host-cni-bin\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.894442 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891897 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-etc-systemd\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.894442 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.891944 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.894442 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.892018 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-cnibin\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.894442 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.892230 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/28b20342-2058-4e26-8ccd-16757e486809-env-overrides\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.894442 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.892266 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg9zs\" (UniqueName: \"kubernetes.io/projected/b28aec9e-b169-4afe-922d-11bb294e0e33-kube-api-access-tg9zs\") pod \"aws-ebs-csi-driver-node-jmtbt\" (UID: \"b28aec9e-b169-4afe-922d-11bb294e0e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" Jun 11 13:26:26.894442 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.892287 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f047a728-0ff9-4b65-ba9d-7dfcacb808f4-hosts-file\") pod \"node-resolver-swccc\" (UID: \"f047a728-0ff9-4b65-ba9d-7dfcacb808f4\") " pod="openshift-dns/node-resolver-swccc" Jun 11 13:26:26.894442 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.892317 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-etc-sysctl-conf\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.894442 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.892332 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3070766-1adb-409f-843f-8867c2861723-cnibin\") pod \"multus-additional-cni-plugins-5wltr\" (UID: \"e3070766-1adb-409f-843f-8867c2861723\") " pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:26.895015 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.892358 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj98v\" (UniqueName: \"kubernetes.io/projected/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-kube-api-access-vj98v\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.895015 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.892376 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/888b6b6d-8d77-4bb0-b0a7-b39b44262482-multus-socket-dir-parent\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.895015 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.892519 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-tmp\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.895015 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.892530 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f047a728-0ff9-4b65-ba9d-7dfcacb808f4-hosts-file\") pod \"node-resolver-swccc\" (UID: \"f047a728-0ff9-4b65-ba9d-7dfcacb808f4\") " pod="openshift-dns/node-resolver-swccc" Jun 11 13:26:26.895015 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.892560 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3070766-1adb-409f-843f-8867c2861723-cnibin\") pod \"multus-additional-cni-plugins-5wltr\" (UID: \"e3070766-1adb-409f-843f-8867c2861723\") " pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:26.895015 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.892588 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-systemd-units\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.895015 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.892619 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-kubelet-config\") pod \"global-pull-secret-syncer-kjtlg\" (UID: \"7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6\") " pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:26.895015 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.892647 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/28b20342-2058-4e26-8ccd-16757e486809-run-ovn\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.895015 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.892666 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3070766-1adb-409f-843f-8867c2861723-os-release\") pod \"multus-additional-cni-plugins-5wltr\" (UID: \"e3070766-1adb-409f-843f-8867c2861723\") " pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:26.895015 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.893959 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/62ccca45-38fd-48eb-85b9-563e624328b5-agent-certs\") pod \"konnectivity-agent-f4sfh\" (UID: \"62ccca45-38fd-48eb-85b9-563e624328b5\") " pod="kube-system/konnectivity-agent-f4sfh" Jun 11 13:26:26.895015 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.894300 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/28b20342-2058-4e26-8ccd-16757e486809-ovn-node-metrics-cert\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.895681 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.895663 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-etc-tuned\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.896254 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.896220 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xksb5" Jun 11 13:26:26.916208 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.916166 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz9kq\" (UniqueName: \"kubernetes.io/projected/28b20342-2058-4e26-8ccd-16757e486809-kube-api-access-nz9kq\") pod \"ovnkube-node-87tcg\" (UID: \"28b20342-2058-4e26-8ccd-16757e486809\") " pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:26.918840 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.918818 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzf5q\" (UniqueName: \"kubernetes.io/projected/c6ad6978-e1a9-4aa8-8aaa-48b7d29f1ab1-kube-api-access-kzf5q\") pod \"iptables-alerter-j9vjz\" (UID: \"c6ad6978-e1a9-4aa8-8aaa-48b7d29f1ab1\") " pod="openshift-network-operator/iptables-alerter-j9vjz" Jun 11 13:26:26.920946 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:26.920927 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 13:26:26.921012 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:26.920952 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 13:26:26.921012 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:26.920965 2563 projected.go:196] Error preparing data for projected volume kube-api-access-ttkvm for pod openshift-network-diagnostics/network-check-target-svdx4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:26:26.921134 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:26.921019 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12885b90-19b5-4c6f-838e-22cc394e21db-kube-api-access-ttkvm podName:12885b90-19b5-4c6f-838e-22cc394e21db nodeName:}" failed. No retries permitted until 2026-06-11 13:26:27.421003344 +0000 UTC m=+2.989421662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ttkvm" (UniqueName: "kubernetes.io/projected/12885b90-19b5-4c6f-838e-22cc394e21db-kube-api-access-ttkvm") pod "network-check-target-svdx4" (UID: "12885b90-19b5-4c6f-838e-22cc394e21db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:26:26.923363 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.923337 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj98v\" (UniqueName: \"kubernetes.io/projected/2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55-kube-api-access-vj98v\") pod \"tuned-phwdp\" (UID: \"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55\") " pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:26.925454 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.925399 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg9zs\" (UniqueName: \"kubernetes.io/projected/b28aec9e-b169-4afe-922d-11bb294e0e33-kube-api-access-tg9zs\") pod \"aws-ebs-csi-driver-node-jmtbt\" (UID: \"b28aec9e-b169-4afe-922d-11bb294e0e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" Jun 11 13:26:26.926533 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.926498 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8zxb\" (UniqueName: \"kubernetes.io/projected/f047a728-0ff9-4b65-ba9d-7dfcacb808f4-kube-api-access-q8zxb\") pod \"node-resolver-swccc\" (UID: \"f047a728-0ff9-4b65-ba9d-7dfcacb808f4\") " pod="openshift-dns/node-resolver-swccc" Jun 11 13:26:26.926969 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.926890 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8prwj\" (UniqueName: \"kubernetes.io/projected/dbcbad68-5014-4dbd-99f2-087716f10a31-kube-api-access-8prwj\") pod \"network-metrics-daemon-698v8\" (UID: \"dbcbad68-5014-4dbd-99f2-087716f10a31\") " pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:26.928525 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.928507 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pzqv\" (UniqueName: \"kubernetes.io/projected/888b6b6d-8d77-4bb0-b0a7-b39b44262482-kube-api-access-7pzqv\") pod \"multus-qh4rj\" (UID: \"888b6b6d-8d77-4bb0-b0a7-b39b44262482\") " pod="openshift-multus/multus-qh4rj" Jun 11 13:26:26.929212 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.929162 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4bss\" (UniqueName: \"kubernetes.io/projected/e3070766-1adb-409f-843f-8867c2861723-kube-api-access-q4bss\") pod \"multus-additional-cni-plugins-5wltr\" (UID: \"e3070766-1adb-409f-843f-8867c2861723\") " pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:26.932012 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:26.931992 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6pml\" (UniqueName: \"kubernetes.io/projected/50d20acf-e30a-41ef-871b-b8adc1ff8a0a-kube-api-access-c6pml\") pod \"node-ca-9dk9k\" (UID: \"50d20acf-e30a-41ef-871b-b8adc1ff8a0a\") " pod="openshift-image-registry/node-ca-9dk9k" Jun 11 13:26:27.068536 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:27.068440 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f4sfh" Jun 11 13:26:27.074768 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:27.074747 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j9vjz" Jun 11 13:26:27.078588 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:27.078559 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62ccca45_38fd_48eb_85b9_563e624328b5.slice/crio-73c101120a6edf67530d7053323400a444cdae92d7c06347913c0756f2b16f31 WatchSource:0}: Error finding container 73c101120a6edf67530d7053323400a444cdae92d7c06347913c0756f2b16f31: Status 404 returned error can't find the container with id 73c101120a6edf67530d7053323400a444cdae92d7c06347913c0756f2b16f31 Jun 11 13:26:27.084649 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:27.084626 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6ad6978_e1a9_4aa8_8aaa_48b7d29f1ab1.slice/crio-7ddac3e09365990a629d188962ff0ff781fefc31714950e6b45426fcf6138f5a WatchSource:0}: Error finding container 7ddac3e09365990a629d188962ff0ff781fefc31714950e6b45426fcf6138f5a: Status 404 returned error can't find the container with id 7ddac3e09365990a629d188962ff0ff781fefc31714950e6b45426fcf6138f5a Jun 11 13:26:27.095075 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:27.095039 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qh4rj" Jun 11 13:26:27.101495 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:27.101476 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-swccc" Jun 11 13:26:27.108710 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:27.108691 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9dk9k" Jun 11 13:26:27.110671 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:27.109029 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod888b6b6d_8d77_4bb0_b0a7_b39b44262482.slice/crio-489988ea461da7316ece051d1fdcc06e11ce8afb72d75a85bad585863d129e70 WatchSource:0}: Error finding container 489988ea461da7316ece051d1fdcc06e11ce8afb72d75a85bad585863d129e70: Status 404 returned error can't find the container with id 489988ea461da7316ece051d1fdcc06e11ce8afb72d75a85bad585863d129e70 Jun 11 13:26:27.114008 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:27.113983 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf047a728_0ff9_4b65_ba9d_7dfcacb808f4.slice/crio-a03d527b821c5d2f420f63250130112e2edff2d70f55cbe8cdf109b19e2ac16b WatchSource:0}: Error finding container a03d527b821c5d2f420f63250130112e2edff2d70f55cbe8cdf109b19e2ac16b: Status 404 returned error can't find the container with id a03d527b821c5d2f420f63250130112e2edff2d70f55cbe8cdf109b19e2ac16b Jun 11 13:26:27.116398 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:27.116374 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:27.123122 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:27.123099 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5wltr" Jun 11 13:26:27.130972 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:27.130954 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" Jun 11 13:26:27.133530 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:27.133508 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3070766_1adb_409f_843f_8867c2861723.slice/crio-8d748964957a38b79a3b31ae4ccf606cbed6277fd2354eeb78d1978afa99ccae WatchSource:0}: Error finding container 8d748964957a38b79a3b31ae4ccf606cbed6277fd2354eeb78d1978afa99ccae: Status 404 returned error can't find the container with id 8d748964957a38b79a3b31ae4ccf606cbed6277fd2354eeb78d1978afa99ccae Jun 11 13:26:27.138079 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:27.137887 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-phwdp" Jun 11 13:26:27.140209 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:27.140189 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb28aec9e_b169_4afe_922d_11bb294e0e33.slice/crio-f3c6a386f13c340abbe4325bedb7c473b82cab054bc83cae43008e682ff96df9 WatchSource:0}: Error finding container f3c6a386f13c340abbe4325bedb7c473b82cab054bc83cae43008e682ff96df9: Status 404 returned error can't find the container with id f3c6a386f13c340abbe4325bedb7c473b82cab054bc83cae43008e682ff96df9 Jun 11 13:26:27.397201 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:27.397174 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-original-pull-secret\") pod \"global-pull-secret-syncer-kjtlg\" (UID: \"7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6\") " pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:27.397311 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:27.397229 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs\") pod \"network-metrics-daemon-698v8\" (UID: \"dbcbad68-5014-4dbd-99f2-087716f10a31\") " pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:27.397380 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:27.397324 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 13:26:27.397435 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:27.397388 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-original-pull-secret podName:7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6 nodeName:}" failed. No retries permitted until 2026-06-11 13:26:28.397370033 +0000 UTC m=+3.965788338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-original-pull-secret") pod "global-pull-secret-syncer-kjtlg" (UID: "7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6") : object "kube-system"/"original-pull-secret" not registered Jun 11 13:26:27.397435 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:27.397324 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:26:27.397435 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:27.397432 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs podName:dbcbad68-5014-4dbd-99f2-087716f10a31 nodeName:}" failed. No retries permitted until 2026-06-11 13:26:28.397425109 +0000 UTC m=+3.965843414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs") pod "network-metrics-daemon-698v8" (UID: "dbcbad68-5014-4dbd-99f2-087716f10a31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:26:27.498097 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:27.498068 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttkvm\" (UniqueName: \"kubernetes.io/projected/12885b90-19b5-4c6f-838e-22cc394e21db-kube-api-access-ttkvm\") pod \"network-check-target-svdx4\" (UID: \"12885b90-19b5-4c6f-838e-22cc394e21db\") " pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:26:27.498215 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:27.498192 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 13:26:27.498215 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:27.498212 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 13:26:27.498309 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:27.498225 2563 projected.go:196] Error preparing data for projected volume kube-api-access-ttkvm for pod openshift-network-diagnostics/network-check-target-svdx4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:26:27.498309 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:27.498274 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12885b90-19b5-4c6f-838e-22cc394e21db-kube-api-access-ttkvm podName:12885b90-19b5-4c6f-838e-22cc394e21db nodeName:}" failed. No retries permitted until 2026-06-11 13:26:28.498260538 +0000 UTC m=+4.066678844 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ttkvm" (UniqueName: "kubernetes.io/projected/12885b90-19b5-4c6f-838e-22cc394e21db-kube-api-access-ttkvm") pod "network-check-target-svdx4" (UID: "12885b90-19b5-4c6f-838e-22cc394e21db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:26:27.862671 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:27.862631 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" event={"ID":"b28aec9e-b169-4afe-922d-11bb294e0e33","Type":"ContainerStarted","Data":"f3c6a386f13c340abbe4325bedb7c473b82cab054bc83cae43008e682ff96df9"} Jun 11 13:26:27.870648 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:27.870617 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9dk9k" event={"ID":"50d20acf-e30a-41ef-871b-b8adc1ff8a0a","Type":"ContainerStarted","Data":"40d234396d05533e0b3b8b709546dee7b7d078f3fe81b44dba3e9179c1009889"} Jun 11 13:26:27.875806 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:27.875778 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-swccc" event={"ID":"f047a728-0ff9-4b65-ba9d-7dfcacb808f4","Type":"ContainerStarted","Data":"a03d527b821c5d2f420f63250130112e2edff2d70f55cbe8cdf109b19e2ac16b"} Jun 11 13:26:27.883640 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:27.883613 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qh4rj" event={"ID":"888b6b6d-8d77-4bb0-b0a7-b39b44262482","Type":"ContainerStarted","Data":"489988ea461da7316ece051d1fdcc06e11ce8afb72d75a85bad585863d129e70"} Jun 11 13:26:27.889621 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:27.889593 2563 generic.go:356] "Generic (PLEG): container finished" podID="ce578246f2dac87eebf5b94bf718ad67" containerID="a6f0ed8966ed9d991a68d73646c07f857bc8b925572cbea55d0ce2d5d26be7d7" exitCode=0 Jun 11 13:26:27.890114 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:27.890091 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal" event={"ID":"ce578246f2dac87eebf5b94bf718ad67","Type":"ContainerDied","Data":"a6f0ed8966ed9d991a68d73646c07f857bc8b925572cbea55d0ce2d5d26be7d7"} Jun 11 13:26:27.897084 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:27.897061 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5wltr" event={"ID":"e3070766-1adb-409f-843f-8867c2861723","Type":"ContainerStarted","Data":"8d748964957a38b79a3b31ae4ccf606cbed6277fd2354eeb78d1978afa99ccae"} Jun 11 13:26:27.900297 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:27.900226 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 13:21:26 +0000 UTC" deadline="2027-12-11 10:09:19.494343161 +0000 UTC" Jun 11 13:26:27.900297 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:27.900253 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13148h42m51.59409395s" Jun 11 13:26:27.908822 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:27.908797 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" event={"ID":"28b20342-2058-4e26-8ccd-16757e486809","Type":"ContainerStarted","Data":"42530eb049eb6a259c8bd87a3c6ef394501597f19d019cd0464809f37d5763cb"} Jun 11 13:26:27.915278 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:27.915249 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j9vjz" event={"ID":"c6ad6978-e1a9-4aa8-8aaa-48b7d29f1ab1","Type":"ContainerStarted","Data":"7ddac3e09365990a629d188962ff0ff781fefc31714950e6b45426fcf6138f5a"} Jun 11 13:26:27.926579 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:27.924219 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f4sfh" event={"ID":"62ccca45-38fd-48eb-85b9-563e624328b5","Type":"ContainerStarted","Data":"73c101120a6edf67530d7053323400a444cdae92d7c06347913c0756f2b16f31"} Jun 11 13:26:28.405058 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:28.404994 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-original-pull-secret\") pod \"global-pull-secret-syncer-kjtlg\" (UID: \"7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6\") " pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:28.405269 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:28.405080 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs\") pod \"network-metrics-daemon-698v8\" (UID: \"dbcbad68-5014-4dbd-99f2-087716f10a31\") " pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:28.405269 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:28.405192 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:26:28.405269 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:28.405253 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs podName:dbcbad68-5014-4dbd-99f2-087716f10a31 nodeName:}" failed. No retries permitted until 2026-06-11 13:26:30.405234845 +0000 UTC m=+5.973653156 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs") pod "network-metrics-daemon-698v8" (UID: "dbcbad68-5014-4dbd-99f2-087716f10a31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:26:28.405779 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:28.405641 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 13:26:28.405779 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:28.405692 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-original-pull-secret podName:7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6 nodeName:}" failed. No retries permitted until 2026-06-11 13:26:30.405677171 +0000 UTC m=+5.974095479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-original-pull-secret") pod "global-pull-secret-syncer-kjtlg" (UID: "7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6") : object "kube-system"/"original-pull-secret" not registered Jun 11 13:26:28.505897 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:28.505853 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttkvm\" (UniqueName: \"kubernetes.io/projected/12885b90-19b5-4c6f-838e-22cc394e21db-kube-api-access-ttkvm\") pod \"network-check-target-svdx4\" (UID: \"12885b90-19b5-4c6f-838e-22cc394e21db\") " pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:26:28.506081 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:28.506004 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 13:26:28.506081 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:28.506027 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 13:26:28.506081 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:28.506039 2563 projected.go:196] Error preparing data for projected volume kube-api-access-ttkvm for pod openshift-network-diagnostics/network-check-target-svdx4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:26:28.506319 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:28.506110 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12885b90-19b5-4c6f-838e-22cc394e21db-kube-api-access-ttkvm podName:12885b90-19b5-4c6f-838e-22cc394e21db nodeName:}" failed. No retries permitted until 2026-06-11 13:26:30.506093636 +0000 UTC m=+6.074511958 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ttkvm" (UniqueName: "kubernetes.io/projected/12885b90-19b5-4c6f-838e-22cc394e21db-kube-api-access-ttkvm") pod "network-check-target-svdx4" (UID: "12885b90-19b5-4c6f-838e-22cc394e21db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:26:28.652595 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:26:28.652561 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb4c058_dd7f_4eea_8ff0_6bd7f2357c55.slice/crio-27a63adea70653c7b093e7ebe80a21d4c1ca16514cbdf47887c78a82511b3401 WatchSource:0}: Error finding container 27a63adea70653c7b093e7ebe80a21d4c1ca16514cbdf47887c78a82511b3401: Status 404 returned error can't find the container with id 27a63adea70653c7b093e7ebe80a21d4c1ca16514cbdf47887c78a82511b3401 Jun 11 13:26:28.843774 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:28.843746 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:28.843897 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:28.843867 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtlg" podUID="7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6" Jun 11 13:26:28.844171 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:28.844154 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:28.844277 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:28.844256 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698v8" podUID="dbcbad68-5014-4dbd-99f2-087716f10a31" Jun 11 13:26:28.844365 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:28.844351 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:26:28.844447 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:28.844429 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svdx4" podUID="12885b90-19b5-4c6f-838e-22cc394e21db" Jun 11 13:26:28.900418 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:28.900352 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 13:21:26 +0000 UTC" deadline="2028-03-28 09:59:41.794944942 +0000 UTC" Jun 11 13:26:28.900418 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:28.900414 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15740h33m12.894535576s" Jun 11 13:26:28.931701 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:28.931637 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal" event={"ID":"ce578246f2dac87eebf5b94bf718ad67","Type":"ContainerStarted","Data":"331c796eb212a1a7ca348dc6e9bbbea3f8d96c2d66ec4af658ebed4284b09f0b"} Jun 11 13:26:28.936779 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:28.936744 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-phwdp" event={"ID":"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55","Type":"ContainerStarted","Data":"27a63adea70653c7b093e7ebe80a21d4c1ca16514cbdf47887c78a82511b3401"} Jun 11 13:26:28.944629 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:28.944604 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-186.ec2.internal" event={"ID":"98f8e857b61fd5c153132da526b56dd7","Type":"ContainerStarted","Data":"79777d8452b260cc6f513a1213afdef6681b2eb6cee338a0640c8597daa76d96"} Jun 11 13:26:29.002949 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:29.002896 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-186.ec2.internal" podStartSLOduration=3.002876103 podStartE2EDuration="3.002876103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:26:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:26:28.97513645 +0000 UTC m=+4.543554780" watchObservedRunningTime="2026-06-11 13:26:29.002876103 +0000 UTC m=+4.571294432" Jun 11 13:26:30.426300 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:30.426261 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-original-pull-secret\") pod \"global-pull-secret-syncer-kjtlg\" (UID: \"7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6\") " pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:30.426743 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:30.426327 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs\") pod \"network-metrics-daemon-698v8\" (UID: \"dbcbad68-5014-4dbd-99f2-087716f10a31\") " pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:30.426743 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:30.426452 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:26:30.426743 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:30.426510 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs podName:dbcbad68-5014-4dbd-99f2-087716f10a31 nodeName:}" failed. No retries permitted until 2026-06-11 13:26:34.426491647 +0000 UTC m=+9.994909955 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs") pod "network-metrics-daemon-698v8" (UID: "dbcbad68-5014-4dbd-99f2-087716f10a31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:26:30.426914 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:30.426864 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 13:26:30.426914 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:30.426908 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-original-pull-secret podName:7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6 nodeName:}" failed. No retries permitted until 2026-06-11 13:26:34.426893155 +0000 UTC m=+9.995311477 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-original-pull-secret") pod "global-pull-secret-syncer-kjtlg" (UID: "7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6") : object "kube-system"/"original-pull-secret" not registered Jun 11 13:26:30.527744 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:30.527635 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttkvm\" (UniqueName: \"kubernetes.io/projected/12885b90-19b5-4c6f-838e-22cc394e21db-kube-api-access-ttkvm\") pod \"network-check-target-svdx4\" (UID: \"12885b90-19b5-4c6f-838e-22cc394e21db\") " pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:26:30.527892 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:30.527821 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 13:26:30.527892 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:30.527848 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 13:26:30.527892 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:30.527864 2563 projected.go:196] Error preparing data for projected volume kube-api-access-ttkvm for pod openshift-network-diagnostics/network-check-target-svdx4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:26:30.528077 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:30.527923 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12885b90-19b5-4c6f-838e-22cc394e21db-kube-api-access-ttkvm podName:12885b90-19b5-4c6f-838e-22cc394e21db nodeName:}" failed. No retries permitted until 2026-06-11 13:26:34.52790566 +0000 UTC m=+10.096323968 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ttkvm" (UniqueName: "kubernetes.io/projected/12885b90-19b5-4c6f-838e-22cc394e21db-kube-api-access-ttkvm") pod "network-check-target-svdx4" (UID: "12885b90-19b5-4c6f-838e-22cc394e21db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:26:30.843166 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:30.843128 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:26:30.843325 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:30.843254 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svdx4" podUID="12885b90-19b5-4c6f-838e-22cc394e21db" Jun 11 13:26:30.843611 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:30.843593 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:30.843730 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:30.843700 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698v8" podUID="dbcbad68-5014-4dbd-99f2-087716f10a31" Jun 11 13:26:30.843854 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:30.843751 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:30.843854 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:30.843816 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtlg" podUID="7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6" Jun 11 13:26:32.842191 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:32.842155 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:32.842580 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:32.842287 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtlg" podUID="7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6" Jun 11 13:26:32.842580 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:32.842446 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:26:32.842580 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:32.842529 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svdx4" podUID="12885b90-19b5-4c6f-838e-22cc394e21db" Jun 11 13:26:32.842718 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:32.842626 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:32.842755 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:32.842715 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698v8" podUID="dbcbad68-5014-4dbd-99f2-087716f10a31" Jun 11 13:26:34.458107 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:34.458069 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-original-pull-secret\") pod \"global-pull-secret-syncer-kjtlg\" (UID: \"7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6\") " pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:34.458542 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:34.458120 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs\") pod \"network-metrics-daemon-698v8\" (UID: \"dbcbad68-5014-4dbd-99f2-087716f10a31\") " pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:34.458542 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:34.458220 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:26:34.458542 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:34.458269 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs podName:dbcbad68-5014-4dbd-99f2-087716f10a31 nodeName:}" failed. No retries permitted until 2026-06-11 13:26:42.458255386 +0000 UTC m=+18.026673692 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs") pod "network-metrics-daemon-698v8" (UID: "dbcbad68-5014-4dbd-99f2-087716f10a31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:26:34.458542 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:34.458309 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 13:26:34.458542 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:34.458328 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-original-pull-secret podName:7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6 nodeName:}" failed. No retries permitted until 2026-06-11 13:26:42.458321733 +0000 UTC m=+18.026740039 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-original-pull-secret") pod "global-pull-secret-syncer-kjtlg" (UID: "7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6") : object "kube-system"/"original-pull-secret" not registered Jun 11 13:26:34.558902 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:34.558869 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttkvm\" (UniqueName: \"kubernetes.io/projected/12885b90-19b5-4c6f-838e-22cc394e21db-kube-api-access-ttkvm\") pod \"network-check-target-svdx4\" (UID: \"12885b90-19b5-4c6f-838e-22cc394e21db\") " pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:26:34.559091 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:34.559019 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 13:26:34.559091 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:34.559056 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 13:26:34.559091 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:34.559073 2563 projected.go:196] Error preparing data for projected volume kube-api-access-ttkvm for pod openshift-network-diagnostics/network-check-target-svdx4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:26:34.559259 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:34.559128 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12885b90-19b5-4c6f-838e-22cc394e21db-kube-api-access-ttkvm podName:12885b90-19b5-4c6f-838e-22cc394e21db nodeName:}" failed. No retries permitted until 2026-06-11 13:26:42.55910872 +0000 UTC m=+18.127527027 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ttkvm" (UniqueName: "kubernetes.io/projected/12885b90-19b5-4c6f-838e-22cc394e21db-kube-api-access-ttkvm") pod "network-check-target-svdx4" (UID: "12885b90-19b5-4c6f-838e-22cc394e21db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:26:34.841656 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:34.841585 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:26:34.841791 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:34.841690 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svdx4" podUID="12885b90-19b5-4c6f-838e-22cc394e21db" Jun 11 13:26:34.842104 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:34.842084 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:34.842336 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:34.842315 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698v8" podUID="dbcbad68-5014-4dbd-99f2-087716f10a31" Jun 11 13:26:34.842486 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:34.842473 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:34.842654 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:34.842633 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtlg" podUID="7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6" Jun 11 13:26:35.968366 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:35.968331 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5wltr" event={"ID":"e3070766-1adb-409f-843f-8867c2861723","Type":"ContainerStarted","Data":"278633ced510e8f75f69c23c92edf6adf69a15d8972f7e5ca45347d4318caeb1"} Jun 11 13:26:35.971725 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:35.971698 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f4sfh" event={"ID":"62ccca45-38fd-48eb-85b9-563e624328b5","Type":"ContainerStarted","Data":"67228f0b5ce79a2e2694d93c814b66e2bcabecbe8660374c01202da77aade0f2"} Jun 11 13:26:35.975898 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:35.975871 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" event={"ID":"b28aec9e-b169-4afe-922d-11bb294e0e33","Type":"ContainerStarted","Data":"d6d4f1e6590a7cc3b703113e43d16c64017f45334c8fd3c74f3c749ac42d9290"} Jun 11 13:26:35.978801 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:35.977683 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9dk9k" event={"ID":"50d20acf-e30a-41ef-871b-b8adc1ff8a0a","Type":"ContainerStarted","Data":"4f602108cd9f2249d16d42525206531ca4b3e17b68f9e747b9d21a790d288686"} Jun 11 13:26:35.980231 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:35.979842 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-swccc" event={"ID":"f047a728-0ff9-4b65-ba9d-7dfcacb808f4","Type":"ContainerStarted","Data":"e8efe2de8ed76e7d8f449b2a3cf9398ccfdcefd9f3d476136a14ea0c8933a430"} Jun 11 13:26:35.993408 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:35.992957 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-186.ec2.internal" podStartSLOduration=9.992929072999999 podStartE2EDuration="9.992929073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:26:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:26:29.003658417 +0000 UTC m=+4.572076744" watchObservedRunningTime="2026-06-11 13:26:35.992929073 +0000 UTC m=+11.561347402" Jun 11 13:26:36.021024 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:36.020983 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-swccc" podStartSLOduration=2.7421851139999998 podStartE2EDuration="11.020972993s" totalImagesPullingTime="8.278787879s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:26:36.007927325 +0000 UTC m=+11.576345647" watchObservedRunningTime="2026-06-11 13:26:36.020972993 +0000 UTC m=+11.589391377" Jun 11 13:26:36.021998 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:36.021334 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f4sfh" podStartSLOduration=3.71260863 podStartE2EDuration="12.021325803s" totalImagesPullingTime="8.308717173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:26:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:26:36.020780119 +0000 UTC m=+11.589198445" watchObservedRunningTime="2026-06-11 13:26:36.021325803 +0000 UTC m=+11.589744133" Jun 11 13:26:36.034440 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:36.034400 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9dk9k" podStartSLOduration=2.76336066 podStartE2EDuration="11.034390303s" totalImagesPullingTime="8.271029643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:26:36.033965851 +0000 UTC m=+11.602384179" watchObservedRunningTime="2026-06-11 13:26:36.034390303 +0000 UTC m=+11.602808679" Jun 11 13:26:36.840562 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:36.840530 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:36.840701 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:36.840665 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtlg" podUID="7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6" Jun 11 13:26:36.841016 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:36.840998 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:26:36.841132 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:36.841110 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svdx4" podUID="12885b90-19b5-4c6f-838e-22cc394e21db" Jun 11 13:26:36.841224 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:36.841207 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:36.841327 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:36.841303 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698v8" podUID="dbcbad68-5014-4dbd-99f2-087716f10a31" Jun 11 13:26:36.988376 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:36.988342 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j9vjz" event={"ID":"c6ad6978-e1a9-4aa8-8aaa-48b7d29f1ab1","Type":"ContainerStarted","Data":"bbd9cae3666be84ac4e526328ad9373075926585a82afd5a07863ce7b4b5e1f7"} Jun 11 13:26:37.003752 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:37.003708 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-j9vjz" podStartSLOduration=4.694905062 podStartE2EDuration="13.003694921s" totalImagesPullingTime="8.308789859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:26:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:26:37.003375251 +0000 UTC m=+12.571793580" watchObservedRunningTime="2026-06-11 13:26:37.003694921 +0000 UTC m=+12.572113248" Jun 11 13:26:38.319554 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:38.319517 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f4sfh" Jun 11 13:26:38.320342 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:38.320317 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f4sfh" Jun 11 13:26:38.841208 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:38.841144 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:38.841208 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:38.841166 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:38.841208 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:38.841152 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:26:38.841480 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:38.841269 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698v8" podUID="dbcbad68-5014-4dbd-99f2-087716f10a31" Jun 11 13:26:38.841480 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:38.841326 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svdx4" podUID="12885b90-19b5-4c6f-838e-22cc394e21db" Jun 11 13:26:38.841480 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:38.841413 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtlg" podUID="7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6" Jun 11 13:26:40.840718 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:40.840541 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:40.841263 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:40.840551 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:26:40.841263 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:40.840809 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtlg" podUID="7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6" Jun 11 13:26:40.841263 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:40.840584 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:40.841263 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:40.840845 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svdx4" podUID="12885b90-19b5-4c6f-838e-22cc394e21db" Jun 11 13:26:40.841263 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:40.840913 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698v8" podUID="dbcbad68-5014-4dbd-99f2-087716f10a31" Jun 11 13:26:42.516967 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:42.516928 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs\") pod \"network-metrics-daemon-698v8\" (UID: \"dbcbad68-5014-4dbd-99f2-087716f10a31\") " pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:42.517459 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:42.517020 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-original-pull-secret\") pod \"global-pull-secret-syncer-kjtlg\" (UID: \"7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6\") " pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:42.517459 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:42.517100 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:26:42.517459 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:42.517141 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 13:26:42.517459 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:42.517166 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs podName:dbcbad68-5014-4dbd-99f2-087716f10a31 nodeName:}" failed. No retries permitted until 2026-06-11 13:26:58.51714812 +0000 UTC m=+34.085566425 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs") pod "network-metrics-daemon-698v8" (UID: "dbcbad68-5014-4dbd-99f2-087716f10a31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:26:42.517459 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:42.517188 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-original-pull-secret podName:7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6 nodeName:}" failed. No retries permitted until 2026-06-11 13:26:58.517172915 +0000 UTC m=+34.085591224 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-original-pull-secret") pod "global-pull-secret-syncer-kjtlg" (UID: "7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6") : object "kube-system"/"original-pull-secret" not registered Jun 11 13:26:42.618030 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:42.617998 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttkvm\" (UniqueName: \"kubernetes.io/projected/12885b90-19b5-4c6f-838e-22cc394e21db-kube-api-access-ttkvm\") pod \"network-check-target-svdx4\" (UID: \"12885b90-19b5-4c6f-838e-22cc394e21db\") " pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:26:42.618200 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:42.618178 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 13:26:42.618200 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:42.618200 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 13:26:42.618299 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:42.618211 2563 projected.go:196] Error preparing data for projected volume kube-api-access-ttkvm for pod openshift-network-diagnostics/network-check-target-svdx4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:26:42.618299 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:42.618258 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12885b90-19b5-4c6f-838e-22cc394e21db-kube-api-access-ttkvm podName:12885b90-19b5-4c6f-838e-22cc394e21db nodeName:}" failed. No retries permitted until 2026-06-11 13:26:58.618244309 +0000 UTC m=+34.186662614 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ttkvm" (UniqueName: "kubernetes.io/projected/12885b90-19b5-4c6f-838e-22cc394e21db-kube-api-access-ttkvm") pod "network-check-target-svdx4" (UID: "12885b90-19b5-4c6f-838e-22cc394e21db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:26:42.841725 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:42.841237 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:42.841725 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:42.841244 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:42.841725 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:42.841364 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698v8" podUID="dbcbad68-5014-4dbd-99f2-087716f10a31" Jun 11 13:26:42.841725 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:42.841243 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:26:42.841725 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:42.841427 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtlg" podUID="7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6" Jun 11 13:26:42.841725 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:42.841520 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svdx4" podUID="12885b90-19b5-4c6f-838e-22cc394e21db" Jun 11 13:26:44.841389 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:44.841360 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:44.841795 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:44.841491 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:44.841795 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:44.841520 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtlg" podUID="7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6" Jun 11 13:26:44.841795 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:44.841562 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698v8" podUID="dbcbad68-5014-4dbd-99f2-087716f10a31" Jun 11 13:26:44.841795 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:44.841591 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:26:44.841795 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:44.841677 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svdx4" podUID="12885b90-19b5-4c6f-838e-22cc394e21db" Jun 11 13:26:46.006626 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:46.006592 2563 generic.go:356] "Generic (PLEG): container finished" podID="e3070766-1adb-409f-843f-8867c2861723" containerID="278633ced510e8f75f69c23c92edf6adf69a15d8972f7e5ca45347d4318caeb1" exitCode=0 Jun 11 13:26:46.007005 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:46.006635 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5wltr" event={"ID":"e3070766-1adb-409f-843f-8867c2861723","Type":"ContainerDied","Data":"278633ced510e8f75f69c23c92edf6adf69a15d8972f7e5ca45347d4318caeb1"} Jun 11 13:26:46.713412 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:46.713376 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 13:26:46.831922 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:46.831725 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T13:26:46.71339497Z","UUID":"fe30986f-cc9b-44fb-8b22-72a7ea714d6b","Handler":null,"Name":"","Endpoint":""} Jun 11 13:26:46.833011 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:46.832992 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 13:26:46.833137 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:46.833067 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 13:26:46.840746 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:46.840397 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:46.840746 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:46.840505 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtlg" podUID="7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6" Jun 11 13:26:46.840746 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:46.840515 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:46.840746 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:46.840404 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:26:46.840746 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:46.840609 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698v8" podUID="dbcbad68-5014-4dbd-99f2-087716f10a31" Jun 11 13:26:46.840746 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:46.840686 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svdx4" podUID="12885b90-19b5-4c6f-838e-22cc394e21db" Jun 11 13:26:47.011022 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:47.010989 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" event={"ID":"b28aec9e-b169-4afe-922d-11bb294e0e33","Type":"ContainerStarted","Data":"fff1d4ebff248b3f52b063997b0f4cee72d45dbe5d49d6fc7db7f8e456973fc8"} Jun 11 13:26:47.012626 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:47.012597 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qh4rj" event={"ID":"888b6b6d-8d77-4bb0-b0a7-b39b44262482","Type":"ContainerStarted","Data":"c29ca768fb670b249b23c60b60e5625cf531a4d6340218f103d89efb5027705b"} Jun 11 13:26:47.015073 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:47.015037 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-87tcg_28b20342-2058-4e26-8ccd-16757e486809/ovn-acl-logging/0.log" Jun 11 13:26:47.015453 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:47.015423 2563 generic.go:356] "Generic (PLEG): container finished" podID="28b20342-2058-4e26-8ccd-16757e486809" containerID="16c83b39da4cd7f52b4f8ce82f9fc5a86711058de827ce9daa8c677e3db65baa" exitCode=1 Jun 11 13:26:47.015561 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:47.015458 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" event={"ID":"28b20342-2058-4e26-8ccd-16757e486809","Type":"ContainerStarted","Data":"af0ca9e6421ddd9dd8568d7e1d8e32479001cfb6f650b6b1112a0386211ff7ad"} Jun 11 13:26:47.015561 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:47.015535 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" event={"ID":"28b20342-2058-4e26-8ccd-16757e486809","Type":"ContainerStarted","Data":"7a248b2a9d10ce01cf3341f22476857b36ffb71b1c663a08587484c74a97b591"} Jun 11 13:26:47.015674 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:47.015582 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" event={"ID":"28b20342-2058-4e26-8ccd-16757e486809","Type":"ContainerDied","Data":"16c83b39da4cd7f52b4f8ce82f9fc5a86711058de827ce9daa8c677e3db65baa"} Jun 11 13:26:47.015674 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:47.015634 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" event={"ID":"28b20342-2058-4e26-8ccd-16757e486809","Type":"ContainerStarted","Data":"735d83891e3e1beda8329450fcdb77ae0d1ad19e7990228b2250c929a04086a8"} Jun 11 13:26:47.016863 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:47.016842 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-phwdp" event={"ID":"2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55","Type":"ContainerStarted","Data":"5c6195851ff3538cf2e34ccdcacac02fe2f1d08a794b30c6ba3cbde26d0e2e0b"} Jun 11 13:26:47.060932 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:47.060893 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qh4rj" podStartSLOduration=2.837335692 podStartE2EDuration="22.060879014s" totalImagesPullingTime="19.223543322s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:26:47.060262046 +0000 UTC m=+22.628680377" watchObservedRunningTime="2026-06-11 13:26:47.060879014 +0000 UTC m=+22.629297340" Jun 11 13:26:47.275493 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:47.275459 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f4sfh" Jun 11 13:26:47.275950 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:47.275934 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 11 13:26:47.277066 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:47.277026 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f4sfh" Jun 11 13:26:47.307588 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:47.307544 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-phwdp" podStartSLOduration=4.644593337 podStartE2EDuration="22.307531944s" totalImagesPullingTime="17.662938607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:26:47.09077342 +0000 UTC m=+22.659191747" watchObservedRunningTime="2026-06-11 13:26:47.307531944 +0000 UTC m=+22.875950276" Jun 11 13:26:48.021672 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:48.021651 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-87tcg_28b20342-2058-4e26-8ccd-16757e486809/ovn-acl-logging/0.log" Jun 11 13:26:48.022217 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:48.022101 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" event={"ID":"28b20342-2058-4e26-8ccd-16757e486809","Type":"ContainerStarted","Data":"fefd4932cdbfab7ffeb3e39e09bb2e63d16859ed7bba5760c4d9d2aba76a8736"} Jun 11 13:26:48.022217 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:48.022188 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" event={"ID":"28b20342-2058-4e26-8ccd-16757e486809","Type":"ContainerStarted","Data":"0b640b81b20b4e4421b16eb5820522ea493207fe1b5dcea9f5cc0f8f66c1ee83"} Jun 11 13:26:48.840716 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:48.840681 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:48.840871 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:48.840686 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:26:48.840871 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:48.840812 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtlg" podUID="7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6" Jun 11 13:26:48.840871 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:48.840855 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:48.841034 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:48.840942 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svdx4" podUID="12885b90-19b5-4c6f-838e-22cc394e21db" Jun 11 13:26:48.841111 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:48.841060 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698v8" podUID="dbcbad68-5014-4dbd-99f2-087716f10a31" Jun 11 13:26:49.026926 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:49.026893 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" event={"ID":"b28aec9e-b169-4afe-922d-11bb294e0e33","Type":"ContainerStarted","Data":"9e5ff956b05e56e86bfe685985d113dd2517cd3dc954e7eb052808549f0228c3"} Jun 11 13:26:50.840915 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:50.840856 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:50.841320 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:50.840856 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:26:50.841320 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:50.840946 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtlg" podUID="7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6" Jun 11 13:26:50.841320 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:50.841007 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svdx4" podUID="12885b90-19b5-4c6f-838e-22cc394e21db" Jun 11 13:26:50.841320 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:50.841076 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:50.841320 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:50.841138 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698v8" podUID="dbcbad68-5014-4dbd-99f2-087716f10a31" Jun 11 13:26:51.032150 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:51.032123 2563 generic.go:356] "Generic (PLEG): container finished" podID="e3070766-1adb-409f-843f-8867c2861723" containerID="3cdba37c431a68d514e5969d887ddce30925703b8c8c49fd62deb9370ef4d756" exitCode=0 Jun 11 13:26:51.032251 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:51.032198 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5wltr" event={"ID":"e3070766-1adb-409f-843f-8867c2861723","Type":"ContainerDied","Data":"3cdba37c431a68d514e5969d887ddce30925703b8c8c49fd62deb9370ef4d756"} Jun 11 13:26:51.035225 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:51.035203 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-87tcg_28b20342-2058-4e26-8ccd-16757e486809/ovn-acl-logging/0.log" Jun 11 13:26:51.035539 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:51.035519 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" event={"ID":"28b20342-2058-4e26-8ccd-16757e486809","Type":"ContainerStarted","Data":"d207c331419e07d0b4d924749d3fd62efafe306ad1d8b7c5659e7e7cbd735189"} Jun 11 13:26:51.056618 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:51.056581 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jmtbt" podStartSLOduration=5.6240877959999995 podStartE2EDuration="26.056570318s" totalImagesPullingTime="20.432482522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:26:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:26:49.045905298 +0000 UTC m=+24.614323625" watchObservedRunningTime="2026-06-11 13:26:51.056570318 +0000 UTC m=+26.624988706" Jun 11 13:26:52.840969 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:52.840933 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:52.841459 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:52.840938 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:26:52.841459 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:52.841037 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtlg" podUID="7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6" Jun 11 13:26:52.841459 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:52.841119 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svdx4" podUID="12885b90-19b5-4c6f-838e-22cc394e21db" Jun 11 13:26:52.841459 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:52.841167 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:52.841459 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:52.841238 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698v8" podUID="dbcbad68-5014-4dbd-99f2-087716f10a31" Jun 11 13:26:53.041126 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:53.041100 2563 generic.go:356] "Generic (PLEG): container finished" podID="e3070766-1adb-409f-843f-8867c2861723" containerID="857b1380fc5880bc29f8be30aa296d379d1a6572c77993d1e6c775543be54ba9" exitCode=0 Jun 11 13:26:53.041248 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:53.041163 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5wltr" event={"ID":"e3070766-1adb-409f-843f-8867c2861723","Type":"ContainerDied","Data":"857b1380fc5880bc29f8be30aa296d379d1a6572c77993d1e6c775543be54ba9"} Jun 11 13:26:53.044579 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:53.044559 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-87tcg_28b20342-2058-4e26-8ccd-16757e486809/ovn-acl-logging/0.log" Jun 11 13:26:53.044901 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:53.044884 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" event={"ID":"28b20342-2058-4e26-8ccd-16757e486809","Type":"ContainerStarted","Data":"3f24353b0ca2369ce33e290de408ffb1915d06b23b29c3443309533585063950"} Jun 11 13:26:53.045083 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:53.045068 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:53.045156 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:53.045139 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:53.045276 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:53.045262 2563 scope.go:117] "RemoveContainer" containerID="16c83b39da4cd7f52b4f8ce82f9fc5a86711058de827ce9daa8c677e3db65baa" Jun 11 13:26:53.062768 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:53.062749 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:54.052406 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:54.052388 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-87tcg_28b20342-2058-4e26-8ccd-16757e486809/ovn-acl-logging/0.log" Jun 11 13:26:54.052824 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:54.052799 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" event={"ID":"28b20342-2058-4e26-8ccd-16757e486809","Type":"ContainerStarted","Data":"4cbe231219ef98174c7a143c84a98904599b653f7402547e030567432a1a40af"} Jun 11 13:26:54.053219 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:54.053182 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:54.067286 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:54.067263 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:26:54.081178 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:54.081140 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" podStartSLOduration=9.647446305999999 podStartE2EDuration="29.081126402s" totalImagesPullingTime="19.433680096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:26:54.08021923 +0000 UTC m=+29.648637556" watchObservedRunningTime="2026-06-11 13:26:54.081126402 +0000 UTC m=+29.649544723" Jun 11 13:26:54.802253 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:54.802224 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-svdx4"] Jun 11 13:26:54.802394 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:54.802381 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:26:54.802508 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:54.802488 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svdx4" podUID="12885b90-19b5-4c6f-838e-22cc394e21db" Jun 11 13:26:54.806170 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:54.806145 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kjtlg"] Jun 11 13:26:54.806287 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:54.806260 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:54.806385 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:54.806360 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtlg" podUID="7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6" Jun 11 13:26:54.807181 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:54.807075 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-698v8"] Jun 11 13:26:54.807181 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:54.807182 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:54.807339 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:54.807289 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698v8" podUID="dbcbad68-5014-4dbd-99f2-087716f10a31" Jun 11 13:26:55.056718 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:55.056512 2563 generic.go:356] "Generic (PLEG): container finished" podID="e3070766-1adb-409f-843f-8867c2861723" containerID="5018f336ecea8e9167309ed46685fa4ecacf5f6e120403cf1dada4bb2c6d052a" exitCode=0 Jun 11 13:26:55.057025 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:55.056585 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5wltr" event={"ID":"e3070766-1adb-409f-843f-8867c2861723","Type":"ContainerDied","Data":"5018f336ecea8e9167309ed46685fa4ecacf5f6e120403cf1dada4bb2c6d052a"} Jun 11 13:26:55.840434 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:55.840349 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:55.840947 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:55.840910 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698v8" podUID="dbcbad68-5014-4dbd-99f2-087716f10a31" Jun 11 13:26:55.841095 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:55.840969 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:55.841154 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:55.841092 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtlg" podUID="7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6" Jun 11 13:26:56.841414 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:56.841327 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:26:56.842082 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:56.841455 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svdx4" podUID="12885b90-19b5-4c6f-838e-22cc394e21db" Jun 11 13:26:57.840934 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:57.840905 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:57.841136 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:57.841013 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698v8" podUID="dbcbad68-5014-4dbd-99f2-087716f10a31" Jun 11 13:26:57.841136 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:57.841077 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:57.841256 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:57.841165 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjtlg" podUID="7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6" Jun 11 13:26:58.534362 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:58.534327 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs\") pod \"network-metrics-daemon-698v8\" (UID: \"dbcbad68-5014-4dbd-99f2-087716f10a31\") " pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:58.534870 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:58.534422 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-original-pull-secret\") pod \"global-pull-secret-syncer-kjtlg\" (UID: \"7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6\") " pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:58.534870 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:58.534472 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:26:58.534870 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:58.534526 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 13:26:58.534870 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:58.534545 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs podName:dbcbad68-5014-4dbd-99f2-087716f10a31 nodeName:}" failed. No retries permitted until 2026-06-11 13:27:30.534521703 +0000 UTC m=+66.102940010 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs") pod "network-metrics-daemon-698v8" (UID: "dbcbad68-5014-4dbd-99f2-087716f10a31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 13:26:58.534870 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:58.534573 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-original-pull-secret podName:7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6 nodeName:}" failed. No retries permitted until 2026-06-11 13:27:30.534557886 +0000 UTC m=+66.102976207 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-original-pull-secret") pod "global-pull-secret-syncer-kjtlg" (UID: "7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6") : object "kube-system"/"original-pull-secret" not registered Jun 11 13:26:58.635307 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:58.635273 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttkvm\" (UniqueName: \"kubernetes.io/projected/12885b90-19b5-4c6f-838e-22cc394e21db-kube-api-access-ttkvm\") pod \"network-check-target-svdx4\" (UID: \"12885b90-19b5-4c6f-838e-22cc394e21db\") " pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:26:58.635467 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:58.635443 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 13:26:58.635467 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:58.635466 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 13:26:58.635575 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:58.635479 2563 projected.go:196] Error preparing data for projected volume kube-api-access-ttkvm for pod openshift-network-diagnostics/network-check-target-svdx4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:26:58.635575 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:58.635543 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12885b90-19b5-4c6f-838e-22cc394e21db-kube-api-access-ttkvm podName:12885b90-19b5-4c6f-838e-22cc394e21db nodeName:}" failed. No retries permitted until 2026-06-11 13:27:30.635521959 +0000 UTC m=+66.203940282 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ttkvm" (UniqueName: "kubernetes.io/projected/12885b90-19b5-4c6f-838e-22cc394e21db-kube-api-access-ttkvm") pod "network-check-target-svdx4" (UID: "12885b90-19b5-4c6f-838e-22cc394e21db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 13:26:58.840531 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:58.840461 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:26:58.840650 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:58.840586 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svdx4" podUID="12885b90-19b5-4c6f-838e-22cc394e21db" Jun 11 13:26:59.311291 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.311263 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-186.ec2.internal" event="NodeReady" Jun 11 13:26:59.311421 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.311410 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 13:26:59.350782 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.350757 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6999954d75-grkv5"] Jun 11 13:26:59.364851 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.364770 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-96zlw"] Jun 11 13:26:59.364940 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.364836 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:26:59.368792 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.367945 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 13:26:59.368792 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.367939 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 13:26:59.368792 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.368577 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 13:26:59.370144 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.370123 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fc7fj\"" Jun 11 13:26:59.372888 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.372873 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 13:26:59.379003 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.378983 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7cd67"] Jun 11 13:26:59.379124 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.379107 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-96zlw" Jun 11 13:26:59.381259 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.381243 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bmddv\"" Jun 11 13:26:59.381493 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.381476 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 13:26:59.381543 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.381496 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 13:26:59.399355 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.399334 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6999954d75-grkv5"] Jun 11 13:26:59.399433 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.399358 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7cd67"] Jun 11 13:26:59.399433 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.399370 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-96zlw"] Jun 11 13:26:59.399433 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.399427 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7cd67" Jun 11 13:26:59.401724 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.401703 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 13:26:59.401879 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.401862 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 13:26:59.402226 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.402210 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 13:26:59.402466 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.402451 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ttvjj\"" Jun 11 13:26:59.442609 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.442587 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/379feca0-7097-4421-bb88-a094c13ac9de-image-registry-private-configuration\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:26:59.442693 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.442635 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/379feca0-7097-4421-bb88-a094c13ac9de-registry-certificates\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:26:59.442693 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.442652 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/379feca0-7097-4421-bb88-a094c13ac9de-installation-pull-secrets\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:26:59.442769 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.442712 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/379feca0-7097-4421-bb88-a094c13ac9de-trusted-ca\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:26:59.442769 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.442733 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-bound-sa-token\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:26:59.442853 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.442767 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:26:59.442853 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.442798 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/379feca0-7097-4421-bb88-a094c13ac9de-ca-trust-extracted\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:26:59.442853 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.442826 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh65z\" (UniqueName: \"kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-kube-api-access-vh65z\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:26:59.543832 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.543809 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-tmp-dir\") pod \"dns-default-96zlw\" (UID: \"1a9b80d7-f85f-408f-aa85-4b4f4e1bded7\") " pod="openshift-dns/dns-default-96zlw" Jun 11 13:26:59.544271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.543836 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/379feca0-7097-4421-bb88-a094c13ac9de-image-registry-private-configuration\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:26:59.544271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.543867 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/379feca0-7097-4421-bb88-a094c13ac9de-registry-certificates\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:26:59.544271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.543886 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/379feca0-7097-4421-bb88-a094c13ac9de-installation-pull-secrets\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:26:59.544271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.543938 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/379feca0-7097-4421-bb88-a094c13ac9de-trusted-ca\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:26:59.544271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.543971 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-bound-sa-token\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:26:59.544271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.544007 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:26:59.544271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.544028 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/379feca0-7097-4421-bb88-a094c13ac9de-ca-trust-extracted\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:26:59.544271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.544078 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls\") pod \"dns-default-96zlw\" (UID: \"1a9b80d7-f85f-408f-aa85-4b4f4e1bded7\") " pod="openshift-dns/dns-default-96zlw" Jun 11 13:26:59.544271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.544145 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh65z\" (UniqueName: \"kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-kube-api-access-vh65z\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:26:59.544271 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:59.544160 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 13:26:59.544271 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:59.544175 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6999954d75-grkv5: secret "image-registry-tls" not found Jun 11 13:26:59.544271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.544177 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-config-volume\") pod \"dns-default-96zlw\" (UID: \"1a9b80d7-f85f-408f-aa85-4b4f4e1bded7\") " pod="openshift-dns/dns-default-96zlw" Jun 11 13:26:59.544271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.544200 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z77mj\" (UniqueName: \"kubernetes.io/projected/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-kube-api-access-z77mj\") pod \"dns-default-96zlw\" (UID: \"1a9b80d7-f85f-408f-aa85-4b4f4e1bded7\") " pod="openshift-dns/dns-default-96zlw" Jun 11 13:26:59.544271 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:59.544231 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls podName:379feca0-7097-4421-bb88-a094c13ac9de nodeName:}" failed. No retries permitted until 2026-06-11 13:27:00.044213742 +0000 UTC m=+35.612632050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls") pod "image-registry-6999954d75-grkv5" (UID: "379feca0-7097-4421-bb88-a094c13ac9de") : secret "image-registry-tls" not found Jun 11 13:26:59.544271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.544249 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/443f8e98-5a4b-4dd3-865a-78f1f3960ae1-cert\") pod \"ingress-canary-7cd67\" (UID: \"443f8e98-5a4b-4dd3-865a-78f1f3960ae1\") " pod="openshift-ingress-canary/ingress-canary-7cd67" Jun 11 13:26:59.544271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.544273 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwq9x\" (UniqueName: \"kubernetes.io/projected/443f8e98-5a4b-4dd3-865a-78f1f3960ae1-kube-api-access-pwq9x\") pod \"ingress-canary-7cd67\" (UID: \"443f8e98-5a4b-4dd3-865a-78f1f3960ae1\") " pod="openshift-ingress-canary/ingress-canary-7cd67" Jun 11 13:26:59.544798 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.544532 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/379feca0-7097-4421-bb88-a094c13ac9de-ca-trust-extracted\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:26:59.544798 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.544558 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/379feca0-7097-4421-bb88-a094c13ac9de-registry-certificates\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:26:59.544905 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.544886 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/379feca0-7097-4421-bb88-a094c13ac9de-trusted-ca\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:26:59.547501 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.547391 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/379feca0-7097-4421-bb88-a094c13ac9de-installation-pull-secrets\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:26:59.547572 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.547409 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/379feca0-7097-4421-bb88-a094c13ac9de-image-registry-private-configuration\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:26:59.554132 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.554112 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-bound-sa-token\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:26:59.554768 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.554751 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh65z\" (UniqueName: \"kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-kube-api-access-vh65z\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:26:59.645516 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.645448 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-tmp-dir\") pod \"dns-default-96zlw\" (UID: \"1a9b80d7-f85f-408f-aa85-4b4f4e1bded7\") " pod="openshift-dns/dns-default-96zlw" Jun 11 13:26:59.645516 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.645509 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls\") pod \"dns-default-96zlw\" (UID: \"1a9b80d7-f85f-408f-aa85-4b4f4e1bded7\") " pod="openshift-dns/dns-default-96zlw" Jun 11 13:26:59.645641 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.645534 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-config-volume\") pod \"dns-default-96zlw\" (UID: \"1a9b80d7-f85f-408f-aa85-4b4f4e1bded7\") " pod="openshift-dns/dns-default-96zlw" Jun 11 13:26:59.645641 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.645549 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z77mj\" (UniqueName: \"kubernetes.io/projected/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-kube-api-access-z77mj\") pod \"dns-default-96zlw\" (UID: \"1a9b80d7-f85f-408f-aa85-4b4f4e1bded7\") " pod="openshift-dns/dns-default-96zlw" Jun 11 13:26:59.645641 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.645564 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/443f8e98-5a4b-4dd3-865a-78f1f3960ae1-cert\") pod \"ingress-canary-7cd67\" (UID: \"443f8e98-5a4b-4dd3-865a-78f1f3960ae1\") " pod="openshift-ingress-canary/ingress-canary-7cd67" Jun 11 13:26:59.645641 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.645578 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwq9x\" (UniqueName: \"kubernetes.io/projected/443f8e98-5a4b-4dd3-865a-78f1f3960ae1-kube-api-access-pwq9x\") pod \"ingress-canary-7cd67\" (UID: \"443f8e98-5a4b-4dd3-865a-78f1f3960ae1\") " pod="openshift-ingress-canary/ingress-canary-7cd67" Jun 11 13:26:59.645772 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:59.645691 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 13:26:59.645772 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:26:59.645768 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls podName:1a9b80d7-f85f-408f-aa85-4b4f4e1bded7 nodeName:}" failed. No retries permitted until 2026-06-11 13:27:00.145746838 +0000 UTC m=+35.714165146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls") pod "dns-default-96zlw" (UID: "1a9b80d7-f85f-408f-aa85-4b4f4e1bded7") : secret "dns-default-metrics-tls" not found Jun 11 13:26:59.645855 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.645772 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-tmp-dir\") pod \"dns-default-96zlw\" (UID: \"1a9b80d7-f85f-408f-aa85-4b4f4e1bded7\") " pod="openshift-dns/dns-default-96zlw" Jun 11 13:26:59.646116 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.646080 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-config-volume\") pod \"dns-default-96zlw\" (UID: \"1a9b80d7-f85f-408f-aa85-4b4f4e1bded7\") " pod="openshift-dns/dns-default-96zlw" Jun 11 13:26:59.647755 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.647740 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/443f8e98-5a4b-4dd3-865a-78f1f3960ae1-cert\") pod \"ingress-canary-7cd67\" (UID: \"443f8e98-5a4b-4dd3-865a-78f1f3960ae1\") " pod="openshift-ingress-canary/ingress-canary-7cd67" Jun 11 13:26:59.653538 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.653520 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwq9x\" (UniqueName: \"kubernetes.io/projected/443f8e98-5a4b-4dd3-865a-78f1f3960ae1-kube-api-access-pwq9x\") pod \"ingress-canary-7cd67\" (UID: \"443f8e98-5a4b-4dd3-865a-78f1f3960ae1\") " pod="openshift-ingress-canary/ingress-canary-7cd67" Jun 11 13:26:59.664939 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.664919 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z77mj\" (UniqueName: \"kubernetes.io/projected/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-kube-api-access-z77mj\") pod \"dns-default-96zlw\" (UID: \"1a9b80d7-f85f-408f-aa85-4b4f4e1bded7\") " pod="openshift-dns/dns-default-96zlw" Jun 11 13:26:59.707169 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.707152 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7cd67" Jun 11 13:26:59.841037 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.841009 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:26:59.841171 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.841060 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:26:59.843434 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.843410 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 13:26:59.843617 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.843597 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8hj25\"" Jun 11 13:26:59.843698 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.843626 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 13:26:59.866273 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:26:59.866252 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7cd67"] Jun 11 13:27:00.047702 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:00.047677 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:27:00.047811 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:00.047777 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 13:27:00.047811 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:00.047787 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6999954d75-grkv5: secret "image-registry-tls" not found Jun 11 13:27:00.047872 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:00.047827 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls podName:379feca0-7097-4421-bb88-a094c13ac9de nodeName:}" failed. No retries permitted until 2026-06-11 13:27:01.047814036 +0000 UTC m=+36.616232341 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls") pod "image-registry-6999954d75-grkv5" (UID: "379feca0-7097-4421-bb88-a094c13ac9de") : secret "image-registry-tls" not found Jun 11 13:27:00.068066 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:00.068026 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7cd67" event={"ID":"443f8e98-5a4b-4dd3-865a-78f1f3960ae1","Type":"ContainerStarted","Data":"957eb061609f86acfe38b4ef27421cd0b68703f243eca271fc843d334e81343f"} Jun 11 13:27:00.070436 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:00.070416 2563 generic.go:356] "Generic (PLEG): container finished" podID="e3070766-1adb-409f-843f-8867c2861723" containerID="dcc639f5e3fa89cd238b3402a1db6b3d92f3ac7a9444ef32f343fd32c24864d3" exitCode=0 Jun 11 13:27:00.070510 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:00.070443 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5wltr" event={"ID":"e3070766-1adb-409f-843f-8867c2861723","Type":"ContainerDied","Data":"dcc639f5e3fa89cd238b3402a1db6b3d92f3ac7a9444ef32f343fd32c24864d3"} Jun 11 13:27:00.148720 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:00.148333 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls\") pod \"dns-default-96zlw\" (UID: \"1a9b80d7-f85f-408f-aa85-4b4f4e1bded7\") " pod="openshift-dns/dns-default-96zlw" Jun 11 13:27:00.148720 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:00.148476 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 13:27:00.148720 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:00.148594 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls podName:1a9b80d7-f85f-408f-aa85-4b4f4e1bded7 nodeName:}" failed. No retries permitted until 2026-06-11 13:27:01.148550213 +0000 UTC m=+36.716968538 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls") pod "dns-default-96zlw" (UID: "1a9b80d7-f85f-408f-aa85-4b4f4e1bded7") : secret "dns-default-metrics-tls" not found Jun 11 13:27:00.840887 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:00.840858 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:27:00.844282 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:00.844260 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rsrvd\"" Jun 11 13:27:00.844433 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:00.844259 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 13:27:00.844545 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:00.844260 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 13:27:01.054764 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:01.054738 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:27:01.054904 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:01.054890 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 13:27:01.054951 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:01.054907 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6999954d75-grkv5: secret "image-registry-tls" not found Jun 11 13:27:01.054991 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:01.054962 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls podName:379feca0-7097-4421-bb88-a094c13ac9de nodeName:}" failed. No retries permitted until 2026-06-11 13:27:03.054942995 +0000 UTC m=+38.623361303 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls") pod "image-registry-6999954d75-grkv5" (UID: "379feca0-7097-4421-bb88-a094c13ac9de") : secret "image-registry-tls" not found Jun 11 13:27:01.076574 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:01.076546 2563 generic.go:356] "Generic (PLEG): container finished" podID="e3070766-1adb-409f-843f-8867c2861723" containerID="bec26c11a2253bb66f4c27b3621665847aad388869cf9140b3114e74391c5912" exitCode=0 Jun 11 13:27:01.076695 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:01.076600 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5wltr" event={"ID":"e3070766-1adb-409f-843f-8867c2861723","Type":"ContainerDied","Data":"bec26c11a2253bb66f4c27b3621665847aad388869cf9140b3114e74391c5912"} Jun 11 13:27:01.155394 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:01.155190 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls\") pod \"dns-default-96zlw\" (UID: \"1a9b80d7-f85f-408f-aa85-4b4f4e1bded7\") " pod="openshift-dns/dns-default-96zlw" Jun 11 13:27:01.155510 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:01.155425 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 13:27:01.155510 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:01.155476 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls podName:1a9b80d7-f85f-408f-aa85-4b4f4e1bded7 nodeName:}" failed. No retries permitted until 2026-06-11 13:27:03.155463181 +0000 UTC m=+38.723881486 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls") pod "dns-default-96zlw" (UID: "1a9b80d7-f85f-408f-aa85-4b4f4e1bded7") : secret "dns-default-metrics-tls" not found Jun 11 13:27:02.083580 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:02.083548 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5wltr" event={"ID":"e3070766-1adb-409f-843f-8867c2861723","Type":"ContainerStarted","Data":"2eea2dda88ab431492ff59bf14a519aba73cf06a20d5714cdf300e6cef5fed05"} Jun 11 13:27:02.107310 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:02.107261 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5wltr" podStartSLOduration=18.447863816 podStartE2EDuration="37.107246113s" totalImagesPullingTime="18.659382297s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:26:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:27:02.105629204 +0000 UTC m=+37.674047706" watchObservedRunningTime="2026-06-11 13:27:02.107246113 +0000 UTC m=+37.675664440" Jun 11 13:27:02.257193 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:02.257158 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:27:02.344479 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:02.344412 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:27:03.069424 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:03.069389 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:27:03.069593 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:03.069559 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 13:27:03.069593 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:03.069581 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6999954d75-grkv5: secret "image-registry-tls" not found Jun 11 13:27:03.069723 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:03.069644 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls podName:379feca0-7097-4421-bb88-a094c13ac9de nodeName:}" failed. No retries permitted until 2026-06-11 13:27:07.069625439 +0000 UTC m=+42.638043746 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls") pod "image-registry-6999954d75-grkv5" (UID: "379feca0-7097-4421-bb88-a094c13ac9de") : secret "image-registry-tls" not found Jun 11 13:27:03.086879 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:03.086854 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7cd67" event={"ID":"443f8e98-5a4b-4dd3-865a-78f1f3960ae1","Type":"ContainerStarted","Data":"1d4e5b9c0e0dc17b5bc78655cd22b41564feaa8fac9544a38185668127163508"} Jun 11 13:27:03.103511 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:03.103468 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7cd67" podStartSLOduration=1.589188933 podStartE2EDuration="4.10345648s" totalImagesPullingTime="2.514267547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:27:03.102475612 +0000 UTC m=+38.670893939" watchObservedRunningTime="2026-06-11 13:27:03.10345648 +0000 UTC m=+38.671874827" Jun 11 13:27:03.163093 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:03.163068 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l"] Jun 11 13:27:03.166512 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:03.166498 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" Jun 11 13:27:03.170415 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:03.170393 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls\") pod \"dns-default-96zlw\" (UID: \"1a9b80d7-f85f-408f-aa85-4b4f4e1bded7\") " pod="openshift-dns/dns-default-96zlw" Jun 11 13:27:03.170514 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:03.170501 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 13:27:03.170586 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:03.170565 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls podName:1a9b80d7-f85f-408f-aa85-4b4f4e1bded7 nodeName:}" failed. No retries permitted until 2026-06-11 13:27:07.170548891 +0000 UTC m=+42.738967198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls") pod "dns-default-96zlw" (UID: "1a9b80d7-f85f-408f-aa85-4b4f4e1bded7") : secret "dns-default-metrics-tls" not found Jun 11 13:27:03.170963 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:03.170947 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 13:27:03.171461 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:03.171443 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 11 13:27:03.177981 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:03.177964 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 13:27:03.178084 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:03.178026 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 13:27:03.181810 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:03.181793 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l"] Jun 11 13:27:03.270865 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:03.270842 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fb472fb-6cf9-49ff-b052-82598fe6749d-tmp\") pod \"klusterlet-addon-workmgr-5559697b58-fkt6l\" (UID: \"4fb472fb-6cf9-49ff-b052-82598fe6749d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" Jun 11 13:27:03.270971 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:03.270884 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78bss\" (UniqueName: \"kubernetes.io/projected/4fb472fb-6cf9-49ff-b052-82598fe6749d-kube-api-access-78bss\") pod \"klusterlet-addon-workmgr-5559697b58-fkt6l\" (UID: \"4fb472fb-6cf9-49ff-b052-82598fe6749d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" Jun 11 13:27:03.270971 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:03.270925 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4fb472fb-6cf9-49ff-b052-82598fe6749d-klusterlet-config\") pod \"klusterlet-addon-workmgr-5559697b58-fkt6l\" (UID: \"4fb472fb-6cf9-49ff-b052-82598fe6749d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" Jun 11 13:27:03.371457 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:03.371394 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78bss\" (UniqueName: \"kubernetes.io/projected/4fb472fb-6cf9-49ff-b052-82598fe6749d-kube-api-access-78bss\") pod \"klusterlet-addon-workmgr-5559697b58-fkt6l\" (UID: \"4fb472fb-6cf9-49ff-b052-82598fe6749d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" Jun 11 13:27:03.371457 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:03.371442 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4fb472fb-6cf9-49ff-b052-82598fe6749d-klusterlet-config\") pod \"klusterlet-addon-workmgr-5559697b58-fkt6l\" (UID: \"4fb472fb-6cf9-49ff-b052-82598fe6749d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" Jun 11 13:27:03.371619 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:03.371601 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fb472fb-6cf9-49ff-b052-82598fe6749d-tmp\") pod \"klusterlet-addon-workmgr-5559697b58-fkt6l\" (UID: \"4fb472fb-6cf9-49ff-b052-82598fe6749d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" Jun 11 13:27:03.371941 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:03.371927 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fb472fb-6cf9-49ff-b052-82598fe6749d-tmp\") pod \"klusterlet-addon-workmgr-5559697b58-fkt6l\" (UID: \"4fb472fb-6cf9-49ff-b052-82598fe6749d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" Jun 11 13:27:03.375111 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:03.375095 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4fb472fb-6cf9-49ff-b052-82598fe6749d-klusterlet-config\") pod \"klusterlet-addon-workmgr-5559697b58-fkt6l\" (UID: \"4fb472fb-6cf9-49ff-b052-82598fe6749d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" Jun 11 13:27:03.380196 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:03.380177 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78bss\" (UniqueName: \"kubernetes.io/projected/4fb472fb-6cf9-49ff-b052-82598fe6749d-kube-api-access-78bss\") pod \"klusterlet-addon-workmgr-5559697b58-fkt6l\" (UID: \"4fb472fb-6cf9-49ff-b052-82598fe6749d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" Jun 11 13:27:03.475181 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:03.475164 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" Jun 11 13:27:03.602164 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:03.602139 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l"] Jun 11 13:27:03.605870 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:27:03.605841 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fb472fb_6cf9_49ff_b052_82598fe6749d.slice/crio-e8e95225203fe28142e9df907e3b20d19eec40a2ed10160f5db9ee58a46bd274 WatchSource:0}: Error finding container e8e95225203fe28142e9df907e3b20d19eec40a2ed10160f5db9ee58a46bd274: Status 404 returned error can't find the container with id e8e95225203fe28142e9df907e3b20d19eec40a2ed10160f5db9ee58a46bd274 Jun 11 13:27:04.090435 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:04.090404 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" event={"ID":"4fb472fb-6cf9-49ff-b052-82598fe6749d","Type":"ContainerStarted","Data":"e8e95225203fe28142e9df907e3b20d19eec40a2ed10160f5db9ee58a46bd274"} Jun 11 13:27:04.829769 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:04.829734 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:27:04.929772 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:04.929675 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:27:05.831487 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:05.831424 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:27:05.939241 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:05.939214 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:27:06.238162 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:06.238128 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:27:06.339171 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:06.339112 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:27:07.099661 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:07.099632 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:27:07.100131 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:07.099756 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 13:27:07.100131 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:07.099773 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6999954d75-grkv5: secret "image-registry-tls" not found Jun 11 13:27:07.100131 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:07.099837 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls podName:379feca0-7097-4421-bb88-a094c13ac9de nodeName:}" failed. No retries permitted until 2026-06-11 13:27:15.099819782 +0000 UTC m=+50.668238104 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls") pod "image-registry-6999954d75-grkv5" (UID: "379feca0-7097-4421-bb88-a094c13ac9de") : secret "image-registry-tls" not found Jun 11 13:27:07.200819 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:07.200786 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls\") pod \"dns-default-96zlw\" (UID: \"1a9b80d7-f85f-408f-aa85-4b4f4e1bded7\") " pod="openshift-dns/dns-default-96zlw" Jun 11 13:27:07.200969 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:07.200933 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 13:27:07.201081 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:07.201000 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls podName:1a9b80d7-f85f-408f-aa85-4b4f4e1bded7 nodeName:}" failed. No retries permitted until 2026-06-11 13:27:15.200983654 +0000 UTC m=+50.769401960 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls") pod "dns-default-96zlw" (UID: "1a9b80d7-f85f-408f-aa85-4b4f4e1bded7") : secret "dns-default-metrics-tls" not found Jun 11 13:27:07.415995 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:07.415886 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:27:07.516671 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:07.516627 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:27:07.616523 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:07.616483 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:27:08.936876 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:08.936849 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:27:09.001324 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:09.001305 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:27:09.103620 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:09.103591 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" event={"ID":"4fb472fb-6cf9-49ff-b052-82598fe6749d","Type":"ContainerStarted","Data":"9ad669a69ab37cda973a1974638bde849e8fd694424be1f99fd05523a2fcd5d0"} Jun 11 13:27:09.103761 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:09.103709 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" Jun 11 13:27:09.105233 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:09.105207 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" Jun 11 13:27:09.134883 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:09.134841 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" podStartSLOduration=1.285459718 podStartE2EDuration="6.13482911s" totalImagesPullingTime="4.849369392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:27:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:27:09.120444208 +0000 UTC m=+44.688862537" watchObservedRunningTime="2026-06-11 13:27:09.13482911 +0000 UTC m=+44.703247434" Jun 11 13:27:15.156664 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:15.156635 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:27:15.157162 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:15.156773 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 13:27:15.157162 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:15.156789 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6999954d75-grkv5: secret "image-registry-tls" not found Jun 11 13:27:15.157162 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:15.156837 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls podName:379feca0-7097-4421-bb88-a094c13ac9de nodeName:}" failed. No retries permitted until 2026-06-11 13:27:31.15682302 +0000 UTC m=+66.725241325 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls") pod "image-registry-6999954d75-grkv5" (UID: "379feca0-7097-4421-bb88-a094c13ac9de") : secret "image-registry-tls" not found Jun 11 13:27:15.257765 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:15.257741 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls\") pod \"dns-default-96zlw\" (UID: \"1a9b80d7-f85f-408f-aa85-4b4f4e1bded7\") " pod="openshift-dns/dns-default-96zlw" Jun 11 13:27:15.257881 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:15.257866 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 13:27:15.257930 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:15.257921 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls podName:1a9b80d7-f85f-408f-aa85-4b4f4e1bded7 nodeName:}" failed. No retries permitted until 2026-06-11 13:27:31.257909617 +0000 UTC m=+66.826327922 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls") pod "dns-default-96zlw" (UID: "1a9b80d7-f85f-408f-aa85-4b4f4e1bded7") : secret "dns-default-metrics-tls" not found Jun 11 13:27:26.069038 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:26.069009 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-87tcg" Jun 11 13:27:26.220425 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:26.220390 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:27:26.321063 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:26.320969 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:27:27.812620 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:27.812587 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:27:27.913148 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:27.913120 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:27:28.869012 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:28.868984 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:27:28.925237 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:28.925205 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:27:30.565738 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:30.565703 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-original-pull-secret\") pod \"global-pull-secret-syncer-kjtlg\" (UID: \"7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6\") " pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:27:30.566213 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:30.565752 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs\") pod \"network-metrics-daemon-698v8\" (UID: \"dbcbad68-5014-4dbd-99f2-087716f10a31\") " pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:27:30.568415 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:30.568394 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 13:27:30.568470 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:30.568443 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 13:27:30.576370 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:30.576354 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 13:27:30.576440 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:30.576428 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs podName:dbcbad68-5014-4dbd-99f2-087716f10a31 nodeName:}" failed. No retries permitted until 2026-06-11 13:28:34.576410502 +0000 UTC m=+130.144828821 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs") pod "network-metrics-daemon-698v8" (UID: "dbcbad68-5014-4dbd-99f2-087716f10a31") : secret "metrics-daemon-secret" not found Jun 11 13:27:30.579299 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:30.579279 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6-original-pull-secret\") pod \"global-pull-secret-syncer-kjtlg\" (UID: \"7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6\") " pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:27:30.666570 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:30.666541 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttkvm\" (UniqueName: \"kubernetes.io/projected/12885b90-19b5-4c6f-838e-22cc394e21db-kube-api-access-ttkvm\") pod \"network-check-target-svdx4\" (UID: \"12885b90-19b5-4c6f-838e-22cc394e21db\") " pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:27:30.668934 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:30.668919 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 13:27:30.678927 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:30.678911 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 13:27:30.690076 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:30.690038 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttkvm\" (UniqueName: \"kubernetes.io/projected/12885b90-19b5-4c6f-838e-22cc394e21db-kube-api-access-ttkvm\") pod \"network-check-target-svdx4\" (UID: \"12885b90-19b5-4c6f-838e-22cc394e21db\") " pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:27:30.756218 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:30.756178 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjtlg" Jun 11 13:27:30.854274 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:30.854248 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rsrvd\"" Jun 11 13:27:30.861517 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:30.861478 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:27:30.876292 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:30.876268 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kjtlg"] Jun 11 13:27:30.877915 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:27:30.877889 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b28e1df_48c1_48ff_bc7b_f1d7512fb5f6.slice/crio-b98081d6d8fcf3fba9b3130ca4d35f5462f3499c6af8a4d92f71223386bb48ea WatchSource:0}: Error finding container b98081d6d8fcf3fba9b3130ca4d35f5462f3499c6af8a4d92f71223386bb48ea: Status 404 returned error can't find the container with id b98081d6d8fcf3fba9b3130ca4d35f5462f3499c6af8a4d92f71223386bb48ea Jun 11 13:27:30.979495 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:30.979463 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-svdx4"] Jun 11 13:27:30.982489 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:27:30.982464 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12885b90_19b5_4c6f_838e_22cc394e21db.slice/crio-903a7540866e7ebc1c09fc551505a0e103dc46b58a7737b5061f65f36c69126b WatchSource:0}: Error finding container 903a7540866e7ebc1c09fc551505a0e103dc46b58a7737b5061f65f36c69126b: Status 404 returned error can't find the container with id 903a7540866e7ebc1c09fc551505a0e103dc46b58a7737b5061f65f36c69126b Jun 11 13:27:31.151923 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:31.151836 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-svdx4" event={"ID":"12885b90-19b5-4c6f-838e-22cc394e21db","Type":"ContainerStarted","Data":"903a7540866e7ebc1c09fc551505a0e103dc46b58a7737b5061f65f36c69126b"} Jun 11 13:27:31.152829 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:31.152807 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kjtlg" event={"ID":"7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6","Type":"ContainerStarted","Data":"b98081d6d8fcf3fba9b3130ca4d35f5462f3499c6af8a4d92f71223386bb48ea"} Jun 11 13:27:31.171186 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:31.171158 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:27:31.171310 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:31.171295 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 13:27:31.171357 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:31.171312 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6999954d75-grkv5: secret "image-registry-tls" not found Jun 11 13:27:31.171397 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:31.171363 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls podName:379feca0-7097-4421-bb88-a094c13ac9de nodeName:}" failed. No retries permitted until 2026-06-11 13:28:03.171347615 +0000 UTC m=+98.739765920 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls") pod "image-registry-6999954d75-grkv5" (UID: "379feca0-7097-4421-bb88-a094c13ac9de") : secret "image-registry-tls" not found Jun 11 13:27:31.272175 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:31.272122 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls\") pod \"dns-default-96zlw\" (UID: \"1a9b80d7-f85f-408f-aa85-4b4f4e1bded7\") " pod="openshift-dns/dns-default-96zlw" Jun 11 13:27:31.272329 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:31.272294 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 13:27:31.272371 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:27:31.272363 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls podName:1a9b80d7-f85f-408f-aa85-4b4f4e1bded7 nodeName:}" failed. No retries permitted until 2026-06-11 13:28:03.272343046 +0000 UTC m=+98.840761365 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls") pod "dns-default-96zlw" (UID: "1a9b80d7-f85f-408f-aa85-4b4f4e1bded7") : secret "dns-default-metrics-tls" not found Jun 11 13:27:34.162415 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:34.162330 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-svdx4" event={"ID":"12885b90-19b5-4c6f-838e-22cc394e21db","Type":"ContainerStarted","Data":"a91b9aba64afa68289e9d0fbf2d0292193d6dafd8d83d55bba11433d7fe61625"} Jun 11 13:27:34.162822 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:34.162416 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:27:34.177935 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:34.177875 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-svdx4" podStartSLOduration=67.30015948 podStartE2EDuration="1m10.177856167s" totalImagesPullingTime="2.877696687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:26:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:27:34.177125962 +0000 UTC m=+69.745544290" watchObservedRunningTime="2026-06-11 13:27:34.177856167 +0000 UTC m=+69.746274494" Jun 11 13:27:36.169333 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:36.169296 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kjtlg" event={"ID":"7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6","Type":"ContainerStarted","Data":"9c40138ed07161924df2cb1ba09fa48f89412b29426968b87acfa57b28bdb284"} Jun 11 13:27:36.184738 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:36.184689 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kjtlg" podStartSLOduration=66.78923886 podStartE2EDuration="1m11.184674483s" totalImagesPullingTime="4.395435623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:27:36.184120866 +0000 UTC m=+71.752539193" watchObservedRunningTime="2026-06-11 13:27:36.184674483 +0000 UTC m=+71.753092809" Jun 11 13:27:39.524262 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:39.524227 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:27:39.625323 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:27:39.625293 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:28:03.184982 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:28:03.184877 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:28:03.185416 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:28:03.185078 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 13:28:03.185416 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:28:03.185099 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6999954d75-grkv5: secret "image-registry-tls" not found Jun 11 13:28:03.185416 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:28:03.185168 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls podName:379feca0-7097-4421-bb88-a094c13ac9de nodeName:}" failed. No retries permitted until 2026-06-11 13:29:07.185145292 +0000 UTC m=+162.753563621 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls") pod "image-registry-6999954d75-grkv5" (UID: "379feca0-7097-4421-bb88-a094c13ac9de") : secret "image-registry-tls" not found Jun 11 13:28:03.285466 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:28:03.285407 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls\") pod \"dns-default-96zlw\" (UID: \"1a9b80d7-f85f-408f-aa85-4b4f4e1bded7\") " pod="openshift-dns/dns-default-96zlw" Jun 11 13:28:03.285643 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:28:03.285539 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 13:28:03.285643 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:28:03.285600 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls podName:1a9b80d7-f85f-408f-aa85-4b4f4e1bded7 nodeName:}" failed. No retries permitted until 2026-06-11 13:29:07.285582184 +0000 UTC m=+162.854000491 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls") pod "dns-default-96zlw" (UID: "1a9b80d7-f85f-408f-aa85-4b4f4e1bded7") : secret "dns-default-metrics-tls" not found Jun 11 13:28:05.168487 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:28:05.168459 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-svdx4" Jun 11 13:28:34.587135 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:28:34.587091 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs\") pod \"network-metrics-daemon-698v8\" (UID: \"dbcbad68-5014-4dbd-99f2-087716f10a31\") " pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:28:34.587636 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:28:34.587220 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 13:28:34.587636 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:28:34.587292 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs podName:dbcbad68-5014-4dbd-99f2-087716f10a31 nodeName:}" failed. No retries permitted until 2026-06-11 13:30:36.587272514 +0000 UTC m=+252.155690820 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs") pod "network-metrics-daemon-698v8" (UID: "dbcbad68-5014-4dbd-99f2-087716f10a31") : secret "metrics-daemon-secret" not found Jun 11 13:29:02.378134 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:29:02.378100 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6999954d75-grkv5" podUID="379feca0-7097-4421-bb88-a094c13ac9de" Jun 11 13:29:02.387220 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:29:02.387200 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-96zlw" podUID="1a9b80d7-f85f-408f-aa85-4b4f4e1bded7" Jun 11 13:29:02.851404 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:29:02.851367 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-698v8" podUID="dbcbad68-5014-4dbd-99f2-087716f10a31" Jun 11 13:29:03.362181 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:29:03.362155 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-96zlw" Jun 11 13:29:03.362315 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:29:03.362158 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:29:07.199592 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:29:07.199551 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:29:07.199943 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:29:07.199693 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 13:29:07.199943 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:29:07.199711 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6999954d75-grkv5: secret "image-registry-tls" not found Jun 11 13:29:07.199943 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:29:07.199770 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls podName:379feca0-7097-4421-bb88-a094c13ac9de nodeName:}" failed. No retries permitted until 2026-06-11 13:31:09.199753469 +0000 UTC m=+284.768171794 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls") pod "image-registry-6999954d75-grkv5" (UID: "379feca0-7097-4421-bb88-a094c13ac9de") : secret "image-registry-tls" not found Jun 11 13:29:07.300547 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:29:07.300523 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls\") pod \"dns-default-96zlw\" (UID: \"1a9b80d7-f85f-408f-aa85-4b4f4e1bded7\") " pod="openshift-dns/dns-default-96zlw" Jun 11 13:29:07.300636 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:29:07.300625 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 13:29:07.300683 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:29:07.300675 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls podName:1a9b80d7-f85f-408f-aa85-4b4f4e1bded7 nodeName:}" failed. No retries permitted until 2026-06-11 13:31:09.300664067 +0000 UTC m=+284.869082372 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls") pod "dns-default-96zlw" (UID: "1a9b80d7-f85f-408f-aa85-4b4f4e1bded7") : secret "dns-default-metrics-tls" not found Jun 11 13:29:09.104851 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:29:09.104806 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" podUID="4fb472fb-6cf9-49ff-b052-82598fe6749d" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused" Jun 11 13:29:09.377851 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:29:09.377793 2563 generic.go:356] "Generic (PLEG): container finished" podID="4fb472fb-6cf9-49ff-b052-82598fe6749d" containerID="9ad669a69ab37cda973a1974638bde849e8fd694424be1f99fd05523a2fcd5d0" exitCode=1 Jun 11 13:29:09.377851 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:29:09.377842 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" event={"ID":"4fb472fb-6cf9-49ff-b052-82598fe6749d","Type":"ContainerDied","Data":"9ad669a69ab37cda973a1974638bde849e8fd694424be1f99fd05523a2fcd5d0"} Jun 11 13:29:09.378121 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:29:09.378108 2563 scope.go:117] "RemoveContainer" containerID="9ad669a69ab37cda973a1974638bde849e8fd694424be1f99fd05523a2fcd5d0" Jun 11 13:29:10.382405 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:29:10.382371 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" event={"ID":"4fb472fb-6cf9-49ff-b052-82598fe6749d","Type":"ContainerStarted","Data":"fd38ccda45178e3ac6bbca3224e49cfeb70310f3857302593ae778cbb99f8429"} Jun 11 13:29:10.382852 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:29:10.382728 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" Jun 11 13:29:10.383240 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:29:10.383228 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" Jun 11 13:29:16.841428 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:29:16.841396 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:29:28.418411 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:29:28.418360 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:24.856902 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:24.856870 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:36.668666 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:36.668632 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs\") pod \"network-metrics-daemon-698v8\" (UID: \"dbcbad68-5014-4dbd-99f2-087716f10a31\") " pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:30:36.669137 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:36.668732 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 13:30:36.669137 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:36.668788 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs podName:dbcbad68-5014-4dbd-99f2-087716f10a31 nodeName:}" failed. No retries permitted until 2026-06-11 13:32:38.668775156 +0000 UTC m=+374.237193461 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs") pod "network-metrics-daemon-698v8" (UID: "dbcbad68-5014-4dbd-99f2-087716f10a31") : secret "metrics-daemon-secret" not found Jun 11 13:30:39.363682 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:39.363627 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:39.417676 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:39.417633 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:47.297949 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.297858 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dsftk"] Jun 11 13:30:47.300689 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.300668 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7795d4b9f9-p7jbr"] Jun 11 13:30:47.300879 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.300810 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dsftk" Jun 11 13:30:47.303434 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.303414 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:30:47.303678 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.303576 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 11 13:30:47.304743 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.304726 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 13:30:47.304906 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.304887 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 11 13:30:47.304957 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.304923 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 13:30:47.305007 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.304887 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-q5gdn\"" Jun 11 13:30:47.305621 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.305608 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 13:30:47.305668 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.305636 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 11 13:30:47.305806 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.305785 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 11 13:30:47.306126 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.306110 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 11 13:30:47.306704 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.306686 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 11 13:30:47.306776 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.306763 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gb55v\"" Jun 11 13:30:47.307940 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.307919 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 13:30:47.314989 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.314970 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dsftk"] Jun 11 13:30:47.322212 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.322193 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7795d4b9f9-p7jbr"] Jun 11 13:30:47.341129 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.341104 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-default-certificate\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:30:47.341240 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.341139 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-stats-auth\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:30:47.341240 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.341197 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2a82040-2b53-4601-9b06-30a8d1f74749-service-ca-bundle\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:30:47.341240 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.341225 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f97xc\" (UniqueName: \"kubernetes.io/projected/f2a82040-2b53-4601-9b06-30a8d1f74749-kube-api-access-f97xc\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:30:47.341335 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.341241 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5225166c-f562-4f2b-b455-6b632cac5728-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dsftk\" (UID: \"5225166c-f562-4f2b-b455-6b632cac5728\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dsftk" Jun 11 13:30:47.341335 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.341276 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-metrics-certs\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:30:47.341398 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.341337 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5225166c-f562-4f2b-b455-6b632cac5728-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-dsftk\" (UID: \"5225166c-f562-4f2b-b455-6b632cac5728\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dsftk" Jun 11 13:30:47.341398 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.341364 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4kq4\" (UniqueName: \"kubernetes.io/projected/5225166c-f562-4f2b-b455-6b632cac5728-kube-api-access-f4kq4\") pod \"cluster-monitoring-operator-74bbf69bbb-dsftk\" (UID: \"5225166c-f562-4f2b-b455-6b632cac5728\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dsftk" Jun 11 13:30:47.375237 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.375203 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-c827l"] Jun 11 13:30:47.377936 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.377920 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c827l" Jun 11 13:30:47.380926 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.380901 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 11 13:30:47.381185 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.381170 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 11 13:30:47.381604 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.381587 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-57t66\"" Jun 11 13:30:47.390849 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.390827 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-c827l"] Jun 11 13:30:47.441884 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.441856 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-metrics-certs\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:30:47.442017 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.441903 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-default-certificate\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:30:47.442017 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.441928 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2b6be6bd-eb90-46b7-aa8f-dba0063c97ed-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-c827l\" (UID: \"2b6be6bd-eb90-46b7-aa8f-dba0063c97ed\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c827l" Jun 11 13:30:47.442017 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.441955 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f97xc\" (UniqueName: \"kubernetes.io/projected/f2a82040-2b53-4601-9b06-30a8d1f74749-kube-api-access-f97xc\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:30:47.442017 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.441979 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5225166c-f562-4f2b-b455-6b632cac5728-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dsftk\" (UID: \"5225166c-f562-4f2b-b455-6b632cac5728\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dsftk" Jun 11 13:30:47.442017 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:47.441995 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 13:30:47.442288 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.442021 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5225166c-f562-4f2b-b455-6b632cac5728-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-dsftk\" (UID: \"5225166c-f562-4f2b-b455-6b632cac5728\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dsftk" Jun 11 13:30:47.442288 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.442067 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4kq4\" (UniqueName: \"kubernetes.io/projected/5225166c-f562-4f2b-b455-6b632cac5728-kube-api-access-f4kq4\") pod \"cluster-monitoring-operator-74bbf69bbb-dsftk\" (UID: \"5225166c-f562-4f2b-b455-6b632cac5728\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dsftk" Jun 11 13:30:47.442288 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:47.442082 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-metrics-certs podName:f2a82040-2b53-4601-9b06-30a8d1f74749 nodeName:}" failed. No retries permitted until 2026-06-11 13:30:47.942061671 +0000 UTC m=+263.510479990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-metrics-certs") pod "router-default-7795d4b9f9-p7jbr" (UID: "f2a82040-2b53-4601-9b06-30a8d1f74749") : secret "router-metrics-certs-default" not found Jun 11 13:30:47.442288 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.442123 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b6be6bd-eb90-46b7-aa8f-dba0063c97ed-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c827l\" (UID: \"2b6be6bd-eb90-46b7-aa8f-dba0063c97ed\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c827l" Jun 11 13:30:47.442288 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:47.442145 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 13:30:47.442288 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.442162 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-stats-auth\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:30:47.442288 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:47.442215 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5225166c-f562-4f2b-b455-6b632cac5728-cluster-monitoring-operator-tls podName:5225166c-f562-4f2b-b455-6b632cac5728 nodeName:}" failed. No retries permitted until 2026-06-11 13:30:47.942197298 +0000 UTC m=+263.510615606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5225166c-f562-4f2b-b455-6b632cac5728-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-dsftk" (UID: "5225166c-f562-4f2b-b455-6b632cac5728") : secret "cluster-monitoring-operator-tls" not found Jun 11 13:30:47.442288 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.442237 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2a82040-2b53-4601-9b06-30a8d1f74749-service-ca-bundle\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:30:47.442590 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:47.442399 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f2a82040-2b53-4601-9b06-30a8d1f74749-service-ca-bundle podName:f2a82040-2b53-4601-9b06-30a8d1f74749 nodeName:}" failed. No retries permitted until 2026-06-11 13:30:47.942379299 +0000 UTC m=+263.510797619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f2a82040-2b53-4601-9b06-30a8d1f74749-service-ca-bundle") pod "router-default-7795d4b9f9-p7jbr" (UID: "f2a82040-2b53-4601-9b06-30a8d1f74749") : configmap references non-existent config key: service-ca.crt Jun 11 13:30:47.443199 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.443177 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5225166c-f562-4f2b-b455-6b632cac5728-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-dsftk\" (UID: \"5225166c-f562-4f2b-b455-6b632cac5728\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dsftk" Jun 11 13:30:47.444577 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.444557 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-default-certificate\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:30:47.444654 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.444600 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-stats-auth\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:30:47.452658 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.452636 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f97xc\" (UniqueName: \"kubernetes.io/projected/f2a82040-2b53-4601-9b06-30a8d1f74749-kube-api-access-f97xc\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:30:47.452769 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.452739 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4kq4\" (UniqueName: \"kubernetes.io/projected/5225166c-f562-4f2b-b455-6b632cac5728-kube-api-access-f4kq4\") pod \"cluster-monitoring-operator-74bbf69bbb-dsftk\" (UID: \"5225166c-f562-4f2b-b455-6b632cac5728\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dsftk" Jun 11 13:30:47.542881 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.542848 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2b6be6bd-eb90-46b7-aa8f-dba0063c97ed-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-c827l\" (UID: \"2b6be6bd-eb90-46b7-aa8f-dba0063c97ed\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c827l" Jun 11 13:30:47.543037 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.542906 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b6be6bd-eb90-46b7-aa8f-dba0063c97ed-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c827l\" (UID: \"2b6be6bd-eb90-46b7-aa8f-dba0063c97ed\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c827l" Jun 11 13:30:47.543037 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:47.543022 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 13:30:47.543132 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:47.543111 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b6be6bd-eb90-46b7-aa8f-dba0063c97ed-networking-console-plugin-cert podName:2b6be6bd-eb90-46b7-aa8f-dba0063c97ed nodeName:}" failed. No retries permitted until 2026-06-11 13:30:48.043090757 +0000 UTC m=+263.611509063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b6be6bd-eb90-46b7-aa8f-dba0063c97ed-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-c827l" (UID: "2b6be6bd-eb90-46b7-aa8f-dba0063c97ed") : secret "networking-console-plugin-cert" not found Jun 11 13:30:47.543566 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.543548 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2b6be6bd-eb90-46b7-aa8f-dba0063c97ed-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-c827l\" (UID: \"2b6be6bd-eb90-46b7-aa8f-dba0063c97ed\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c827l" Jun 11 13:30:47.552025 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.551974 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:47.652127 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.652100 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:47.946648 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.946576 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5225166c-f562-4f2b-b455-6b632cac5728-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dsftk\" (UID: \"5225166c-f562-4f2b-b455-6b632cac5728\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dsftk" Jun 11 13:30:47.946648 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.946640 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2a82040-2b53-4601-9b06-30a8d1f74749-service-ca-bundle\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:30:47.946800 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:47.946660 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-metrics-certs\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:30:47.946800 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:47.946712 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 13:30:47.946800 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:47.946750 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 13:30:47.946800 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:47.946772 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5225166c-f562-4f2b-b455-6b632cac5728-cluster-monitoring-operator-tls podName:5225166c-f562-4f2b-b455-6b632cac5728 nodeName:}" failed. No retries permitted until 2026-06-11 13:30:48.946756942 +0000 UTC m=+264.515175247 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5225166c-f562-4f2b-b455-6b632cac5728-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-dsftk" (UID: "5225166c-f562-4f2b-b455-6b632cac5728") : secret "cluster-monitoring-operator-tls" not found Jun 11 13:30:47.946800 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:47.946790 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-metrics-certs podName:f2a82040-2b53-4601-9b06-30a8d1f74749 nodeName:}" failed. No retries permitted until 2026-06-11 13:30:48.946778652 +0000 UTC m=+264.515196958 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-metrics-certs") pod "router-default-7795d4b9f9-p7jbr" (UID: "f2a82040-2b53-4601-9b06-30a8d1f74749") : secret "router-metrics-certs-default" not found Jun 11 13:30:47.946800 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:47.946802 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f2a82040-2b53-4601-9b06-30a8d1f74749-service-ca-bundle podName:f2a82040-2b53-4601-9b06-30a8d1f74749 nodeName:}" failed. No retries permitted until 2026-06-11 13:30:48.946796104 +0000 UTC m=+264.515214410 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f2a82040-2b53-4601-9b06-30a8d1f74749-service-ca-bundle") pod "router-default-7795d4b9f9-p7jbr" (UID: "f2a82040-2b53-4601-9b06-30a8d1f74749") : configmap references non-existent config key: service-ca.crt Jun 11 13:30:48.047580 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:48.047555 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b6be6bd-eb90-46b7-aa8f-dba0063c97ed-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c827l\" (UID: \"2b6be6bd-eb90-46b7-aa8f-dba0063c97ed\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c827l" Jun 11 13:30:48.047675 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:48.047662 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 13:30:48.047717 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:48.047708 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b6be6bd-eb90-46b7-aa8f-dba0063c97ed-networking-console-plugin-cert podName:2b6be6bd-eb90-46b7-aa8f-dba0063c97ed nodeName:}" failed. No retries permitted until 2026-06-11 13:30:49.047693135 +0000 UTC m=+264.616111443 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b6be6bd-eb90-46b7-aa8f-dba0063c97ed-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-c827l" (UID: "2b6be6bd-eb90-46b7-aa8f-dba0063c97ed") : secret "networking-console-plugin-cert" not found Jun 11 13:30:48.954053 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:48.954019 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2a82040-2b53-4601-9b06-30a8d1f74749-service-ca-bundle\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:30:48.954409 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:48.954069 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-metrics-certs\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:30:48.954409 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:48.954160 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 13:30:48.954409 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:48.954194 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f2a82040-2b53-4601-9b06-30a8d1f74749-service-ca-bundle podName:f2a82040-2b53-4601-9b06-30a8d1f74749 nodeName:}" failed. No retries permitted until 2026-06-11 13:30:50.954176193 +0000 UTC m=+266.522594499 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f2a82040-2b53-4601-9b06-30a8d1f74749-service-ca-bundle") pod "router-default-7795d4b9f9-p7jbr" (UID: "f2a82040-2b53-4601-9b06-30a8d1f74749") : configmap references non-existent config key: service-ca.crt Jun 11 13:30:48.954409 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:48.954214 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-metrics-certs podName:f2a82040-2b53-4601-9b06-30a8d1f74749 nodeName:}" failed. No retries permitted until 2026-06-11 13:30:50.95420739 +0000 UTC m=+266.522625695 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-metrics-certs") pod "router-default-7795d4b9f9-p7jbr" (UID: "f2a82040-2b53-4601-9b06-30a8d1f74749") : secret "router-metrics-certs-default" not found Jun 11 13:30:48.954409 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:48.954228 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5225166c-f562-4f2b-b455-6b632cac5728-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dsftk\" (UID: \"5225166c-f562-4f2b-b455-6b632cac5728\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dsftk" Jun 11 13:30:48.954409 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:48.954304 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 13:30:48.954409 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:48.954332 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5225166c-f562-4f2b-b455-6b632cac5728-cluster-monitoring-operator-tls podName:5225166c-f562-4f2b-b455-6b632cac5728 nodeName:}" failed. No retries permitted until 2026-06-11 13:30:50.954326235 +0000 UTC m=+266.522744541 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5225166c-f562-4f2b-b455-6b632cac5728-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-dsftk" (UID: "5225166c-f562-4f2b-b455-6b632cac5728") : secret "cluster-monitoring-operator-tls" not found Jun 11 13:30:49.054644 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:49.054603 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b6be6bd-eb90-46b7-aa8f-dba0063c97ed-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c827l\" (UID: \"2b6be6bd-eb90-46b7-aa8f-dba0063c97ed\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c827l" Jun 11 13:30:49.054792 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:49.054734 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 13:30:49.054792 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:49.054785 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b6be6bd-eb90-46b7-aa8f-dba0063c97ed-networking-console-plugin-cert podName:2b6be6bd-eb90-46b7-aa8f-dba0063c97ed nodeName:}" failed. No retries permitted until 2026-06-11 13:30:51.05477204 +0000 UTC m=+266.623190347 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b6be6bd-eb90-46b7-aa8f-dba0063c97ed-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-c827l" (UID: "2b6be6bd-eb90-46b7-aa8f-dba0063c97ed") : secret "networking-console-plugin-cert" not found Jun 11 13:30:50.481989 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:50.481946 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:50.969806 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:50.969778 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2a82040-2b53-4601-9b06-30a8d1f74749-service-ca-bundle\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:30:50.969945 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:50.969814 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-metrics-certs\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:30:50.969945 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:50.969854 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5225166c-f562-4f2b-b455-6b632cac5728-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dsftk\" (UID: \"5225166c-f562-4f2b-b455-6b632cac5728\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dsftk" Jun 11 13:30:50.969945 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:50.969926 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 13:30:50.970124 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:50.969927 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f2a82040-2b53-4601-9b06-30a8d1f74749-service-ca-bundle podName:f2a82040-2b53-4601-9b06-30a8d1f74749 nodeName:}" failed. No retries permitted until 2026-06-11 13:30:54.969911849 +0000 UTC m=+270.538330155 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f2a82040-2b53-4601-9b06-30a8d1f74749-service-ca-bundle") pod "router-default-7795d4b9f9-p7jbr" (UID: "f2a82040-2b53-4601-9b06-30a8d1f74749") : configmap references non-existent config key: service-ca.crt Jun 11 13:30:50.970124 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:50.969979 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 13:30:50.970124 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:50.970002 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-metrics-certs podName:f2a82040-2b53-4601-9b06-30a8d1f74749 nodeName:}" failed. No retries permitted until 2026-06-11 13:30:54.969971595 +0000 UTC m=+270.538389906 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-metrics-certs") pod "router-default-7795d4b9f9-p7jbr" (UID: "f2a82040-2b53-4601-9b06-30a8d1f74749") : secret "router-metrics-certs-default" not found Jun 11 13:30:50.970124 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:50.970022 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5225166c-f562-4f2b-b455-6b632cac5728-cluster-monitoring-operator-tls podName:5225166c-f562-4f2b-b455-6b632cac5728 nodeName:}" failed. No retries permitted until 2026-06-11 13:30:54.970011438 +0000 UTC m=+270.538429743 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5225166c-f562-4f2b-b455-6b632cac5728-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-dsftk" (UID: "5225166c-f562-4f2b-b455-6b632cac5728") : secret "cluster-monitoring-operator-tls" not found Jun 11 13:30:51.070468 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:51.070434 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b6be6bd-eb90-46b7-aa8f-dba0063c97ed-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c827l\" (UID: \"2b6be6bd-eb90-46b7-aa8f-dba0063c97ed\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c827l" Jun 11 13:30:51.070610 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:51.070548 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 13:30:51.070610 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:51.070589 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b6be6bd-eb90-46b7-aa8f-dba0063c97ed-networking-console-plugin-cert podName:2b6be6bd-eb90-46b7-aa8f-dba0063c97ed nodeName:}" failed. No retries permitted until 2026-06-11 13:30:55.070577134 +0000 UTC m=+270.638995439 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b6be6bd-eb90-46b7-aa8f-dba0063c97ed-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-c827l" (UID: "2b6be6bd-eb90-46b7-aa8f-dba0063c97ed") : secret "networking-console-plugin-cert" not found Jun 11 13:30:52.396991 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:52.396956 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:52.524015 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:52.523983 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:52.784016 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:52.783983 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:52.843755 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:52.843724 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:53.209891 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:53.209864 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:53.318114 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:53.318074 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:53.382985 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:53.382954 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:53.489135 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:53.489034 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:53.588991 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:53.588961 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:54.545387 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:54.545359 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-swccc_f047a728-0ff9-4b65-ba9d-7dfcacb808f4/dns-node-resolver/0.log" Jun 11 13:30:55.006556 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.006515 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2a82040-2b53-4601-9b06-30a8d1f74749-service-ca-bundle\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:30:55.006556 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.006562 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-metrics-certs\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:30:55.006777 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.006625 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5225166c-f562-4f2b-b455-6b632cac5728-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dsftk\" (UID: \"5225166c-f562-4f2b-b455-6b632cac5728\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dsftk" Jun 11 13:30:55.006777 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:55.006689 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f2a82040-2b53-4601-9b06-30a8d1f74749-service-ca-bundle podName:f2a82040-2b53-4601-9b06-30a8d1f74749 nodeName:}" failed. No retries permitted until 2026-06-11 13:31:03.006668651 +0000 UTC m=+278.575086960 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f2a82040-2b53-4601-9b06-30a8d1f74749-service-ca-bundle") pod "router-default-7795d4b9f9-p7jbr" (UID: "f2a82040-2b53-4601-9b06-30a8d1f74749") : configmap references non-existent config key: service-ca.crt Jun 11 13:30:55.006777 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:55.006730 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 13:30:55.006928 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:55.006731 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 13:30:55.006928 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:55.006818 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-metrics-certs podName:f2a82040-2b53-4601-9b06-30a8d1f74749 nodeName:}" failed. No retries permitted until 2026-06-11 13:31:03.006800996 +0000 UTC m=+278.575219304 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-metrics-certs") pod "router-default-7795d4b9f9-p7jbr" (UID: "f2a82040-2b53-4601-9b06-30a8d1f74749") : secret "router-metrics-certs-default" not found Jun 11 13:30:55.006928 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:55.006893 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5225166c-f562-4f2b-b455-6b632cac5728-cluster-monitoring-operator-tls podName:5225166c-f562-4f2b-b455-6b632cac5728 nodeName:}" failed. No retries permitted until 2026-06-11 13:31:03.006866758 +0000 UTC m=+278.575285077 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5225166c-f562-4f2b-b455-6b632cac5728-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-dsftk" (UID: "5225166c-f562-4f2b-b455-6b632cac5728") : secret "cluster-monitoring-operator-tls" not found Jun 11 13:30:55.085592 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.085555 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-qpwmf"] Jun 11 13:30:55.089420 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.089404 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-qpwmf" Jun 11 13:30:55.091510 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.091484 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 11 13:30:55.091611 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.091541 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xdfz7\"" Jun 11 13:30:55.091611 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.091549 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 11 13:30:55.092199 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.092171 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 11 13:30:55.092279 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.092205 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 11 13:30:55.093877 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.093860 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-qpwmf"] Jun 11 13:30:55.107746 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.107727 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b6be6bd-eb90-46b7-aa8f-dba0063c97ed-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c827l\" (UID: \"2b6be6bd-eb90-46b7-aa8f-dba0063c97ed\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c827l" Jun 11 13:30:55.107866 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:55.107850 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 13:30:55.107914 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:30:55.107904 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b6be6bd-eb90-46b7-aa8f-dba0063c97ed-networking-console-plugin-cert podName:2b6be6bd-eb90-46b7-aa8f-dba0063c97ed nodeName:}" failed. No retries permitted until 2026-06-11 13:31:03.107890508 +0000 UTC m=+278.676308814 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b6be6bd-eb90-46b7-aa8f-dba0063c97ed-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-c827l" (UID: "2b6be6bd-eb90-46b7-aa8f-dba0063c97ed") : secret "networking-console-plugin-cert" not found Jun 11 13:30:55.118876 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.118858 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:55.208499 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.208471 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/383d8fc8-de6e-4f03-aafb-408a6e0788a6-signing-key\") pod \"service-ca-7d74d578b8-qpwmf\" (UID: \"383d8fc8-de6e-4f03-aafb-408a6e0788a6\") " pod="openshift-service-ca/service-ca-7d74d578b8-qpwmf" Jun 11 13:30:55.208599 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.208528 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/383d8fc8-de6e-4f03-aafb-408a6e0788a6-signing-cabundle\") pod \"service-ca-7d74d578b8-qpwmf\" (UID: \"383d8fc8-de6e-4f03-aafb-408a6e0788a6\") " pod="openshift-service-ca/service-ca-7d74d578b8-qpwmf" Jun 11 13:30:55.208599 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.208577 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl7xn\" (UniqueName: \"kubernetes.io/projected/383d8fc8-de6e-4f03-aafb-408a6e0788a6-kube-api-access-sl7xn\") pod \"service-ca-7d74d578b8-qpwmf\" (UID: \"383d8fc8-de6e-4f03-aafb-408a6e0788a6\") " pod="openshift-service-ca/service-ca-7d74d578b8-qpwmf" Jun 11 13:30:55.309265 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.309201 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/383d8fc8-de6e-4f03-aafb-408a6e0788a6-signing-key\") pod \"service-ca-7d74d578b8-qpwmf\" (UID: \"383d8fc8-de6e-4f03-aafb-408a6e0788a6\") " pod="openshift-service-ca/service-ca-7d74d578b8-qpwmf" Jun 11 13:30:55.309265 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.309250 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/383d8fc8-de6e-4f03-aafb-408a6e0788a6-signing-cabundle\") pod \"service-ca-7d74d578b8-qpwmf\" (UID: \"383d8fc8-de6e-4f03-aafb-408a6e0788a6\") " pod="openshift-service-ca/service-ca-7d74d578b8-qpwmf" Jun 11 13:30:55.309422 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.309275 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl7xn\" (UniqueName: \"kubernetes.io/projected/383d8fc8-de6e-4f03-aafb-408a6e0788a6-kube-api-access-sl7xn\") pod \"service-ca-7d74d578b8-qpwmf\" (UID: \"383d8fc8-de6e-4f03-aafb-408a6e0788a6\") " pod="openshift-service-ca/service-ca-7d74d578b8-qpwmf" Jun 11 13:30:55.309885 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.309860 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/383d8fc8-de6e-4f03-aafb-408a6e0788a6-signing-cabundle\") pod \"service-ca-7d74d578b8-qpwmf\" (UID: \"383d8fc8-de6e-4f03-aafb-408a6e0788a6\") " pod="openshift-service-ca/service-ca-7d74d578b8-qpwmf" Jun 11 13:30:55.311693 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.311673 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/383d8fc8-de6e-4f03-aafb-408a6e0788a6-signing-key\") pod \"service-ca-7d74d578b8-qpwmf\" (UID: \"383d8fc8-de6e-4f03-aafb-408a6e0788a6\") " pod="openshift-service-ca/service-ca-7d74d578b8-qpwmf" Jun 11 13:30:55.317350 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.317328 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl7xn\" (UniqueName: \"kubernetes.io/projected/383d8fc8-de6e-4f03-aafb-408a6e0788a6-kube-api-access-sl7xn\") pod \"service-ca-7d74d578b8-qpwmf\" (UID: \"383d8fc8-de6e-4f03-aafb-408a6e0788a6\") " pod="openshift-service-ca/service-ca-7d74d578b8-qpwmf" Jun 11 13:30:55.342678 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.342658 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9dk9k_50d20acf-e30a-41ef-871b-b8adc1ff8a0a/node-ca/0.log" Jun 11 13:30:55.398990 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.398948 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-qpwmf" Jun 11 13:30:55.491610 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.491561 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:55.520588 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.520559 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-qpwmf"] Jun 11 13:30:55.523697 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:30:55.523669 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod383d8fc8_de6e_4f03_aafb_408a6e0788a6.slice/crio-88e19d027cef80178d900185db86547080448d9fae0a85cb1423bea89e7875f6 WatchSource:0}: Error finding container 88e19d027cef80178d900185db86547080448d9fae0a85cb1423bea89e7875f6: Status 404 returned error can't find the container with id 88e19d027cef80178d900185db86547080448d9fae0a85cb1423bea89e7875f6 Jun 11 13:30:55.592381 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.592306 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:55.652657 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.652624 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-qpwmf" event={"ID":"383d8fc8-de6e-4f03-aafb-408a6e0788a6","Type":"ContainerStarted","Data":"88e19d027cef80178d900185db86547080448d9fae0a85cb1423bea89e7875f6"} Jun 11 13:30:55.940453 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.940362 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7cd67_443f8e98-5a4b-4dd3-865a-78f1f3960ae1/serve-healthcheck-canary/0.log" Jun 11 13:30:55.974740 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:55.974706 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:30:58.663172 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:58.663136 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-qpwmf" event={"ID":"383d8fc8-de6e-4f03-aafb-408a6e0788a6","Type":"ContainerStarted","Data":"e718e6bb58c07525d5d7c9381f3225c845c27c2c5234221058dccd12213dedca"} Jun 11 13:30:58.679065 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:58.678987 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-qpwmf" podStartSLOduration=1.032346354 podStartE2EDuration="3.678963786s" totalImagesPullingTime="2.646617432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:30:58.677261867 +0000 UTC m=+274.245680233" watchObservedRunningTime="2026-06-11 13:30:58.678963786 +0000 UTC m=+274.247382115" Jun 11 13:30:58.924468 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:30:58.924374 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:00.003784 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:00.003747 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:00.105155 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:00.105115 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:00.155034 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:00.155005 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:00.229514 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:00.229473 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:00.430924 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:00.430830 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:00.593192 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:00.593153 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:00.700025 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:00.699922 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:01.700653 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:01.700620 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:02.101371 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:02.101339 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:02.299567 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:02.299535 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:02.400009 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:02.399930 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:02.506588 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:02.506557 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:02.910186 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:02.910150 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:03.072919 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:03.072884 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5225166c-f562-4f2b-b455-6b632cac5728-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dsftk\" (UID: \"5225166c-f562-4f2b-b455-6b632cac5728\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dsftk" Jun 11 13:31:03.073146 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:03.072955 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2a82040-2b53-4601-9b06-30a8d1f74749-service-ca-bundle\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:31:03.073146 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:03.072977 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-metrics-certs\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:31:03.073146 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:31:03.073074 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 13:31:03.073146 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:31:03.073086 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 13:31:03.073146 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:31:03.073122 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f2a82040-2b53-4601-9b06-30a8d1f74749-service-ca-bundle podName:f2a82040-2b53-4601-9b06-30a8d1f74749 nodeName:}" failed. No retries permitted until 2026-06-11 13:31:19.073105581 +0000 UTC m=+294.641523890 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f2a82040-2b53-4601-9b06-30a8d1f74749-service-ca-bundle") pod "router-default-7795d4b9f9-p7jbr" (UID: "f2a82040-2b53-4601-9b06-30a8d1f74749") : configmap references non-existent config key: service-ca.crt Jun 11 13:31:03.073146 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:31:03.073144 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-metrics-certs podName:f2a82040-2b53-4601-9b06-30a8d1f74749 nodeName:}" failed. No retries permitted until 2026-06-11 13:31:19.073135457 +0000 UTC m=+294.641553765 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-metrics-certs") pod "router-default-7795d4b9f9-p7jbr" (UID: "f2a82040-2b53-4601-9b06-30a8d1f74749") : secret "router-metrics-certs-default" not found Jun 11 13:31:03.073355 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:31:03.073156 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5225166c-f562-4f2b-b455-6b632cac5728-cluster-monitoring-operator-tls podName:5225166c-f562-4f2b-b455-6b632cac5728 nodeName:}" failed. No retries permitted until 2026-06-11 13:31:19.07314918 +0000 UTC m=+294.641567489 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5225166c-f562-4f2b-b455-6b632cac5728-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-dsftk" (UID: "5225166c-f562-4f2b-b455-6b632cac5728") : secret "cluster-monitoring-operator-tls" not found Jun 11 13:31:03.173534 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:03.173450 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b6be6bd-eb90-46b7-aa8f-dba0063c97ed-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c827l\" (UID: \"2b6be6bd-eb90-46b7-aa8f-dba0063c97ed\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c827l" Jun 11 13:31:03.173679 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:31:03.173594 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 13:31:03.173679 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:31:03.173652 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b6be6bd-eb90-46b7-aa8f-dba0063c97ed-networking-console-plugin-cert podName:2b6be6bd-eb90-46b7-aa8f-dba0063c97ed nodeName:}" failed. No retries permitted until 2026-06-11 13:31:19.173637966 +0000 UTC m=+294.742056274 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b6be6bd-eb90-46b7-aa8f-dba0063c97ed-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-c827l" (UID: "2b6be6bd-eb90-46b7-aa8f-dba0063c97ed") : secret "networking-console-plugin-cert" not found Jun 11 13:31:03.705813 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:03.705784 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:03.840101 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:03.840070 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:03.927354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:03.927323 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:04.101944 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:04.101909 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:04.325164 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:04.325131 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:04.497426 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:04.497402 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:04.701105 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:04.701011 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:05.423935 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:05.423903 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:05.904816 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:05.904785 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:06.099963 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:06.099933 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:06.237273 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:06.237249 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:06.338081 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:06.338024 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:06.363132 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:31:06.363096 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-96zlw" podUID="1a9b80d7-f85f-408f-aa85-4b4f4e1bded7" Jun 11 13:31:06.363132 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:31:06.363101 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6999954d75-grkv5" podUID="379feca0-7097-4421-bb88-a094c13ac9de" Jun 11 13:31:06.437719 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:06.437688 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:06.552558 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:06.552463 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:06.687511 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:06.687480 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-96zlw" Jun 11 13:31:06.687511 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:06.687494 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:31:06.709888 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:06.709859 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:07.705838 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:07.705802 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:07.906410 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:07.906378 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:08.103102 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:08.103069 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:08.506858 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:08.506829 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:09.225815 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:09.225778 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:31:09.228294 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:09.228271 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls\") pod \"image-registry-6999954d75-grkv5\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:31:09.306649 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:09.306619 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:09.326764 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:09.326737 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls\") pod \"dns-default-96zlw\" (UID: \"1a9b80d7-f85f-408f-aa85-4b4f4e1bded7\") " pod="openshift-dns/dns-default-96zlw" Jun 11 13:31:09.329143 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:09.329121 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9b80d7-f85f-408f-aa85-4b4f4e1bded7-metrics-tls\") pod \"dns-default-96zlw\" (UID: \"1a9b80d7-f85f-408f-aa85-4b4f4e1bded7\") " pod="openshift-dns/dns-default-96zlw" Jun 11 13:31:09.391341 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:09.391309 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fc7fj\"" Jun 11 13:31:09.391486 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:09.391310 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bmddv\"" Jun 11 13:31:09.399119 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:09.399097 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:31:09.399197 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:09.399183 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-96zlw" Jun 11 13:31:09.505800 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:09.505770 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:09.552332 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:09.552304 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-96zlw"] Jun 11 13:31:09.555387 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:31:09.555361 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a9b80d7_f85f_408f_aa85_4b4f4e1bded7.slice/crio-7d6f903ccd573ff937783761eb088344844546a3ea4e9536cbbbc77cbc8b8b0e WatchSource:0}: Error finding container 7d6f903ccd573ff937783761eb088344844546a3ea4e9536cbbbc77cbc8b8b0e: Status 404 returned error can't find the container with id 7d6f903ccd573ff937783761eb088344844546a3ea4e9536cbbbc77cbc8b8b0e Jun 11 13:31:09.571126 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:09.571097 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6999954d75-grkv5"] Jun 11 13:31:09.609792 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:31:09.609750 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod379feca0_7097_4421_bb88_a094c13ac9de.slice/crio-2ecee5b5da865965ffbfc5e3355d5bd2e6fd011b109364772dd9ae319cb8e644 WatchSource:0}: Error finding container 2ecee5b5da865965ffbfc5e3355d5bd2e6fd011b109364772dd9ae319cb8e644: Status 404 returned error can't find the container with id 2ecee5b5da865965ffbfc5e3355d5bd2e6fd011b109364772dd9ae319cb8e644 Jun 11 13:31:09.697376 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:09.697345 2563 generic.go:356] "Generic (PLEG): container finished" podID="4fb472fb-6cf9-49ff-b052-82598fe6749d" containerID="fd38ccda45178e3ac6bbca3224e49cfeb70310f3857302593ae778cbb99f8429" exitCode=1 Jun 11 13:31:09.697553 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:09.697419 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" event={"ID":"4fb472fb-6cf9-49ff-b052-82598fe6749d","Type":"ContainerDied","Data":"fd38ccda45178e3ac6bbca3224e49cfeb70310f3857302593ae778cbb99f8429"} Jun 11 13:31:09.697553 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:09.697473 2563 scope.go:117] "RemoveContainer" containerID="9ad669a69ab37cda973a1974638bde849e8fd694424be1f99fd05523a2fcd5d0" Jun 11 13:31:09.697810 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:09.697784 2563 scope.go:117] "RemoveContainer" containerID="fd38ccda45178e3ac6bbca3224e49cfeb70310f3857302593ae778cbb99f8429" Jun 11 13:31:09.697996 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:31:09.697970 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-5559697b58-fkt6l_open-cluster-management-agent-addon(4fb472fb-6cf9-49ff-b052-82598fe6749d)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" podUID="4fb472fb-6cf9-49ff-b052-82598fe6749d" Jun 11 13:31:09.698705 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:09.698682 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-96zlw" event={"ID":"1a9b80d7-f85f-408f-aa85-4b4f4e1bded7","Type":"ContainerStarted","Data":"7d6f903ccd573ff937783761eb088344844546a3ea4e9536cbbbc77cbc8b8b0e"} Jun 11 13:31:09.700136 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:09.700116 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6999954d75-grkv5" event={"ID":"379feca0-7097-4421-bb88-a094c13ac9de","Type":"ContainerStarted","Data":"d897fc9fd34a6687a0d533a8269054aa74831fcc35045cc4052d14e835333fa6"} Jun 11 13:31:09.700218 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:09.700152 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6999954d75-grkv5" event={"ID":"379feca0-7097-4421-bb88-a094c13ac9de","Type":"ContainerStarted","Data":"2ecee5b5da865965ffbfc5e3355d5bd2e6fd011b109364772dd9ae319cb8e644"} Jun 11 13:31:09.700274 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:09.700256 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:31:09.705078 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:09.705039 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:09.732203 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:09.732147 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6999954d75-grkv5" podStartSLOduration=284.732132478 podStartE2EDuration="4m44.732132478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:26:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:31:09.731787547 +0000 UTC m=+285.300205879" watchObservedRunningTime="2026-06-11 13:31:09.732132478 +0000 UTC m=+285.300550805" Jun 11 13:31:10.099390 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:10.099360 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:10.383199 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:10.383120 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" Jun 11 13:31:10.497656 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:10.497621 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:10.703702 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:10.703617 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:10.705297 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:10.705275 2563 scope.go:117] "RemoveContainer" containerID="fd38ccda45178e3ac6bbca3224e49cfeb70310f3857302593ae778cbb99f8429" Jun 11 13:31:10.705538 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:31:10.705502 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-5559697b58-fkt6l_open-cluster-management-agent-addon(4fb472fb-6cf9-49ff-b052-82598fe6749d)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" podUID="4fb472fb-6cf9-49ff-b052-82598fe6749d" Jun 11 13:31:10.855637 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:10.855604 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:10.958321 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:10.958286 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:11.012084 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:11.012033 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:11.126450 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:11.126411 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:11.509144 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:11.509113 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:11.607881 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:11.607855 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:11.709440 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:11.709411 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-96zlw" event={"ID":"1a9b80d7-f85f-408f-aa85-4b4f4e1bded7","Type":"ContainerStarted","Data":"a25dfaafc8071e2ed09a7bb1e4020264a25609d8d9cd052f4572c91b0d6e55d0"} Jun 11 13:31:11.709570 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:11.709466 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-96zlw" event={"ID":"1a9b80d7-f85f-408f-aa85-4b4f4e1bded7","Type":"ContainerStarted","Data":"20de70ce73524277052e333112fbbcc834e679fee9df5547a76983a5b391599c"} Jun 11 13:31:11.709570 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:11.709518 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-96zlw" Jun 11 13:31:11.724937 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:11.724887 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-96zlw" podStartSLOduration=250.84905868 podStartE2EDuration="4m12.724868929s" totalImagesPullingTime="1.875810249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:31:11.724187469 +0000 UTC m=+287.292605796" watchObservedRunningTime="2026-06-11 13:31:11.724868929 +0000 UTC m=+287.293287255" Jun 11 13:31:11.903749 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:11.903715 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:11.958676 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:11.958654 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:12.517002 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:12.516968 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:12.723354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:12.723321 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:12.825383 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:12.825324 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:13.476068 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.476023 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" Jun 11 13:31:13.476400 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.476387 2563 scope.go:117] "RemoveContainer" containerID="fd38ccda45178e3ac6bbca3224e49cfeb70310f3857302593ae778cbb99f8429" Jun 11 13:31:13.476539 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:31:13.476520 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-5559697b58-fkt6l_open-cluster-management-agent-addon(4fb472fb-6cf9-49ff-b052-82598fe6749d)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" podUID="4fb472fb-6cf9-49ff-b052-82598fe6749d" Jun 11 13:31:13.678904 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.678872 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-lkw42"] Jun 11 13:31:13.682001 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.681984 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-lkw42" Jun 11 13:31:13.684305 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.684281 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 13:31:13.684424 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.684400 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 13:31:13.684624 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.684609 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9f55j\"" Jun 11 13:31:13.694742 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.694720 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-lkw42"] Jun 11 13:31:13.734251 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.734202 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xl9df"] Jun 11 13:31:13.737231 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.737217 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xl9df" Jun 11 13:31:13.740137 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.740113 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 13:31:13.740460 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.740443 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 13:31:13.740540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.740451 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 13:31:13.740540 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.740477 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cxvqj\"" Jun 11 13:31:13.740653 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.740581 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 13:31:13.752704 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.752682 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xl9df"] Jun 11 13:31:13.761823 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.761804 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dtrx\" (UniqueName: \"kubernetes.io/projected/1adb637a-55f3-43a6-97e0-d26a81460f4d-kube-api-access-2dtrx\") pod \"downloads-6657875f97-lkw42\" (UID: \"1adb637a-55f3-43a6-97e0-d26a81460f4d\") " pod="openshift-console/downloads-6657875f97-lkw42" Jun 11 13:31:13.786116 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.786094 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:13.853887 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.853865 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:13.863148 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.863130 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dtrx\" (UniqueName: \"kubernetes.io/projected/1adb637a-55f3-43a6-97e0-d26a81460f4d-kube-api-access-2dtrx\") pod \"downloads-6657875f97-lkw42\" (UID: \"1adb637a-55f3-43a6-97e0-d26a81460f4d\") " pod="openshift-console/downloads-6657875f97-lkw42" Jun 11 13:31:13.863229 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.863157 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/303cd2f0-96c2-488e-92ea-ecf586d4e1c0-data-volume\") pod \"insights-runtime-extractor-xl9df\" (UID: \"303cd2f0-96c2-488e-92ea-ecf586d4e1c0\") " pod="openshift-insights/insights-runtime-extractor-xl9df" Jun 11 13:31:13.863229 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.863198 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/303cd2f0-96c2-488e-92ea-ecf586d4e1c0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xl9df\" (UID: \"303cd2f0-96c2-488e-92ea-ecf586d4e1c0\") " pod="openshift-insights/insights-runtime-extractor-xl9df" Jun 11 13:31:13.863304 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.863262 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/303cd2f0-96c2-488e-92ea-ecf586d4e1c0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xl9df\" (UID: \"303cd2f0-96c2-488e-92ea-ecf586d4e1c0\") " pod="openshift-insights/insights-runtime-extractor-xl9df" Jun 11 13:31:13.863339 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.863307 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/303cd2f0-96c2-488e-92ea-ecf586d4e1c0-crio-socket\") pod \"insights-runtime-extractor-xl9df\" (UID: \"303cd2f0-96c2-488e-92ea-ecf586d4e1c0\") " pod="openshift-insights/insights-runtime-extractor-xl9df" Jun 11 13:31:13.863339 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.863330 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msf2h\" (UniqueName: \"kubernetes.io/projected/303cd2f0-96c2-488e-92ea-ecf586d4e1c0-kube-api-access-msf2h\") pod \"insights-runtime-extractor-xl9df\" (UID: \"303cd2f0-96c2-488e-92ea-ecf586d4e1c0\") " pod="openshift-insights/insights-runtime-extractor-xl9df" Jun 11 13:31:13.870824 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.870800 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dtrx\" (UniqueName: \"kubernetes.io/projected/1adb637a-55f3-43a6-97e0-d26a81460f4d-kube-api-access-2dtrx\") pod \"downloads-6657875f97-lkw42\" (UID: \"1adb637a-55f3-43a6-97e0-d26a81460f4d\") " pod="openshift-console/downloads-6657875f97-lkw42" Jun 11 13:31:13.964555 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.964532 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/303cd2f0-96c2-488e-92ea-ecf586d4e1c0-crio-socket\") pod \"insights-runtime-extractor-xl9df\" (UID: \"303cd2f0-96c2-488e-92ea-ecf586d4e1c0\") " pod="openshift-insights/insights-runtime-extractor-xl9df" Jun 11 13:31:13.964645 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.964561 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msf2h\" (UniqueName: \"kubernetes.io/projected/303cd2f0-96c2-488e-92ea-ecf586d4e1c0-kube-api-access-msf2h\") pod \"insights-runtime-extractor-xl9df\" (UID: \"303cd2f0-96c2-488e-92ea-ecf586d4e1c0\") " pod="openshift-insights/insights-runtime-extractor-xl9df" Jun 11 13:31:13.964645 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.964594 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/303cd2f0-96c2-488e-92ea-ecf586d4e1c0-data-volume\") pod \"insights-runtime-extractor-xl9df\" (UID: \"303cd2f0-96c2-488e-92ea-ecf586d4e1c0\") " pod="openshift-insights/insights-runtime-extractor-xl9df" Jun 11 13:31:13.964645 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.964632 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/303cd2f0-96c2-488e-92ea-ecf586d4e1c0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xl9df\" (UID: \"303cd2f0-96c2-488e-92ea-ecf586d4e1c0\") " pod="openshift-insights/insights-runtime-extractor-xl9df" Jun 11 13:31:13.964769 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.964653 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/303cd2f0-96c2-488e-92ea-ecf586d4e1c0-crio-socket\") pod \"insights-runtime-extractor-xl9df\" (UID: \"303cd2f0-96c2-488e-92ea-ecf586d4e1c0\") " pod="openshift-insights/insights-runtime-extractor-xl9df" Jun 11 13:31:13.964769 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.964658 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/303cd2f0-96c2-488e-92ea-ecf586d4e1c0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xl9df\" (UID: \"303cd2f0-96c2-488e-92ea-ecf586d4e1c0\") " pod="openshift-insights/insights-runtime-extractor-xl9df" Jun 11 13:31:13.964992 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.964970 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/303cd2f0-96c2-488e-92ea-ecf586d4e1c0-data-volume\") pod \"insights-runtime-extractor-xl9df\" (UID: \"303cd2f0-96c2-488e-92ea-ecf586d4e1c0\") " pod="openshift-insights/insights-runtime-extractor-xl9df" Jun 11 13:31:13.965222 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.965208 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/303cd2f0-96c2-488e-92ea-ecf586d4e1c0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xl9df\" (UID: \"303cd2f0-96c2-488e-92ea-ecf586d4e1c0\") " pod="openshift-insights/insights-runtime-extractor-xl9df" Jun 11 13:31:13.966977 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.966954 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/303cd2f0-96c2-488e-92ea-ecf586d4e1c0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xl9df\" (UID: \"303cd2f0-96c2-488e-92ea-ecf586d4e1c0\") " pod="openshift-insights/insights-runtime-extractor-xl9df" Jun 11 13:31:13.972059 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.972028 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msf2h\" (UniqueName: \"kubernetes.io/projected/303cd2f0-96c2-488e-92ea-ecf586d4e1c0-kube-api-access-msf2h\") pod \"insights-runtime-extractor-xl9df\" (UID: \"303cd2f0-96c2-488e-92ea-ecf586d4e1c0\") " pod="openshift-insights/insights-runtime-extractor-xl9df" Jun 11 13:31:13.990739 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:13.990693 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-lkw42" Jun 11 13:31:14.046634 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:14.046603 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xl9df" Jun 11 13:31:14.121502 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:14.121472 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-lkw42"] Jun 11 13:31:14.124782 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:31:14.124757 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1adb637a_55f3_43a6_97e0_d26a81460f4d.slice/crio-3535b872be6fb0a13e73b820fe89c71512a9871b5c2ccbe726f6eea84f36807f WatchSource:0}: Error finding container 3535b872be6fb0a13e73b820fe89c71512a9871b5c2ccbe726f6eea84f36807f: Status 404 returned error can't find the container with id 3535b872be6fb0a13e73b820fe89c71512a9871b5c2ccbe726f6eea84f36807f Jun 11 13:31:14.179124 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:14.179096 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xl9df"] Jun 11 13:31:14.182079 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:31:14.182032 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod303cd2f0_96c2_488e_92ea_ecf586d4e1c0.slice/crio-1e334bf687c70991416ad552a9ef34d39a4d05fb8d3d22a4f1b292092cff81c9 WatchSource:0}: Error finding container 1e334bf687c70991416ad552a9ef34d39a4d05fb8d3d22a4f1b292092cff81c9: Status 404 returned error can't find the container with id 1e334bf687c70991416ad552a9ef34d39a4d05fb8d3d22a4f1b292092cff81c9 Jun 11 13:31:14.722184 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:14.722140 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-lkw42" event={"ID":"1adb637a-55f3-43a6-97e0-d26a81460f4d","Type":"ContainerStarted","Data":"3535b872be6fb0a13e73b820fe89c71512a9871b5c2ccbe726f6eea84f36807f"} Jun 11 13:31:14.724351 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:14.724322 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xl9df" event={"ID":"303cd2f0-96c2-488e-92ea-ecf586d4e1c0","Type":"ContainerStarted","Data":"d88ff286310ad298d68935efc0c53890d1d6b0ee6885ebc8dca1000388eb1904"} Jun 11 13:31:14.724465 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:14.724386 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xl9df" event={"ID":"303cd2f0-96c2-488e-92ea-ecf586d4e1c0","Type":"ContainerStarted","Data":"1e334bf687c70991416ad552a9ef34d39a4d05fb8d3d22a4f1b292092cff81c9"} Jun 11 13:31:15.729722 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:15.729678 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xl9df" event={"ID":"303cd2f0-96c2-488e-92ea-ecf586d4e1c0","Type":"ContainerStarted","Data":"b56b287bb67be0f99678f434092a86d3e98de49ed2c704dc30451ada7c6da1d1"} Jun 11 13:31:17.739153 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:17.739113 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xl9df" event={"ID":"303cd2f0-96c2-488e-92ea-ecf586d4e1c0","Type":"ContainerStarted","Data":"6610ef7b2490b0f37e21e833e6b64b70a7f9792f29e29526ad6f9838cd392ed1"} Jun 11 13:31:17.756449 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:17.756388 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xl9df" podStartSLOduration=2.049320363 podStartE2EDuration="4.756369665s" totalImagesPullingTime="2.707049302s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:31:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:31:17.754912809 +0000 UTC m=+293.323331136" watchObservedRunningTime="2026-06-11 13:31:17.756369665 +0000 UTC m=+293.324787993" Jun 11 13:31:19.113383 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:19.113346 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2a82040-2b53-4601-9b06-30a8d1f74749-service-ca-bundle\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:31:19.113383 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:19.113388 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-metrics-certs\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:31:19.114036 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:19.113513 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5225166c-f562-4f2b-b455-6b632cac5728-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dsftk\" (UID: \"5225166c-f562-4f2b-b455-6b632cac5728\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dsftk" Jun 11 13:31:19.114237 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:19.114209 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2a82040-2b53-4601-9b06-30a8d1f74749-service-ca-bundle\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:31:19.116074 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:19.116027 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5225166c-f562-4f2b-b455-6b632cac5728-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dsftk\" (UID: \"5225166c-f562-4f2b-b455-6b632cac5728\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dsftk" Jun 11 13:31:19.116479 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:19.116456 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2a82040-2b53-4601-9b06-30a8d1f74749-metrics-certs\") pod \"router-default-7795d4b9f9-p7jbr\" (UID: \"f2a82040-2b53-4601-9b06-30a8d1f74749\") " pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:31:19.214321 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:19.214281 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b6be6bd-eb90-46b7-aa8f-dba0063c97ed-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c827l\" (UID: \"2b6be6bd-eb90-46b7-aa8f-dba0063c97ed\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c827l" Jun 11 13:31:19.217161 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:19.217134 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b6be6bd-eb90-46b7-aa8f-dba0063c97ed-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c827l\" (UID: \"2b6be6bd-eb90-46b7-aa8f-dba0063c97ed\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c827l" Jun 11 13:31:19.410598 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:19.410509 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dsftk" Jun 11 13:31:19.416301 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:19.416105 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:31:19.486698 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:19.486662 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c827l" Jun 11 13:31:19.570781 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:19.570510 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dsftk"] Jun 11 13:31:19.573562 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:31:19.573507 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5225166c_f562_4f2b_b455_6b632cac5728.slice/crio-1e2dc7fea543a9b7357f0d354935b10de39c44df236fd2384e8f6ee017a51641 WatchSource:0}: Error finding container 1e2dc7fea543a9b7357f0d354935b10de39c44df236fd2384e8f6ee017a51641: Status 404 returned error can't find the container with id 1e2dc7fea543a9b7357f0d354935b10de39c44df236fd2384e8f6ee017a51641 Jun 11 13:31:19.594100 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:19.594020 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7795d4b9f9-p7jbr"] Jun 11 13:31:19.598671 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:31:19.598639 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2a82040_2b53_4601_9b06_30a8d1f74749.slice/crio-de1508bd580cbce94fb1195161089b3cb0f1ca8ab3da07979487f43a212ff103 WatchSource:0}: Error finding container de1508bd580cbce94fb1195161089b3cb0f1ca8ab3da07979487f43a212ff103: Status 404 returned error can't find the container with id de1508bd580cbce94fb1195161089b3cb0f1ca8ab3da07979487f43a212ff103 Jun 11 13:31:19.643933 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:19.643903 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-c827l"] Jun 11 13:31:19.653038 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:31:19.653006 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b6be6bd_eb90_46b7_aa8f_dba0063c97ed.slice/crio-d004c0f5aa2de8e043d055cdcc1a29970a586da5dc5c9428a23f3ddc20aa4440 WatchSource:0}: Error finding container d004c0f5aa2de8e043d055cdcc1a29970a586da5dc5c9428a23f3ddc20aa4440: Status 404 returned error can't find the container with id d004c0f5aa2de8e043d055cdcc1a29970a586da5dc5c9428a23f3ddc20aa4440 Jun 11 13:31:19.748273 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:19.748214 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c827l" event={"ID":"2b6be6bd-eb90-46b7-aa8f-dba0063c97ed","Type":"ContainerStarted","Data":"d004c0f5aa2de8e043d055cdcc1a29970a586da5dc5c9428a23f3ddc20aa4440"} Jun 11 13:31:19.749891 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:19.749850 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" event={"ID":"f2a82040-2b53-4601-9b06-30a8d1f74749","Type":"ContainerStarted","Data":"3494662e60790f32a37a8598552bd16c534f62b994027a33517b89160554bf34"} Jun 11 13:31:19.750018 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:19.749895 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" event={"ID":"f2a82040-2b53-4601-9b06-30a8d1f74749","Type":"ContainerStarted","Data":"de1508bd580cbce94fb1195161089b3cb0f1ca8ab3da07979487f43a212ff103"} Jun 11 13:31:19.751256 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:19.751225 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dsftk" event={"ID":"5225166c-f562-4f2b-b455-6b632cac5728","Type":"ContainerStarted","Data":"1e2dc7fea543a9b7357f0d354935b10de39c44df236fd2384e8f6ee017a51641"} Jun 11 13:31:19.768236 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:19.768175 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" podStartSLOduration=32.768161287 podStartE2EDuration="32.768161287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:30:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:31:19.766429016 +0000 UTC m=+295.334847353" watchObservedRunningTime="2026-06-11 13:31:19.768161287 +0000 UTC m=+295.336579592" Jun 11 13:31:19.842659 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:31:19.842607 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-698v8" podUID="dbcbad68-5014-4dbd-99f2-087716f10a31" Jun 11 13:31:20.416971 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:20.416891 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:31:20.419964 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:20.419769 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:31:20.756304 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:20.756205 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:31:20.758769 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:20.758519 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7795d4b9f9-p7jbr" Jun 11 13:31:21.715205 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:21.715172 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-96zlw" Jun 11 13:31:22.112791 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:22.112711 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:22.213715 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:22.213671 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:22.278509 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:22.278467 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j4294"] Jun 11 13:31:22.282000 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:22.281973 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j4294" Jun 11 13:31:22.289879 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:22.289751 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qfzqm\"" Jun 11 13:31:22.290136 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:22.290032 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 13:31:22.292341 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:22.292286 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j4294"] Jun 11 13:31:22.294001 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:22.293950 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:22.443456 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:22.443358 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/310234a4-f82e-43b8-89a3-d0319ad252b1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-j4294\" (UID: \"310234a4-f82e-43b8-89a3-d0319ad252b1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j4294" Jun 11 13:31:22.544660 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:22.544600 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/310234a4-f82e-43b8-89a3-d0319ad252b1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-j4294\" (UID: \"310234a4-f82e-43b8-89a3-d0319ad252b1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j4294" Jun 11 13:31:22.544844 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:31:22.544751 2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 11 13:31:22.544844 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:31:22.544825 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/310234a4-f82e-43b8-89a3-d0319ad252b1-tls-certificates podName:310234a4-f82e-43b8-89a3-d0319ad252b1 nodeName:}" failed. No retries permitted until 2026-06-11 13:31:23.044804649 +0000 UTC m=+298.613222968 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/310234a4-f82e-43b8-89a3-d0319ad252b1-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-j4294" (UID: "310234a4-f82e-43b8-89a3-d0319ad252b1") : secret "prometheus-operator-admission-webhook-tls" not found Jun 11 13:31:22.765532 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:22.765491 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c827l" event={"ID":"2b6be6bd-eb90-46b7-aa8f-dba0063c97ed","Type":"ContainerStarted","Data":"b40ec3413ad16036eed693b54ba9e30ef939231d6c5c6a3231021e8e8f21eef5"} Jun 11 13:31:22.767441 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:22.767403 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dsftk" event={"ID":"5225166c-f562-4f2b-b455-6b632cac5728","Type":"ContainerStarted","Data":"49d0e70f9db22ed9000b7833de1633adf7f276489182d06a278fb49636de98e3"} Jun 11 13:31:22.782356 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:22.782300 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c827l" podStartSLOduration=33.675147955 podStartE2EDuration="35.782279758s" totalImagesPullingTime="2.107131803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:31:22.780906501 +0000 UTC m=+298.349324831" watchObservedRunningTime="2026-06-11 13:31:22.782279758 +0000 UTC m=+298.350698087" Jun 11 13:31:22.796159 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:22.796101 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dsftk" podStartSLOduration=33.605770502 podStartE2EDuration="35.79608088s" totalImagesPullingTime="2.190310378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:31:22.795714363 +0000 UTC m=+298.364132693" watchObservedRunningTime="2026-06-11 13:31:22.79608088 +0000 UTC m=+298.364499211" Jun 11 13:31:22.885783 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:22.885744 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:22.945919 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:22.945886 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:23.049839 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:23.049752 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/310234a4-f82e-43b8-89a3-d0319ad252b1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-j4294\" (UID: \"310234a4-f82e-43b8-89a3-d0319ad252b1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j4294" Jun 11 13:31:23.052509 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:23.052448 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/310234a4-f82e-43b8-89a3-d0319ad252b1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-j4294\" (UID: \"310234a4-f82e-43b8-89a3-d0319ad252b1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j4294" Jun 11 13:31:23.064914 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:23.064883 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:23.194671 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:23.194642 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j4294" Jun 11 13:31:23.350439 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:23.350355 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j4294"] Jun 11 13:31:23.353574 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:31:23.353545 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod310234a4_f82e_43b8_89a3_d0319ad252b1.slice/crio-576a0bd5e4227787be6086d3ef3b69d71bfcd44be9ce7972db7d9f0ceeb97ec1 WatchSource:0}: Error finding container 576a0bd5e4227787be6086d3ef3b69d71bfcd44be9ce7972db7d9f0ceeb97ec1: Status 404 returned error can't find the container with id 576a0bd5e4227787be6086d3ef3b69d71bfcd44be9ce7972db7d9f0ceeb97ec1 Jun 11 13:31:23.772474 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:23.772431 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j4294" event={"ID":"310234a4-f82e-43b8-89a3-d0319ad252b1","Type":"ContainerStarted","Data":"576a0bd5e4227787be6086d3ef3b69d71bfcd44be9ce7972db7d9f0ceeb97ec1"} Jun 11 13:31:24.842438 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:24.842286 2563 scope.go:117] "RemoveContainer" containerID="fd38ccda45178e3ac6bbca3224e49cfeb70310f3857302593ae778cbb99f8429" Jun 11 13:31:28.811542 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:28.811503 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:29.404405 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:29.404346 2563 patch_prober.go:28] interesting pod/image-registry-6999954d75-grkv5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 13:31:29.404595 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:29.404426 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6999954d75-grkv5" podUID="379feca0-7097-4421-bb88-a094c13ac9de" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 13:31:29.892690 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:29.892657 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:30.709541 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:30.709511 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:31:30.840894 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:30.840854 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:31:30.981776 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:30.981700 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:31.075564 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:31.075514 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:31.661184 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:31.661161 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-87tcg_28b20342-2058-4e26-8ccd-16757e486809/ovn-acl-logging/0.log" Jun 11 13:31:31.661486 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:31.661467 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-87tcg_28b20342-2058-4e26-8ccd-16757e486809/ovn-acl-logging/0.log" Jun 11 13:31:31.666202 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:31.666184 2563 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 13:31:31.804835 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:31.804802 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j4294" event={"ID":"310234a4-f82e-43b8-89a3-d0319ad252b1","Type":"ContainerStarted","Data":"4e241a03a528f9f0f1c486ab07aecb8e50c40dcd7fec6f21f73e67845ffbcde2"} Jun 11 13:31:31.805017 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:31.805002 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j4294" Jun 11 13:31:31.806846 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:31.806817 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" event={"ID":"4fb472fb-6cf9-49ff-b052-82598fe6749d","Type":"ContainerStarted","Data":"79c2511eecd9c63cc2250365f0851cd765fe84fdfcab58732c0b9f9122446e43"} Jun 11 13:31:31.807287 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:31.807164 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" Jun 11 13:31:31.808473 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:31.808451 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-lkw42" event={"ID":"1adb637a-55f3-43a6-97e0-d26a81460f4d","Type":"ContainerStarted","Data":"ae60348469245dc6a9494eb8a850dc4c4cd67fd28cc5983e12c08bbc6978edd7"} Jun 11 13:31:31.808618 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:31.808602 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5559697b58-fkt6l" Jun 11 13:31:31.810447 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:31.810427 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j4294" Jun 11 13:31:31.820373 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:31.820297 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j4294" podStartSLOduration=1.5371539749999998 podStartE2EDuration="9.820282485s" totalImagesPullingTime="8.28312851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:31:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:31:31.819796797 +0000 UTC m=+307.388215139" watchObservedRunningTime="2026-06-11 13:31:31.820282485 +0000 UTC m=+307.388700813" Jun 11 13:31:31.868962 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:31.868899 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-lkw42" podStartSLOduration=1.304926233 podStartE2EDuration="18.868877547s" totalImagesPullingTime="17.563951314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:31:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:31:31.868614296 +0000 UTC m=+307.437032627" watchObservedRunningTime="2026-06-11 13:31:31.868877547 +0000 UTC m=+307.437295877" Jun 11 13:31:32.344148 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.344114 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:32.405308 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.405275 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-kqhbr"] Jun 11 13:31:32.433251 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.433222 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-kqhbr" Jun 11 13:31:32.437856 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.437826 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 11 13:31:32.438435 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.438408 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-85tb8\"" Jun 11 13:31:32.438678 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.438655 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 13:31:32.440342 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.440315 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-kqhbr"] Jun 11 13:31:32.442136 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.442036 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 11 13:31:32.503842 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.503806 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:32.534228 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.534194 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d300e493-0472-4c8a-9abf-9e28372bcbf7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-kqhbr\" (UID: \"d300e493-0472-4c8a-9abf-9e28372bcbf7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-kqhbr" Jun 11 13:31:32.534382 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.534236 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d300e493-0472-4c8a-9abf-9e28372bcbf7-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-kqhbr\" (UID: \"d300e493-0472-4c8a-9abf-9e28372bcbf7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-kqhbr" Jun 11 13:31:32.534382 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.534272 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d300e493-0472-4c8a-9abf-9e28372bcbf7-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-kqhbr\" (UID: \"d300e493-0472-4c8a-9abf-9e28372bcbf7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-kqhbr" Jun 11 13:31:32.534382 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.534329 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhr4p\" (UniqueName: \"kubernetes.io/projected/d300e493-0472-4c8a-9abf-9e28372bcbf7-kube-api-access-jhr4p\") pod \"prometheus-operator-7f7d445d84-kqhbr\" (UID: \"d300e493-0472-4c8a-9abf-9e28372bcbf7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-kqhbr" Jun 11 13:31:32.590522 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.590483 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:32.635345 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.635270 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d300e493-0472-4c8a-9abf-9e28372bcbf7-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-kqhbr\" (UID: \"d300e493-0472-4c8a-9abf-9e28372bcbf7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-kqhbr" Jun 11 13:31:32.635345 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.635322 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d300e493-0472-4c8a-9abf-9e28372bcbf7-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-kqhbr\" (UID: \"d300e493-0472-4c8a-9abf-9e28372bcbf7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-kqhbr" Jun 11 13:31:32.635345 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.635350 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhr4p\" (UniqueName: \"kubernetes.io/projected/d300e493-0472-4c8a-9abf-9e28372bcbf7-kube-api-access-jhr4p\") pod \"prometheus-operator-7f7d445d84-kqhbr\" (UID: \"d300e493-0472-4c8a-9abf-9e28372bcbf7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-kqhbr" Jun 11 13:31:32.635611 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.635445 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d300e493-0472-4c8a-9abf-9e28372bcbf7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-kqhbr\" (UID: \"d300e493-0472-4c8a-9abf-9e28372bcbf7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-kqhbr" Jun 11 13:31:32.636133 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.636102 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d300e493-0472-4c8a-9abf-9e28372bcbf7-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-kqhbr\" (UID: \"d300e493-0472-4c8a-9abf-9e28372bcbf7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-kqhbr" Jun 11 13:31:32.638357 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.638327 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d300e493-0472-4c8a-9abf-9e28372bcbf7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-kqhbr\" (UID: \"d300e493-0472-4c8a-9abf-9e28372bcbf7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-kqhbr" Jun 11 13:31:32.638457 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.638437 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d300e493-0472-4c8a-9abf-9e28372bcbf7-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-kqhbr\" (UID: \"d300e493-0472-4c8a-9abf-9e28372bcbf7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-kqhbr" Jun 11 13:31:32.643712 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.643695 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhr4p\" (UniqueName: \"kubernetes.io/projected/d300e493-0472-4c8a-9abf-9e28372bcbf7-kube-api-access-jhr4p\") pod \"prometheus-operator-7f7d445d84-kqhbr\" (UID: \"d300e493-0472-4c8a-9abf-9e28372bcbf7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-kqhbr" Jun 11 13:31:32.745896 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.745855 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-kqhbr" Jun 11 13:31:32.813980 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.813512 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-lkw42" Jun 11 13:31:32.828081 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.828027 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-lkw42" Jun 11 13:31:32.935559 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.935476 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-kqhbr"] Jun 11 13:31:32.939880 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:31:32.939550 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd300e493_0472_4c8a_9abf_9e28372bcbf7.slice/crio-c6450dbdb36fee4680d23ab054fcb4210f894f472b12be0d68f44c4ad6e6099b WatchSource:0}: Error finding container c6450dbdb36fee4680d23ab054fcb4210f894f472b12be0d68f44c4ad6e6099b: Status 404 returned error can't find the container with id c6450dbdb36fee4680d23ab054fcb4210f894f472b12be0d68f44c4ad6e6099b Jun 11 13:31:32.941789 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:32.941766 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 13:31:33.821318 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:33.821273 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-kqhbr" event={"ID":"d300e493-0472-4c8a-9abf-9e28372bcbf7","Type":"ContainerStarted","Data":"c6450dbdb36fee4680d23ab054fcb4210f894f472b12be0d68f44c4ad6e6099b"} Jun 11 13:31:35.076902 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:35.076824 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:35.341772 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:35.341695 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:35.444186 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:35.444120 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:35.538788 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:35.538755 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6999954d75-grkv5"] Jun 11 13:31:35.620243 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:35.620150 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:35.718390 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:35.718345 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:35.830793 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:35.830748 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-kqhbr" event={"ID":"d300e493-0472-4c8a-9abf-9e28372bcbf7","Type":"ContainerStarted","Data":"7549f19164af077fceb5056e0f008dddfc6db4965d10f5a426f538a1e56f80c6"} Jun 11 13:31:35.831127 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:35.830864 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-kqhbr" event={"ID":"d300e493-0472-4c8a-9abf-9e28372bcbf7","Type":"ContainerStarted","Data":"5072fe9a479b43c88e291be1eb4f22113ead26517ecc18f934f754a34ccb5eaf"} Jun 11 13:31:35.870718 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:35.870612 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-kqhbr" podStartSLOduration=2.04031817 podStartE2EDuration="3.870598187s" totalImagesPullingTime="1.830280017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:31:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:31:35.869622301 +0000 UTC m=+311.438040632" watchObservedRunningTime="2026-06-11 13:31:35.870598187 +0000 UTC m=+311.439016517" Jun 11 13:31:35.963122 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:35.963080 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:36.064533 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:36.064502 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:37.500188 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.500065 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:37.637627 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.637562 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:37.733813 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.733775 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:37.778895 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.778813 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jvk2j"] Jun 11 13:31:37.802136 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.802106 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.804795 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.804775 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 13:31:37.805304 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.805282 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 13:31:37.805448 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.805431 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 13:31:37.805782 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.805765 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w7bqj\"" Jun 11 13:31:37.846923 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.846895 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:37.877474 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.877444 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4092b73a-2bb7-434a-b7d6-44821cb04bb1-node-exporter-wtmp\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.877615 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.877492 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4092b73a-2bb7-434a-b7d6-44821cb04bb1-root\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.877615 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.877518 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4092b73a-2bb7-434a-b7d6-44821cb04bb1-node-exporter-tls\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.877615 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.877547 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4092b73a-2bb7-434a-b7d6-44821cb04bb1-node-exporter-accelerators-collector-config\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.877615 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.877577 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4092b73a-2bb7-434a-b7d6-44821cb04bb1-sys\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.877615 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.877613 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lcsq\" (UniqueName: \"kubernetes.io/projected/4092b73a-2bb7-434a-b7d6-44821cb04bb1-kube-api-access-2lcsq\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.877873 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.877691 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4092b73a-2bb7-434a-b7d6-44821cb04bb1-metrics-client-ca\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.877873 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.877730 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4092b73a-2bb7-434a-b7d6-44821cb04bb1-node-exporter-textfile\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.877873 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.877762 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4092b73a-2bb7-434a-b7d6-44821cb04bb1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.941690 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.941656 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:37.979195 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.979162 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4092b73a-2bb7-434a-b7d6-44821cb04bb1-node-exporter-wtmp\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.979365 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.979211 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4092b73a-2bb7-434a-b7d6-44821cb04bb1-root\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.979365 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.979230 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4092b73a-2bb7-434a-b7d6-44821cb04bb1-node-exporter-tls\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.979365 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.979258 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4092b73a-2bb7-434a-b7d6-44821cb04bb1-node-exporter-accelerators-collector-config\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.979365 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.979294 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4092b73a-2bb7-434a-b7d6-44821cb04bb1-sys\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.979365 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.979335 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4092b73a-2bb7-434a-b7d6-44821cb04bb1-root\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.979365 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.979339 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lcsq\" (UniqueName: \"kubernetes.io/projected/4092b73a-2bb7-434a-b7d6-44821cb04bb1-kube-api-access-2lcsq\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.979634 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.979394 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4092b73a-2bb7-434a-b7d6-44821cb04bb1-node-exporter-wtmp\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.979634 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.979411 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4092b73a-2bb7-434a-b7d6-44821cb04bb1-metrics-client-ca\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.979634 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.979440 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4092b73a-2bb7-434a-b7d6-44821cb04bb1-node-exporter-textfile\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.979634 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.979468 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4092b73a-2bb7-434a-b7d6-44821cb04bb1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.979773 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.979718 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4092b73a-2bb7-434a-b7d6-44821cb04bb1-sys\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.979829 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:31:37.979814 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 13:31:37.979877 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:31:37.979869 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4092b73a-2bb7-434a-b7d6-44821cb04bb1-node-exporter-tls podName:4092b73a-2bb7-434a-b7d6-44821cb04bb1 nodeName:}" failed. No retries permitted until 2026-06-11 13:31:38.479851632 +0000 UTC m=+314.048269955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4092b73a-2bb7-434a-b7d6-44821cb04bb1-node-exporter-tls") pod "node-exporter-jvk2j" (UID: "4092b73a-2bb7-434a-b7d6-44821cb04bb1") : secret "node-exporter-tls" not found Jun 11 13:31:37.980003 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.979975 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4092b73a-2bb7-434a-b7d6-44821cb04bb1-node-exporter-accelerators-collector-config\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.980471 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.980441 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4092b73a-2bb7-434a-b7d6-44821cb04bb1-node-exporter-textfile\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.980471 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.980460 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4092b73a-2bb7-434a-b7d6-44821cb04bb1-metrics-client-ca\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.982254 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.982229 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4092b73a-2bb7-434a-b7d6-44821cb04bb1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:37.995862 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:37.995819 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lcsq\" (UniqueName: \"kubernetes.io/projected/4092b73a-2bb7-434a-b7d6-44821cb04bb1-kube-api-access-2lcsq\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:38.041696 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:38.041628 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:38.142127 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:38.142098 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:38.245382 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:38.245344 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:38.342289 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:38.342210 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:38.483638 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:38.483602 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4092b73a-2bb7-434a-b7d6-44821cb04bb1-node-exporter-tls\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:38.486479 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:38.486452 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4092b73a-2bb7-434a-b7d6-44821cb04bb1-node-exporter-tls\") pod \"node-exporter-jvk2j\" (UID: \"4092b73a-2bb7-434a-b7d6-44821cb04bb1\") " pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:38.569419 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:38.569387 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:38.716009 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:38.715977 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jvk2j" Jun 11 13:31:38.731039 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:38.731010 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:38.760605 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:31:38.760399 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4092b73a_2bb7_434a_b7d6_44821cb04bb1.slice/crio-acdc56780a830c76c0c4ad2055b5f7d0fd5357cf981b7694631277d058b975d4 WatchSource:0}: Error finding container acdc56780a830c76c0c4ad2055b5f7d0fd5357cf981b7694631277d058b975d4: Status 404 returned error can't find the container with id acdc56780a830c76c0c4ad2055b5f7d0fd5357cf981b7694631277d058b975d4 Jun 11 13:31:38.826036 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:38.826005 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:38.846543 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:38.846509 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jvk2j" event={"ID":"4092b73a-2bb7-434a-b7d6-44821cb04bb1","Type":"ContainerStarted","Data":"acdc56780a830c76c0c4ad2055b5f7d0fd5357cf981b7694631277d058b975d4"} Jun 11 13:31:39.149339 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:39.149257 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:39.969547 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:39.969512 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:40.062751 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:40.062701 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:40.775028 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:40.775002 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:40.856996 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:40.856960 2563 generic.go:356] "Generic (PLEG): container finished" podID="4092b73a-2bb7-434a-b7d6-44821cb04bb1" containerID="56287efd5beba9ae16002c87ed704705dfc3167cdbb50ee78e7a9ef12951f867" exitCode=0 Jun 11 13:31:40.857181 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:40.857028 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jvk2j" event={"ID":"4092b73a-2bb7-434a-b7d6-44821cb04bb1","Type":"ContainerDied","Data":"56287efd5beba9ae16002c87ed704705dfc3167cdbb50ee78e7a9ef12951f867"} Jun 11 13:31:40.881761 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:40.881722 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:41.086378 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:41.086353 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:41.199948 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:41.199911 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:41.862275 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:41.862238 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jvk2j" event={"ID":"4092b73a-2bb7-434a-b7d6-44821cb04bb1","Type":"ContainerStarted","Data":"6f3ce5520943f7499d759f8e82300db5a48ef09c1fbef495dbd67839e7cfc533"} Jun 11 13:31:41.862433 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:41.862330 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jvk2j" event={"ID":"4092b73a-2bb7-434a-b7d6-44821cb04bb1","Type":"ContainerStarted","Data":"7ac81b8651ee2aa13d2db74deec01460ebae5a620cd8b80cbc034745130e9201"} Jun 11 13:31:41.895511 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:41.895459 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jvk2j" podStartSLOduration=3.03804839 podStartE2EDuration="4.895442852s" totalImagesPullingTime="1.735019212s" totalInitContainerRuntime="122.37525ms" isStatefulPod=true podCreationTimestamp="2026-06-11 13:31:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:31:41.894708462 +0000 UTC m=+317.463126789" watchObservedRunningTime="2026-06-11 13:31:41.895442852 +0000 UTC m=+317.463861183" Jun 11 13:31:42.534751 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:42.534717 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-wgh4x"] Jun 11 13:31:42.537215 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:42.537163 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:42.547849 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:42.547807 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wgh4x" Jun 11 13:31:42.550606 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:42.550419 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-w8gmp\"" Jun 11 13:31:42.551216 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:42.551193 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 11 13:31:42.551553 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:42.551518 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-wgh4x"] Jun 11 13:31:42.608487 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:42.608456 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:42.616594 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:42.616556 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw84j\" (UniqueName: \"kubernetes.io/projected/8d420a89-1713-4b10-9c6d-06ecd3b030e1-kube-api-access-tw84j\") pod \"monitoring-plugin-76b68cc874-wgh4x\" (UID: \"8d420a89-1713-4b10-9c6d-06ecd3b030e1\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wgh4x" Jun 11 13:31:42.616767 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:42.616612 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8d420a89-1713-4b10-9c6d-06ecd3b030e1-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-wgh4x\" (UID: \"8d420a89-1713-4b10-9c6d-06ecd3b030e1\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wgh4x" Jun 11 13:31:42.717675 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:42.717633 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw84j\" (UniqueName: \"kubernetes.io/projected/8d420a89-1713-4b10-9c6d-06ecd3b030e1-kube-api-access-tw84j\") pod \"monitoring-plugin-76b68cc874-wgh4x\" (UID: \"8d420a89-1713-4b10-9c6d-06ecd3b030e1\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wgh4x" Jun 11 13:31:42.717675 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:42.717692 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8d420a89-1713-4b10-9c6d-06ecd3b030e1-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-wgh4x\" (UID: \"8d420a89-1713-4b10-9c6d-06ecd3b030e1\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wgh4x" Jun 11 13:31:42.717899 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:31:42.717841 2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 11 13:31:42.717899 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:31:42.717889 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d420a89-1713-4b10-9c6d-06ecd3b030e1-monitoring-plugin-cert podName:8d420a89-1713-4b10-9c6d-06ecd3b030e1 nodeName:}" failed. No retries permitted until 2026-06-11 13:31:43.217876007 +0000 UTC m=+318.786294313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/8d420a89-1713-4b10-9c6d-06ecd3b030e1-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-wgh4x" (UID: "8d420a89-1713-4b10-9c6d-06ecd3b030e1") : secret "monitoring-plugin-cert" not found Jun 11 13:31:42.728497 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:42.728460 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw84j\" (UniqueName: \"kubernetes.io/projected/8d420a89-1713-4b10-9c6d-06ecd3b030e1-kube-api-access-tw84j\") pod \"monitoring-plugin-76b68cc874-wgh4x\" (UID: \"8d420a89-1713-4b10-9c6d-06ecd3b030e1\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wgh4x" Jun 11 13:31:43.082216 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:43.082180 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:43.222594 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:43.222561 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8d420a89-1713-4b10-9c6d-06ecd3b030e1-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-wgh4x\" (UID: \"8d420a89-1713-4b10-9c6d-06ecd3b030e1\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wgh4x" Jun 11 13:31:43.225006 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:43.224986 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8d420a89-1713-4b10-9c6d-06ecd3b030e1-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-wgh4x\" (UID: \"8d420a89-1713-4b10-9c6d-06ecd3b030e1\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wgh4x" Jun 11 13:31:43.460009 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:43.459976 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wgh4x" Jun 11 13:31:43.606630 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:43.606564 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-wgh4x"] Jun 11 13:31:43.609097 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:31:43.609064 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d420a89_1713_4b10_9c6d_06ecd3b030e1.slice/crio-b68f5f13271b5e81c344a55373e1a8a2ef30fc458931f77ccfc13b17603c0c64 WatchSource:0}: Error finding container b68f5f13271b5e81c344a55373e1a8a2ef30fc458931f77ccfc13b17603c0c64: Status 404 returned error can't find the container with id b68f5f13271b5e81c344a55373e1a8a2ef30fc458931f77ccfc13b17603c0c64 Jun 11 13:31:43.870118 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:43.870007 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wgh4x" event={"ID":"8d420a89-1713-4b10-9c6d-06ecd3b030e1","Type":"ContainerStarted","Data":"b68f5f13271b5e81c344a55373e1a8a2ef30fc458931f77ccfc13b17603c0c64"} Jun 11 13:31:44.037070 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.037008 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:44.041981 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.041950 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 13:31:44.060702 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.059504 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.063074 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.062424 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 13:31:44.063074 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.062702 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vnc58\"" Jun 11 13:31:44.063074 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.062819 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 13:31:44.063074 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.062904 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 13:31:44.064179 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.063483 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 13:31:44.067960 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.064705 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 13:31:44.067960 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.064917 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 13:31:44.067960 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.065195 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 13:31:44.067960 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.065373 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 13:31:44.067960 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.065879 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 13:31:44.067960 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.066096 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 13:31:44.067960 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.066326 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 13:31:44.067960 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.066610 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 13:31:44.067960 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.066843 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 13:31:44.067960 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.067193 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2b3b9ujff3id1\"" Jun 11 13:31:44.067960 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.067499 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 13:31:44.067960 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.067738 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 13:31:44.067960 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.067833 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 13:31:44.130825 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.130732 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.130825 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.130773 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-web-config\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.130825 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.130802 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.131120 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.130826 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.131120 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.130852 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.131120 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.130876 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn5zh\" (UniqueName: \"kubernetes.io/projected/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-kube-api-access-wn5zh\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.131120 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.130928 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.131120 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.130971 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.131120 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.131028 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.131120 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.131082 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.131120 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.131117 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-config\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.131472 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.131131 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.131472 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.131185 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.131472 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.131261 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-config-out\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.131472 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.131287 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.131472 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.131312 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.131472 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.131339 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.131472 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.131428 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.131472 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.131463 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.131724 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.131492 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.232411 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.232372 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-config-out\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.232411 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.232410 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.232663 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.232428 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.232663 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.232565 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.232663 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.232612 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.232822 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.232638 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.232822 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.232700 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.233125 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.233098 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.233225 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.233138 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-web-config\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.234029 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.233280 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.234029 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.233254 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.234029 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.233380 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.234029 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.233414 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.234029 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.233448 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn5zh\" (UniqueName: \"kubernetes.io/projected/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-kube-api-access-wn5zh\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.234029 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.233482 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.234029 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.233510 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.234029 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.233546 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.234029 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.233572 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.234029 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.233606 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.234029 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.233618 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-config\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.234029 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.233642 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.234029 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.233694 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.236541 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.235940 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.236541 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.236150 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-config-out\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.236541 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.236182 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.243134 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.238664 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.243134 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.239100 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.243134 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.239342 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.243134 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.239500 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.243134 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.239879 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.243134 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.240416 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.243134 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.240971 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.243134 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.241159 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.243134 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.241340 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.243134 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.241574 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.243134 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.241694 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-web-config\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.243134 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.242463 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.244705 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.244664 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.247009 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.246979 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn5zh\" (UniqueName: \"kubernetes.io/projected/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-kube-api-access-wn5zh\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.248804 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.248784 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-config\") pod \"prometheus-k8s-0\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.379435 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.379386 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:31:44.565867 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.565813 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 13:31:44.568512 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:31:44.568476 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd0f21e0_ad4e_43e8_86c3_cfe43456fe47.slice/crio-8849c4e1db3d43b56debc8b8dd320ea4b744b7bb575938dd8c5f1a17f7932e17 WatchSource:0}: Error finding container 8849c4e1db3d43b56debc8b8dd320ea4b744b7bb575938dd8c5f1a17f7932e17: Status 404 returned error can't find the container with id 8849c4e1db3d43b56debc8b8dd320ea4b744b7bb575938dd8c5f1a17f7932e17 Jun 11 13:31:44.874667 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:44.874628 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47","Type":"ContainerStarted","Data":"8849c4e1db3d43b56debc8b8dd320ea4b744b7bb575938dd8c5f1a17f7932e17"} Jun 11 13:31:46.881975 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:46.881943 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wgh4x" event={"ID":"8d420a89-1713-4b10-9c6d-06ecd3b030e1","Type":"ContainerStarted","Data":"7e4a18c0d520b423c14de4bc30a758a11ece4655cd8c6d721d1dc5e574e1dfa5"} Jun 11 13:31:46.882439 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:46.882014 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wgh4x" Jun 11 13:31:46.883573 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:46.883545 2563 generic.go:356] "Generic (PLEG): container finished" podID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerID="00b55350d6af07302d61f96967b7c7ce8e70bc1854b17aa001d1d81dbac20fc6" exitCode=0 Jun 11 13:31:46.883683 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:46.883589 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47","Type":"ContainerDied","Data":"00b55350d6af07302d61f96967b7c7ce8e70bc1854b17aa001d1d81dbac20fc6"} Jun 11 13:31:46.887464 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:46.887440 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wgh4x" Jun 11 13:31:46.895507 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:46.895466 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wgh4x" podStartSLOduration=2.273604398 podStartE2EDuration="4.895451537s" totalImagesPullingTime="2.621847139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:31:46.895024406 +0000 UTC m=+322.463442734" watchObservedRunningTime="2026-06-11 13:31:46.895451537 +0000 UTC m=+322.463869866" Jun 11 13:31:50.169645 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:50.169449 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:50.269108 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:50.269076 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:51.240818 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:51.240771 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:51.342807 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:51.342772 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:51.906926 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:51.906897 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47","Type":"ContainerStarted","Data":"5f87e54a377d44ebc3912a2e66b57dad24f1e1f597bf361a37b4b294b846d089"} Jun 11 13:31:52.914508 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:52.914461 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47","Type":"ContainerStarted","Data":"e1a8def21d308a32c6f8ac08b96fabb335cff225d3e5b098a41d1bf0db31988f"} Jun 11 13:31:53.738719 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:53.738682 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:53.839678 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:53.839641 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:53.940402 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:53.940373 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:31:54.925109 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:54.925019 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47","Type":"ContainerStarted","Data":"3e154547a5b16e615a1d46cb5b205fe5750391c11ea3ef04b4fc3adfa465b5d7"} Jun 11 13:31:54.925109 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:54.925104 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47","Type":"ContainerStarted","Data":"80c6611044b8734936404ffc6fd059ca11cc27f08077f7ee7d8f2e71d2eb777a"} Jun 11 13:31:54.925271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:54.925134 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47","Type":"ContainerStarted","Data":"02244091c9ebd5439ca57b8257a9166f23dec7b6d82826d869ac967f6309e531"} Jun 11 13:31:54.925271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:54.925157 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47","Type":"ContainerStarted","Data":"92d7a2df2be6922186a677792d3d85911a2c73d6574615e199194471e22718c4"} Jun 11 13:31:54.952131 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:54.952071 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.094081164 podStartE2EDuration="10.952027277s" totalImagesPullingTime="8.831045144s" totalInitContainerRuntime="26.900969ms" isStatefulPod=false podCreationTimestamp="2026-06-11 13:31:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:31:54.950605324 +0000 UTC m=+330.519023654" watchObservedRunningTime="2026-06-11 13:31:54.952027277 +0000 UTC m=+330.520445606" Jun 11 13:31:59.380459 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:31:59.380401 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:32:00.563761 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.563712 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6999954d75-grkv5" podUID="379feca0-7097-4421-bb88-a094c13ac9de" containerName="registry" containerID="cri-o://d897fc9fd34a6687a0d533a8269054aa74831fcc35045cc4052d14e835333fa6" gracePeriod=30 Jun 11 13:32:00.705728 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.705689 2563 patch_prober.go:28] interesting pod/image-registry-6999954d75-grkv5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" start-of-body= Jun 11 13:32:00.705853 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.705745 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6999954d75-grkv5" podUID="379feca0-7097-4421-bb88-a094c13ac9de" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" Jun 11 13:32:00.805231 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.805203 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:32:00.875554 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.875489 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/379feca0-7097-4421-bb88-a094c13ac9de-installation-pull-secrets\") pod \"379feca0-7097-4421-bb88-a094c13ac9de\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " Jun 11 13:32:00.875554 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.875530 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/379feca0-7097-4421-bb88-a094c13ac9de-trusted-ca\") pod \"379feca0-7097-4421-bb88-a094c13ac9de\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " Jun 11 13:32:00.875736 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.875560 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/379feca0-7097-4421-bb88-a094c13ac9de-ca-trust-extracted\") pod \"379feca0-7097-4421-bb88-a094c13ac9de\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " Jun 11 13:32:00.875736 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.875601 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/379feca0-7097-4421-bb88-a094c13ac9de-registry-certificates\") pod \"379feca0-7097-4421-bb88-a094c13ac9de\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " Jun 11 13:32:00.875736 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.875629 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls\") pod \"379feca0-7097-4421-bb88-a094c13ac9de\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " Jun 11 13:32:00.875736 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.875654 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vh65z\" (UniqueName: \"kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-kube-api-access-vh65z\") pod \"379feca0-7097-4421-bb88-a094c13ac9de\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " Jun 11 13:32:00.875924 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.875747 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-bound-sa-token\") pod \"379feca0-7097-4421-bb88-a094c13ac9de\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " Jun 11 13:32:00.875924 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.875790 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/379feca0-7097-4421-bb88-a094c13ac9de-image-registry-private-configuration\") pod \"379feca0-7097-4421-bb88-a094c13ac9de\" (UID: \"379feca0-7097-4421-bb88-a094c13ac9de\") " Jun 11 13:32:00.876031 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.875931 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/379feca0-7097-4421-bb88-a094c13ac9de-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "379feca0-7097-4421-bb88-a094c13ac9de" (UID: "379feca0-7097-4421-bb88-a094c13ac9de"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 13:32:00.876031 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.876006 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/379feca0-7097-4421-bb88-a094c13ac9de-trusted-ca\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:32:00.876159 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.876085 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/379feca0-7097-4421-bb88-a094c13ac9de-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "379feca0-7097-4421-bb88-a094c13ac9de" (UID: "379feca0-7097-4421-bb88-a094c13ac9de"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 13:32:00.878271 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.878244 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "379feca0-7097-4421-bb88-a094c13ac9de" (UID: "379feca0-7097-4421-bb88-a094c13ac9de"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:32:00.878428 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.878404 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-kube-api-access-vh65z" (OuterVolumeSpecName: "kube-api-access-vh65z") pod "379feca0-7097-4421-bb88-a094c13ac9de" (UID: "379feca0-7097-4421-bb88-a094c13ac9de"). InnerVolumeSpecName "kube-api-access-vh65z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:32:00.878428 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.878412 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/379feca0-7097-4421-bb88-a094c13ac9de-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "379feca0-7097-4421-bb88-a094c13ac9de" (UID: "379feca0-7097-4421-bb88-a094c13ac9de"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:32:00.878635 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.878620 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "379feca0-7097-4421-bb88-a094c13ac9de" (UID: "379feca0-7097-4421-bb88-a094c13ac9de"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:32:00.878761 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.878740 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/379feca0-7097-4421-bb88-a094c13ac9de-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "379feca0-7097-4421-bb88-a094c13ac9de" (UID: "379feca0-7097-4421-bb88-a094c13ac9de"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:32:00.885055 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.885021 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/379feca0-7097-4421-bb88-a094c13ac9de-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "379feca0-7097-4421-bb88-a094c13ac9de" (UID: "379feca0-7097-4421-bb88-a094c13ac9de"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:32:00.945688 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.945660 2563 generic.go:356] "Generic (PLEG): container finished" podID="379feca0-7097-4421-bb88-a094c13ac9de" containerID="d897fc9fd34a6687a0d533a8269054aa74831fcc35045cc4052d14e835333fa6" exitCode=0 Jun 11 13:32:00.945766 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.945703 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6999954d75-grkv5" Jun 11 13:32:00.945766 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.945721 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6999954d75-grkv5" event={"ID":"379feca0-7097-4421-bb88-a094c13ac9de","Type":"ContainerDied","Data":"d897fc9fd34a6687a0d533a8269054aa74831fcc35045cc4052d14e835333fa6"} Jun 11 13:32:00.945835 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.945768 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6999954d75-grkv5" event={"ID":"379feca0-7097-4421-bb88-a094c13ac9de","Type":"ContainerDied","Data":"2ecee5b5da865965ffbfc5e3355d5bd2e6fd011b109364772dd9ae319cb8e644"} Jun 11 13:32:00.945835 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.945795 2563 scope.go:117] "RemoveContainer" containerID="d897fc9fd34a6687a0d533a8269054aa74831fcc35045cc4052d14e835333fa6" Jun 11 13:32:00.958296 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.958278 2563 scope.go:117] "RemoveContainer" containerID="d897fc9fd34a6687a0d533a8269054aa74831fcc35045cc4052d14e835333fa6" Jun 11 13:32:00.958637 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:32:00.958596 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d897fc9fd34a6687a0d533a8269054aa74831fcc35045cc4052d14e835333fa6\": container with ID starting with d897fc9fd34a6687a0d533a8269054aa74831fcc35045cc4052d14e835333fa6 not found: ID does not exist" containerID="d897fc9fd34a6687a0d533a8269054aa74831fcc35045cc4052d14e835333fa6" Jun 11 13:32:00.958709 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.958677 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d897fc9fd34a6687a0d533a8269054aa74831fcc35045cc4052d14e835333fa6"} err="failed to get container status \"d897fc9fd34a6687a0d533a8269054aa74831fcc35045cc4052d14e835333fa6\": rpc error: code = NotFound desc = could not find container \"d897fc9fd34a6687a0d533a8269054aa74831fcc35045cc4052d14e835333fa6\": container with ID starting with d897fc9fd34a6687a0d533a8269054aa74831fcc35045cc4052d14e835333fa6 not found: ID does not exist" Jun 11 13:32:00.967599 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.967576 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6999954d75-grkv5"] Jun 11 13:32:00.971080 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.971059 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6999954d75-grkv5"] Jun 11 13:32:00.977132 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.977109 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/379feca0-7097-4421-bb88-a094c13ac9de-registry-certificates\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:32:00.977220 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.977134 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-registry-tls\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:32:00.977220 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.977147 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vh65z\" (UniqueName: \"kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-kube-api-access-vh65z\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:32:00.977220 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.977155 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/379feca0-7097-4421-bb88-a094c13ac9de-bound-sa-token\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:32:00.977220 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.977164 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/379feca0-7097-4421-bb88-a094c13ac9de-image-registry-private-configuration\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:32:00.977220 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.977172 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/379feca0-7097-4421-bb88-a094c13ac9de-installation-pull-secrets\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:32:00.977220 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:00.977180 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/379feca0-7097-4421-bb88-a094c13ac9de-ca-trust-extracted\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:32:02.845733 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:02.845703 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="379feca0-7097-4421-bb88-a094c13ac9de" path="/var/lib/kubelet/pods/379feca0-7097-4421-bb88-a094c13ac9de/volumes" Jun 11 13:32:06.237089 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:06.237034 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:32:06.334437 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:06.334411 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:32:21.242822 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:21.242784 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:32:21.294791 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:21.294758 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:32:38.674319 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:38.674265 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs\") pod \"network-metrics-daemon-698v8\" (UID: \"dbcbad68-5014-4dbd-99f2-087716f10a31\") " pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:32:38.676697 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:38.676676 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbcbad68-5014-4dbd-99f2-087716f10a31-metrics-certs\") pod \"network-metrics-daemon-698v8\" (UID: \"dbcbad68-5014-4dbd-99f2-087716f10a31\") " pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:32:38.944366 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:38.944283 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8hj25\"" Jun 11 13:32:38.952025 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:38.952005 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698v8" Jun 11 13:32:39.080882 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:39.080834 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-698v8"] Jun 11 13:32:39.083550 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:32:39.083509 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbcbad68_5014_4dbd_99f2_087716f10a31.slice/crio-4471aae870c6f4a3dfebd7eba1c662f0c797dfda379633859d011293fe22c8d0 WatchSource:0}: Error finding container 4471aae870c6f4a3dfebd7eba1c662f0c797dfda379633859d011293fe22c8d0: Status 404 returned error can't find the container with id 4471aae870c6f4a3dfebd7eba1c662f0c797dfda379633859d011293fe22c8d0 Jun 11 13:32:39.089674 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:39.089642 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-698v8" event={"ID":"dbcbad68-5014-4dbd-99f2-087716f10a31","Type":"ContainerStarted","Data":"4471aae870c6f4a3dfebd7eba1c662f0c797dfda379633859d011293fe22c8d0"} Jun 11 13:32:40.095928 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:40.095899 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-698v8" event={"ID":"dbcbad68-5014-4dbd-99f2-087716f10a31","Type":"ContainerStarted","Data":"3913570cf7306329a304f90a73205a4ce31809d3ba86bb5e86c4462d9cc14bf8"} Jun 11 13:32:41.100688 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:41.100650 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-698v8" event={"ID":"dbcbad68-5014-4dbd-99f2-087716f10a31","Type":"ContainerStarted","Data":"517c58a06c4a2023038a1026b7fe609ae2b87222d008996a1d3f4e53de818e81"} Jun 11 13:32:41.121421 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:41.121376 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-698v8" podStartSLOduration=375.276771279 podStartE2EDuration="6m16.121362518s" totalImagesPullingTime="844.591239ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:32:41.11984895 +0000 UTC m=+376.688267277" watchObservedRunningTime="2026-06-11 13:32:41.121362518 +0000 UTC m=+376.689780845" Jun 11 13:32:41.213964 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:41.213932 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:32:41.269857 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:41.269830 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:32:42.869134 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:42.869101 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:32:42.923595 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:42.923569 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:32:43.930972 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:43.930941 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:32:43.985587 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:43.985559 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:32:44.380004 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:44.379960 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:32:44.395697 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:44.395672 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:32:45.129064 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:45.129019 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:32:57.050612 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:57.050567 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:32:57.343290 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:32:57.343151 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:33:02.399314 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:02.399279 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 13:33:02.399738 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:02.399595 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="prometheus" containerID="cri-o://5f87e54a377d44ebc3912a2e66b57dad24f1e1f597bf361a37b4b294b846d089" gracePeriod=600 Jun 11 13:33:02.399738 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:02.399629 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="kube-rbac-proxy" containerID="cri-o://80c6611044b8734936404ffc6fd059ca11cc27f08077f7ee7d8f2e71d2eb777a" gracePeriod=600 Jun 11 13:33:02.399738 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:02.399636 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="kube-rbac-proxy-web" containerID="cri-o://02244091c9ebd5439ca57b8257a9166f23dec7b6d82826d869ac967f6309e531" gracePeriod=600 Jun 11 13:33:02.399738 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:02.399642 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="thanos-sidecar" containerID="cri-o://92d7a2df2be6922186a677792d3d85911a2c73d6574615e199194471e22718c4" gracePeriod=600 Jun 11 13:33:02.399738 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:02.399658 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="config-reloader" containerID="cri-o://e1a8def21d308a32c6f8ac08b96fabb335cff225d3e5b098a41d1bf0db31988f" gracePeriod=600 Jun 11 13:33:02.399738 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:02.399601 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="kube-rbac-proxy-thanos" containerID="cri-o://3e154547a5b16e615a1d46cb5b205fe5750391c11ea3ef04b4fc3adfa465b5d7" gracePeriod=600 Jun 11 13:33:03.181572 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:03.181540 2563 generic.go:356] "Generic (PLEG): container finished" podID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerID="02244091c9ebd5439ca57b8257a9166f23dec7b6d82826d869ac967f6309e531" exitCode=0 Jun 11 13:33:03.181572 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:03.181564 2563 generic.go:356] "Generic (PLEG): container finished" podID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerID="92d7a2df2be6922186a677792d3d85911a2c73d6574615e199194471e22718c4" exitCode=0 Jun 11 13:33:03.181572 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:03.181570 2563 generic.go:356] "Generic (PLEG): container finished" podID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerID="e1a8def21d308a32c6f8ac08b96fabb335cff225d3e5b098a41d1bf0db31988f" exitCode=0 Jun 11 13:33:03.181791 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:03.181607 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47","Type":"ContainerDied","Data":"02244091c9ebd5439ca57b8257a9166f23dec7b6d82826d869ac967f6309e531"} Jun 11 13:33:03.181791 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:03.181667 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47","Type":"ContainerDied","Data":"92d7a2df2be6922186a677792d3d85911a2c73d6574615e199194471e22718c4"} Jun 11 13:33:03.181791 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:03.181693 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47","Type":"ContainerDied","Data":"e1a8def21d308a32c6f8ac08b96fabb335cff225d3e5b098a41d1bf0db31988f"} Jun 11 13:33:04.189668 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:04.189638 2563 generic.go:356] "Generic (PLEG): container finished" podID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerID="3e154547a5b16e615a1d46cb5b205fe5750391c11ea3ef04b4fc3adfa465b5d7" exitCode=0 Jun 11 13:33:04.189668 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:04.189662 2563 generic.go:356] "Generic (PLEG): container finished" podID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerID="80c6611044b8734936404ffc6fd059ca11cc27f08077f7ee7d8f2e71d2eb777a" exitCode=0 Jun 11 13:33:04.190070 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:04.189697 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47","Type":"ContainerDied","Data":"3e154547a5b16e615a1d46cb5b205fe5750391c11ea3ef04b4fc3adfa465b5d7"} Jun 11 13:33:04.190070 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:04.189747 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47","Type":"ContainerDied","Data":"80c6611044b8734936404ffc6fd059ca11cc27f08077f7ee7d8f2e71d2eb777a"} Jun 11 13:33:05.115757 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:33:05.115717 2563 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5f87e54a377d44ebc3912a2e66b57dad24f1e1f597bf361a37b4b294b846d089" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jun 11 13:33:05.117282 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:33:05.117247 2563 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5f87e54a377d44ebc3912a2e66b57dad24f1e1f597bf361a37b4b294b846d089" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jun 11 13:33:05.118176 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:33:05.118146 2563 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5f87e54a377d44ebc3912a2e66b57dad24f1e1f597bf361a37b4b294b846d089" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jun 11 13:33:05.118297 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:33:05.118192 2563 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="prometheus" probeResult="unknown" Jun 11 13:33:05.760858 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:05.760821 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:33:05.820070 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:05.820028 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:33:10.115680 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:33:10.115637 2563 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5f87e54a377d44ebc3912a2e66b57dad24f1e1f597bf361a37b4b294b846d089" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jun 11 13:33:10.116532 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:33:10.116501 2563 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5f87e54a377d44ebc3912a2e66b57dad24f1e1f597bf361a37b4b294b846d089" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jun 11 13:33:10.117298 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:33:10.117275 2563 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5f87e54a377d44ebc3912a2e66b57dad24f1e1f597bf361a37b4b294b846d089" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jun 11 13:33:10.117369 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:33:10.117313 2563 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="prometheus" probeResult="unknown" Jun 11 13:33:11.142559 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.142532 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.215623 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.215590 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-tls-assets\") pod \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " Jun 11 13:33:11.215778 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.215652 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wn5zh\" (UniqueName: \"kubernetes.io/projected/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-kube-api-access-wn5zh\") pod \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " Jun 11 13:33:11.215778 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.215680 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-config-out\") pod \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " Jun 11 13:33:11.215778 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.215706 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-config\") pod \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " Jun 11 13:33:11.215778 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.215734 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-thanos-prometheus-http-client-file\") pod \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " Jun 11 13:33:11.215778 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.215762 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " Jun 11 13:33:11.216089 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.215990 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-kube-rbac-proxy\") pod \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " Jun 11 13:33:11.216148 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.216086 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-k8s-rulefiles-1\") pod \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " Jun 11 13:33:11.216148 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.216117 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-configmap-kubelet-serving-ca-bundle\") pod \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " Jun 11 13:33:11.216252 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.216144 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-metrics-client-certs\") pod \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " Jun 11 13:33:11.216252 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.216197 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-prometheus-k8s-tls\") pod \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " Jun 11 13:33:11.216252 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.216226 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-configmap-serving-certs-ca-bundle\") pod \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " Jun 11 13:33:11.216388 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.216262 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-trusted-ca-bundle\") pod \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " Jun 11 13:33:11.216388 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.216295 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-k8s-rulefiles-2\") pod \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " Jun 11 13:33:11.216388 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.216331 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-k8s-rulefiles-0\") pod \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " Jun 11 13:33:11.216388 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.216363 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-web-config\") pod \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " Jun 11 13:33:11.216616 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.216415 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-k8s-db\") pod \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " Jun 11 13:33:11.216616 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.216458 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-grpc-tls\") pod \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " Jun 11 13:33:11.216714 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.216628 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " Jun 11 13:33:11.216714 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.216661 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-configmap-metrics-client-ca\") pod \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\" (UID: \"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47\") " Jun 11 13:33:11.218574 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.217302 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" (UID: "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 13:33:11.218574 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.217949 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" (UID: "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 13:33:11.218574 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.218346 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" (UID: "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 13:33:11.219312 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.218946 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" (UID: "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:33:11.219312 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.219027 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" (UID: "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 13:33:11.219312 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.219128 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" (UID: "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 13:33:11.219828 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.219799 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" (UID: "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 13:33:11.220744 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.220624 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" (UID: "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:33:11.220744 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.220634 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-config-out" (OuterVolumeSpecName: "config-out") pod "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" (UID: "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:33:11.220744 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.220695 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" (UID: "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:33:11.221002 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.220961 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" (UID: "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 13:33:11.222005 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.221970 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" (UID: "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:33:11.222124 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.222100 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" (UID: "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:33:11.222200 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.222160 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" (UID: "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:33:11.222347 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.222254 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-config" (OuterVolumeSpecName: "config") pod "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" (UID: "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:33:11.222453 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.222395 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-kube-api-access-wn5zh" (OuterVolumeSpecName: "kube-api-access-wn5zh") pod "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" (UID: "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47"). InnerVolumeSpecName "kube-api-access-wn5zh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:33:11.222981 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.222957 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" (UID: "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:33:11.223106 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.223031 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" (UID: "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:33:11.223412 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.223389 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" (UID: "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:33:11.224360 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.224334 2563 generic.go:356] "Generic (PLEG): container finished" podID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerID="5f87e54a377d44ebc3912a2e66b57dad24f1e1f597bf361a37b4b294b846d089" exitCode=0 Jun 11 13:33:11.224447 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.224406 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47","Type":"ContainerDied","Data":"5f87e54a377d44ebc3912a2e66b57dad24f1e1f597bf361a37b4b294b846d089"} Jun 11 13:33:11.224506 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.224493 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.224658 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.224511 2563 scope.go:117] "RemoveContainer" containerID="3e154547a5b16e615a1d46cb5b205fe5750391c11ea3ef04b4fc3adfa465b5d7" Jun 11 13:33:11.224658 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.224496 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0f21e0-ad4e-43e8-86c3-cfe43456fe47","Type":"ContainerDied","Data":"8849c4e1db3d43b56debc8b8dd320ea4b744b7bb575938dd8c5f1a17f7932e17"} Jun 11 13:33:11.234677 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.234654 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-web-config" (OuterVolumeSpecName: "web-config") pod "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" (UID: "dd0f21e0-ad4e-43e8-86c3-cfe43456fe47"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:33:11.239474 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.239459 2563 scope.go:117] "RemoveContainer" containerID="80c6611044b8734936404ffc6fd059ca11cc27f08077f7ee7d8f2e71d2eb777a" Jun 11 13:33:11.245943 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.245927 2563 scope.go:117] "RemoveContainer" containerID="02244091c9ebd5439ca57b8257a9166f23dec7b6d82826d869ac967f6309e531" Jun 11 13:33:11.252069 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.252037 2563 scope.go:117] "RemoveContainer" containerID="92d7a2df2be6922186a677792d3d85911a2c73d6574615e199194471e22718c4" Jun 11 13:33:11.258146 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.258128 2563 scope.go:117] "RemoveContainer" containerID="e1a8def21d308a32c6f8ac08b96fabb335cff225d3e5b098a41d1bf0db31988f" Jun 11 13:33:11.265121 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.265099 2563 scope.go:117] "RemoveContainer" containerID="5f87e54a377d44ebc3912a2e66b57dad24f1e1f597bf361a37b4b294b846d089" Jun 11 13:33:11.271809 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.271794 2563 scope.go:117] "RemoveContainer" containerID="00b55350d6af07302d61f96967b7c7ce8e70bc1854b17aa001d1d81dbac20fc6" Jun 11 13:33:11.278004 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.277986 2563 scope.go:117] "RemoveContainer" containerID="3e154547a5b16e615a1d46cb5b205fe5750391c11ea3ef04b4fc3adfa465b5d7" Jun 11 13:33:11.278345 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:33:11.278325 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e154547a5b16e615a1d46cb5b205fe5750391c11ea3ef04b4fc3adfa465b5d7\": container with ID starting with 3e154547a5b16e615a1d46cb5b205fe5750391c11ea3ef04b4fc3adfa465b5d7 not found: ID does not exist" containerID="3e154547a5b16e615a1d46cb5b205fe5750391c11ea3ef04b4fc3adfa465b5d7" Jun 11 13:33:11.278445 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.278353 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e154547a5b16e615a1d46cb5b205fe5750391c11ea3ef04b4fc3adfa465b5d7"} err="failed to get container status \"3e154547a5b16e615a1d46cb5b205fe5750391c11ea3ef04b4fc3adfa465b5d7\": rpc error: code = NotFound desc = could not find container \"3e154547a5b16e615a1d46cb5b205fe5750391c11ea3ef04b4fc3adfa465b5d7\": container with ID starting with 3e154547a5b16e615a1d46cb5b205fe5750391c11ea3ef04b4fc3adfa465b5d7 not found: ID does not exist" Jun 11 13:33:11.278445 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.278378 2563 scope.go:117] "RemoveContainer" containerID="80c6611044b8734936404ffc6fd059ca11cc27f08077f7ee7d8f2e71d2eb777a" Jun 11 13:33:11.283001 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:33:11.279017 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80c6611044b8734936404ffc6fd059ca11cc27f08077f7ee7d8f2e71d2eb777a\": container with ID starting with 80c6611044b8734936404ffc6fd059ca11cc27f08077f7ee7d8f2e71d2eb777a not found: ID does not exist" containerID="80c6611044b8734936404ffc6fd059ca11cc27f08077f7ee7d8f2e71d2eb777a" Jun 11 13:33:11.283001 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.279077 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80c6611044b8734936404ffc6fd059ca11cc27f08077f7ee7d8f2e71d2eb777a"} err="failed to get container status \"80c6611044b8734936404ffc6fd059ca11cc27f08077f7ee7d8f2e71d2eb777a\": rpc error: code = NotFound desc = could not find container \"80c6611044b8734936404ffc6fd059ca11cc27f08077f7ee7d8f2e71d2eb777a\": container with ID starting with 80c6611044b8734936404ffc6fd059ca11cc27f08077f7ee7d8f2e71d2eb777a not found: ID does not exist" Jun 11 13:33:11.283001 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.279104 2563 scope.go:117] "RemoveContainer" containerID="02244091c9ebd5439ca57b8257a9166f23dec7b6d82826d869ac967f6309e531" Jun 11 13:33:11.283432 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:33:11.283408 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02244091c9ebd5439ca57b8257a9166f23dec7b6d82826d869ac967f6309e531\": container with ID starting with 02244091c9ebd5439ca57b8257a9166f23dec7b6d82826d869ac967f6309e531 not found: ID does not exist" containerID="02244091c9ebd5439ca57b8257a9166f23dec7b6d82826d869ac967f6309e531" Jun 11 13:33:11.283491 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.283438 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02244091c9ebd5439ca57b8257a9166f23dec7b6d82826d869ac967f6309e531"} err="failed to get container status \"02244091c9ebd5439ca57b8257a9166f23dec7b6d82826d869ac967f6309e531\": rpc error: code = NotFound desc = could not find container \"02244091c9ebd5439ca57b8257a9166f23dec7b6d82826d869ac967f6309e531\": container with ID starting with 02244091c9ebd5439ca57b8257a9166f23dec7b6d82826d869ac967f6309e531 not found: ID does not exist" Jun 11 13:33:11.283491 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.283456 2563 scope.go:117] "RemoveContainer" containerID="92d7a2df2be6922186a677792d3d85911a2c73d6574615e199194471e22718c4" Jun 11 13:33:11.283744 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:33:11.283725 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92d7a2df2be6922186a677792d3d85911a2c73d6574615e199194471e22718c4\": container with ID starting with 92d7a2df2be6922186a677792d3d85911a2c73d6574615e199194471e22718c4 not found: ID does not exist" containerID="92d7a2df2be6922186a677792d3d85911a2c73d6574615e199194471e22718c4" Jun 11 13:33:11.283794 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.283747 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92d7a2df2be6922186a677792d3d85911a2c73d6574615e199194471e22718c4"} err="failed to get container status \"92d7a2df2be6922186a677792d3d85911a2c73d6574615e199194471e22718c4\": rpc error: code = NotFound desc = could not find container \"92d7a2df2be6922186a677792d3d85911a2c73d6574615e199194471e22718c4\": container with ID starting with 92d7a2df2be6922186a677792d3d85911a2c73d6574615e199194471e22718c4 not found: ID does not exist" Jun 11 13:33:11.283794 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.283760 2563 scope.go:117] "RemoveContainer" containerID="e1a8def21d308a32c6f8ac08b96fabb335cff225d3e5b098a41d1bf0db31988f" Jun 11 13:33:11.284005 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:33:11.283986 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1a8def21d308a32c6f8ac08b96fabb335cff225d3e5b098a41d1bf0db31988f\": container with ID starting with e1a8def21d308a32c6f8ac08b96fabb335cff225d3e5b098a41d1bf0db31988f not found: ID does not exist" containerID="e1a8def21d308a32c6f8ac08b96fabb335cff225d3e5b098a41d1bf0db31988f" Jun 11 13:33:11.284078 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.284010 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1a8def21d308a32c6f8ac08b96fabb335cff225d3e5b098a41d1bf0db31988f"} err="failed to get container status \"e1a8def21d308a32c6f8ac08b96fabb335cff225d3e5b098a41d1bf0db31988f\": rpc error: code = NotFound desc = could not find container \"e1a8def21d308a32c6f8ac08b96fabb335cff225d3e5b098a41d1bf0db31988f\": container with ID starting with e1a8def21d308a32c6f8ac08b96fabb335cff225d3e5b098a41d1bf0db31988f not found: ID does not exist" Jun 11 13:33:11.284078 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.284025 2563 scope.go:117] "RemoveContainer" containerID="5f87e54a377d44ebc3912a2e66b57dad24f1e1f597bf361a37b4b294b846d089" Jun 11 13:33:11.284391 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:33:11.284373 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f87e54a377d44ebc3912a2e66b57dad24f1e1f597bf361a37b4b294b846d089\": container with ID starting with 5f87e54a377d44ebc3912a2e66b57dad24f1e1f597bf361a37b4b294b846d089 not found: ID does not exist" containerID="5f87e54a377d44ebc3912a2e66b57dad24f1e1f597bf361a37b4b294b846d089" Jun 11 13:33:11.284449 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.284394 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f87e54a377d44ebc3912a2e66b57dad24f1e1f597bf361a37b4b294b846d089"} err="failed to get container status \"5f87e54a377d44ebc3912a2e66b57dad24f1e1f597bf361a37b4b294b846d089\": rpc error: code = NotFound desc = could not find container \"5f87e54a377d44ebc3912a2e66b57dad24f1e1f597bf361a37b4b294b846d089\": container with ID starting with 5f87e54a377d44ebc3912a2e66b57dad24f1e1f597bf361a37b4b294b846d089 not found: ID does not exist" Jun 11 13:33:11.284449 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.284408 2563 scope.go:117] "RemoveContainer" containerID="00b55350d6af07302d61f96967b7c7ce8e70bc1854b17aa001d1d81dbac20fc6" Jun 11 13:33:11.284626 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:33:11.284600 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00b55350d6af07302d61f96967b7c7ce8e70bc1854b17aa001d1d81dbac20fc6\": container with ID starting with 00b55350d6af07302d61f96967b7c7ce8e70bc1854b17aa001d1d81dbac20fc6 not found: ID does not exist" containerID="00b55350d6af07302d61f96967b7c7ce8e70bc1854b17aa001d1d81dbac20fc6" Jun 11 13:33:11.284674 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.284629 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00b55350d6af07302d61f96967b7c7ce8e70bc1854b17aa001d1d81dbac20fc6"} err="failed to get container status \"00b55350d6af07302d61f96967b7c7ce8e70bc1854b17aa001d1d81dbac20fc6\": rpc error: code = NotFound desc = could not find container \"00b55350d6af07302d61f96967b7c7ce8e70bc1854b17aa001d1d81dbac20fc6\": container with ID starting with 00b55350d6af07302d61f96967b7c7ce8e70bc1854b17aa001d1d81dbac20fc6 not found: ID does not exist" Jun 11 13:33:11.317287 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.317264 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:33:11.317287 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.317284 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:33:11.317399 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.317293 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-web-config\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:33:11.317399 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.317303 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-k8s-db\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:33:11.317399 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.317316 2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-grpc-tls\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:33:11.317399 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.317329 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:33:11.317399 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.317338 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-configmap-metrics-client-ca\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:33:11.317399 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.317347 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-tls-assets\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:33:11.317399 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.317355 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wn5zh\" (UniqueName: \"kubernetes.io/projected/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-kube-api-access-wn5zh\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:33:11.317399 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.317362 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-config-out\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:33:11.317399 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.317370 2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-config\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:33:11.317399 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.317377 2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:33:11.317399 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.317385 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:33:11.317399 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.317398 2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-kube-rbac-proxy\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:33:11.317765 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.317410 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:33:11.317765 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.317418 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:33:11.317765 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.317426 2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-metrics-client-certs\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:33:11.317765 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.317434 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:33:11.317765 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.317441 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:33:11.317765 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.317449 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:33:11.548437 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.548395 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 13:33:11.553631 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.553608 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 13:33:11.578865 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.578838 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 13:33:11.579174 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.579158 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="config-reloader" Jun 11 13:33:11.579254 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.579176 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="config-reloader" Jun 11 13:33:11.579254 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.579189 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="thanos-sidecar" Jun 11 13:33:11.579254 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.579198 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="thanos-sidecar" Jun 11 13:33:11.579254 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.579208 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="kube-rbac-proxy-thanos" Jun 11 13:33:11.579254 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.579217 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="kube-rbac-proxy-thanos" Jun 11 13:33:11.579254 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.579228 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="379feca0-7097-4421-bb88-a094c13ac9de" containerName="registry" Jun 11 13:33:11.579254 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.579236 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="379feca0-7097-4421-bb88-a094c13ac9de" containerName="registry" Jun 11 13:33:11.579254 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.579248 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="kube-rbac-proxy-web" Jun 11 13:33:11.579254 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.579256 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="kube-rbac-proxy-web" Jun 11 13:33:11.579659 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.579268 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="prometheus" Jun 11 13:33:11.579659 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.579276 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="prometheus" Jun 11 13:33:11.579659 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.579314 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="init-config-reloader" Jun 11 13:33:11.579659 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.579322 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="init-config-reloader" Jun 11 13:33:11.579659 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.579336 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="kube-rbac-proxy" Jun 11 13:33:11.579659 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.579344 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="kube-rbac-proxy" Jun 11 13:33:11.579659 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.579415 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="thanos-sidecar" Jun 11 13:33:11.579659 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.579426 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="kube-rbac-proxy-thanos" Jun 11 13:33:11.579659 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.579437 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="config-reloader" Jun 11 13:33:11.579659 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.579445 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="kube-rbac-proxy" Jun 11 13:33:11.579659 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.579456 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="kube-rbac-proxy-web" Jun 11 13:33:11.579659 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.579465 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="379feca0-7097-4421-bb88-a094c13ac9de" containerName="registry" Jun 11 13:33:11.579659 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.579472 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" containerName="prometheus" Jun 11 13:33:11.585706 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.585687 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.587683 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.587667 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 13:33:11.588350 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.588329 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 13:33:11.588449 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.588348 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vnc58\"" Jun 11 13:33:11.588449 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.588363 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 13:33:11.588449 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.588433 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 13:33:11.588559 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.588541 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 13:33:11.588591 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.588556 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2b3b9ujff3id1\"" Jun 11 13:33:11.588591 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.588574 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 13:33:11.588658 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.588600 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 13:33:11.588854 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.588835 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 13:33:11.588950 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.588938 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 13:33:11.589206 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.589190 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 13:33:11.589311 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.589215 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 13:33:11.589311 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.589265 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 13:33:11.589311 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.589276 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 13:33:11.591611 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.591594 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 13:33:11.594614 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.594595 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 13:33:11.599878 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.599860 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 13:33:11.720020 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.719989 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-config\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.720020 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.720020 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-web-config\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.720246 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.720056 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.720246 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.720120 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.720246 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.720150 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/83f922b6-94b3-4405-b676-5700b967beca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.720246 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.720168 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83f922b6-94b3-4405-b676-5700b967beca-config-out\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.720246 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.720195 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83f922b6-94b3-4405-b676-5700b967beca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.720449 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.720266 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsxlb\" (UniqueName: \"kubernetes.io/projected/83f922b6-94b3-4405-b676-5700b967beca-kube-api-access-xsxlb\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.720449 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.720297 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/83f922b6-94b3-4405-b676-5700b967beca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.720449 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.720321 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83f922b6-94b3-4405-b676-5700b967beca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.720449 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.720335 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.720449 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.720354 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83f922b6-94b3-4405-b676-5700b967beca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.720449 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.720368 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/83f922b6-94b3-4405-b676-5700b967beca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.720449 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.720435 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.720755 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.720473 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.720755 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.720503 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.720755 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.720545 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83f922b6-94b3-4405-b676-5700b967beca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.720755 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.720568 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83f922b6-94b3-4405-b676-5700b967beca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.720755 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.720598 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/83f922b6-94b3-4405-b676-5700b967beca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.720755 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.720624 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.821611 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.821542 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.821611 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.821578 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.821611 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.821597 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/83f922b6-94b3-4405-b676-5700b967beca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.821844 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.821615 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83f922b6-94b3-4405-b676-5700b967beca-config-out\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.821844 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.821637 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83f922b6-94b3-4405-b676-5700b967beca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.821844 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.821742 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsxlb\" (UniqueName: \"kubernetes.io/projected/83f922b6-94b3-4405-b676-5700b967beca-kube-api-access-xsxlb\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.821844 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.821770 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/83f922b6-94b3-4405-b676-5700b967beca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.821844 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.821793 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83f922b6-94b3-4405-b676-5700b967beca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.821844 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.821812 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.821844 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.821837 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83f922b6-94b3-4405-b676-5700b967beca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.822206 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.821856 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/83f922b6-94b3-4405-b676-5700b967beca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.822206 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.821883 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.822206 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.821908 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.822206 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.821933 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.822206 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.821964 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83f922b6-94b3-4405-b676-5700b967beca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.822206 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.821991 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83f922b6-94b3-4405-b676-5700b967beca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.822206 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.822026 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/83f922b6-94b3-4405-b676-5700b967beca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.822206 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.822070 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.822206 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.822100 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-config\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.822206 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.822123 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-web-config\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.822834 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.822340 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/83f922b6-94b3-4405-b676-5700b967beca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.822834 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.822516 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/83f922b6-94b3-4405-b676-5700b967beca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.823822 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.823121 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83f922b6-94b3-4405-b676-5700b967beca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.823822 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.823317 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83f922b6-94b3-4405-b676-5700b967beca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.823822 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.823489 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83f922b6-94b3-4405-b676-5700b967beca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.823822 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.823628 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/83f922b6-94b3-4405-b676-5700b967beca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.825013 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.824704 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83f922b6-94b3-4405-b676-5700b967beca-config-out\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.825013 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.824781 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.825013 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.824938 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-web-config\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.825013 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.824948 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.825289 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.825074 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.825733 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.825705 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83f922b6-94b3-4405-b676-5700b967beca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.825899 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.825876 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.826491 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.826470 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.827385 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.827365 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.827530 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.827515 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-config\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.827607 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.827586 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83f922b6-94b3-4405-b676-5700b967beca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.827641 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.827593 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/83f922b6-94b3-4405-b676-5700b967beca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.827641 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.827599 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/83f922b6-94b3-4405-b676-5700b967beca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.829752 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.829727 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsxlb\" (UniqueName: \"kubernetes.io/projected/83f922b6-94b3-4405-b676-5700b967beca-kube-api-access-xsxlb\") pod \"prometheus-k8s-0\" (UID: \"83f922b6-94b3-4405-b676-5700b967beca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:11.897097 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:11.897074 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:12.029294 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:12.029253 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 13:33:12.033030 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:33:12.032998 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83f922b6_94b3_4405_b676_5700b967beca.slice/crio-c0f743c1a51139ea28216ac2d17c34f7e0078a99ea186e7845f52bc0e850a67f WatchSource:0}: Error finding container c0f743c1a51139ea28216ac2d17c34f7e0078a99ea186e7845f52bc0e850a67f: Status 404 returned error can't find the container with id c0f743c1a51139ea28216ac2d17c34f7e0078a99ea186e7845f52bc0e850a67f Jun 11 13:33:12.229213 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:12.229178 2563 generic.go:356] "Generic (PLEG): container finished" podID="83f922b6-94b3-4405-b676-5700b967beca" containerID="1f7f6679cff6c15771f40d5d7cf665ecef176e1803c388141feab1e7ea328ad3" exitCode=0 Jun 11 13:33:12.229616 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:12.229270 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83f922b6-94b3-4405-b676-5700b967beca","Type":"ContainerDied","Data":"1f7f6679cff6c15771f40d5d7cf665ecef176e1803c388141feab1e7ea328ad3"} Jun 11 13:33:12.229616 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:12.229353 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83f922b6-94b3-4405-b676-5700b967beca","Type":"ContainerStarted","Data":"c0f743c1a51139ea28216ac2d17c34f7e0078a99ea186e7845f52bc0e850a67f"} Jun 11 13:33:12.845504 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:12.845475 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd0f21e0-ad4e-43e8-86c3-cfe43456fe47" path="/var/lib/kubelet/pods/dd0f21e0-ad4e-43e8-86c3-cfe43456fe47/volumes" Jun 11 13:33:13.237857 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:13.237821 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83f922b6-94b3-4405-b676-5700b967beca","Type":"ContainerStarted","Data":"7b1df8b1b514b512e9bfcfff58f077a6197616374197ddae4a736bf4b0c93b8a"} Jun 11 13:33:13.238227 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:13.237908 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83f922b6-94b3-4405-b676-5700b967beca","Type":"ContainerStarted","Data":"054b463bdf151bd490df853511e83128dc1f1f552ec0f3a4f2cc96e94b210c7b"} Jun 11 13:33:13.238227 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:13.237944 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83f922b6-94b3-4405-b676-5700b967beca","Type":"ContainerStarted","Data":"4a6f4fb272d7329b45c9fe57049b3b8d53cbc389a3dddf0c5a3d38a78a6643a7"} Jun 11 13:33:13.238227 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:13.237969 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83f922b6-94b3-4405-b676-5700b967beca","Type":"ContainerStarted","Data":"e7451f6869e99d3b8cef49cfa2ed6918b8166fbc1db58f40ac4ceb3feef3164d"} Jun 11 13:33:13.238227 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:13.238002 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83f922b6-94b3-4405-b676-5700b967beca","Type":"ContainerStarted","Data":"ec486cdd0de5c972cdc127d0087e13bb72169e52b17d9312b46ea4a81d3e8231"} Jun 11 13:33:13.238227 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:13.238026 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83f922b6-94b3-4405-b676-5700b967beca","Type":"ContainerStarted","Data":"79eefca704c1e434a09be8b4307612437a91ec896c659f3e4732578fbf2ec553"} Jun 11 13:33:13.264568 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:13.264492 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.246589246 podStartE2EDuration="2.264472825s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.883579ms" isStatefulPod=false podCreationTimestamp="2026-06-11 13:33:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:33:13.263095141 +0000 UTC m=+408.831513467" watchObservedRunningTime="2026-06-11 13:33:13.264472825 +0000 UTC m=+408.832891152" Jun 11 13:33:16.897744 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:16.897711 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:33:17.080101 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:17.080069 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:33:17.181638 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:17.181555 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:33:17.243274 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:17.243249 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:33:33.706567 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:33.706523 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:33:33.761137 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:33:33.761095 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:09.410703 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:34:09.410660 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:09.510988 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:34:09.510942 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:11.897243 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:34:11.897207 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:34:11.912988 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:34:11.912958 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:34:12.465987 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:34:12.465958 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:34:22.269806 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:34:22.269748 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:22.318655 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:34:22.318620 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:24.609933 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:34:24.609893 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:24.707266 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:34:24.707237 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:24.807942 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:34:24.807901 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:25.355806 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:34:25.355754 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:25.413270 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:34:25.413233 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:34.158009 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:34:34.157974 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:34.208407 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:34:34.208374 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:35.382021 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:34:35.381988 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:35.437487 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:34:35.437458 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:35.496521 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:34:35.496496 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:51.253610 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:34:51.253570 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:34:51.354464 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:34:51.354434 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:35:17.505184 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:35:17.505145 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:35:24.541956 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:35:24.541923 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:35:24.593637 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:35:24.593596 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:35:39.568374 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:35:39.568339 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:35:39.658368 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:35:39.658336 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:05.888767 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:05.888736 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:07.238832 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:07.238798 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:09.498932 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:09.498895 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:09.598306 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:09.598273 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:11.280529 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:11.280469 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:11.379243 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:11.379211 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:14.087299 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:14.087270 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:14.153111 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:14.153084 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:14.562769 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:14.562743 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:15.176655 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:15.176619 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:22.961405 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:22.961368 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:24.498548 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:24.498508 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-d9tqc"] Jun 11 13:36:24.501798 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:24.501775 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-d9tqc" Jun 11 13:36:24.504229 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:24.504206 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 13:36:24.504883 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:24.504865 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-pn4wd\"" Jun 11 13:36:24.504984 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:24.504891 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 13:36:24.512008 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:24.511987 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-d9tqc"] Jun 11 13:36:24.637031 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:24.637003 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dcb3fea7-ccca-4826-ac3a-484cf6f31536-bound-sa-token\") pod \"cert-manager-59c77684cc-d9tqc\" (UID: \"dcb3fea7-ccca-4826-ac3a-484cf6f31536\") " pod="cert-manager/cert-manager-59c77684cc-d9tqc" Jun 11 13:36:24.637031 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:24.637037 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m644d\" (UniqueName: \"kubernetes.io/projected/dcb3fea7-ccca-4826-ac3a-484cf6f31536-kube-api-access-m644d\") pod \"cert-manager-59c77684cc-d9tqc\" (UID: \"dcb3fea7-ccca-4826-ac3a-484cf6f31536\") " pod="cert-manager/cert-manager-59c77684cc-d9tqc" Jun 11 13:36:24.737913 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:24.737888 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dcb3fea7-ccca-4826-ac3a-484cf6f31536-bound-sa-token\") pod \"cert-manager-59c77684cc-d9tqc\" (UID: \"dcb3fea7-ccca-4826-ac3a-484cf6f31536\") " pod="cert-manager/cert-manager-59c77684cc-d9tqc" Jun 11 13:36:24.738059 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:24.737924 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m644d\" (UniqueName: \"kubernetes.io/projected/dcb3fea7-ccca-4826-ac3a-484cf6f31536-kube-api-access-m644d\") pod \"cert-manager-59c77684cc-d9tqc\" (UID: \"dcb3fea7-ccca-4826-ac3a-484cf6f31536\") " pod="cert-manager/cert-manager-59c77684cc-d9tqc" Jun 11 13:36:24.746475 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:24.746455 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dcb3fea7-ccca-4826-ac3a-484cf6f31536-bound-sa-token\") pod \"cert-manager-59c77684cc-d9tqc\" (UID: \"dcb3fea7-ccca-4826-ac3a-484cf6f31536\") " pod="cert-manager/cert-manager-59c77684cc-d9tqc" Jun 11 13:36:24.746629 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:24.746612 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m644d\" (UniqueName: \"kubernetes.io/projected/dcb3fea7-ccca-4826-ac3a-484cf6f31536-kube-api-access-m644d\") pod \"cert-manager-59c77684cc-d9tqc\" (UID: \"dcb3fea7-ccca-4826-ac3a-484cf6f31536\") " pod="cert-manager/cert-manager-59c77684cc-d9tqc" Jun 11 13:36:24.822068 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:24.821985 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-pn4wd\"" Jun 11 13:36:24.829936 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:24.829915 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-d9tqc" Jun 11 13:36:24.957878 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:24.957848 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-d9tqc"] Jun 11 13:36:24.960086 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:36:24.960060 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddcb3fea7_ccca_4826_ac3a_484cf6f31536.slice/crio-ac1898039c718632011bf95cf5ab30feaa7f21b74325052fbf079b4805e43bf4 WatchSource:0}: Error finding container ac1898039c718632011bf95cf5ab30feaa7f21b74325052fbf079b4805e43bf4: Status 404 returned error can't find the container with id ac1898039c718632011bf95cf5ab30feaa7f21b74325052fbf079b4805e43bf4 Jun 11 13:36:25.939781 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:25.939742 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-d9tqc" event={"ID":"dcb3fea7-ccca-4826-ac3a-484cf6f31536","Type":"ContainerStarted","Data":"ac1898039c718632011bf95cf5ab30feaa7f21b74325052fbf079b4805e43bf4"} Jun 11 13:36:28.954302 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:28.954270 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-d9tqc" event={"ID":"dcb3fea7-ccca-4826-ac3a-484cf6f31536","Type":"ContainerStarted","Data":"d46ef0ce953dae25f92dc00bb60560306512a085111f0c6347d01be88f945e22"} Jun 11 13:36:28.969035 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:28.968983 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-d9tqc" podStartSLOduration=1.70474143 podStartE2EDuration="4.968968904s" totalImagesPullingTime="3.264227474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:36:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:36:28.968234652 +0000 UTC m=+604.536652992" watchObservedRunningTime="2026-06-11 13:36:28.968968904 +0000 UTC m=+604.537387231" Jun 11 13:36:29.146069 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:29.146011 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:29.245586 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:29.245560 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:31.685259 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:31.685228 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-87tcg_28b20342-2058-4e26-8ccd-16757e486809/ovn-acl-logging/0.log" Jun 11 13:36:31.685675 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:31.685228 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-87tcg_28b20342-2058-4e26-8ccd-16757e486809/ovn-acl-logging/0.log" Jun 11 13:36:39.577477 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:39.577439 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:40.588446 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:40.588414 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:49.068589 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:49.068494 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:49.121344 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:49.121308 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:50.035637 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:50.035604 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:50.437382 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:50.437312 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:50.497881 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:50.497847 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:36:53.094633 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:36:53.094595 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:37:00.189623 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:37:00.189583 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:37:01.044087 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:37:01.044056 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:37:01.144826 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:37:01.144772 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:37:07.081555 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:37:07.081501 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:37:07.181555 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:37:07.181520 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:37:10.002508 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:37:10.002473 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:37:10.205397 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:37:10.205362 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:37:14.979142 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:37:14.979111 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:37:17.590151 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:37:17.590123 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:37:17.643419 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:37:17.643394 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:37:19.639646 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:37:19.639607 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:37:19.694162 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:37:19.694133 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:37:32.127105 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:37:32.127071 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:38:11.469924 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:38:11.469887 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:38:11.536779 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:38:11.536743 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:38:22.329073 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:38:22.329025 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:38:22.377924 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:38:22.377888 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:38:22.430921 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:38:22.430884 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:38:50.881999 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:38:50.881966 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:38:50.983463 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:38:50.983425 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:39:02.682037 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:39:02.681999 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:39:02.783690 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:39:02.783656 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:39:02.851691 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:39:02.851657 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:39:02.858487 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:39:02.858461 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-hcr9g/progression-enabled-node-0-0-9rfg9"] Jun 11 13:39:02.861552 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:39:02.861531 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-hcr9g/progression-enabled-node-0-0-9rfg9" Jun 11 13:39:02.864055 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:39:02.864023 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-hcr9g\"/\"openshift-service-ca.crt\"" Jun 11 13:39:02.864176 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:39:02.864125 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-hcr9g\"/\"kube-root-ca.crt\"" Jun 11 13:39:02.864258 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:39:02.864193 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-hcr9g\"/\"default-dockercfg-kk6wj\"" Jun 11 13:39:02.872916 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:39:02.872897 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-hcr9g/progression-enabled-node-0-0-9rfg9"] Jun 11 13:39:02.966778 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:39:02.966739 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxsxp\" (UniqueName: \"kubernetes.io/projected/e6160b3e-7f7f-4036-b928-bfb85e4031bb-kube-api-access-rxsxp\") pod \"progression-enabled-node-0-0-9rfg9\" (UID: \"e6160b3e-7f7f-4036-b928-bfb85e4031bb\") " pod="rhai-e2e-progression-hcr9g/progression-enabled-node-0-0-9rfg9" Jun 11 13:39:03.067909 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:39:03.067879 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxsxp\" (UniqueName: \"kubernetes.io/projected/e6160b3e-7f7f-4036-b928-bfb85e4031bb-kube-api-access-rxsxp\") pod \"progression-enabled-node-0-0-9rfg9\" (UID: \"e6160b3e-7f7f-4036-b928-bfb85e4031bb\") " pod="rhai-e2e-progression-hcr9g/progression-enabled-node-0-0-9rfg9" Jun 11 13:39:03.076294 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:39:03.076262 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxsxp\" (UniqueName: \"kubernetes.io/projected/e6160b3e-7f7f-4036-b928-bfb85e4031bb-kube-api-access-rxsxp\") pod \"progression-enabled-node-0-0-9rfg9\" (UID: \"e6160b3e-7f7f-4036-b928-bfb85e4031bb\") " pod="rhai-e2e-progression-hcr9g/progression-enabled-node-0-0-9rfg9" Jun 11 13:39:03.171237 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:39:03.171200 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-hcr9g/progression-enabled-node-0-0-9rfg9" Jun 11 13:39:03.303482 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:39:03.303458 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-hcr9g/progression-enabled-node-0-0-9rfg9"] Jun 11 13:39:03.306098 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:39:03.306068 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6160b3e_7f7f_4036_b928_bfb85e4031bb.slice/crio-988375e7752fc4bba1e827fff2a73b72175820230e9bfa912c77eb08fc691026 WatchSource:0}: Error finding container 988375e7752fc4bba1e827fff2a73b72175820230e9bfa912c77eb08fc691026: Status 404 returned error can't find the container with id 988375e7752fc4bba1e827fff2a73b72175820230e9bfa912c77eb08fc691026 Jun 11 13:39:03.308327 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:39:03.308308 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 13:39:03.524401 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:39:03.524310 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-hcr9g/progression-enabled-node-0-0-9rfg9" event={"ID":"e6160b3e-7f7f-4036-b928-bfb85e4031bb","Type":"ContainerStarted","Data":"988375e7752fc4bba1e827fff2a73b72175820230e9bfa912c77eb08fc691026"} Jun 11 13:40:30.463731 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:40:30.463688 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:40:30.513081 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:40:30.513023 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:41:04.060884 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:04.060828 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-hcr9g/progression-enabled-node-0-0-9rfg9" event={"ID":"e6160b3e-7f7f-4036-b928-bfb85e4031bb","Type":"ContainerStarted","Data":"1a2cc30658dcb3fa5a80e27686b33adf7496e517dccbb5ff07c6fbaf7571bc11"} Jun 11 13:41:05.064572 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:05.064541 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-hcr9g/progression-enabled-node-0-0-9rfg9" Jun 11 13:41:05.090784 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:05.090730 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-hcr9g/progression-enabled-node-0-0-9rfg9" podStartSLOduration=2.427012609 podStartE2EDuration="2m3.090715305s" totalImagesPullingTime="2m0.663702696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:39:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:41:05.088945898 +0000 UTC m=+880.657364225" watchObservedRunningTime="2026-06-11 13:41:05.090715305 +0000 UTC m=+880.659133633" Jun 11 13:41:06.068031 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:06.067988 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-hcr9g/progression-enabled-node-0-0-9rfg9" Jun 11 13:41:27.183473 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:27.183421 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-hcr9g/progression-enabled-node-0-0-9rfg9" podUID="e6160b3e-7f7f-4036-b928-bfb85e4031bb" containerName="node" probeResult="failure" output="Get \"http://10.132.0.22:28080/metrics\": read tcp 10.132.0.2:38712->10.132.0.22:28080: read: connection reset by peer" Jun 11 13:41:28.065876 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:28.065833 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-hcr9g/progression-enabled-node-0-0-9rfg9" podUID="e6160b3e-7f7f-4036-b928-bfb85e4031bb" containerName="node" probeResult="failure" output="Get \"http://10.132.0.22:28080/metrics\": dial tcp 10.132.0.22:28080: connect: connection refused" Jun 11 13:41:28.066091 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:28.065947 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-hcr9g/progression-enabled-node-0-0-9rfg9" Jun 11 13:41:28.066400 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:28.066371 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-hcr9g/progression-enabled-node-0-0-9rfg9" podUID="e6160b3e-7f7f-4036-b928-bfb85e4031bb" containerName="node" probeResult="failure" output="Get \"http://10.132.0.22:28080/metrics\": dial tcp 10.132.0.22:28080: connect: connection refused" Jun 11 13:41:28.154333 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:28.154299 2563 generic.go:356] "Generic (PLEG): container finished" podID="e6160b3e-7f7f-4036-b928-bfb85e4031bb" containerID="1a2cc30658dcb3fa5a80e27686b33adf7496e517dccbb5ff07c6fbaf7571bc11" exitCode=0 Jun 11 13:41:28.154479 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:28.154357 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-hcr9g/progression-enabled-node-0-0-9rfg9" event={"ID":"e6160b3e-7f7f-4036-b928-bfb85e4031bb","Type":"ContainerDied","Data":"1a2cc30658dcb3fa5a80e27686b33adf7496e517dccbb5ff07c6fbaf7571bc11"} Jun 11 13:41:29.310951 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:29.310918 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-hcr9g/progression-enabled-node-0-0-9rfg9" Jun 11 13:41:29.412062 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:29.411945 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxsxp\" (UniqueName: \"kubernetes.io/projected/e6160b3e-7f7f-4036-b928-bfb85e4031bb-kube-api-access-rxsxp\") pod \"e6160b3e-7f7f-4036-b928-bfb85e4031bb\" (UID: \"e6160b3e-7f7f-4036-b928-bfb85e4031bb\") " Jun 11 13:41:29.414238 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:29.414205 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6160b3e-7f7f-4036-b928-bfb85e4031bb-kube-api-access-rxsxp" (OuterVolumeSpecName: "kube-api-access-rxsxp") pod "e6160b3e-7f7f-4036-b928-bfb85e4031bb" (UID: "e6160b3e-7f7f-4036-b928-bfb85e4031bb"). InnerVolumeSpecName "kube-api-access-rxsxp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:41:29.513161 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:29.513116 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxsxp\" (UniqueName: \"kubernetes.io/projected/e6160b3e-7f7f-4036-b928-bfb85e4031bb-kube-api-access-rxsxp\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:41:30.163000 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:30.162964 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-hcr9g/progression-enabled-node-0-0-9rfg9" event={"ID":"e6160b3e-7f7f-4036-b928-bfb85e4031bb","Type":"ContainerDied","Data":"988375e7752fc4bba1e827fff2a73b72175820230e9bfa912c77eb08fc691026"} Jun 11 13:41:30.163000 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:30.162985 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-hcr9g/progression-enabled-node-0-0-9rfg9" Jun 11 13:41:30.163000 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:30.163011 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="988375e7752fc4bba1e827fff2a73b72175820230e9bfa912c77eb08fc691026" Jun 11 13:41:31.280701 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:31.280663 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:41:31.312248 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:31.312212 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-hcr9g/progression-disabled-node-0-0-4q2mg"] Jun 11 13:41:31.312507 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:31.312495 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6160b3e-7f7f-4036-b928-bfb85e4031bb" containerName="node" Jun 11 13:41:31.312548 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:31.312509 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6160b3e-7f7f-4036-b928-bfb85e4031bb" containerName="node" Jun 11 13:41:31.312580 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:31.312557 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6160b3e-7f7f-4036-b928-bfb85e4031bb" containerName="node" Jun 11 13:41:31.332832 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:31.332807 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-hcr9g/progression-disabled-node-0-0-4q2mg"] Jun 11 13:41:31.332961 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:31.332894 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-hcr9g/progression-disabled-node-0-0-4q2mg" Jun 11 13:41:31.335347 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:31.335325 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-hcr9g\"/\"openshift-service-ca.crt\"" Jun 11 13:41:31.335480 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:31.335434 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-hcr9g\"/\"kube-root-ca.crt\"" Jun 11 13:41:31.335554 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:31.335503 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-hcr9g\"/\"default-dockercfg-kk6wj\"" Jun 11 13:41:31.426816 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:31.426782 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjd4m\" (UniqueName: \"kubernetes.io/projected/849d4ba2-e14b-42b2-8dd8-2701e8ea8f63-kube-api-access-rjd4m\") pod \"progression-disabled-node-0-0-4q2mg\" (UID: \"849d4ba2-e14b-42b2-8dd8-2701e8ea8f63\") " pod="rhai-e2e-progression-hcr9g/progression-disabled-node-0-0-4q2mg" Jun 11 13:41:31.528174 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:31.528137 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjd4m\" (UniqueName: \"kubernetes.io/projected/849d4ba2-e14b-42b2-8dd8-2701e8ea8f63-kube-api-access-rjd4m\") pod \"progression-disabled-node-0-0-4q2mg\" (UID: \"849d4ba2-e14b-42b2-8dd8-2701e8ea8f63\") " pod="rhai-e2e-progression-hcr9g/progression-disabled-node-0-0-4q2mg" Jun 11 13:41:31.536224 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:31.536152 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjd4m\" (UniqueName: \"kubernetes.io/projected/849d4ba2-e14b-42b2-8dd8-2701e8ea8f63-kube-api-access-rjd4m\") pod \"progression-disabled-node-0-0-4q2mg\" (UID: \"849d4ba2-e14b-42b2-8dd8-2701e8ea8f63\") " pod="rhai-e2e-progression-hcr9g/progression-disabled-node-0-0-4q2mg" Jun 11 13:41:31.642215 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:31.642182 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-hcr9g/progression-disabled-node-0-0-4q2mg" Jun 11 13:41:31.714635 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:31.714605 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-87tcg_28b20342-2058-4e26-8ccd-16757e486809/ovn-acl-logging/0.log" Jun 11 13:41:31.715635 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:31.715614 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-87tcg_28b20342-2058-4e26-8ccd-16757e486809/ovn-acl-logging/0.log" Jun 11 13:41:31.785466 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:31.785436 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-hcr9g/progression-disabled-node-0-0-4q2mg"] Jun 11 13:41:31.788431 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:41:31.788369 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod849d4ba2_e14b_42b2_8dd8_2701e8ea8f63.slice/crio-0088985bd392a9218a7d357026bb1cd305dc7859209b2b631a8f07e67b9cf2c0 WatchSource:0}: Error finding container 0088985bd392a9218a7d357026bb1cd305dc7859209b2b631a8f07e67b9cf2c0: Status 404 returned error can't find the container with id 0088985bd392a9218a7d357026bb1cd305dc7859209b2b631a8f07e67b9cf2c0 Jun 11 13:41:32.172111 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:32.171983 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-hcr9g/progression-disabled-node-0-0-4q2mg" event={"ID":"849d4ba2-e14b-42b2-8dd8-2701e8ea8f63","Type":"ContainerStarted","Data":"1542277fee138ac690f69b76ab780151b8aad6d19a5106d67e99771f94388574"} Jun 11 13:41:32.172111 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:32.172036 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-hcr9g/progression-disabled-node-0-0-4q2mg" event={"ID":"849d4ba2-e14b-42b2-8dd8-2701e8ea8f63","Type":"ContainerStarted","Data":"0088985bd392a9218a7d357026bb1cd305dc7859209b2b631a8f07e67b9cf2c0"} Jun 11 13:41:32.172111 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:32.172097 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-hcr9g/progression-disabled-node-0-0-4q2mg" Jun 11 13:41:32.188807 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:32.188752 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-hcr9g/progression-disabled-node-0-0-4q2mg" podStartSLOduration=1.188733211 podStartE2EDuration="1.188733211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:41:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:41:32.185843081 +0000 UTC m=+907.754261402" watchObservedRunningTime="2026-06-11 13:41:32.188733211 +0000 UTC m=+907.757151540" Jun 11 13:41:33.173852 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:33.173818 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-hcr9g/progression-disabled-node-0-0-4q2mg" podUID="849d4ba2-e14b-42b2-8dd8-2701e8ea8f63" containerName="node" probeResult="failure" output="Get \"http://10.132.0.23:28080/metrics\": dial tcp 10.132.0.23:28080: connect: connection refused" Jun 11 13:41:33.176275 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:33.176245 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-hcr9g/progression-disabled-node-0-0-4q2mg" podUID="849d4ba2-e14b-42b2-8dd8-2701e8ea8f63" containerName="node" probeResult="failure" output="Get \"http://10.132.0.23:28080/metrics\": dial tcp 10.132.0.23:28080: connect: connection refused" Jun 11 13:41:34.178086 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:34.178057 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-hcr9g/progression-disabled-node-0-0-4q2mg" Jun 11 13:41:55.176496 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:55.176454 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-hcr9g/progression-disabled-node-0-0-4q2mg" podUID="849d4ba2-e14b-42b2-8dd8-2701e8ea8f63" containerName="node" probeResult="failure" output="Get \"http://10.132.0.23:28080/metrics\": dial tcp 10.132.0.23:28080: connect: connection refused" Jun 11 13:41:55.258564 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:55.258531 2563 generic.go:356] "Generic (PLEG): container finished" podID="849d4ba2-e14b-42b2-8dd8-2701e8ea8f63" containerID="1542277fee138ac690f69b76ab780151b8aad6d19a5106d67e99771f94388574" exitCode=0 Jun 11 13:41:55.258712 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:55.258604 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-hcr9g/progression-disabled-node-0-0-4q2mg" event={"ID":"849d4ba2-e14b-42b2-8dd8-2701e8ea8f63","Type":"ContainerDied","Data":"1542277fee138ac690f69b76ab780151b8aad6d19a5106d67e99771f94388574"} Jun 11 13:41:56.389975 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:56.389948 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-hcr9g/progression-disabled-node-0-0-4q2mg" Jun 11 13:41:56.421593 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:56.421571 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjd4m\" (UniqueName: \"kubernetes.io/projected/849d4ba2-e14b-42b2-8dd8-2701e8ea8f63-kube-api-access-rjd4m\") pod \"849d4ba2-e14b-42b2-8dd8-2701e8ea8f63\" (UID: \"849d4ba2-e14b-42b2-8dd8-2701e8ea8f63\") " Jun 11 13:41:56.423618 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:56.423591 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/849d4ba2-e14b-42b2-8dd8-2701e8ea8f63-kube-api-access-rjd4m" (OuterVolumeSpecName: "kube-api-access-rjd4m") pod "849d4ba2-e14b-42b2-8dd8-2701e8ea8f63" (UID: "849d4ba2-e14b-42b2-8dd8-2701e8ea8f63"). InnerVolumeSpecName "kube-api-access-rjd4m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:41:56.522857 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:56.522801 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjd4m\" (UniqueName: \"kubernetes.io/projected/849d4ba2-e14b-42b2-8dd8-2701e8ea8f63-kube-api-access-rjd4m\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:41:57.267434 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:57.267405 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-hcr9g/progression-disabled-node-0-0-4q2mg" event={"ID":"849d4ba2-e14b-42b2-8dd8-2701e8ea8f63","Type":"ContainerDied","Data":"0088985bd392a9218a7d357026bb1cd305dc7859209b2b631a8f07e67b9cf2c0"} Jun 11 13:41:57.267603 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:57.267436 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-hcr9g/progression-disabled-node-0-0-4q2mg" Jun 11 13:41:57.267603 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:41:57.267446 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0088985bd392a9218a7d357026bb1cd305dc7859209b2b631a8f07e67b9cf2c0" Jun 11 13:42:06.305525 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:06.305492 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-hcr9g/progression-invalid-node-0-0-n7npt"] Jun 11 13:42:06.305915 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:06.305753 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="849d4ba2-e14b-42b2-8dd8-2701e8ea8f63" containerName="node" Jun 11 13:42:06.305915 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:06.305764 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="849d4ba2-e14b-42b2-8dd8-2701e8ea8f63" containerName="node" Jun 11 13:42:06.305915 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:06.305839 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="849d4ba2-e14b-42b2-8dd8-2701e8ea8f63" containerName="node" Jun 11 13:42:06.307841 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:06.307812 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:42:06.308772 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:06.308757 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-hcr9g/progression-invalid-node-0-0-n7npt" Jun 11 13:42:06.310817 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:06.310795 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-hcr9g\"/\"kube-root-ca.crt\"" Jun 11 13:42:06.311080 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:06.311064 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-hcr9g\"/\"openshift-service-ca.crt\"" Jun 11 13:42:06.311142 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:06.311106 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-hcr9g\"/\"default-dockercfg-kk6wj\"" Jun 11 13:42:06.319466 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:06.319442 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-hcr9g/progression-invalid-node-0-0-n7npt"] Jun 11 13:42:06.386895 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:06.386865 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxwfz\" (UniqueName: \"kubernetes.io/projected/d698d880-64e0-4685-a2e0-2399d3c5fae5-kube-api-access-hxwfz\") pod \"progression-invalid-node-0-0-n7npt\" (UID: \"d698d880-64e0-4685-a2e0-2399d3c5fae5\") " pod="rhai-e2e-progression-hcr9g/progression-invalid-node-0-0-n7npt" Jun 11 13:42:06.487346 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:06.487323 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxwfz\" (UniqueName: \"kubernetes.io/projected/d698d880-64e0-4685-a2e0-2399d3c5fae5-kube-api-access-hxwfz\") pod \"progression-invalid-node-0-0-n7npt\" (UID: \"d698d880-64e0-4685-a2e0-2399d3c5fae5\") " pod="rhai-e2e-progression-hcr9g/progression-invalid-node-0-0-n7npt" Jun 11 13:42:06.494896 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:06.494863 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxwfz\" (UniqueName: \"kubernetes.io/projected/d698d880-64e0-4685-a2e0-2399d3c5fae5-kube-api-access-hxwfz\") pod \"progression-invalid-node-0-0-n7npt\" (UID: \"d698d880-64e0-4685-a2e0-2399d3c5fae5\") " pod="rhai-e2e-progression-hcr9g/progression-invalid-node-0-0-n7npt" Jun 11 13:42:06.617680 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:06.617620 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-hcr9g/progression-invalid-node-0-0-n7npt" Jun 11 13:42:06.745013 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:06.744976 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-hcr9g/progression-invalid-node-0-0-n7npt"] Jun 11 13:42:06.749191 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:42:06.749155 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd698d880_64e0_4685_a2e0_2399d3c5fae5.slice/crio-23505798fc7e50515c2cb722aa42f59a475e0f6ac1ec6f9c439c3cb88dea6776 WatchSource:0}: Error finding container 23505798fc7e50515c2cb722aa42f59a475e0f6ac1ec6f9c439c3cb88dea6776: Status 404 returned error can't find the container with id 23505798fc7e50515c2cb722aa42f59a475e0f6ac1ec6f9c439c3cb88dea6776 Jun 11 13:42:07.305936 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:07.305897 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-hcr9g/progression-invalid-node-0-0-n7npt" event={"ID":"d698d880-64e0-4685-a2e0-2399d3c5fae5","Type":"ContainerStarted","Data":"e029ff408ae949ce7102d300905aab1d2d35b8ac87bb034dcb44d969243d1dcf"} Jun 11 13:42:07.306339 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:07.305957 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-hcr9g/progression-invalid-node-0-0-n7npt" event={"ID":"d698d880-64e0-4685-a2e0-2399d3c5fae5","Type":"ContainerStarted","Data":"23505798fc7e50515c2cb722aa42f59a475e0f6ac1ec6f9c439c3cb88dea6776"} Jun 11 13:42:07.306339 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:07.306018 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-hcr9g/progression-invalid-node-0-0-n7npt" Jun 11 13:42:07.323110 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:07.323062 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-hcr9g/progression-invalid-node-0-0-n7npt" podStartSLOduration=1.323028573 podStartE2EDuration="1.323028573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:42:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:42:07.320653312 +0000 UTC m=+942.889071638" watchObservedRunningTime="2026-06-11 13:42:07.323028573 +0000 UTC m=+942.891446899" Jun 11 13:42:08.309066 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:08.309015 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-hcr9g/progression-invalid-node-0-0-n7npt" Jun 11 13:42:21.357858 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:21.357826 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:42:21.923254 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:21.923225 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:42:30.306354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:30.306312 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-hcr9g/progression-invalid-node-0-0-n7npt" podUID="d698d880-64e0-4685-a2e0-2399d3c5fae5" containerName="node" probeResult="failure" output="Get \"http://10.132.0.24:28080/metrics\": dial tcp 10.132.0.24:28080: connect: connection refused" Jun 11 13:42:30.402229 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:30.402199 2563 generic.go:356] "Generic (PLEG): container finished" podID="d698d880-64e0-4685-a2e0-2399d3c5fae5" containerID="e029ff408ae949ce7102d300905aab1d2d35b8ac87bb034dcb44d969243d1dcf" exitCode=0 Jun 11 13:42:30.402345 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:30.402266 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-hcr9g/progression-invalid-node-0-0-n7npt" event={"ID":"d698d880-64e0-4685-a2e0-2399d3c5fae5","Type":"ContainerDied","Data":"e029ff408ae949ce7102d300905aab1d2d35b8ac87bb034dcb44d969243d1dcf"} Jun 11 13:42:31.540174 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:31.540148 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-hcr9g/progression-invalid-node-0-0-n7npt" Jun 11 13:42:31.564305 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:31.564276 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxwfz\" (UniqueName: \"kubernetes.io/projected/d698d880-64e0-4685-a2e0-2399d3c5fae5-kube-api-access-hxwfz\") pod \"d698d880-64e0-4685-a2e0-2399d3c5fae5\" (UID: \"d698d880-64e0-4685-a2e0-2399d3c5fae5\") " Jun 11 13:42:31.566281 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:31.566260 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d698d880-64e0-4685-a2e0-2399d3c5fae5-kube-api-access-hxwfz" (OuterVolumeSpecName: "kube-api-access-hxwfz") pod "d698d880-64e0-4685-a2e0-2399d3c5fae5" (UID: "d698d880-64e0-4685-a2e0-2399d3c5fae5"). InnerVolumeSpecName "kube-api-access-hxwfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:42:31.664879 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:31.664826 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxwfz\" (UniqueName: \"kubernetes.io/projected/d698d880-64e0-4685-a2e0-2399d3c5fae5-kube-api-access-hxwfz\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:42:32.411648 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:32.411619 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-hcr9g/progression-invalid-node-0-0-n7npt" Jun 11 13:42:32.411648 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:32.411646 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-hcr9g/progression-invalid-node-0-0-n7npt" event={"ID":"d698d880-64e0-4685-a2e0-2399d3c5fae5","Type":"ContainerDied","Data":"23505798fc7e50515c2cb722aa42f59a475e0f6ac1ec6f9c439c3cb88dea6776"} Jun 11 13:42:32.411826 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:42:32.411683 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="23505798fc7e50515c2cb722aa42f59a475e0f6ac1ec6f9c439c3cb88dea6776" Jun 11 13:43:02.632886 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:43:02.632812 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:44:20.501401 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:20.501367 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:44:31.921429 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:31.921392 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:44:31.930787 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:31.930761 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-hcr9g/progression-no-metrics-node-0-0-llxll"] Jun 11 13:44:31.931082 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:31.931060 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d698d880-64e0-4685-a2e0-2399d3c5fae5" containerName="node" Jun 11 13:44:31.931082 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:31.931074 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d698d880-64e0-4685-a2e0-2399d3c5fae5" containerName="node" Jun 11 13:44:31.931166 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:31.931123 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d698d880-64e0-4685-a2e0-2399d3c5fae5" containerName="node" Jun 11 13:44:31.933509 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:31.933494 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-hcr9g/progression-no-metrics-node-0-0-llxll" Jun 11 13:44:31.935622 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:31.935595 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-hcr9g\"/\"openshift-service-ca.crt\"" Jun 11 13:44:31.935731 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:31.935692 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-hcr9g\"/\"default-dockercfg-kk6wj\"" Jun 11 13:44:31.936318 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:31.936302 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-hcr9g\"/\"kube-root-ca.crt\"" Jun 11 13:44:31.943136 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:31.943117 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-hcr9g/progression-no-metrics-node-0-0-llxll"] Jun 11 13:44:31.983465 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:31.983443 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n28x\" (UniqueName: \"kubernetes.io/projected/2d298301-125d-496c-a6ba-19ea555ce08c-kube-api-access-2n28x\") pod \"progression-no-metrics-node-0-0-llxll\" (UID: \"2d298301-125d-496c-a6ba-19ea555ce08c\") " pod="rhai-e2e-progression-hcr9g/progression-no-metrics-node-0-0-llxll" Jun 11 13:44:32.084609 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:32.084585 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n28x\" (UniqueName: \"kubernetes.io/projected/2d298301-125d-496c-a6ba-19ea555ce08c-kube-api-access-2n28x\") pod \"progression-no-metrics-node-0-0-llxll\" (UID: \"2d298301-125d-496c-a6ba-19ea555ce08c\") " pod="rhai-e2e-progression-hcr9g/progression-no-metrics-node-0-0-llxll" Jun 11 13:44:32.092463 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:32.092439 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n28x\" (UniqueName: \"kubernetes.io/projected/2d298301-125d-496c-a6ba-19ea555ce08c-kube-api-access-2n28x\") pod \"progression-no-metrics-node-0-0-llxll\" (UID: \"2d298301-125d-496c-a6ba-19ea555ce08c\") " pod="rhai-e2e-progression-hcr9g/progression-no-metrics-node-0-0-llxll" Jun 11 13:44:32.242182 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:32.242161 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-hcr9g/progression-no-metrics-node-0-0-llxll" Jun 11 13:44:32.365223 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:32.365197 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-hcr9g/progression-no-metrics-node-0-0-llxll"] Jun 11 13:44:32.367945 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:44:32.367914 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d298301_125d_496c_a6ba_19ea555ce08c.slice/crio-896fd261be130df293c6dd20a143819e7523353ea10c5589aeee6c7b36ebbb8d WatchSource:0}: Error finding container 896fd261be130df293c6dd20a143819e7523353ea10c5589aeee6c7b36ebbb8d: Status 404 returned error can't find the container with id 896fd261be130df293c6dd20a143819e7523353ea10c5589aeee6c7b36ebbb8d Jun 11 13:44:32.887379 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:32.887348 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-hcr9g/progression-no-metrics-node-0-0-llxll" event={"ID":"2d298301-125d-496c-a6ba-19ea555ce08c","Type":"ContainerStarted","Data":"e2871f6725ba187160dc583ed6796eef0caf10a7b52e163628d88d46826c0702"} Jun 11 13:44:32.887514 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:32.887389 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-hcr9g/progression-no-metrics-node-0-0-llxll" event={"ID":"2d298301-125d-496c-a6ba-19ea555ce08c","Type":"ContainerStarted","Data":"896fd261be130df293c6dd20a143819e7523353ea10c5589aeee6c7b36ebbb8d"} Jun 11 13:44:32.906756 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:32.906684 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-hcr9g/progression-no-metrics-node-0-0-llxll" podStartSLOduration=1.9066645530000002 podStartE2EDuration="1.906664553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:44:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:44:32.904448107 +0000 UTC m=+1088.472866434" watchObservedRunningTime="2026-06-11 13:44:32.906664553 +0000 UTC m=+1088.475082881" Jun 11 13:44:37.907142 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:37.907101 2563 generic.go:356] "Generic (PLEG): container finished" podID="2d298301-125d-496c-a6ba-19ea555ce08c" containerID="e2871f6725ba187160dc583ed6796eef0caf10a7b52e163628d88d46826c0702" exitCode=0 Jun 11 13:44:37.907556 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:37.907171 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-hcr9g/progression-no-metrics-node-0-0-llxll" event={"ID":"2d298301-125d-496c-a6ba-19ea555ce08c","Type":"ContainerDied","Data":"e2871f6725ba187160dc583ed6796eef0caf10a7b52e163628d88d46826c0702"} Jun 11 13:44:39.036768 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:39.036744 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-hcr9g/progression-no-metrics-node-0-0-llxll" Jun 11 13:44:39.129446 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:39.129417 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2n28x\" (UniqueName: \"kubernetes.io/projected/2d298301-125d-496c-a6ba-19ea555ce08c-kube-api-access-2n28x\") pod \"2d298301-125d-496c-a6ba-19ea555ce08c\" (UID: \"2d298301-125d-496c-a6ba-19ea555ce08c\") " Jun 11 13:44:39.131485 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:39.131452 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d298301-125d-496c-a6ba-19ea555ce08c-kube-api-access-2n28x" (OuterVolumeSpecName: "kube-api-access-2n28x") pod "2d298301-125d-496c-a6ba-19ea555ce08c" (UID: "2d298301-125d-496c-a6ba-19ea555ce08c"). InnerVolumeSpecName "kube-api-access-2n28x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:44:39.230021 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:39.229998 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2n28x\" (UniqueName: \"kubernetes.io/projected/2d298301-125d-496c-a6ba-19ea555ce08c-kube-api-access-2n28x\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:44:39.916579 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:39.916545 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-hcr9g/progression-no-metrics-node-0-0-llxll" Jun 11 13:44:39.916739 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:39.916535 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-hcr9g/progression-no-metrics-node-0-0-llxll" event={"ID":"2d298301-125d-496c-a6ba-19ea555ce08c","Type":"ContainerDied","Data":"896fd261be130df293c6dd20a143819e7523353ea10c5589aeee6c7b36ebbb8d"} Jun 11 13:44:39.916739 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:39.916677 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="896fd261be130df293c6dd20a143819e7523353ea10c5589aeee6c7b36ebbb8d" Jun 11 13:44:43.896369 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:43.896338 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:44:44.669767 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:44.669731 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nn8jj/must-gather-j2l2c"] Jun 11 13:44:44.670120 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:44.670103 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d298301-125d-496c-a6ba-19ea555ce08c" containerName="node" Jun 11 13:44:44.670219 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:44.670121 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d298301-125d-496c-a6ba-19ea555ce08c" containerName="node" Jun 11 13:44:44.670219 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:44.670196 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d298301-125d-496c-a6ba-19ea555ce08c" containerName="node" Jun 11 13:44:44.673154 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:44.673134 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nn8jj/must-gather-j2l2c" Jun 11 13:44:44.675488 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:44.675467 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nn8jj\"/\"kube-root-ca.crt\"" Jun 11 13:44:44.676135 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:44.676118 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nn8jj\"/\"openshift-service-ca.crt\"" Jun 11 13:44:44.676135 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:44.676130 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nn8jj\"/\"default-dockercfg-r4mvd\"" Jun 11 13:44:44.680742 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:44.680723 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nn8jj/must-gather-j2l2c"] Jun 11 13:44:44.680871 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:44.680855 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:44:44.767860 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:44.767840 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/768c43e0-96a0-4819-9432-9e6e2d69051d-must-gather-output\") pod \"must-gather-j2l2c\" (UID: \"768c43e0-96a0-4819-9432-9e6e2d69051d\") " pod="openshift-must-gather-nn8jj/must-gather-j2l2c" Jun 11 13:44:44.767983 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:44.767872 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwfq7\" (UniqueName: \"kubernetes.io/projected/768c43e0-96a0-4819-9432-9e6e2d69051d-kube-api-access-rwfq7\") pod \"must-gather-j2l2c\" (UID: \"768c43e0-96a0-4819-9432-9e6e2d69051d\") " pod="openshift-must-gather-nn8jj/must-gather-j2l2c" Jun 11 13:44:44.780308 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:44.780282 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:44:44.868788 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:44.868768 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/768c43e0-96a0-4819-9432-9e6e2d69051d-must-gather-output\") pod \"must-gather-j2l2c\" (UID: \"768c43e0-96a0-4819-9432-9e6e2d69051d\") " pod="openshift-must-gather-nn8jj/must-gather-j2l2c" Jun 11 13:44:44.868896 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:44.868802 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwfq7\" (UniqueName: \"kubernetes.io/projected/768c43e0-96a0-4819-9432-9e6e2d69051d-kube-api-access-rwfq7\") pod \"must-gather-j2l2c\" (UID: \"768c43e0-96a0-4819-9432-9e6e2d69051d\") " pod="openshift-must-gather-nn8jj/must-gather-j2l2c" Jun 11 13:44:44.869083 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:44.869066 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/768c43e0-96a0-4819-9432-9e6e2d69051d-must-gather-output\") pod \"must-gather-j2l2c\" (UID: \"768c43e0-96a0-4819-9432-9e6e2d69051d\") " pod="openshift-must-gather-nn8jj/must-gather-j2l2c" Jun 11 13:44:44.877128 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:44.877109 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwfq7\" (UniqueName: \"kubernetes.io/projected/768c43e0-96a0-4819-9432-9e6e2d69051d-kube-api-access-rwfq7\") pod \"must-gather-j2l2c\" (UID: \"768c43e0-96a0-4819-9432-9e6e2d69051d\") " pod="openshift-must-gather-nn8jj/must-gather-j2l2c" Jun 11 13:44:44.982528 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:44.982507 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nn8jj/must-gather-j2l2c" Jun 11 13:44:45.106008 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:45.105983 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nn8jj/must-gather-j2l2c"] Jun 11 13:44:45.108352 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:44:45.108327 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod768c43e0_96a0_4819_9432_9e6e2d69051d.slice/crio-757567b7a3d098696745384a3db10de8978c2e83df776360df6033fda86afca0 WatchSource:0}: Error finding container 757567b7a3d098696745384a3db10de8978c2e83df776360df6033fda86afca0: Status 404 returned error can't find the container with id 757567b7a3d098696745384a3db10de8978c2e83df776360df6033fda86afca0 Jun 11 13:44:45.109946 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:45.109930 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 13:44:45.944227 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:45.944157 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nn8jj/must-gather-j2l2c" event={"ID":"768c43e0-96a0-4819-9432-9e6e2d69051d","Type":"ContainerStarted","Data":"757567b7a3d098696745384a3db10de8978c2e83df776360df6033fda86afca0"} Jun 11 13:44:48.892507 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:48.892474 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-hcr9g/progression-disabled-node-0-0-4q2mg"] Jun 11 13:44:48.895859 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:48.895831 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-hcr9g/progression-disabled-node-0-0-4q2mg"] Jun 11 13:44:48.902679 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:48.902657 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-hcr9g/progression-enabled-node-0-0-9rfg9"] Jun 11 13:44:48.906969 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:48.906945 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-hcr9g/progression-enabled-node-0-0-9rfg9"] Jun 11 13:44:48.911484 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:48.911465 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-hcr9g/progression-invalid-node-0-0-n7npt"] Jun 11 13:44:48.921019 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:48.920998 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-hcr9g/progression-invalid-node-0-0-n7npt"] Jun 11 13:44:48.934086 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:48.934063 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-hcr9g/progression-no-metrics-node-0-0-llxll"] Jun 11 13:44:48.939975 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:48.939954 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-hcr9g/progression-no-metrics-node-0-0-llxll"] Jun 11 13:44:49.430615 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:49.430578 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:44:49.530823 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:49.530791 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:44:50.033558 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:50.033528 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:44:50.847874 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:50.847847 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d298301-125d-496c-a6ba-19ea555ce08c" path="/var/lib/kubelet/pods/2d298301-125d-496c-a6ba-19ea555ce08c/volumes" Jun 11 13:44:50.848261 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:50.848244 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="849d4ba2-e14b-42b2-8dd8-2701e8ea8f63" path="/var/lib/kubelet/pods/849d4ba2-e14b-42b2-8dd8-2701e8ea8f63/volumes" Jun 11 13:44:50.848572 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:50.848554 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d698d880-64e0-4685-a2e0-2399d3c5fae5" path="/var/lib/kubelet/pods/d698d880-64e0-4685-a2e0-2399d3c5fae5/volumes" Jun 11 13:44:50.848943 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:50.848917 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6160b3e-7f7f-4036-b928-bfb85e4031bb" path="/var/lib/kubelet/pods/e6160b3e-7f7f-4036-b928-bfb85e4031bb/volumes" Jun 11 13:44:51.977382 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:51.977345 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nn8jj/must-gather-j2l2c" event={"ID":"768c43e0-96a0-4819-9432-9e6e2d69051d","Type":"ContainerStarted","Data":"b890d3e09b66b331371a8a0cf678b505c9435496cd8035e159bcd37743b24e07"} Jun 11 13:44:51.977793 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:51.977392 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nn8jj/must-gather-j2l2c" event={"ID":"768c43e0-96a0-4819-9432-9e6e2d69051d","Type":"ContainerStarted","Data":"1a3ac1b31020d17fe62fa5360c403653a4753ed8d22312ba8ba70095b27c37f6"} Jun 11 13:44:51.992475 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:51.992430 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nn8jj/must-gather-j2l2c" podStartSLOduration=2.01169194 podStartE2EDuration="7.992413235s" totalImagesPullingTime="5.980721295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:44:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:44:51.991181083 +0000 UTC m=+1107.559599412" watchObservedRunningTime="2026-06-11 13:44:51.992413235 +0000 UTC m=+1107.560831567" Jun 11 13:44:55.288881 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:55.288848 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:44:55.344731 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:44:55.344693 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:45:35.183245 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:35.183205 2563 generic.go:356] "Generic (PLEG): container finished" podID="768c43e0-96a0-4819-9432-9e6e2d69051d" containerID="1a3ac1b31020d17fe62fa5360c403653a4753ed8d22312ba8ba70095b27c37f6" exitCode=0 Jun 11 13:45:35.183602 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:35.183277 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nn8jj/must-gather-j2l2c" event={"ID":"768c43e0-96a0-4819-9432-9e6e2d69051d","Type":"ContainerDied","Data":"1a3ac1b31020d17fe62fa5360c403653a4753ed8d22312ba8ba70095b27c37f6"} Jun 11 13:45:35.183602 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:35.183543 2563 scope.go:117] "RemoveContainer" containerID="1a3ac1b31020d17fe62fa5360c403653a4753ed8d22312ba8ba70095b27c37f6" Jun 11 13:45:35.584900 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:35.584875 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-nn8jj_must-gather-j2l2c_768c43e0-96a0-4819-9432-9e6e2d69051d/gather/0.log" Jun 11 13:45:35.938253 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:35.938184 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:45:36.184792 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:36.184758 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:45:36.260578 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:36.260553 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:45:40.176323 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:40.176285 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kjtlg_7b28e1df-48c1-48ff-bc7b-f1d7512fb5f6/global-pull-secret-syncer/0.log" Jun 11 13:45:40.311471 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:40.311443 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" Jun 11 13:45:40.442746 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:40.442680 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-186.ec2.internal_98f8e857b61fd5c153132da526b56dd7/haproxy/0.log" Jun 11 13:45:40.929775 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:40.929744 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-nn8jj/must-gather-j2l2c"] Jun 11 13:45:40.929925 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:40.929905 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-nn8jj/must-gather-j2l2c" podUID="768c43e0-96a0-4819-9432-9e6e2d69051d" containerName="copy" containerID="cri-o://b890d3e09b66b331371a8a0cf678b505c9435496cd8035e159bcd37743b24e07" gracePeriod=2 Jun 11 13:45:40.934180 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:40.934157 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-nn8jj/must-gather-j2l2c"] Jun 11 13:45:41.169354 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:41.169330 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-nn8jj_must-gather-j2l2c_768c43e0-96a0-4819-9432-9e6e2d69051d/copy/0.log" Jun 11 13:45:41.171957 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:41.171941 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nn8jj/must-gather-j2l2c" Jun 11 13:45:41.173660 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:45:41.173639 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-j2l2c\" is forbidden: User \"system:node:ip-10-0-140-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-nn8jj\": no relationship found between node 'ip-10-0-140-186.ec2.internal' and this object" podUID="768c43e0-96a0-4819-9432-9e6e2d69051d" pod="openshift-must-gather-nn8jj/must-gather-j2l2c" Jun 11 13:45:41.210500 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:41.210475 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-nn8jj_must-gather-j2l2c_768c43e0-96a0-4819-9432-9e6e2d69051d/copy/0.log" Jun 11 13:45:41.210815 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:41.210796 2563 generic.go:356] "Generic (PLEG): container finished" podID="768c43e0-96a0-4819-9432-9e6e2d69051d" containerID="b890d3e09b66b331371a8a0cf678b505c9435496cd8035e159bcd37743b24e07" exitCode=143 Jun 11 13:45:41.210879 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:41.210852 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nn8jj/must-gather-j2l2c" Jun 11 13:45:41.210930 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:41.210897 2563 scope.go:117] "RemoveContainer" containerID="b890d3e09b66b331371a8a0cf678b505c9435496cd8035e159bcd37743b24e07" Jun 11 13:45:41.212711 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:45:41.212689 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-j2l2c\" is forbidden: User \"system:node:ip-10-0-140-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-nn8jj\": no relationship found between node 'ip-10-0-140-186.ec2.internal' and this object" podUID="768c43e0-96a0-4819-9432-9e6e2d69051d" pod="openshift-must-gather-nn8jj/must-gather-j2l2c" Jun 11 13:45:41.218005 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:41.217988 2563 scope.go:117] "RemoveContainer" containerID="1a3ac1b31020d17fe62fa5360c403653a4753ed8d22312ba8ba70095b27c37f6" Jun 11 13:45:41.229396 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:41.229377 2563 scope.go:117] "RemoveContainer" containerID="b890d3e09b66b331371a8a0cf678b505c9435496cd8035e159bcd37743b24e07" Jun 11 13:45:41.229631 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:45:41.229614 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b890d3e09b66b331371a8a0cf678b505c9435496cd8035e159bcd37743b24e07\": container with ID starting with b890d3e09b66b331371a8a0cf678b505c9435496cd8035e159bcd37743b24e07 not found: ID does not exist" containerID="b890d3e09b66b331371a8a0cf678b505c9435496cd8035e159bcd37743b24e07" Jun 11 13:45:41.229687 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:41.229638 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b890d3e09b66b331371a8a0cf678b505c9435496cd8035e159bcd37743b24e07"} err="failed to get container status \"b890d3e09b66b331371a8a0cf678b505c9435496cd8035e159bcd37743b24e07\": rpc error: code = NotFound desc = could not find container \"b890d3e09b66b331371a8a0cf678b505c9435496cd8035e159bcd37743b24e07\": container with ID starting with b890d3e09b66b331371a8a0cf678b505c9435496cd8035e159bcd37743b24e07 not found: ID does not exist" Jun 11 13:45:41.229687 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:41.229660 2563 scope.go:117] "RemoveContainer" containerID="1a3ac1b31020d17fe62fa5360c403653a4753ed8d22312ba8ba70095b27c37f6" Jun 11 13:45:41.229880 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:45:41.229863 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a3ac1b31020d17fe62fa5360c403653a4753ed8d22312ba8ba70095b27c37f6\": container with ID starting with 1a3ac1b31020d17fe62fa5360c403653a4753ed8d22312ba8ba70095b27c37f6 not found: ID does not exist" containerID="1a3ac1b31020d17fe62fa5360c403653a4753ed8d22312ba8ba70095b27c37f6" Jun 11 13:45:41.229926 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:41.229886 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a3ac1b31020d17fe62fa5360c403653a4753ed8d22312ba8ba70095b27c37f6"} err="failed to get container status \"1a3ac1b31020d17fe62fa5360c403653a4753ed8d22312ba8ba70095b27c37f6\": rpc error: code = NotFound desc = could not find container \"1a3ac1b31020d17fe62fa5360c403653a4753ed8d22312ba8ba70095b27c37f6\": container with ID starting with 1a3ac1b31020d17fe62fa5360c403653a4753ed8d22312ba8ba70095b27c37f6 not found: ID does not exist" Jun 11 13:45:41.236159 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:41.236143 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/768c43e0-96a0-4819-9432-9e6e2d69051d-must-gather-output\") pod \"768c43e0-96a0-4819-9432-9e6e2d69051d\" (UID: \"768c43e0-96a0-4819-9432-9e6e2d69051d\") " Jun 11 13:45:41.236233 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:41.236222 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwfq7\" (UniqueName: \"kubernetes.io/projected/768c43e0-96a0-4819-9432-9e6e2d69051d-kube-api-access-rwfq7\") pod \"768c43e0-96a0-4819-9432-9e6e2d69051d\" (UID: \"768c43e0-96a0-4819-9432-9e6e2d69051d\") " Jun 11 13:45:41.238181 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:41.238158 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/768c43e0-96a0-4819-9432-9e6e2d69051d-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "768c43e0-96a0-4819-9432-9e6e2d69051d" (UID: "768c43e0-96a0-4819-9432-9e6e2d69051d"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:45:41.238324 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:41.238304 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/768c43e0-96a0-4819-9432-9e6e2d69051d-kube-api-access-rwfq7" (OuterVolumeSpecName: "kube-api-access-rwfq7") pod "768c43e0-96a0-4819-9432-9e6e2d69051d" (UID: "768c43e0-96a0-4819-9432-9e6e2d69051d"). InnerVolumeSpecName "kube-api-access-rwfq7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:45:41.337426 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:41.337406 2563 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/768c43e0-96a0-4819-9432-9e6e2d69051d-must-gather-output\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:45:41.337426 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:41.337426 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwfq7\" (UniqueName: \"kubernetes.io/projected/768c43e0-96a0-4819-9432-9e6e2d69051d-kube-api-access-rwfq7\") on node \"ip-10-0-140-186.ec2.internal\" DevicePath \"\"" Jun 11 13:45:41.520694 ip-10-0-140-186 kubenswrapper[2563]: E0611 13:45:41.520665 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-j2l2c\" is forbidden: User \"system:node:ip-10-0-140-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-nn8jj\": no relationship found between node 'ip-10-0-140-186.ec2.internal' and this object" podUID="768c43e0-96a0-4819-9432-9e6e2d69051d" pod="openshift-must-gather-nn8jj/must-gather-j2l2c" Jun 11 13:45:41.616765 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:41.616742 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:45:41.684917 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:41.684893 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f4sfh_62ccca45-38fd-48eb-85b9-563e624328b5/konnectivity-agent/0.log" limit=1024 Jun 11 13:45:42.845381 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:42.845296 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="768c43e0-96a0-4819-9432-9e6e2d69051d" path="/var/lib/kubelet/pods/768c43e0-96a0-4819-9432-9e6e2d69051d/volumes" Jun 11 13:45:43.699214 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:43.699147 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-dsftk_5225166c-f562-4f2b-b455-6b632cac5728/cluster-monitoring-operator/0.log" Jun 11 13:45:43.886563 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:43.886542 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-wgh4x_8d420a89-1713-4b10-9c6d-06ecd3b030e1/monitoring-plugin/0.log" Jun 11 13:45:44.160088 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:44.160062 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jvk2j_4092b73a-2bb7-434a-b7d6-44821cb04bb1/node-exporter/0.log" Jun 11 13:45:44.187056 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:44.187020 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jvk2j_4092b73a-2bb7-434a-b7d6-44821cb04bb1/kube-rbac-proxy/0.log" Jun 11 13:45:44.210288 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:44.210267 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jvk2j_4092b73a-2bb7-434a-b7d6-44821cb04bb1/init-textfile/0.log" Jun 11 13:45:44.336611 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:44.336593 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83f922b6-94b3-4405-b676-5700b967beca/prometheus/0.log" Jun 11 13:45:44.365164 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:44.365144 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83f922b6-94b3-4405-b676-5700b967beca/config-reloader/0.log" Jun 11 13:45:44.387858 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:44.387831 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83f922b6-94b3-4405-b676-5700b967beca/thanos-sidecar/0.log" Jun 11 13:45:44.417089 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:44.417022 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83f922b6-94b3-4405-b676-5700b967beca/kube-rbac-proxy-web/0.log" Jun 11 13:45:44.441580 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:44.441560 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83f922b6-94b3-4405-b676-5700b967beca/kube-rbac-proxy/0.log" Jun 11 13:45:44.468602 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:44.468582 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83f922b6-94b3-4405-b676-5700b967beca/kube-rbac-proxy-thanos/0.log" Jun 11 13:45:44.500576 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:44.500557 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83f922b6-94b3-4405-b676-5700b967beca/init-config-reloader/0.log" Jun 11 13:45:44.541874 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:44.541858 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-kqhbr_d300e493-0472-4c8a-9abf-9e28372bcbf7/prometheus-operator/0.log" Jun 11 13:45:44.565313 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:44.565297 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-kqhbr_d300e493-0472-4c8a-9abf-9e28372bcbf7/kube-rbac-proxy/0.log" Jun 11 13:45:44.591371 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:44.591356 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-j4294_310234a4-f82e-43b8-89a3-d0319ad252b1/prometheus-operator-admission-webhook/0.log" Jun 11 13:45:46.114390 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:46.114367 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-c827l_2b6be6bd-eb90-46b7-aa8f-dba0063c97ed/networking-console-plugin/0.log" Jun 11 13:45:47.072418 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:47.072390 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-lkw42_1adb637a-55f3-43a6-97e0-d26a81460f4d/download-server/0.log" Jun 11 13:45:48.081641 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.081612 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8sscs/perf-node-gather-daemonset-sh5qn"] Jun 11 13:45:48.082231 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.082206 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="768c43e0-96a0-4819-9432-9e6e2d69051d" containerName="gather" Jun 11 13:45:48.082231 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.082231 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="768c43e0-96a0-4819-9432-9e6e2d69051d" containerName="gather" Jun 11 13:45:48.082419 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.082261 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="768c43e0-96a0-4819-9432-9e6e2d69051d" containerName="copy" Jun 11 13:45:48.082419 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.082269 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="768c43e0-96a0-4819-9432-9e6e2d69051d" containerName="copy" Jun 11 13:45:48.084767 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.082554 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="768c43e0-96a0-4819-9432-9e6e2d69051d" containerName="gather" Jun 11 13:45:48.084767 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.082591 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="768c43e0-96a0-4819-9432-9e6e2d69051d" containerName="copy" Jun 11 13:45:48.088132 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.088111 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8sscs/perf-node-gather-daemonset-sh5qn" Jun 11 13:45:48.090619 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.090601 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8sscs\"/\"default-dockercfg-2w9lb\"" Jun 11 13:45:48.091360 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.091346 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8sscs\"/\"kube-root-ca.crt\"" Jun 11 13:45:48.091435 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.091349 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8sscs\"/\"openshift-service-ca.crt\"" Jun 11 13:45:48.093836 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.093807 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8sscs/perf-node-gather-daemonset-sh5qn"] Jun 11 13:45:48.187625 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.187605 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d247dfc-727a-47d6-8e68-5e72fe187bac-lib-modules\") pod \"perf-node-gather-daemonset-sh5qn\" (UID: \"1d247dfc-727a-47d6-8e68-5e72fe187bac\") " pod="openshift-must-gather-8sscs/perf-node-gather-daemonset-sh5qn" Jun 11 13:45:48.187744 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.187642 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d247dfc-727a-47d6-8e68-5e72fe187bac-sys\") pod \"perf-node-gather-daemonset-sh5qn\" (UID: \"1d247dfc-727a-47d6-8e68-5e72fe187bac\") " pod="openshift-must-gather-8sscs/perf-node-gather-daemonset-sh5qn" Jun 11 13:45:48.187744 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.187663 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1d247dfc-727a-47d6-8e68-5e72fe187bac-podres\") pod \"perf-node-gather-daemonset-sh5qn\" (UID: \"1d247dfc-727a-47d6-8e68-5e72fe187bac\") " pod="openshift-must-gather-8sscs/perf-node-gather-daemonset-sh5qn" Jun 11 13:45:48.187744 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.187682 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1d247dfc-727a-47d6-8e68-5e72fe187bac-proc\") pod \"perf-node-gather-daemonset-sh5qn\" (UID: \"1d247dfc-727a-47d6-8e68-5e72fe187bac\") " pod="openshift-must-gather-8sscs/perf-node-gather-daemonset-sh5qn" Jun 11 13:45:48.187857 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.187743 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks8xf\" (UniqueName: \"kubernetes.io/projected/1d247dfc-727a-47d6-8e68-5e72fe187bac-kube-api-access-ks8xf\") pod \"perf-node-gather-daemonset-sh5qn\" (UID: \"1d247dfc-727a-47d6-8e68-5e72fe187bac\") " pod="openshift-must-gather-8sscs/perf-node-gather-daemonset-sh5qn" Jun 11 13:45:48.288997 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.288969 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1d247dfc-727a-47d6-8e68-5e72fe187bac-proc\") pod \"perf-node-gather-daemonset-sh5qn\" (UID: \"1d247dfc-727a-47d6-8e68-5e72fe187bac\") " pod="openshift-must-gather-8sscs/perf-node-gather-daemonset-sh5qn" Jun 11 13:45:48.289106 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.289008 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks8xf\" (UniqueName: \"kubernetes.io/projected/1d247dfc-727a-47d6-8e68-5e72fe187bac-kube-api-access-ks8xf\") pod \"perf-node-gather-daemonset-sh5qn\" (UID: \"1d247dfc-727a-47d6-8e68-5e72fe187bac\") " pod="openshift-must-gather-8sscs/perf-node-gather-daemonset-sh5qn" Jun 11 13:45:48.289106 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.289030 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d247dfc-727a-47d6-8e68-5e72fe187bac-lib-modules\") pod \"perf-node-gather-daemonset-sh5qn\" (UID: \"1d247dfc-727a-47d6-8e68-5e72fe187bac\") " pod="openshift-must-gather-8sscs/perf-node-gather-daemonset-sh5qn" Jun 11 13:45:48.289106 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.289067 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d247dfc-727a-47d6-8e68-5e72fe187bac-sys\") pod \"perf-node-gather-daemonset-sh5qn\" (UID: \"1d247dfc-727a-47d6-8e68-5e72fe187bac\") " pod="openshift-must-gather-8sscs/perf-node-gather-daemonset-sh5qn" Jun 11 13:45:48.289106 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.289094 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1d247dfc-727a-47d6-8e68-5e72fe187bac-podres\") pod \"perf-node-gather-daemonset-sh5qn\" (UID: \"1d247dfc-727a-47d6-8e68-5e72fe187bac\") " pod="openshift-must-gather-8sscs/perf-node-gather-daemonset-sh5qn" Jun 11 13:45:48.289278 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.289104 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1d247dfc-727a-47d6-8e68-5e72fe187bac-proc\") pod \"perf-node-gather-daemonset-sh5qn\" (UID: \"1d247dfc-727a-47d6-8e68-5e72fe187bac\") " pod="openshift-must-gather-8sscs/perf-node-gather-daemonset-sh5qn" Jun 11 13:45:48.289278 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.289152 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d247dfc-727a-47d6-8e68-5e72fe187bac-sys\") pod \"perf-node-gather-daemonset-sh5qn\" (UID: \"1d247dfc-727a-47d6-8e68-5e72fe187bac\") " pod="openshift-must-gather-8sscs/perf-node-gather-daemonset-sh5qn" Jun 11 13:45:48.289278 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.289169 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d247dfc-727a-47d6-8e68-5e72fe187bac-lib-modules\") pod \"perf-node-gather-daemonset-sh5qn\" (UID: \"1d247dfc-727a-47d6-8e68-5e72fe187bac\") " pod="openshift-must-gather-8sscs/perf-node-gather-daemonset-sh5qn" Jun 11 13:45:48.289278 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.289181 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1d247dfc-727a-47d6-8e68-5e72fe187bac-podres\") pod \"perf-node-gather-daemonset-sh5qn\" (UID: \"1d247dfc-727a-47d6-8e68-5e72fe187bac\") " pod="openshift-must-gather-8sscs/perf-node-gather-daemonset-sh5qn" Jun 11 13:45:48.297221 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.297194 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks8xf\" (UniqueName: \"kubernetes.io/projected/1d247dfc-727a-47d6-8e68-5e72fe187bac-kube-api-access-ks8xf\") pod \"perf-node-gather-daemonset-sh5qn\" (UID: \"1d247dfc-727a-47d6-8e68-5e72fe187bac\") " pod="openshift-must-gather-8sscs/perf-node-gather-daemonset-sh5qn" Jun 11 13:45:48.399061 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.398991 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8sscs/perf-node-gather-daemonset-sh5qn" Jun 11 13:45:48.428507 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.428479 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-96zlw_1a9b80d7-f85f-408f-aa85-4b4f4e1bded7/dns/0.log" Jun 11 13:45:48.448630 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.448581 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-96zlw_1a9b80d7-f85f-408f-aa85-4b4f4e1bded7/kube-rbac-proxy/0.log" Jun 11 13:45:48.539711 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.539681 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8sscs/perf-node-gather-daemonset-sh5qn"] Jun 11 13:45:48.544006 ip-10-0-140-186 kubenswrapper[2563]: W0611 13:45:48.543975 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1d247dfc_727a_47d6_8e68_5e72fe187bac.slice/crio-bd38d280b8297fa101c8093915f07469677bf4319c01671b2c05954881aa2159 WatchSource:0}: Error finding container bd38d280b8297fa101c8093915f07469677bf4319c01671b2c05954881aa2159: Status 404 returned error can't find the container with id bd38d280b8297fa101c8093915f07469677bf4319c01671b2c05954881aa2159 Jun 11 13:45:48.752229 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:48.752198 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-swccc_f047a728-0ff9-4b65-ba9d-7dfcacb808f4/dns-node-resolver/0.log" Jun 11 13:45:49.181700 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:49.181643 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9dk9k_50d20acf-e30a-41ef-871b-b8adc1ff8a0a/node-ca/0.log" Jun 11 13:45:49.245363 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:49.245337 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8sscs/perf-node-gather-daemonset-sh5qn" event={"ID":"1d247dfc-727a-47d6-8e68-5e72fe187bac","Type":"ContainerStarted","Data":"d6eea6c89c36b084f6d8eff086df40e29ebd60a133768ebcd84425641d3ecb86"} Jun 11 13:45:49.245461 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:49.245381 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8sscs/perf-node-gather-daemonset-sh5qn" event={"ID":"1d247dfc-727a-47d6-8e68-5e72fe187bac","Type":"ContainerStarted","Data":"bd38d280b8297fa101c8093915f07469677bf4319c01671b2c05954881aa2159"} Jun 11 13:45:49.245461 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:49.245441 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8sscs/perf-node-gather-daemonset-sh5qn" Jun 11 13:45:49.261842 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:49.261745 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8sscs/perf-node-gather-daemonset-sh5qn" podStartSLOduration=1.261731259 podStartE2EDuration="1.261731259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:45:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:45:49.261485457 +0000 UTC m=+1164.829903783" watchObservedRunningTime="2026-06-11 13:45:49.261731259 +0000 UTC m=+1164.830149587" Jun 11 13:45:49.921343 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:49.921318 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7795d4b9f9-p7jbr_f2a82040-2b53-4601-9b06-30a8d1f74749/router/0.log" Jun 11 13:45:50.225009 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:50.224988 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7cd67_443f8e98-5a4b-4dd3-865a-78f1f3960ae1/serve-healthcheck-canary/0.log" Jun 11 13:45:50.744611 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:50.744588 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xl9df_303cd2f0-96c2-488e-92ea-ecf586d4e1c0/kube-rbac-proxy/0.log" Jun 11 13:45:50.767148 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:50.767121 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xl9df_303cd2f0-96c2-488e-92ea-ecf586d4e1c0/exporter/0.log" Jun 11 13:45:50.789614 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:50.789595 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xl9df_303cd2f0-96c2-488e-92ea-ecf586d4e1c0/extractor/0.log" Jun 11 13:45:55.259326 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:55.259298 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8sscs/perf-node-gather-daemonset-sh5qn" Jun 11 13:45:57.057333 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:57.057275 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5wltr_e3070766-1adb-409f-843f-8867c2861723/kube-multus-additional-cni-plugins/0.log" Jun 11 13:45:57.085122 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:57.085102 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5wltr_e3070766-1adb-409f-843f-8867c2861723/egress-router-binary-copy/0.log" Jun 11 13:45:57.110730 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:57.110706 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5wltr_e3070766-1adb-409f-843f-8867c2861723/cni-plugins/0.log" Jun 11 13:45:57.140331 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:57.140315 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5wltr_e3070766-1adb-409f-843f-8867c2861723/bond-cni-plugin/0.log" Jun 11 13:45:57.170879 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:57.170864 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5wltr_e3070766-1adb-409f-843f-8867c2861723/routeoverride-cni/0.log" Jun 11 13:45:57.201764 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:57.201748 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5wltr_e3070766-1adb-409f-843f-8867c2861723/whereabouts-cni-bincopy/0.log" Jun 11 13:45:57.225400 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:57.225378 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5wltr_e3070766-1adb-409f-843f-8867c2861723/whereabouts-cni/0.log" Jun 11 13:45:57.689696 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:57.689641 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qh4rj_888b6b6d-8d77-4bb0-b0a7-b39b44262482/kube-multus/0.log" Jun 11 13:45:57.746437 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:57.746419 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-698v8_dbcbad68-5014-4dbd-99f2-087716f10a31/network-metrics-daemon/0.log" Jun 11 13:45:57.777698 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:57.777678 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-698v8_dbcbad68-5014-4dbd-99f2-087716f10a31/kube-rbac-proxy/0.log" Jun 11 13:45:58.678845 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:58.678817 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-87tcg_28b20342-2058-4e26-8ccd-16757e486809/ovn-controller/0.log" Jun 11 13:45:58.699854 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:58.699823 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-87tcg_28b20342-2058-4e26-8ccd-16757e486809/ovn-acl-logging/0.log" Jun 11 13:45:58.699967 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:58.699900 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-87tcg_28b20342-2058-4e26-8ccd-16757e486809/ovn-acl-logging/1.log" Jun 11 13:45:58.720753 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:58.720735 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-87tcg_28b20342-2058-4e26-8ccd-16757e486809/kube-rbac-proxy-node/0.log" Jun 11 13:45:58.756601 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:58.756585 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-87tcg_28b20342-2058-4e26-8ccd-16757e486809/kube-rbac-proxy-ovn-metrics/0.log" Jun 11 13:45:58.789635 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:58.789619 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-87tcg_28b20342-2058-4e26-8ccd-16757e486809/northd/0.log" Jun 11 13:45:58.817381 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:58.817364 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-87tcg_28b20342-2058-4e26-8ccd-16757e486809/nbdb/0.log" Jun 11 13:45:58.841700 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:58.841684 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-87tcg_28b20342-2058-4e26-8ccd-16757e486809/sbdb/0.log" Jun 11 13:45:58.883869 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:45:58.883822 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-87tcg_28b20342-2058-4e26-8ccd-16757e486809/ovnkube-controller/0.log" Jun 11 13:46:00.630174 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:46:00.630147 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-svdx4_12885b90-19b5-4c6f-838e-22cc394e21db/network-check-target-container/0.log" Jun 11 13:46:01.684957 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:46:01.684924 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-j9vjz_c6ad6978-e1a9-4aa8-8aaa-48b7d29f1ab1/iptables-alerter/0.log" Jun 11 13:46:02.404143 ip-10-0-140-186 kubenswrapper[2563]: I0611 13:46:02.404113 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-phwdp_2fb4c058-dd7f-4eea-8ff0-6bd7f2357c55/tuned/0.log"